OpenAI Retracts Endorsement of SWE-Bench Pro Coding Benchmark
An internal audit found that roughly a third of SWE-Bench Pro's coding tasks are flawed, prompting OpenAI to withdraw its recommendation that developers rely on the benchmark.
Read more →AI Benchmarksand OpenAI
Every AI News story tagged with both AI Benchmarks and OpenAI — the two topics side by side, updated as new articles publish.
3 articles
Meta AI Chief Claims In-Training "Watermelon" Model Has Caught Up to GPT-5.5
Meta's superintelligence chief told employees that the company's next model, codenamed Watermelon, has caught up to OpenAI's GPT-5.5 on key benchmarks — though the specific tests and results have not been disclosed.
Read more →OpenAI Releases GeneBench-Pro to Test AI in Biology Research
OpenAI has released GeneBench-Pro, a 129-problem benchmark that tests whether AI agents can exercise the judgment-intensive analytical reasoning required for real-world computational biology research.
Read more →