AIFuture
Back to news
AI ResearchThe Decoder·

OpenAI finds roughly 30 percent of popular AI coding test is broken

OpenAI finds roughly 30 percent of popular AI coding test is broken

OpenAI reviewed SWE-Bench Pro, a widely used test for measuring AI models' programming skills, and found roughly 30 percent of its tasks are broken. The company is pulling its earlier endorsement of the benchmark. The article OpenAI finds roughly 30 percent of popular AI coding test is broken appeared first on The Decoder.

This is a summary curated by AIFuture. Read the complete article at the original source:

Read the full story on The Decoder

More AI News

IndustryTechCrunch

Anthropic says its own AI models breached three companies during security tests

After OpenAI's models broke into Hugging Face, Anthropic checked its own history and found three similar incidents

Jul 31, 2026

AI ResearchTechCrunch

AI hedge fund Situational Awareness may have sold its public portfolio, but it still has its Anthropic shares

The former OpenAI researcher’s fund was forced to unwind public equities after leveraged public bets plummeted. But he still has cards to play.

Jul 30, 2026

IndustryTechCrunch

Reddit reports a solid quarter but shows signs of AI’s impact

Reddit's financial situation is looking good but uncertainty about its relationship to Google and the new AI-ified web are stirring market concerns.

Jul 30, 2026

Build the skills behind the headlines

Data ScienceCoursera

Deep Learning Specialization

Five-course series on neural networks, CNNs, sequence models, and transformers from DeepLearning.AI.

Intermediate·Subscription
View Course
Data ScienceCoursera

Machine Learning Specialization

Andrew Ng's flagship program covering supervised and unsupervised learning, neural networks, and best practices for real-world ML.

Beginner·Subscription
View Course
Generative AICoursera

Generative AI for Everyone

Andrew Ng explains how generative AI works and how to apply it in your work and life — no coding required.

Beginner·Subscription
View Course

Never miss what matters in AI

Get the most important AI news and course picks in your inbox.