AIFuture
Back to news
AI ResearchThe Decoder·

OpenAI finds roughly 30 percent of popular AI coding test is broken

OpenAI finds roughly 30 percent of popular AI coding test is broken

OpenAI reviewed SWE-Bench Pro, a widely used test for measuring AI models' programming skills, and found roughly 30 percent of its tasks are broken. The company is pulling its earlier endorsement of the benchmark. The article OpenAI finds roughly 30 percent of popular AI coding test is broken appeared first on The Decoder.

This is a summary curated by AIFuture. Read the complete article at the original source:

Read the full story on The Decoder

Build the skills behind the headlines

Data ScienceedX

CS50's Introduction to AI with Python

Harvard's deep dive into the algorithms behind modern AI — search, knowledge, optimization, and machine learning.

Intermediate·Free / Verified
View Course
Data ScienceCoursera

Deep Learning Specialization

Five-course series on neural networks, CNNs, sequence models, and transformers from DeepLearning.AI.

Intermediate·Subscription
View Course
Data ScienceCoursera

Machine Learning Specialization

Andrew Ng's flagship program covering supervised and unsupervised learning, neural networks, and best practices for real-world ML.

Beginner·Subscription
View Course

Never miss what matters in AI

Get the most important AI news and course picks in your inbox.