AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test

Alibaba's new coding-agent benchmark, Co-Design Bench, tests AI agents on real user requests that already tripped them up in practice. Even GPT-6 Astra, the top performer, fully solves only 26.4 percent of tasks. On older benchmarks, the same models score above 99 percent. The article AI coding agents still need…
Excerpt provided by The Decoder via its public feed. Full reporting belongs to the original publisher.
Read the full story on The DecoderRelated coverage
TechCrunch AI · 8m ago
OpenAI rolls out new business profiles, making ChatGPT just a little bit more like Google
The Verge AI · 58m ago
ChatGPT is getting verified AI ‘Business Agents’
The Verge AI · 1h ago
Anthropic has its own AI-powered office suite now
The Verge AI · 2h ago
Google releases Gemini 4 Carbon with agent ‘swarm’ feature