AutoRefine: Auto-Calibrating Code Judges from Workflow Outcomes
arXiv cs.AI · Shervin Shahidi, James Poon, Hang Xie, Kenneth O. Xu, Robin H{\aa}kanson, Vikram Nair, Jens Pillgram-Larsen, Nachiappan Nagappan ·
arXiv:2611.09291v1 Announce Type: new Abstract: LLM judges increasingly serve as quality gates for code changes that have no test oracle, but a judge prompt must be calibrated for its task and recalibrated as the system it judges evolves, while hand labels for the calibration are resource intensive and go stale.…
Excerpt provided by arXiv cs.AI via its public feed. Full reporting belongs to the original publisher.
Read the full story on arXiv cs.AI
Related coverage
The Verge AI · 1h ago
The indie game community is in disarray over AI and Big Walk
The Verge AI · 1h ago
Anthropic has its own AI-powered office suite now
The Verge AI · 4h ago
Adobe is going all in on agentic AI
TechCrunch AI · 5h ago
Cyberattacks threaten to make open-source AI a little less open, Hugging Face exec warns