RankShift: Evaluating Ranking Instability Across Benchmark Dimensions in Document Parsing
arXiv:2611.10679v1 Announce Type: new Abstract: Document parsing benchmarks are often treated as stable measures of model quality, yet rankings may depend substantially on benchmark design choices. In this work, we present RankShift, a systematic study comparing OCR and vision-language models (VLMs) under…
Excerpt provided by arXiv cs.AI via its public feed. Full reporting belongs to the original publisher.
Read the full story on arXiv cs.AI
Related coverage
The Decoder · 36m ago
Gemini 4 Carbon arrives just in time to feel like yesterdays news in the fastest model cycle yet
Ars Technica AI · 3h ago
DeepMind reveals Gemini Robotics 2.5 and open safety benchmark "ASIMOV-jailbreak"
Google DeepMind · 6h ago
Introducing AlphaProof Code: a breakthrough in verifying complex software at depth
OpenAI · 9h ago
Closing the AI guidance gap in education