AlterNet: Adaptive-Depth Mixture-of-Experts with Learned Halting for Elastic Inference
arXiv:2611.08741v1 Announce Type: new Abstract: Most LLM architectures have fixed compute demands determined at training time. We propose a novel architecture that combines the Mixture-of-Experts architecture with shallow experts and a novel dynamic-depth system to make the extent of a forward pass dynamically…
Excerpt provided by arXiv cs.AI via its public feed. Full reporting belongs to the original publisher.
Read the full story on arXiv cs.AI
Related coverage
TechCrunch AI · 10m ago
PSI is trying to make a business out of AI-driven scientific discovery
The Decoder · 55m ago
Gemini 4 Carbon arrives just in time to feel like yesterdays news in the fastest model cycle yet
Ars Technica AI · 4h ago
DeepMind reveals Gemini Robotics 2.5 and open safety benchmark "ASIMOV-jailbreak"
Google DeepMind · 7h ago
Introducing AlphaProof Code: a breakthrough in verifying complex software at depth