FEATUREDAI HOT (Curated Pool)· aihot-apiZH01:00 · 07·08
→Ant Group's Zhou Jun: A trillion-parameter model burns a Tesla's worth of compute every 15 minutes—his team shifts from token count to token density to cut long-context cost from exponential to linear
Ant Group VP Zhou Jun laid out the math at AICon: running a trillion-parameter model for 15 minutes costs as much as a Tesla. His team's answer is higher token density, not more tokens. A hybrid linear attention architecture—7 parts Lightning Attention, 1 part MLA—drops 256K long-context cost from exponential to linear, freeing compute for reasoning. The Kpop algorithm separates tool-call tokens from natural-language tokens; combined with chain-of-thought pruning and self-distillation, token output shrinks roughly 4× with no capability loss. A 100B-param model beats larger ones on BFCL and other agent benchmarks, small-model flash throughput hits 2.4×, and five-turn conversation cost falls over 10×.
#Agent#Reasoning#Ant Group#Zhou Jun
why featured
Featured · importance 72 · hook + knowledge
editor take
Ant Group's hybrid linear attention drops 256K long-context cost from exponential to linear, cutting five-turn conversation cost over 10×.
sharp
The math Zhou Jun laid out at AICon is blunt: running a trillion-parameter model for 15 minutes costs as much as a Tesla. So his team went after token density instead of more tokens. A hybrid architecture—7 parts Lightning Attention, 1 part MLA—drops 256K long-context cost from exponential to linear, freeing compute for reasoning.
The Kpop algorithm separates tool-call tokens from natural-language tokens, then adds chain-of-thought pruning and self-distillation to shrink token output roughly 4× with no capability loss. A 100B-param model beats larger ones on BFCL and other agent benchmarks, small-model flash throughput hits 2.4×.
Only the talk summary is available—no test sets or comparison models listed. I'd discount the 10× cost reduction claim until we see what it's measured against: their own previous setup, or same-scale open-source models. But the direction makes sense. In agent workloads, long context and tool calls eat compute; fixing attention and token efficiency is more practical than scaling parameters.
HKR breakdown
hook ✓knowledge ✓resonance —