FEATUREDComputing Life · Share (鸭哥 research reports)· rssZH00:00 · 09·09
→Three Small Things Last Week: Agent Ledgers, Interfaces, and Rooms
Several AI engineering efforts last week converged on the same bottleneck: agents forget, collide, and can't touch the physical world. Security researcher Jordy Zomer open-sourced Lemmalog, splitting agent memory into a probabilistic front-end for fact extraction and a deterministic Datalog engine for causal reasoning and cascading retraction. Anthropic and Janelia unveiled the Model Hardware Standard, letting LLMs control lab instruments via natural-language labels while hard-coding safety limits in driver firmware—a lesson learned after Claude mistook liquid foaming for a software error at Genentech. Startup Raft blamed multi-agent chaos on the room, not the models, identifying a reasoning-commit gap where agents act on stale snapshots; their fix includes draft holding, pull-based inboxes, and silence as a valid action. Anthropic also formalized Fermat's Last Theorem in 11 days, but early multi-agent attempts collapsed until the team moved to the Prove2Me dependency-graph platform. All four stories share one pattern: wrapping probabilistic models in deterministic engineering scaffolds. Lemmalog scored just 0.128 on preference tasks, MHS figures are all self-reported with no public spec, and Raft's scale claims lack third-party discussion—discount these numbers for now.
#Agent#Memory#Jordy Zomer#Lemmalog
why featured
Featured · importance 78 · hook + knowledge + resonance
editor take
Four teams last week hit the same bottleneck—agent memory, coordination, physical access—and all wrapped probabilistic models in deterministic scaffolds.
sharp
These four stories converge on the same engineering pattern: probabilistic models need deterministic scaffolding to function as agents.
Jordy Zomer's Lemmalog splits agent memory into a model front-end for fact extraction and a Datalog back-end for causal reasoning. Retract a premise, and all dependent inferences auto-expire. The idea is old news in databases, but applying it to agent memory is a sharp fix. The catch: Zomer's own benchmark shows just 0.128 on preference tasks—the real bottleneck is extracting accurate facts from natural language, not the reasoning engine.
Anthropic's MHS lets LLMs control lab instruments via natural-language labels, with safety limits hard-coded in driver firmware. They learned this after Claude mistook liquid foaming for a software error at Genentech. The reported 99.3% hands-free rate and 3x speedup are all self-reported, and the spec isn't public yet—I'd discount those numbers.
Raft's take is blunt: multi-agent chaos isn't the models' fault, it's the room's. Agents operate in turns—snapshot, reason, act—but the room moves on during those reasoning seconds. They call this the reasoning-commit gap. Stanford's CooperBench found the same thing: top coding models paired up performed nearly 50% worse than solo, and adding chat channels didn't help.
The direction is clear across all four: models handle perception and generation, deterministic systems handle state and safety. Lemmalog's 0.128, MHS's self-reported figures, and Raft's lack of third-party discussion all say the same thing—this pattern is early, don't over-index on the numbers yet.
HKR breakdown
hook ✓knowledge ✓resonance ✓