curated · 2026-09-06

The reason this is worth a look: anyone building computer-use agents knows the pain of rewriting rollout code for every new environment or model. CUA-Lite wraps 15+ benchmarks, 10+ datasets, and 14 model families behind one API, with shared harnesses for eval, SFT, and RL. The standout piece is Lite.OSWorld. The original OSWorld boots a full QEMU VM per task, needs hardware virtualization, and burns time and money. Their Docker-based version drops the VM requirement entirely—no /dev/kvm needed, runs on any host with Docker, and keeps the original tasks and evaluators intact. That's a real cost win for teams training CUA agents at scale without a GPU cluster. One thing the post doesn't include: benchmark scores or training results from any model on this platform. It reads more like an infrastructure release than a performance story. I'd treat it as "unified interface plus cheap sandboxes" and hold off on reading it as a capability leap.

Fortune caught OpenAI editing benchmark numbers after the GPT-6 Astra launch, and the changes are hard to dismiss as routine fixes. The hallucination rate went from 4.2% to 2%, then back to 4.2%. Anthropic's Fable 5.1 math score was briefly cut by nearly 10 points, making Astra's lead look bigger. OpenAI calls it normal pre-release validation, but Stanford researchers flagged that the system card barely describes the hallucination eval—no sample size, no methodology. I'd discount these numbers heavily: the blog itself admits these are best-case scores under any compute budget, not what a ChatGPT user would see. The edits look more like marketing calibration than technical corrections.