FEATUREDComputing Life · Share (鸭哥 research reports)· rssZH00:00 · 08·30
→The value of multimodal models isn't understanding images—it's deciding to look
Meta, Z.ai, and DeepSeek each released multimodal models in August with strikingly similar demos: the model observes a video or screenshot, calls tools to generate a webpage, slides, or a mini-game, then inspects its own output. This shifts vision from a passive input channel to an action the model initiates. The article likens it to the 2023 shift from static RAG to agentic RAG, but notes the loop direction is reversed—here the model self-verifies after producing. Evaluation moves beyond image Q&A: Meta's WildArtifactBench uses pairwise comparisons and Elo scores to assess full artifact creation. Training also changes; both GLM and Meta train models in generate-inspect-revise loops, logging interaction trajectories as training data. For builders, the key question is no longer static image accuracy but whether the model can complete an observe-generate-inspect closed loop.
#Multimodal#Code#Meta#Muse Spark 1.2
why featured
Featured · importance 82 · hook + knowledge + resonance
editor take
Three labs demoed models inspecting their own visual output—evaluation shifts from image Q&A to closed-loop verification.
sharp
This piece is worth opening because Meta, Z.ai, and DeepSeek all showed the same pattern in August: the model watches a video or screenshot, calls tools to build a webpage, slides, or a mini-game, then inspects its own output. It's similar to the 2023 shift from static RAG to agentic search, but the loop direction is reversed—here the model produces first, then looks back to verify.
Evaluation is changing too. Meta's WildArtifactBench ditches standard-answer scoring for pairwise comparisons and Elo rankings. On the training side, both GLM and Muse Spark 1.2 log full generate-inspect-revise trajectories as training data, so the model internalizes the loop as its own behavior.
For builders, the selection criterion is shifting from static image accuracy to whether the model can complete an observe-generate-inspect closed loop. What's missing right now is closed-loop success rates in real production tasks—the three labs mostly showed curated demos.
HKR breakdown
hook ✓knowledge ✓resonance ✓