sharp
The Reddit summary gives one comparison: Qwen 3.6 27B produced 33,946 tokens in 18m04s, while Gemma 4 31B produced 6,209 tokens in 3m51s. My read: this is a useful smell test, not evidence that Gemma has stronger logic. It is one prompt, one task, one author’s judgment, and the body is blocked by a 403. We do not have the prompt, sampling settings, runtime, generated files, screenshots, failure modes, or a scoring rubric. Practitioners should file this under community signal, not model selection data.
The useful number here is the token gap, not the declared winner. Qwen wrote 33,946 tokens; Gemma wrote 6,209. That is about a 5.5x difference. Runtime tracks the same direction: 18m04s versus 3m51s, around 4.7x. That gap can come from model behavior, inference stack, stop conditions, context handling, or repeated self-repair. The post summary does not disclose those conditions. So the defensible claim is narrow: in this single-file Pac-Man task, Gemma 4 31B generated a much shorter answer, finished faster, and the author preferred its logic.
I’m wary of these “make Pac-Man” tests. They look like coding benchmarks, but they mix requirements parsing, Canvas or DOM fluency, JavaScript state machines, collision detection, ghost movement, keyboard events, game loops, and visual polish. A longer output can mean overengineering. It can also mean the model implemented maps, scoring, restart behavior, and ghost AI instead of faking the demo. A shorter output can mean cleaner planning. It can also mean missing edge cases. Without the playable artifact and a feature checklist, 6,209 tokens does not automatically mean better reasoning.
External context matters here. This is not SWE-bench, LiveCodeBench, or Aider’s coding leaderboard. SWE-bench has repos, issues, patches, and tests, even with all the known harness and contamination concerns. Aider at least reports edit success, cost, and model behavior under a repeatable workflow. A single-file Pac-Man prompt is closer to a front-end demo plus one-shot code generation test. That has value for local-model users, especially around the 27B to 31B class. People want to know whether a model can produce a playable artifact on consumer hardware. But it has weak enterprise signal unless the author publishes the prompt, temperature, top_p, quantization, inference backend, hardware, and scoring video.
The Qwen versus Gemma framing also needs care. Qwen models have often leaned into broad multilingual coverage, coding breadth, tool use, and verbose completion style. Gemma models have often been valued for cleaner instruction following and smaller deployment friction. I’m speaking from pattern memory here, not from this blocked Reddit body. The 5.5x token gap smells like two different solving styles: Qwen trying to include the whole world in one file, Gemma trying to close the playable loop quickly. That is useful, but it is not a clean capability ranking.
If I were rerunning this, I’d use at least 10 seeds with the same backend and decoding settings. I’d score launch success, map boundaries, movement, pellet scoring, ghost pursuit, collision death, win-loss state, and single-file compliance. Then I’d add token count and latency. If Gemma 4 31B still uses one-sixth the tokens and gets a higher functional score, that becomes a strong signal. Right now, the safe takeaway is narrower: Gemma looked more efficient in this community sample, and Qwen looked verbose. The “stronger logic” claim lacks the disclosed evidence chain.