23:41
15d ago
→Ploy migrated its production AI agent from Claude Opus 4.8 to GPT-5.6 Sol: 2.2× faster builds, 27% cheaper
Ploy's agent builds real marketing websites. Claude Opus 4.8 held the default slot for four months with no challenger. GPT-5.6 Sol changed that on launch day. Head-to-head: mean build time dropped from 8m to 3m 42s, cost from $3.06 to $2.22, visual score rose from 0.936 to 0.970. The migration wasn't plug-and-play. Their eval harness was tuned to Opus's sequential style; GPT-5.6's parallel tool calls blew through budgets, and roughly a third of initial failures were harness assumptions, not model errors. GPT-5.6 also writes leaner code—one case went from 17,957 CSS characters and 174 variables to 2,508 characters and 45 variables. Design output is clean and modern but tends toward uniformity; brand adherence required extra steering. The post flags tool schemas, caching, and reasoning replay as additional migration steps but doesn't detail the fixes.
82
SCORE
H1·K1·R1