1. Ambitious benchmark for AI website creation
"Ploy’s agent builds and edits real marketing websites... it plans a page, reads the codebase, writes components, generates imagery, screenshots its own work, and decides when it’s done." – blfr
2. Rigorous evaluation of successive AI releases against that benchmark
"For the four months Opus held the default slot (first Opus 4.7, then 4.8), nothing we tested beat it." – blfr
3. Expectation that newer models outperform older ones on specific tasks
"Unlike OP I haven't run a rigorous test, but I still would expect Fable to be significantly better at building marketing websites than Opus." – another user