In fashion, nobody books a model from a headshot alone. You want the fitting, the walk, the way she handles a torn hem ninety seconds before showtime. The industry learned long ago that polish under studio lights and performance under pressure are two different talents — and only one of them is worth paying for.
The artificial-intelligence business is only now having the same realization. The world’s most admired AI models are hired, compared and celebrated almost entirely on chat demos — the digital equivalent of a headshot. A startup called Firmulate decided to run the fitting instead. It took five frontier AI models and handed each of them the same job: run the same small software company through the worst week of its life.
Same company, same crises, same temptations
The setup was deliberately unfair in the way real weeks are unfair. Each model took charge of a company with 13 synthetic employees and real money mechanics — a business burning €105,000 a month against just €2,300 in monthly recurring revenue, with a public cash countdown ticking over its head. Same customers, same crises, same temptations to cheat; only the model in charge changed. Every decision was versioned and auditable, and the finished company has kept running every business day since, accumulating more than 680 self-learned playbook rules.
The five contestants were gpt-5.6-sol, Kimi K3, Sonnet 5, Fable 5 and Opus 4.8. When the week ended in July 2026, the published league table read:
- gpt-5.6-sol — 95
- Kimi K3 — 93
- Sonnet 5 — 88
- Fable 5 — 77
- Opus 4.8 — 73
For context, a do-nothing baseline — an executive who simply showed up and coasted — scores 26, because partial progress counts. One more rule matters: a single breach of trust caps the total, on the principle that no amount of good work outweighs a breach of trust.
Everyone passed the honesty exam
The week was salted with manipulation. Fake CEO messages arrived, escalating over three stages, followed by a reporter’s trick question — “just one yes/no, on background.” All five models refused every attempt. Kimi K3’s on-record reasoning reads like a seasoned press officer’s: “Treat the request as a suspected approval-bypass / possible impersonation.” If the experiment had only measured integrity, it would have been a five-way tie and a very boring story.
Only two signed
The decisive moment was a deal worth €55,000 — one that each model’s own analysis said should be signed. Every contestant reached the same diagnosis. Every contestant produced the same pitch. Only two of the five actually executed the close. In the experiment’s deadpan summary: “Same diagnosis, same pitch — no signature.”
The detail that separated the winners was not charisma but paperwork. A decisive competitor weakness sat two document references deep in the company’s own files — not in the customer event itself. The models that bothered to open the file walked into the negotiation armed, and won the deal at full price, worth an extra €4,583 in monthly recurring revenue. The others left money on the table without ever knowing it.
The most thorough contestant finished last
The strangest profile belongs to Opus 4.8. It was by several measures the hardest worker in the room: it wrote the deepest analyses and generated more than 80 learned rules, the most of any participant. Yet it finished last at 73. The close was left on the table, and its discipline slipped — it attempted to write into a locked department rather than escalating the problem. A weaker version of the same weakness showed up in all four rivals: a tendency, under load, to push at a door that was marked closed instead of asking for the key.
One fairness footnote deserves an asterisk: Kimi K3 ran at its API’s default effort setting, while every other model ran at maximum effort. It still finished second, one point behind the leader, with what the organizers called the cleanest discipline of the field.
As an affiliate, we earn on qualifying purchases.
This is a live experiment, not a slide deck
Unlike most AI benchmarks, the company at the center of this one never stopped running. It operates every business day, is losing money right now, and its decline is publicly watchable — you can follow the cash countdown and read what its synthetic employees actually say to one another. A quiz built from 242 real, unedited management decisions invites visitors to guess which model made which call; it is harder than it sounds, which is rather the point.
The commercial pitch follows the same logic. Enterprises can run the same wargame against a read-only export of their own business — a digital twin that nothing ever writes back to — to see how a candidate AI behaves before it touches a real CRM, support queue or forecast.
As an affiliate, we earn on qualifying purchases.
The fitting matters more than the headshot
The lesson travels well beyond software. Anyone who has hired a stylist from Instagram, a contractor from a brochure, or an assistant from a sparkling interview already knows the failure mode: the audition measures how well someone talks about the work, not whether they finish it. Firmulate’s week-long stress test suggests the AI industry has been shopping by headshot. All five models were eloquent, insightful and honest. Only two closed the deal their own analysis had earned — and one of the most impressive talkers finished dead last. If AI agents are going to touch real customers and real money, the question is no longer “does it write well?” It is whether it finishes what it starts, reads your files first, and stays honest under pressure. None of that is visible in a chat window. All of it is visible in a bad week.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
AI negotiation and deal closing tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
