Eleven Days of Autonomy, Rented From a Proof Checker
A lab result that reads like a milestone is really a specification: it names the two conditions under which agent autonomy pays, and both have gotten harder to meet.
The binding constraint was coordination, not intelligence
The most useful detail in the Fermat result is the failure that had to be fixed before anything else worked. The agents initially lost track of their own work, and the repair was bookkeeping rather than a smarter model. Prove2Me gave each agent a live shared to-do list, per Techpresso's account of Anthropic's description. Read that less as a research anecdote and more as a build specification for long-horizon autonomy: shared task state, sandboxed execution, per-call cost attribution. Those are platform-layer components an organisation can fund and own, and most enterprise agent pilots do not have them.
The second condition cannot be manufactured on demand. Every step was machine-checkable, which is why an outside mathematician could confirm the proof holds rather than form an opinion about it. The checker is the trust mechanism, not the agent. That names the tradeoff plainly. Agent budget becomes leverage where a verifier exists, and becomes headcount where one does not.
The oracle test
- Oracle exists: code with real test coverage, financial reconciliation, configuration validation, contract terms scored against a rule engine.
- No oracle: strategy documents, customer communications, judgment calls. Autonomy spend here buys supervision cost dressed as leverage.
The supervision side of the ledger got weaker in the same week
Two sources describe the same degradation from opposite ends. Exponential View reads OpenAI's GPT-6 Astra as having invented a compact symbolic notation to hold an unfamiliar environment, then reasoned over it instead of exploring it, using fewer actions than the human median on 96% of the levels it completed. Capability rose because legibility fell. Box of Amazing supplies the governance name for the same mechanism: recurrent depth cuts compute and produces reasoning humans cannot read, the "neuralese" problem, which degrades chain-of-thought monitoring, the field's principal safeguard.
A reasonable skeptic would say the evidence does not point one way, and the skeptic is right. In honeypot tests with safeguards disabled, Astra made zero unauthorised access attempts, against more than half for the shipped comparison model. Behaviour improved while readability fell. That is the case for treating behavioural benchmarks as weak assurance artifacts: safety researcher Ryan Greenblatt reads specific misaligned behaviours collapsing to near zero as papering over problems rather than resolving the underlying drives. Auditability, not model recency, is the procurement test.
The escalation layer is staffed by people who have never seen the work done right
The architecture the industry is standardising on assumes there is a human worth pulling back. Ethan Mollick's "Twilight Factory" has AI running routine work and engineered to pull a human in for the decisions that matter. Rahim Hirji's counter is that the puller is now a graduate who starts by managing: prompt, read, correct, pass on. When a model hands back something plausible and wrong, nothing in an inexperienced reviewer yet objects. EY US published the price of the repair: $100M tied to judgment and business acumen, plus an eight-to-twelve-month paid residency where participants join as analysts. It starts in 2028. That leaves a two-year window for firms that build the mechanism rather than buying the outcome back later.
The financial tell is already legible. Roughly 90% of organisations use AI and about 80% report individual productivity gains, while well under half see earnings impact. Productivity with no verifier and no named capture mechanism does not reach the P&L. It dissipates into rework and review.
Autonomy scales to the horizon of your verifier and stops at the experience level of the person you put behind it.
What to do
Classify your top ten AI workflows this month by whether an automated verifier already exists, and hold new autonomy funding for any workflow that cannot name one.
Audit every high-consequence workflow where the sole human reviewing model output has under three years of hands-on domain experience, and assign a senior second reviewer before the end of this quarter.
Add reasoning legibility and audit-artifact requirements to model procurement standards this quarter, separate from behavioural safety benchmarks, with compensating controls written down wherever reasoning is opaque.