Product & Strategy

The Product Desk

The Signal

Meta shipped three apps in four months from ideas it rejected for a decade on cost.

The cost that collapsed was maintenance, not build. Agents pulled a reusable scaffold out of Facebook's codebase, and Forum inherited login, notifications, and ranking, so no new team had to stay on call for it. Which means every idea you killed on engineering cost since 2024 was priced against inputs that no longer exist. That list is worth rereading before the next planning cycle.

In Play

  1. Killed Ideas Became A Shipped Portfolio

    Meta VP Jagjit Chawla said on the Skip podcast that AI agents extracted a reusable app scaffold from Facebook's codebase, and a small pod shipped Forum in weeks, then Seller in July and Creator Studio in August. Ideas rejected for a decade on cost grounds shipped in one summer. The defect for you is the prioritization model itself: it still runs on pre-agent build and maintenance estimates. Chawla also claims an agent scaffolds the iOS app from the Android one to roughly 80%.

  2. Reasoning Effort Outranks Model Choice

    OpenAI shipped GPT-6 Astra on Sept 3 at $10/$50 per 1M tokens, roughly 2.5x its predecessor's per-token price. Cognition measured near-Fable-5 quality at 64% lower cost; Artificial Analysis measured it 75% more expensive per task at max effort. Astra also scored 62.7-66% on ARC-AGI-3 with a standard harness and 99-99.9% with a provider adapter. Your model-selection doc cannot cite a vendor score you have not reproduced on your own harness.

  3. California Can Erase Your Disclosure Runway

    California's AI Transparency Act took effect Aug 2 for developers above 1M monthly users, requiring a user-facing detection tool, visible disclosure and latent metadata; the EU AI Act's Article 50 landed the same day with the same dual-layer shape. SB 1000, on Newsom's desk until Sept 30, extends those duties below 1M users and carries an urgency clause that binds on signature. Separately, New York City banned student-facing generative AI for 600,000 elementary and middle schoolers.

  4. The Interface Unbundled From The System Of Record

    Salesforce's Claudeforce partnership lets a user run CRM from inside Claude, per a16z's Seema Amble — the most valuable system of record in enterprise software ceded the interface and kept the data and the actions. In twelve months Docusign's Iris, Atlassian's Rovo and Klaviyo's Composer moved from retrieval to applying human-defined policy. Anything you scoped as differentiated AI a year ago is now incumbent table stakes, and memory is not the replacement moat.

  5. Agent Discovery Pays; Agent Checkout Does Not

    OpenAI launched Instant Checkout on the Agentic Commerce Protocol in September 2025 and pulled it back in March, ceding checkout to merchants to focus on product discovery, Newcomer reports. Recommendation trust already exists — an April Retail Dive/Rithum survey found ~53% of shoppers trust AI recommendations as much as brand websites — while transaction trust does not. Ship agent-readable catalog data now and keep agent payment authority behind a flag.

Deep Dives

The Rejected-Ideas List Is The Highest-Yield Backlog You Own

Three shipped apps and a one-prompt clone of an acquired business describe the same repricing, and only one of those two facts makes your roadmap safer.

The number that moved was maintenance, not build

Jagjit Chawla's account puts the decisive cost on ownership rather than construction. Forum inherited Facebook login, notifications, performance work and ranking infrastructure, so no new organization was required to keep it alive. That is what had killed the idea repeatedly for a decade: pulling roughly ten engineers off the main app always lost the opportunity-cost argument, and a feature for tens of millions inside an app serving two billion reads as bloat. Once Forum worked, Seller and Creator Studio came off the same cookie cutter. The prioritization bar never moved; the estimate feeding it did.

The clone window is measured in days

The practitioner evidence points the same way from outside Meta. Latent.Space burned over 20 billion tokens on early-access Astra across a month of real work, and the subagent-fleet workload the author describes as junior-AI-engineer labor cost roughly $100 over two days. In that month one small team built replacements for four previously paid SaaS subscriptions and stood up an admittedly incomplete GitHub-plus-Vercel replacement. Ben Tossell separately reproduced remove.bg — a real background-removal business Canva acquired and is sunsetting in December — in a single Fable 5.1 prompt, then published the code. Commenters noted macOS has done it natively for years. OS bundling, acquirer sunset and one-prompt replication converged on the same narrow feature.

Where the sources disagree, and who actually benefits

The hands-on accounts read cheap building as permission to build more. a16z's Seema Amble reads the identical capability as an incumbent advantage. Salesforce's Claudeforce hands the front door to Claude and keeps the record and the actions underneath. Docusign's Iris applies a legal team's playbook, Atlassian's Rovo routes and resolves, Klaviyo's Composer builds and grades campaigns — one product cycle from retrieval to narrow policy. Meta's own edge in this story is not the agent; it is promoting a new app to two billion dailies. If you lack owned distribution, cheap building helps the incumbent more than it helps you.

What actually compounds

Memory is not the answer, because the labs are shipping general-purpose memory and recall cannot say whether the work was good. The asset that survives is the learning loop over model plus harness, and the two proof points here are unusually concrete. Harvey post-trained Tenet on roughly 1,750 simulated partner-assigned matters averaging about 50 grading criteria each, using synthetic, public and expert-authored data with no customer data at all. Meta's production version rates Reels on four dimensions — interest match, timeliness, freshness, time-worthiness — with a small share of users scoring what they see, the ML team goaled on growing five-star and shrinking one-star ratings, read over months because roughly 1,000 experiments run daily and per-experiment attribution breaks down.

A team's list of things it already decided not to build is worth more than its engineering capacity.

Hold the caveats where they belong. This is one VP's account of one company, and Chawla reversed himself within months on PMs shipping production code. The cannibalization defense — power users with their own surface produce more content that feeds both apps — is asserted with no holdout behind it. a16z is a venture firm publishing a thesis about a category it funds. The SaaS-replacement claims are first-party anecdote. Borrow the argument structure, then replicate once, small, with logged numbers.

What to do

  1. Pull every idea your team killed on engineering or maintenance cost since 2024 and re-score the top ten this sprint against agent-era inputs: extracted scaffolding, inherited infrastructure, cross-platform port cost.

  2. Run a scaffold-extraction spike this sprint and record your own Android-to-iOS or web-to-mobile completion percentage instead of planning against Meta's roughly 80%.

  3. Commission 100-plus expert-authored scenarios at roughly 50 rubric criteria each for your top job this quarter, and wire them into CI as an eval gate.

Astra's Effort Dial Is Worth More Than Its Benchmark Sheet

The setting that decides whether OpenAI's new flagship cuts your bill or doubles it is a config parameter your product does not expose yet.

Higher effort billed less than low effort

An engineer pinned the effort dial to low, because low is the cheap setting. On the ARC-AGI-3 runs, Astra at max effort cost $26,000 while low effort cost $38,000 and medium cost $48,000, because higher effort took fewer actions to finish the job. That one line should end the habit of hardcoding cheap. Quality runs the same direction: hallucination rate falls from 92% to 51% at max effort with a four-point accuracy gain, and on HealthBench Professional Astra at its lowest effort beat GPT-5.6 Sol's best score at roughly half the cost, with a separate internal health eval showing three times fewer factual mistakes. The Responses API changes reasoning effort without breaking cache, and adds async function calling and mid-turn steering. The engineering excuse for a single global setting is gone.

The harness is the score

Astra scores 62.7-66% on ARC-AGI-3 with a standard harness and 99-99.9% with a provider adapter that preserves opaque reasoning state and uses native compaction. François Chollet's near-100% run cost roughly $360 per game, and he noted the benchmark saturated twice as fast as expected, under 1% to 100% in six months, with ARC-AGI-4 not arriving until Q1 2027. Skeptics read the jump as harness exploitation rather than raw capability. They may be right. The operating conclusion does not move either way: vendor scores describe a serving architecture you do not have, and there is roughly a twelve-month window in which public benchmarks say almost nothing about a specific product.

What the upgrade pitch leaves out

Artificial Analysis logged an approximately 80 Elo drop on GDPval-AA v2, a Presentation Quality Elo regression versus Sol, and 2-3 point regressions on tau-cubed Banking, SciCode and AA-LCR, alongside an 80 Elo gain on AA-Briefcase long-horizon knowledge work. A product doing formatted output, financial workflows or long-context retrieval can ship a visible regression under a release note that says upgrade. The forcing function is to name the evals that describe what users actually do, then run them before the version bump rather than after the complaint. Standardizing on one leader is not available: Anthropic's Fable 5.1 leads the Coding Agent Index at 70 against Astra's 67, Meta's Muse Spark 1.3 leads the Intelligence Index, and Gemini 3.8 Flash edges Astra on DeepSWE 73.8% to 73.3%.

Effort settingQuality signalCost signalWhere it belongs in your product
LowestBeats prior flagship's best on HealthBench Professional~half the cost of Sol's bestFree tier, drafts, classification, high-volume paths
MaxHallucination 92%→51%, +4 points accuracy75% more per task than Sol at maxRegulated output, customer-facing claims, irreversible actions

Autonomy a chat turn cannot express

UK AISI measured Astra's no-chain-of-thought time horizon at 30.9 minutes against 3.6 minutes for GPT-5.6 Sol, and it became Pokémon champion in 18h12m versus 96h35m. Codex can ask a question while continuing independent work, and an experimental feature lets the model keep notes and search earlier context windows. A turn-based surface cannot represent half an hour of independent work. What it needs instead is progress surfacing, interruption and resume, mid-flight steering, and a question queue that does not block the run. Pricing is diverging by mechanism rather than by amount: Anthropic cut cached inputs 75%, Google is running Gemini 3.8 Flash at 50% off until Jan 1 2027, and Meta offers 90% off in exchange for user data.

The same launch made one evaluator's costs fall by 64% and another's rise by 75%, which means effort and harness are product decisions, not defaults.

What to do

  1. Freeze a regression suite this week covering output formatting, financial task flows and long-context retrieval, and gate any model swap behind it.

  2. Ship reasoning effort as a dynamic routing parameter this sprint — low by default, max on high-stakes paths — and target a 25% blended cost reduction at flat or better success rate.

  3. Run a design sprint this quarter on long-horizon agent UX: progress surfacing, interruption and resume, mid-flight steering, and a non-blocking question queue.

Newsom Has Until September 30 To Delete Your Disclosure Runway

Two transparency regimes already switched on with one shared architecture, and the bill on the governor's desk removes the user threshold most roadmaps are quietly treating as runway.

The urgency clause is the whole problem

A product lead scheduled provenance work for next quarter because the covered-provider line sat above her monthly active count. SB 1000 removes that comfort. It extends California's covered-provider definition to companies with fewer than one million monthly users, requires latent disclosure whenever generative AI created or altered an output, and carries an urgency clause, so it binds on enactment. There is no phase-in and no engineering runway. Newsom signs or vetoes by September 30. Roadmaps that treated the million-user line as build time are scoped against a date that can vanish on signature. AB 2713, also pending, would push large platforms to surface whether provenance data shows AI generation.

One pipeline serves both regimes

The two live regimes converged on the same shape, which makes the build cheaper than the panic suggests. California's AI Transparency Act took effect August 2 and requires covered developers generating image, video or audio to ship a user-facing detection tool for their own synthetic outputs, a visible manifest disclosure, and latent disclosure in metadata. The EU AI Act's Article 50 landed the same day, requiring AI-interaction disclosure plus machine-readable marking of synthetic image, audio, text and video. One provenance service with a manifest layer and a machine-readable latent layer, called by every generative surface, satisfies both and survives SB 1000's expansion. Per-feature implementations guarantee rework. Teams log the detection tool as a checkbox; someone will test it publicly and post the screenshot.

Litigation reaches you before enforcement does

The child-safety vector moves fastest because it is the most bipartisan. The CHATBOT Act from Ted Cruz and Brian Schatz cleared Senate Commerce, requiring parental notice and consent for teen chatbot accounts and banning targeted advertising to teens and under-13s. California's SB 1119 stacks child-safety risk assessments and audits above $500M revenue but attaches a private right of action that applies regardless of size. New York's S 10675 adds operator liability for chatbots impersonating licensed professionals. Plaintiffs' lawyers arrive before regulators do, which means the revenue threshold protects nobody.

The buyer layer is faster than the statute layer

New York City imposed a one-year moratorium on student-facing generative AI across elementary and middle schools covering 600,000 students, and per AP the ban applies to any software using student-facing generative AI. That is capability-scoped, not vendor-scoped: a math practice app with an AI hint button sits in the same bucket as a chatbot tutor. Meta's settlement with state attorneys general, published as a legal document rather than a product blog, is the closest thing the industry has to a minor-safety requirements spec. Bloomberg's Alexandra Levine reports TikTok and YouTube's silence about what they will change may be backfiring.

The permissive news is the least operationally relevant news. The G20 unanimously adopted US-proposed light-touch AI guidelines, and the Justice Department argued AI training is fair use. The binding constraints are state attorneys general and institutional buyers, so the durable capability is selective compliance without a release: jurisdiction and age-band feature flags built as a platform primitive rather than a per-feature hack. Sort each constraint on two axes, capability-scoped versus vendor-scoped, and config change versus deploy. Capability-scoped plus deploy is where the next quarter goes. New York's A 11626 would mandate an AI-off toggle on AI search surfaces; shipping it voluntarily first produces the opt-out rate, the number that says whether the AI surface is retained or merely tolerated.

Regulators have stopped asking whether your AI works and started asking whether you can turn it off, per tenant, per age band, per region.

What to do

  1. Scope one dual-layer disclosure service — visible manifest plus machine-readable latent metadata — before September 30, and make it a platform call rather than per-feature work.

  2. Run a minors-exposure gap audit this sprint across registration, messaging, recommendations and notifications, scored against the commitment categories in Meta's state AG settlement.

  3. Ship jurisdiction and age-band feature flags as a platform capability this quarter, targeting any AI or minor-facing feature disabled for a named geography or age band in under an hour.

The bottom line

The pattern across these items is a swap in what is scarce: shipping a thing now costs less than earning the right to run it and proving it is good. That breaks the planning reflex that treats engineering capacity as the ceiling on ambition — the ceiling is now a defensible definition of quality plus a jurisdiction and a buyer who will let you operate. Write down the two artifacts nobody can hand you this week: the rubric that decides what good output means for your highest-volume workflow, and the switch that turns that surface off per tenant, per age band, per region.