Product & Strategy

The Product Desk

The Signal

77% of enterprise buyers now re-shop their AI vendors at least every six months.

The buyer who signed last quarter is already running your dashboard next to a competitor's, and a slice of them never close either tab. What they're grading is the 90-day in-product proof window: value the user can see inside the tool, not value narrated in a quarterly review. The pilot-to-production gap used to buy vendors a year of patience, and we said that patience would outlast the hype cycle. It didn't. Onboarding depth is now the renewal argument, which puts time-to-value on the roadmap ahead of whatever the deck says ships next.

In Play

  1. Enterprise AI Contracts Compressed To Six Months

    Madrona's survey found 77% of companies re-evaluate their AI vendors every six months or continuously, a pattern TLDR IT reads as "fast in, fast out." Salesforce simultaneously folded Agentforce, Slack, and Tableau Next into three editions — Core, Advanced, and Max. For you, the renewal is won in-product on a 90-day proof cycle, and your feature now competes against a tier the buyer already owns.

  2. Agents Execute Well, Rethink Almost Never

    A Tsinghua-led study ran 1,338 agent trajectories and 5,111 training runs, per Turing Post, lifting average benchmark scores from 10.4% to 23.0%. Agents changed high-level strategy in only about 2% of runs, and memory, human guidance, and 2-8x more inference compute all failed to change that. Any roadmap item that assumes long-running agents self-correct needs forced pivot checkpoints instead.

  3. Cross-App Overlap Saw Netflix's Decline First

    a16z's Sept 4 chart pack reports that the share of YouTube users who also use Netflix fell about 20% since January 2026, while Netflix-to-YouTube overlap stayed flat, using Apptopia data. Netflix still holds streaming's highest LTV at roughly $1,500 per premium customer, about 2x the next best, even as US weekly users fell ~15% and time spent ~30% over three-plus years. Bidirectional overlap decay is the earliest churn signal available to you.

  4. Vertical AI Was Won With Plumbing

    OpenAI connected Epic environments to its ChatGPT for Healthcare workspace on Sept 1 with Cedars-Sinai and HCA as named references, gated behind an admin toggle and a signed Business Associate Agreement, per Pivot 5. Its safety claim — 99.1% across 4,363 of its own physician ratings on 27 clinical use cases — carries no independent testing. Microsoft separately cut transcription to $0.10 per hour across 60 languages, 72% below its April 2026 price.

  5. Local Inference Crossed A Product Threshold

    Nvidia's RTX Spark laptops arrive fall 2026 with 1 petaflop and 128GB of unified memory, enough to run 120-billion-parameter models locally with up to a 1M-token context, per TLDR Hardware. Microsoft's Project Zenith targets 30B-plus models on 64GB machines with "no usage limits" while the same company imposes time limits on Xbox cloud gaming as costs climb. Any unlimited AI tier you price this year needs metering and fair-use language now.

Deep Dives

Your Annual AI Contract Is A Six-Month Audition

Renewal now turns on evidence your product generates about itself — and Thursday proved a single-provider dependency can take that evidence offline for hours.

Where the bundle actually beats you

Salesforce's repackaging into Core, Advanced, and Max pulls Agentforce, Slack, Tableau Next, security, and support behind fewer purchase decisions. The danger for a point solution is not the feature comparison — it is that the comparison never happens. The buyer already owns a version of your capability inside a tier they bought for other reasons, so the loss arrives as procurement inertia rather than a lost bake-off. The pricing consequence follows directly: you are now competing against the marginal cost of an edition upgrade, not against a standalone SKU's list price. Reprice against that number, and lead with the two things a suite structurally cannot promise — model portability and operational independence from one vendor's roadmap.

The outage was correlated, not vendor-specific

ChatGPT, Claude, and Grok all suffered overlapping multi-hour outages inside the same window. That is not three vendor incidents; it is one correlated-dependency failure across the frontier-model layer. Every product with a single-provider path went dark simultaneously, which means the enterprises running automated workflows on top discovered their continuity plan was an assumption. After an outage like this, "resilient to provider outages" stops being an engineering nicety and becomes a line a buyer asks you to demonstrate — with a named fallback provider, a feature-level kill switch, and degraded-mode copy that does not read like a stack trace.

The leverage window in vendor terms

The contract side also moved in your favor. Anthropic did not amend the data retention policy that drew a backlash earlier in 2026 — per Ben Thompson's reading, it removed the policy entirely, alongside an "Enterprise Frontier Safeguards" construct, under revenue pressure while OpenAI shipped a competing model in the same week. The detail worth quoting back at your account team is that the removal is described as being in effect "in the meantime." That is interim language, and it is your justification for demanding the current state in writing plus notice on any change.

A vendor that deletes a policy under competitive pressure will restore it under margin pressure. Get the current terms in writing while the pressure runs your direction.

Where the sources disagree, and what to do about it

One assumption in most business cases does not survive the evidence here. Bloomberg reports OpenAI cut prices across multiple models specifically to defend against low-cost Chinese competitors, while Anthropic's chief commercial officer Paul Smith said on the record: "I've got no appetite to try and buy market share by lowering prices." Token-cost deflation is therefore a vendor-specific bet, not a market fact. Meanwhile the hardware reporting points the other way, toward a falling cost floor over 18 months. Both can be true, and the resolution is the same: run every AI feature's unit economics under a 30% discount scenario and a flat-for-12-months scenario, then tag each feature margin-positive or margin-contingent. The contingent ones get resequenced now, which costs roadmap credibility, instead of later, which costs engineering capacity.

The pattern across all three threads is that the AI decision your team treats as technical — which provider, which tier — is a commercial and continuity decision reviewed twice a year by someone who will not read your architecture doc.

What to do

  1. Ship per-account outcome telemetry and an exportable ROI view for every AI feature this sprint, with a 90-day value-demonstration target per named account.

  2. Write the multi-model fallback PRD this sprint: primary/secondary routing, feature-level kill switches, degraded-mode copy, and a documented manual workflow for each AI-dependent flow.

  3. Re-open data-handling terms with your primary model vendor before the next renewal, requiring the current retention state in writing and 90-day notice on any change.

Agents Iterate Confidently In The Wrong Direction

No independent benchmark arbitrates a frontier capability claim until Q1 2027, which leaves telemetry from your own workflows as the only evidence a roadmap review can trust.

The taxonomy is the transferable artifact

A team runs two coding agents against the same training problem and keeps the one with the better final score. What it actually kept was a methodology, and neither agent said so. The Tsinghua-led work names the failure by splitting agent behavior into two layers, and the split is the part worth stealing for telemetry. Execution covers data prep, hyperparameter tuning, bug fixes, and checkpoint selection. Strategy covers switching the training method, adding or removing a stage, changing data type, or redirecting remaining compute. Agents are strong at the first and effectively frozen on the second. Worse, the method each agent picked tracked agent identity rather than task fit: Claude Code mostly chose full-parameter supervised fine-tuning, Codex CLI preferred parameter-efficient fine-tuning, across problems. An agent bake-off scored on outcomes alone compares two fixed methodologies wearing agent wrappers.

The cost consequence is blunt. Agents burned the majority of those runs on low-value local corrections while lacking any reliable way to recognize a mistake mid-flight. Deployed without strategy-level guardrails, a long-horizon agent is a machine for spending compute confidently in the wrong direction.

The arbitration vacuum

The leaderboard will not arbitrate this either. Per Alberto Romero's read of OpenAI's launch materials, GPT-6 Astra effectively saturated FrontierMath and ARC-AGI 3, and ARC-AGI 4 is not due until Q1 2027. Call it two quarters in which no independent yardstick exists that a procurement team or a rival CTO can point at. Romero is explicit that he never used the model — his assessment draws on the launch post and early-tester testimonials, with no scores, prices, or third-party evals anywhere in it. His replacement scorecard is really an instrumentation spec: task completion rate, cost-per-completed-task, and supervision-minutes-per-task, measured on in-house workflows.

In an evaluation vacuum, whoever holds internal task-level data makes the vendor call. Everyone else is quoting marketing.

The verification failure has a worked example

Shipping without that instrumentation is now documented. One builder shipped a 107-million-row civic spending product with 235 human messages, 656 subagents, and 8.2 billion tokens. The app was a static site with no backend, so a £5m spend threshold filter was applied to shrink the payload, and it silently distorted the product's central claim. It surfaced because a human felt the numbers looked off. The same log admits the agents' review output exceeded what one person could read.

Read the two findings together and the pattern is consistent across sources: generation got cheap and judgment did not. An infrastructure constraint became an undisclosed data filter with no automated check between it and the ship date. An agent will iterate for hours without noticing its approach is wrong. Human review is thin cover for both, because the volume of output defeats it. The only controls that scale are machine-run: a reconciliation query that fails the build, a forced checkpoint that makes the agent declare whether its approach is working, and a strategy-change-rate dashboard baselined against 2%.

One positioning note while the instrumentation work is open. Memory plus skills plus structured feedback was the single largest measured gain in the study, lifting HumanEval to 62.8%. Fund that line. Then scrub "self-improving" and "autonomous" from the collateral, because on this evidence the thing being sold is faster linear iteration, and in an enterprise deal the gap between the claim and the data is exposure. The forcing function for next sprint is narrow: an agent workflow either has a machine check that can fail the build, or it does not go to production. Execution-layer gains are real and buyable. Strategy-layer judgment stays with the team.

What to do

  1. Add mandatory strategy checkpoints to every agent spec with runs longer than a few minutes this sprint: the agent states its current approach, then continues, pivots, or escalates to a named human.

  2. Stand up a golden-task eval harness of 30-50 real workflow tasks this quarter, scored on completion rate, cost-per-completed-task, and supervision minutes, run against your incumbent model plus two challengers.

  3. Add a merge-blocking data-invariant gate this sprint that reconciles output totals to source and enumerates every cap, filter, or threshold applied for performance.

The Overlap Metric That Saw Netflix's Decline First

Streaming's best monetization number held for three years while the audience behind it thinned, and the early warning sat in a third-party dataset nobody had on a dashboard.

The trap inside a category-leading LTV

The subscriber who is leaving does not announce it. She keeps the plan, opens the app less, watches something else somewhere else, and still shows up in the LTV number as proof of a moat. Read the composition of that lead and it stops being reassuring. It reflects higher subscription prices plus strong retention, and higher prices are simultaneously the leading suspect for the churn, with "streamflation" cited as the driver. The metric that looks like the moat is partly the mechanism of the decay. Moses Sternstein goes as far as asking whether Netflix is having its "Blockbuster moment," two decades after handing Blockbuster theirs. The generalizable defect for a product team is that a monetization metric aggregates surviving users. It is structurally incapable of reporting that the population is thinning, and it will look strongest right before it breaks.

Direction matters more than level

Cross-app overlap works as an early warning because it is asymmetric. Two products can share users while only one of them is genuinely required. When the overlap falls in one direction and holds in the other, the falling side has become optional and the flat side has become infrastructure. That is a substitutability read computable monthly from third-party panel data for the top three adjacent platforms, with an alert on any 10%-plus one-way decay. It surfaced Netflix's problem long before revenue did. That is the whole argument for building the panel, and it is the cheapest early-warning system available to a consumer product team.

Absolute engagement is flattering a share loss

The attention data underneath changes planning inputs, not just dashboards. Aggregate US social media time is still rising, barely. But social's share of mobile screentime fell about 3 percentage points since April 2026, after years of steady, sometimes double-digit growth. People spend more time on social in absolute terms and far more time on everything else. Every absolute-engagement metric in the industry is currently reporting a win on top of a share loss.

Then the cohort split. The 17-25 cohort drives all US social growth, while 36+ users have tapered off since October 2025. A blended 2027 engagement target hides that taper, and 36+ is exactly the segment most teams monetize. Sternstein's hypothesis that short-form video, particularly YouTube, absorbed the attention is flagged as directional rather than proven, and a16z discloses it has not independently verified the third-party data. Treat the direction as strong and the attribution as open.

LTV tells you what your best users were worth. Bidirectional overlap decay tells you whether they will still be here next year.

The move, and the counter-move to avoid

Netflix's answer, live sports plus its own clips and shorts, is a defensive push onto a competitor's format. The forcing function before funding a format-matching bet of one's own is to name the asymmetric advantage held in that format. If no such advantage exists, the overlap data argues the problem was never format. It was necessity. Compete on complementarity, on being the product the other one's users cannot drop, and instrument the direction of that dependency monthly. The alternative is learning about it in a renewal call.

What to do

  1. Ship a bidirectional cross-app overlap panel for your top three adjacent platforms this sprint, with a monthly refresh and an alert on any 10%-plus asymmetric decay.

  2. Replace absolute time-spent and DAU as your headline engagement metric with share-of-session this quarter, and re-baseline 2027 targets separately by age cohort.

The bottom line

Three of today's items fail in the same place: the number meant to settle an argument came from the party with an interest in the answer. That breaks the working assumption that picking the right model or vendor is the decision determining your AI outcome. The decision is who produces the evidence, and outside your own instrumentation, nobody currently does — buyers re-shopping on shorter cycles will ask for it before they ask about your model. Name one owner this week for a single evidence pack on your highest-volume AI surface: the outcome metric, the machine-run gate, and the export a champion can forward without you in the room.