LLM Commoditization

Once LLMs reach “good enough” performance for a given task, competition shifts to price — and the structural economics of LLM provision (high fixed cost, near-zero marginal cost, no proprietary data flywheel) make it difficult for any provider to maintain durable pricing power.

What It Is

The commoditisation thesis holds that LLMs will converge on functionally equivalent performance for most commercial use cases, at which point the market will price them like infrastructure or utilities rather than premium software. The mechanism: (1) open-source models close the gap with frontier proprietary models; (2) enterprise buyers discover they cannot verify which model is “best” for their use case; (3) competitive pressure drives prices toward marginal cost; (4) margins collapse for all but the most differentiated or lowest-cost providers.

Fawkes Capital (December 2025) frames this as the “flaw in the AI narrative” — LLMs do not exhibit the same economies of scale as cloud computing. In cloud, scale creates genuine cost advantages (amortised infrastructure, engineering expertise, procurement leverage) that enable durable margin. In LLM provision, the primary input is compute, which is available to all at similar prices from NVIDIA or cloud providers. There is no equivalent of Google’s search index or AWS’s network effects in LLM provision.

Sara Hooker (SSRN, 2026) complements this with the “slow death of scaling” argument: the relationship between training compute and model performance is rapidly changing, meaning the frontier advantage that comes from raw scale spending is less durable than assumed.

Why It Matters (for Investors)

LLM commoditisation affects investors in multiple ways. First, investments predicated on sustaining pricing power in AI model provision face erosion risk. Second, the “picks and shovels” strategy (investing in AI infrastructure like NVIDIA) depends on maintained demand growth and sustained GPU pricing power — both at risk if LLM provision commoditises. Third, if models commoditise, the investible opportunity shifts up the stack (to applications that create differentiated value on top of commodity models) and sideways (to the human capital and organisational capability needed to deploy AI effectively).

The commoditisation dynamic also affects the competitive moat question for AI-native companies generally: if models are commodity inputs, moats must come from proprietary data, distribution, workflow integration, or domain expertise — not from model quality itself.

Evidence & Examples

  • Google’s TPU infrastructure now rivals NVIDIA’s latest commercially available GPUs at significantly lower cost — a direct challenge to NVIDIA’s GPU pricing power (2025.12.19-Why-We-Worry-Part-1.pdf)
  • NVIDIA has taken equity stakes in companies (including OpenAI) that depend on its support — effectively subsidising its customer base to stave off competition, which Fawkes argues is not a sustainable strategy (2025.12.19-Why-We-Worry-Part-1.pdf)
  • Amazon’s Trainium 3 chip has narrowed the performance gap with NVIDIA and is likely to be cost-competitive upon release (2025.12.19-Why-We-Worry-Part-1.pdf)
  • Fawkes: “Most customers will not care which model is marginally better, in much the same way travellers care more about airfare than the nuanced engineering differences between aircraft” — articulating the commoditisation end state (2025.12.19-Why-We-Worry-Part-1.pdf)
  • Sara Hooker: “The relationship between training compute and performance is highly uncertain and rapidly changing. Relying on scaling alone misses a critical shift that is underway” — suggesting the scale advantage that justifies current pricing is temporary (ssrn-5877662 (1).pdf)
  • Academia has been “marginalized from meaningfully participating in AI progress” as industry labs stop publishing — but Hooker argues this is about to be disrupted as scaling alone loses its dominance (ssrn-5877662 (1).pdf)

Tensions & Open Questions

  • Application-layer differentiation: Even if models commoditise, companies that build high-quality applications on top of commodity models may sustain pricing power at the application layer. The commodity-vs.-application stack question is the central investment framing issue for AI (see AI Investment Thesis Capex and Returns).
  • Proprietary data as the alternative moat: If model quality is not a durable differentiator, proprietary training data may be. Companies that own or control unique datasets (clinical records, legal documents, financial transactions, proprietary code) may be able to maintain performance advantages. This is a key investment thesis in AI-native verticals.
  • ⚠️ CONTRADICTION: Contrary Tech Trends 2026 and the broader VC community have maintained a bullish view on infrastructure and frontier models — arguing that the winner-take-most dynamics in model capability will produce durable concentration at the frontier. This contradicts the Fawkes commoditisation thesis. The resolution may depend on whether AGI-adjacent capabilities create qualitatively new applications that reset the market structure.
  • 📅 POTENTIALLY STALE — vertical models complicate the commoditisation picture: The article focuses on horizontal LLM commoditisation, but a new source in Raw/ (The age of vertical models is here, @eoghan, March 2026) documents that Intercom’s Apex model — trained on billions of proprietary customer service interactions — outperforms GPT-5.4 and Opus 4.5 on customer service tasks at lower cost and latency. Similar vertical model advantages are documented at Decagon (80%+ of traffic on proprietary models) and Cursor. This suggests the commoditisation thesis holds for general LLMs but that the model layer is not fully commoditised for domain-specific applications backed by proprietary data. Moats at the model layer ARE possible when domain data creates a training flywheel. [Raw/ — pending ingestion]
  • OpenAI’s model viability: Fawkes argues OpenAI’s inability to monetise at scale — without Google’s integrated ecosystem advantages — makes its business model potentially unsustainable. If correct, this has major implications for the broader AI investment ecosystem that has priced OpenAI’s success as a baseline assumption.

AI Capex Economics and Bubble Risk · Scaling Law Uncertainty · AI Investment Thesis Capex and Returns · Agentic AI Fundamentals