Bharath SrivatsanSeptember 2026
Tokenomics
AI is changing software economics. LLMs are increasingly both a flywheel for engineering productivity and a new source of non-negligible marginal costs (as businesses build AI-enabled features that require large amounts of compute).
These changes threaten to upend the traditional market structure for software companies. What might these new dynamics imply for firm sizes and competition? What might they mean for the distribution of surpluses between consumers and producers (model creators like Anthropic, inference providers like AWS, and application layer businesses like Salesforce)? How might they change as regulatory shocks or compute scarcity take effect? This multi-part series will use simulations and surveys of recently-published literature to explore these questions.
Part 1: AI and the application layer
1.1 Background
While physical businesses experience economies of scale as they sell to more users (their average cost per unit falls as fixed costs are spread and production and distribution get more efficient), they still incur a real cost to build each incremental unit.
In fact, physical businesses can even experience dis-economies of scale, as extraordinarily large firms struggle with coordination costs and higher prices for increasingly scarce inputs.1 For businesses past that point, there is eventually a size at which it is cheaper for smaller entrants (on the other side of the cost curve) to serve each marginal user. This can be a natural brake against monopolization that doesn't exist in software markets.
Software is different. Most software costs a lot to initially develop, but has almost zero marginal cost; serving each additional user is close to free. This means that average costs decrease even more substantially with scale: spreading fixed costs over a billion users is cheaper than over a hundred.2
It of course isn't exactly true that there is zero marginal cost to software — hosting, storage, support, and per-transaction fees all scale with adoption. But software products see almost double the margins (in one study, 72% gross margins for software, against 37% for machinery and 33% for general retail).
Many other factors3 also disadvantage potential entrants and encourage increased concentration in software markets:
For more on the economic literature about software-specific market factors, see Hal Varian, "Economics of Information Technology" (2001, revised 2003).
- Bundles: Bundling products deters new entrants into a market: competitors may need to rebuild the whole suite to displace users. Because adding another product to a bundle costs ~nothing for software firms, incumbents are more incentivized to create large bundles
- Free tiers: zero marginal costs allow software firms to build free tiers that remove the potential strategy of new entrants offering initially worse but cheaper products (in order to gain a foothold)
- Switching costs: Moving from one product to another incurs costs as well, benefiting incumbents. Studies have found that migration, integration, and training can cost anywhere from 1.3 to eleven times the cost of the software itself.4
- Network effects: If a product is worth more to each user as more people use it, the leader's product is better because it leads. This can lead to accelerated consolidation, as the prospect and momentum of a winner leads to buyers preferring them5
Taken together, this is why software markets produce Googles and Microsofts and Metas rather than fifty mid-sized competitors. Even in new categories, companies understand the immense returns to scale and thus invest in massive, aggressive user land grabs.
1.2 Nonzero marginal costs and scale advantages
With AI, the era of zero-marginal-cost software may be over. An increasing number of applications are building AI features for their users that cost them non-negligible amounts in inference6, and the introduction of nonzero marginal costs raises the lowest price they can charge to break even on each unit.
In 2025 the Wall Street Journal reported that AI features had cost Notion roughly ten points of margin, TechCrunch found that margins on code-generation products were "either neutral or negative", and Bessemer's fastest-growing AI companies averaged about 25% gross margin against 60 to 80% for classic SaaS.
Counterintuitively, this may advantage smaller firms. We can use a simple simulation to show how non-negligible marginal costs can decrease the advantage that larger firms have over smaller ones.
We first derive a simple formula for average costs (2): divide fixed costs by the number of users and add it to both normal software marginal costs and new token costs. Then, we compute the ratio of a small firm's cost to a large one (3) and see that it asymptotically drops to 1 as token costs rise.
But marginal costs aren't the only way AI is changing businesses' unit economics. Tokens are also being consumed by application layer firms as an input into their fixed costs (since engineering teams can use AI to speed up development).
We now update the simulation to take into account fixed costs that also go down if tokens are cheaper. Note that if tokens are extremely expensive, firms will just continue to use people to build software, so we take the minimum cost of (building with people, building with AI). We can then recompute the ratio formula, but now using the fixed cost term that varies by token cost.7
This result assumes that tokens are an input into production by substituting for human labor (in other words, as tokens become cheaper, they more efficiently replace costly engineering salaries in the production function). Instead, if tokens were a complement for research and engineering work, cheaper tokens would raise the return to spending on employees, which would favor the firms that could afford more of them. The general result is that the impact of tokens on fixed costs depends in part on the elasticity of substitution, but in either case cheaper tokens would lead to a higher quality of product per unit of human input. Finally, the reduction here holds the product fixed; if AI leads firms to spend more on quality rather than retaining savings, fixed cost dollar amounts may not fall.
Together, these simulations suggest that the gap between large and small firms is smaller than it was before AI.
- When tokens are expensive, larger firms have a smaller advantage over new entrants, because fixed costs play a smaller role in the overall cost of the software and amortizing them over more users matters less
- When tokens are cheap, the product is cheaper to build in the first place, so there is less fixed cost to spread at all8
As an example of the changing dynamics of size: a few years ago, GitHub Copilot had many classic incumbent advantages - Microsoft's distribution, integration with a very popular editor, and the closest relationship with OpenAI. In 2023 it was still losing more than $20 a month on a $10 subscription, and in June 2026 GitHub moved every plan to usage-based billing at the listed API rates, because flat pricing was "no longer sustainable". Meanwhile, newer startups like Cursor and Claude Code have seen hockey-stick adoption for their code assistant products despite charging high prices to cover similar costs. It was both easier for the smaller firms to leapfrog Copilot's capabilities and harder for Microsoft to offer subsidized pricing forever.
1.3 AI and anti-incumbency effects
AI may be weakening some of the other pro-incumbency levers of software as well:
| Software advantage | AI-era changes | |
|---|---|---|
| Diseconomies of scale do not kick in for software | → | Going after marginal users may mean going after customers who have extremely customized or inference-heavy workloads, driving up costs9 |
| Bundling products to discourage competition is free | → | Token costs mean giving users more products might require starkly higher bundle prices, and building + bundling adjacent software is cheaper |
| Acquiring customers with a free tier is viable | → | Free tiers must be aggressively limited or eliminated lest they risk ballooning costs |
| Software install cycles make it hard to switch products | → | AI reduces the cost of engineering, making it easier to move (or build in house) |
| Network effects lead to consolidation behind fast growers | → | While mostly unchanged, the increased competition due to faster AI feature diffusion may make premature consolidation less likely |
Many AI apps find that handling edge cases in open-ended inputs and unstructured user interactions is far costlier. This balloons the long tail cost of AI-enabled software in a similar way to traditional diseconomies of scale.
Anecdotally, it does seem like we're seeing more competition in software markets. New features seem to percolate through competitors extremely rapidly, and new (software) business formation is way up.10
The uneven diffusion of AI may also function in the short to medium term as an anti-incumbency effect. AI-native startups seem faster at building new products and organizing their companies to reduce coordination costs, and may use that to outcompete larger, slower movers. As with any new technology this could bite the other way too; for example, faster AI-driven development may require more legal and security support, something that larger companies are better prepared to provide.
It isn't a given that this will remain true, though. AI might eventually introduce powerful new vectors for concentration:
- Data-enabled user customization may become more important, as AI-enabled software and custom models fit users' needs better and better11
- With a new wave of software, attracting customers and getting them to change behavior may become harder than before. Distribution may then become more important, benefiting incumbents
- Keeping up with feature wars and a more expensive (risky) security landscape may dramatically increase the cost of building winning software (even with cheaper token costs). This could yield benefits to high capitalization as wealthier firms outcompete startups
- Many on Twitter seem to believe that AI spells the death of SaaS, as users rebuild all software in house. In this world, the model/inference layer captures the value of the application layer and consolidates the overall software ecosystem
Hagiu and Wright's (2023) study on data moats suggests that training on user data operates like a weak network effect: the marginal value of another user's data falls off quickly, data goes stale, it can be bought or synthesized, and the improvement it buys can be copied once seen. However, this refers to across-user, rather than within-user learning. AI may enable user-specific improvements and customization that function like higher switching costs.
These factors don't yet seem to have taken effect. New apps are exploding, and Ramp's AI Index shows AI budgets growing alongside software budgets rather than in place of them. For now, at least, we are in the golden age of software.
1.4 Token costs and market-level dynamics
So far, we've discussed individual firms and their responses to varying token costs. We can go one step further, and model how token costs impact market-wide dynamics like firm counts and gross margins.
For a given software vertical, we can model the market as a Salop (1979) circular city. Consumer preferences are spread uniformly, and they each buy from their "nearest" product, bearing a cost that models how much they care which product they get. Firms freely enter so long as they can cover their fixed costs (free entry is more likely to be true given the weaker incumbency effects discussed in 1.3). This allows us to back into closed-form formulas for both the number of firms and the price each customer pays.
(1) A firm's demand, modeled as a factor of how much its price undercuts its neighbors, and how much (uniformly distributed) customers prefer its product
(2) Given that each neighbor charges the same price, each firm's best prices is its marginal price plus a markup that depends on the customer's preference for a given product and the total number of firms
(3) We can model the number of firms in the equilibrium by setting the last firm's profit (price minus marginal cost, times the number of users it serves) equal to its fixed costs
(4) Putting the number of firms back into the pricing formula, we get a formula for the amount customers pay that it not dependent on the firm count
(5) Gross margin is this resulting price minus the cost of goods sold, over the price
The specific numbers here are illustrative, but we can see some takeaways as a function of token costs:
- As token costs rise, gross margins and the equilibrium number of firms fall (the latter because the market shrinks)
- Higher token prices raise the fixed costs of building software and shrink the number of users in the category. The latter spreads costs among fewer people, meaning pricing rises faster than the token price increase alone
- As applications become more token hungry (as users use more tokens each month), these effects become more pronounced
1.5 Pricing dynamics
For a long time, seat-based subscription pricing was the natural model for software, since each additional user cost the same (negligible) amount to support. With the introduction of material token costs and wide variance in usage patterns, flat seat rates no longer make sense.12
Instead, we're seeing new pricing structures take off:
- Usage-based billing, where firms charge users per token or per action. Sometimes this is modeled as hybrid pricing, where users are charged a flat fee plus a usage-based overage rate
- Outcome-based pricing, where firms charge for successful outcomes (resolved customer support cases, etc.)
We can build a simulation to show how each pricing model performs under varying user conditions. We first model the following variables:
- θ, preferred usage: the number of tokens a given consumer would use if tokens were free. This is a lognormal model (with a long tail), as power users can burn extraordinary numbers of tokens
- k, efficiency: the number of tokens needed for a given result. This is also lognormal, since some users have more complex tasks (coding tasks in a large, messy codebase needs more tokens than doing the same in a small one)
- w, preference: what each result is worth to a user, in dollars. This is modeled independently of θ - some users' workloads may be low value but burn lots of tokens (e.g. using gpt-6-astra to grep for code)
Each regime has an intuitive pricing model: seat-based users pay a fixed price; metered users pay per usage, outcome-based users pay some amount per successful task (usage divided by the number of tokens per successful task), and hybrid users pay a flat fee plus an overage amount.
A user will use θ tokens if they were free, meaning the marginal value of tokens declines and reaches zero at θ tokens. The total value of the tokens used is the product of the integral of each token's value (determined by number of tokens and tasks accomplished) and the user's dollar preference per task accomplished.
We can now see13 how each pricing regime responds to rising token costs:
Note that in this simulation, gross margins falling as token costs rise is partly mechanical (as costs rise, the proportion of profit goes down) and not a true marker of firms doing worse; dollar profits themselves better illustrate the impact of token prices on firms.
- Flat / seat-based: The flat price must rise to cover heavy users as token costs rise, which then pushes out light users and raises the average bill of those remaining.
- Metered billing: Metering never loses money. Users for whom the results are not worth the token costs do not use the product at all, and usage goes down for those who do use the product since they stop at the marginal point beyond which usage is no longer worth it. This is what similar case studies like usage-based broadband pricing show.14
- Outcome pricing serves the most users and makes the most money when tokens are cheap (as users are paying for something that costs less to produce), but drops margin fastest as tokens get more expensive. The firm is paying for its least efficient users, who burn many tokens to achieve few results
- Hybrid pricing: The flat fee adds a floor to pricing, excluding some users who would have paid just for the tokens-consumed. On the other hand, the fee extracts a surplus from users who value the product above what metering alone would cost them. In other words, the strategy is to charge fewer users, more. Hybrid pricing is never worse than metering here, because the fee chosen by the model maximizes profits, and a hybrid price with a $0 fee is a metered price
The main takeaway is that all of these approaches dominate flat / seat-based pricing, and as token costs remain volatile, firms can protect their margins by shifting pricing structures.15
Not every firm will make the shift. Lambrecht and Skiera find that some consumers prefer flat rates even when a meter would cost less: they overweight the risk of a large bill and value simplicity. None of that changes with AI, so some firms will keep a flat fee, especially for entry-level usage.
1.6 Summary
AI is changing the economics of application-layer software firms:
- AI re-introduces nonzero marginal costs to software, while reducing the upfront price for building software. Both of these effects disproportionately benefit small firms over large (though they do not even the playing field on their own)
- AI may also reduce or reverse the other software-specific factors that previously benefited incumbents
- As token costs rise, gross margins, market size, and the number of firms supported in each vertical all fall
- Nonzero marginal costs encourage businesses to shift from seat-based pricing to outcome-based, metered, or hybrid approaches
Part 2 introduces the labs and inference providers, models how token prices are set, and explores how various levers affect the creation and distribution of consumer surpluses.