AI Demand Outpaces Compute Supply

Despite public market volatility in July and August, the AI sector has demonstrated continuous acceleration across the board. This rapid growth includes notable progress from companies like Anthropic, which is currently in a quiet period, as well as clear advancements from OpenAI and various open-source models. The acceleration is particularly evident in areas such as Grock, which showed dramatic improvements following a recent update to Grokbot.

The prevailing sentiment in the AI industry is shifting from a 'winner-take-all' mentality to one where the entire ecosystem can thrive. This 'win-win' scenario suggests that frontier labs, cloud providers, open-source initiatives, and application developers can all capture significant value as AI adoption expands. The previous 'zero-sum' thinking is being dismissed in favor of an 'and' ecosystem, where entities like Anthropic, OpenAI, SpaceX, Meta, and Google (through TPU sales) can all benefit. Furthermore, this broad growth extends to NeoClouds and inference clouds, which are built on top of these emerging infrastructures.

Anthropic is reportedly implementing a unique approach to vet job candidates, focusing on mission alignment by discussing the possibility of equity value dropping to zero. This strategy aims to attract individuals who are deeply committed to the company's mission rather than solely motivated by financial gain. The shift reflects a desire to foster a 'missionary' culture, moving away from a 'mercenary' mindset that might prioritize short-term equity. This approach highlights the critical need to balance the company's overarching mission with the substantial capital required to fund intensive compute operations.

AI labs face a critical strategic decision regarding the allocation of their compute resources: whether to prioritize current revenue generation through inference or invest in long-term model advancement through training. Companies might drastically reallocate compute, potentially shifting 80% from inference to training, which would significantly impact immediate revenue. For instance, a move from 8 gigs for inference and 2 gigs for training to 8 gigs for training could reduce revenue from $480 to $120. This indicates that current revenue generation in these labs is highly discretionary and subject to strategic shifts based on research breakthroughs. Public markets, therefore, may need to adjust their expectations and valuations to account for these strategic reallocations that prioritize future R&D over short-term profits.

Surprisingly, the highest-income zip code and county in America also boast the highest per capita concentration of data centers. Loudoun County, Virginia, exemplifies this trend, being the highest-income county in the US and simultaneously hosting the nation's densest concentration of data centers. These facilities not only represent significant technological infrastructure but also contribute substantially to the local economy through tax revenue.

The booming data center industry is playing a significant role in the re-industrialization of the United States. A key factor driving this trend is the substantially lower cost of natural gas in the US compared to Europe and Asia, where prices are dramatically higher. Natural gas is a crucial input for both manufacturing and data center operations, providing a considerable cost advantage for the US. This economic shift is helping to revitalize small towns that have historically suffered from industrial decline, bringing new investment and employment opportunities.

The current trajectory suggests a severe undersupply of compute capacity in the coming years, largely due to an underbuilding on the supply side. Forecasted infrastructure builds through 2028 are likely to face political delays, exacerbating the problem. Contrary to market expectations of oversupply, there is a significant risk of a severe shortage, which could lead to dramatic consequences. This undersupply has the potential to cause substantial price increases for access to AI intelligence, impacting a wide range of industries and consumers.

Despite their apparent accessibility, open-source AI models often come with hidden costs and specific licensing terms. These models are more accurately described as 'open weights' rather than strictly open source, meaning their underlying parameters are public but their usage may be restricted. For example, the Llama license includes a requirement for a 30% revenue share from any revenue generated using the model. Additionally, open-weight models can sometimes be less efficient and more costly on a per-task basis compared to proprietary solutions.

With the increasing demand for compute capacity, space-based data centers are emerging as a potential solution to overcome terrestrial limitations. These orbital data centers are envisioned not as massive structures but as relatively small units, comparable in size to an airplane. Space offers inherent advantages for these operations, including constant access to solar power and efficient thermal cooling provided by the vacuum environment. The economic feasibility of such ventures largely hinges on the reusability of launch vehicles like Starship, which can significantly reduce the cost of deploying infrastructure into orbit.

The economics of computing are poised to be fundamentally altered by orbital solutions, particularly with advancements in space travel. While training models on Earth will always retain advantages due to low latency and physical proximity of GPUs, a growing fraction of the world's compute power is expected to shift to orbit. The reusability of Starship, which reduces launch costs to under $1 billion, is a game-changer that makes space-based operations economically viable. This shift will create a hybrid model where terrestrial data centers remain crucial for latency-sensitive tasks, but orbital computing takes on an increasingly significant role for other applications.

The long-term commercial potential of space industrialization extends far beyond orbital data centers to include ventures like asteroid mining and space-based manufacturing. Asteroids are believed to contain vast quantities of precious metals and other valuable resources, making asteroid mining a very real prospect in the future. This aligns with Jeff Bezos' vision of Earth becoming primarily a 'residential' planet, with heavy industry relocated to space. The development of robust space infrastructure, particularly through SpaceX's capability for thousands of launches per year, is essential for realizing these ambitions, potentially including the establishment of lunar bases to facilitate operations.

The landscape of AI models is evolving towards a future dominated by an ensemble of specialized models rather than a single, all-encompassing winner. This reflects the reality that no single model can be optimal for every task, leading to a Pareto curve where different models excel in specific areas. Major players like Microsoft are already pivoting towards integrating various open-source models, acknowledging this shift. Even NVIDIA, a hardware leader, is potentially taking a leading role in the development of open-source models. This trend suggests that large companies will increasingly move away from relying solely on one frontier model, opting instead for diverse, multi-model strategies.

The future of AI within the enterprise is likely to be a hybrid model, moving away from a winner-take-all scenario. This multimodel approach is more favorable for companies like Microsoft, which can integrate various solutions. Businesses are expected to utilize multiple frontier models operating behind an abstraction layer or router, enabling a flexible and robust AI infrastructure. This structure allows enterprises to leverage the high-end planning capabilities of advanced models while maintaining cost-effective execution through more specialized or smaller models.

Cursor distinguishes itself from other AI labs by adopting a practical engineering philosophy, prioritizing product-centric development over abstract narratives of 'digital deity.' While sharing similar long-term visions with other companies, Cursor's path to achieving those goals is notably different. Their approach focuses on meeting customers where they are, offering tangible solutions that solve immediate problems. This mindset, reflected in their integration with SpaceX, aligns with practical engineering principles rather than theoretical discussions of Artificial General Intelligence (AGI), demonstrating a concrete path toward greater autonomy in AI applications.

Nvidia's dominance in the AI accelerator market is attributed to Jensen Huang’s successful strategy of being vertically integrated while remaining horizontally open. This approach allows Nvidia to control key aspects of the hardware and software stack while fostering a broad ecosystem for developers and other companies. Competing hardware makers are advised to avoid direct confrontation with Nvidia and instead focus on finding niche areas where they can plug into Nvidia's existing ecosystem. The scale of this market is immense, with every 1% of market share in the AI accelerator market estimated to be worth approximately $100 billion, underscoring the strategic importance of Nvidia's position.

The increasing adoption of open-source AI models, while potentially lowering profit margins per token, paradoxically boosts the long-term demand for compute capacity. This is because open-source accessibility typically leads to a much higher total consumption of tokens across the ecosystem. For instance, a margin shift from 90% to 40% on tokens made with an Nvidia GPU would encourage more tokens to be consumed. This increased volume of usage, in turn, necessitates a greater aggregate need for compute capacity, ultimately benefiting companies like Nvidia through higher sales of their hardware.