In a single week this month, the central processing unit reclaimed the spotlight in the technology world. On October 12, AMD's chief executive Lisa Su told the Open Compute Project summit that she had raised her forecast for the 2030 server CPU market three times in nine months, to more than $200 billion. Three days later, TSMC's chairman C.C. Wei told investors that demand for AI agent CPUs was rising and called it a clear trend. And on October 19, Modal, a company that runs computing sandboxes for AI agents, reported that in its own tests a single Nvidia Vera server delivered up to twice the throughput of an Intel machine under heavy load.
Nvidia, the company that taught the world to stop worrying about CPUs, has said since May that it expects nearly $20 billion in CPU revenue this fiscal year. Lead times for some server processors have stretched to six months, and prices have climbed. The headlines have settled on a simple narrative: the CPU is back.
The demand is genuine. The reason becomes clearer when an AI system actually performs a task. An agent that books travel or fixes code does more than generate text. It opens files, runs programs, queries databases, checks permissions, and loops back to the model, often many times before finishing. Most of that work runs on general-purpose processors.
The harder question is which processors. “CPU demand” now bundles several distinct businesses. A processor feeding GPUs has a different job from one running agents’ tools. Network chips carry processors of their own. Other chips take over work around memory, storage, and security. Some are CPUs; others work alongside them or replace particular functions. Qualcomm, Arm, Nvidia, the cloud giants, and the memory makers all say they are building chips for AI’s new work, and they are rarely talking about the same chip, buyer, or competitor.
From a standard part to a fragmented market
The server CPU business used to be easy to describe. For most of the 2010s, the server CPU was the closest thing computing had to a standard part: one family of designs, sold to everyone, with Intel holding roughly 95% share. If you knew how many servers were being built, you knew roughly how many CPUs were being sold, and by whom.
Two counts show what changed, and they point in opposite directions. Across the industry, the number of companies designing server processors went from seven in 2020 to at least twelve today. Nvidia designs its own CPU. Arm, after 35 years of licensing designs to others, now sells finished chips. Amazon, Microsoft, Google, Alibaba, and Huawei design their own. Qualcomm is returning to the data center. Inside a single AI system, the count has collapsed. A 2018 server held logic chips from about five companies. A Vera Rubin rack holds them from two. A longer list of chip designers does not mean more choice for every customer. Whoever designs the complete system decides which suppliers get a place inside it.
This piece is a guide to those distinctions. We group the chips into six overlapping families: the chip next to the GPU; the CPU that runs agents; the network chip that grew into a server; the chips that make memory work; the chips in phones, PCs, and cars; and China’s many-chip answer to constrained supply. The first four follow particular jobs. The last two show how those jobs come together in different products and markets. For each, we ask where independent chipmakers still have room to compete, where customers are designing more themselves, and where demand creates openings beyond the familiar CPU names.
An apology in advance: this piece is more technical than most of ours. It is written for investors willing to spend a little time with the distinctions behind a season in which every chipmaker seems to be announcing an AI CPU. We have tried to keep the language plain, but the details matter to understanding who might benefit. Readers short on time can take the main point from here.
The CPU revival is several stories sharing one word, and each slot has its own winner, decided largely by who controls it. We start with what is real in the boom and what is overstated. We explain how we sort the chips, walk through the six families, and end with what investors should watch.
What is real, and what is overstated
The CPU’s revival begins with a simple change: AI is being asked to finish jobs. Writing a piece of code is only the start. Something must open the files, run the code, test it, and deal with what breaks. Graphics processing units power the model that issues the instructions. CPUs do much of the ordinary computing needed to carry them out. As agents take on more work, that second job grows. Inference servers already carry more CPUs per GPU than training servers did. Chipmakers have started building racks with no GPUs at all, filled with tens of thousands of CPU cores meant only for agents and their tools.
This changes the balance between the two processors. Faster GPUs produce instructions faster than the rest of the system can act on them, so the next delay comes from running a program, fetching information, or moving data. More spending on the GPU then buys less improvement than expected. A relatively cheap CPU becomes important because it keeps far more expensive equipment productive. In a top-end Nvidia rack, the CPUs are a few percent of the bill, and they can decide how well the rest is used.
But several clocks are running. One measures how long the model takes to respond. Another measures how long the software takes to act. A third measures time spent waiting for a website, a database, or another service. A faster processor shortens only some of these. Calling all of them a CPU bottleneck exaggerates the opportunity.
Nor does every agent need a processor to itself. Many spend long stretches idle, holding their files and working memory open. In one large set of real-world data, nine in ten agent environments used a twentieth or less of the processing power set aside for them, and hundreds shared a single server. Memory ran out first.
Then several agents become busy together, and the picture changes. The same data showed that when a handful of agents were active at once, they could saturate a server’s CPU cores. The pattern is familiar from cloud computing: demand is spiky, and the peak matters more than the average. That is why chipmakers are designing for bursts of activity, with many cores that can be switched on and off quickly.
The revival is also uneven across regions. In China, where access to advanced GPUs is restricted by US export controls, domestic chipmakers are pushing their own CPU designs, often based on Arm or RISC-V architectures. Companies like Huawei and Alibaba are integrating CPUs into their own server systems, reducing reliance on foreign suppliers. This is part of a broader trend of self-reliance in semiconductors, as seen in decentralized energy and other strategic sectors.
For investors, the key is to distinguish between the hype and the substance. The CPU is indeed back, but not as a single market. It is a collection of niches, each with its own dynamics. The winners will be those who control the system-level design, whether that is Nvidia, AMD, or the cloud giants. The losers may be the independent chipmakers who find themselves squeezed out of the most valuable slots.
As the AI industry matures, the CPU’s role will only grow. But the story is not a simple revival; it is a transformation. The chip that was once a commodity is now a strategic asset, and the competition to control it is reshaping the global semiconductor landscape, with Asia at the center.
