Apple Silicon might get used for AI chips in server farms
William Gallagher
A new rumor claims that Apple will use TSMC's 3nm technology for an AI server processor that it is designing alongside its iPhone and Mac chips.
It's already known that TSMC has been developing 3 nanometer processors, and believed that Apple has bought out its entire production capacity for it. The presumption was that Apple would use the process for latest versions of its A-series iPhone chips, and M-series Mac ones.
Now, however, a leaker named "Phone Chip Expert" on Chinese social media site Weibo, claims that Apple is designing a specific, bespoke artificial intelligence processor. As first spotted by MacRumors, the leaker says it will go into mass production in the second half of 2025.
If correct, this suggests that Apple is not exclusively focusing on AI being run locally on device. It's been presumed that Apple prefers AI running on the iPhone because of privacy, but so far AI has required greater processing capacity, and storage, than is always available on device.
To that end, Apple has recently acquired firms in both Canada and France that work on compressing AI requirements. Apple has also published a research paper specifically about how it can tackle "the challenge of efficiently running LLMs that exceed the available DRAM capacity by storing the model parameters on flash memory but bringing them on demand to DRAM."
Even if, as previously expected, the iPhone will perform most of its AI on device, there may yet be more intensive processing that requires being offloaded to a data center. It makes sense for Apple to use TSMC and its technologies to make that be as fast and efficient as possible.
However, it's also the case that TSMC is an existing partner and is already producing iPhone, iPad, and Mac processors. If Apple were to work with another manufacturer, it would necessarily have to reveal its plans to them for best optimization and coordination.
The "Phone Chip Expert" does not have a current Apple rumor track record, but they do have an accurate one from about five years ago. The claim of Apple needing AI server farms and designing their processors with TSMC is plausible, and a logical assumption based on what the company will need.
Andrew Orr
Malcolm Owen
Christine McKee
Chip Loder
18 Comments
This has been one of those obvious moves for long while now.
Upcoming Nvidia server hardware is now running at up to 1000 W, requires liquid cooling and cost a whole lot of money. If Apple can produce equivalent performance at 250 to 500 W and having equivalent LLM performance at lower memory footprints, it may actually make LLM chatbots, searches, and services profitable. And they may get a two-for if that hardware can be run in a Mac Pro.
I have not seen whether MS Co-pilot subscriptions make any profits yet. The non-MS LLM services? I think they are all operating at loss. Still early for Google to see if their LLM services will be profitable.
Apple? All part of their ecosystem train and can be amortized across multiple products, especially if their LLM services sell hardware.
Hope not. Apple should go all-in with on-device.