AI data centers are eating the memory industry, and it could hurt your wallet

Memory maker Micron (MU) reported blowout first-quarter earnings on Wednesday, beating both revenue and profit estimates and providing a better-than-expected second-quarter outlook as data center builders look to grab as many of the company’s memory chips as possible.

Micron Technology makes memory (called DRAM) for data centers. As the construction of data centers in the United States booms, the price of this kind of memory is getting higher and higher.

There’s just one problem: DRAM is also used in devices like smartphones and laptops.

Consumer PCs and other systems use a type of DRAM called double data rate memory (DDR), while data centers use a type of DRAM called high-bandwidth memory (HBM).

Due to the higher profit margins of data center components, DRAM vendors are currently more focused on building HBM rather than DRAM. This leaves the wider market hungry.

It’s not just PC buyers who are feeling the sting. Everything from cars to medical devices could be affected by a shortage of memory chips.

To make matters worse, before releasing its financial report, Micron announced that it would exit the consumer memory business and focus on providing memory for artificial intelligence data centers.

“It’s not going to be good for consumers because it’s going to drive up prices very quickly,” Ryan Reith, group vice president of Worldwide Device Trackers at IDC, told Yahoo Finance.

See also  Winter Olympian Pees A Message In The Snow For Trump Administration
Thursday, August 22, 2024, at the Amazon Web Services data center in Boardman, Oregon. (AP Photo/Jenny Kane)
Amazon Web Services data center in Boardman, Oregon, on August 22, 2024. (AP Photo/Jenny Kane) · Associated Press

While most of us tend to think of GPUs powering AI data centers, they are just part of a cluster of servers running applications like OpenAI (OPAI.PVT) ChatGPT and Google (GOOG, GOOGL) Gemini. In addition to CPU and storage, they also require large memory pools.

question? There are only a few major memory manufacturers in the world. These include well-known companies such as Samsung, SK Hynix and Micron (MU). Huge demand for data center equipment is driving up prices across the industry.

According to Reuters, Samsung has increased the price of some memory by as much as 60%. Enthusiast site PCPartPicker tracks the prices of various memory modules, showing that the cost of some has climbed from $100 to nearly $450.

“I think the general consensus is that over the last month… this has gotten more attention, but not in a positive way,” Reese said, adding that the price impact may ultimately be passed on to consumers, especially on lower-cost laptops.

That’s because companies that make entry-level and mid-range systems have less wiggle room on pricing before completely draining profits.

“All of these things are essentially PCs. Any embedded device, gaming console, specialized medical device, those are embedded computers, they all have memory, and they all have some type of storage,” Bob O’Donnell, founder and principal analyst at TECHnaanalysis Research, told Yahoo Finance.

But as long as memory companies can make a killing on HBM, they don’t necessarily mind if there’s a shortage of components for PCs and other systems, especially since profit margins on HBM are higher than on other types of memory.

See also  The Most Startling Line From Trump's Davos Speech

Bernstein analyst Stacy Rasgon explained that there are ways device makers can offset the impact of rising memory prices, including using cheaper, less powerful components elsewhere in their products or putting pressure on suppliers to reduce costs.

However, this isn’t the first time the tech industry has faced memory supply issues. After all, this is a notoriously cyclical market.

“The reality is, demand is huge and capacity is expanding, but it’s never plain sailing,” O’Donnell said.

He added: “So… all the demand is absorbed, so you build these new plants and you end up with one more ton of capacity and then the price drops precipitously because there’s so much capacity.”

But with so many companies building data centers around the world, it’s difficult to tell when the memory market will pull back.

Sign up for the Yahoo Finance Week in Technology newsletter.
Sign up for the Yahoo Finance Week in Technology newsletter. · Yahoo Finance

Email Daniel Howley at dhowley@technology shoutfinance.com. Follow him on Twitter: @DanielHowley.

For the latest earnings reports and analysis, earnings rumors and expectations, and company earnings news, click here

Read the latest financial and business news from Yahoo Financece.

Spread the love

Leave a Reply

Your email address will not be published. Required fields are marked *