AI’s Demand to Drive Server DRAM: 2024 Predictions Show 17.3% Annual Increase in Content per Box
February 5, 2024 | TrendForceEstimated reading time: 2 minutes
In 2024, the tech industry remains steadfastly focused on AI, with the continued rollout of advanced AI chips leading to significant enhancements in processing speeds. TrendForce posits that this advancement is set to drive growth in both DRAM and NAND Flash across various AI applications, including smartphones, servers, and notebooks. The server sector is expected to see the most significant growth, with content per box for server DRAM projected to rise by 17.3% annually, while enterprise SSDs are forecast to increase by 13.2%. The market penetration rate for AI smartphones and AI PCs is expected to experience noticeable growth in 2025 and is anticipated to further drive the average content per box upward.
Looking first at smartphones, despite chipmakers focusing on improving processing performance, the absence of new AI functionalities has somewhat constrained the impact of AI. Memory prices plummeted in 2023 due to oversupply, making lower-priced options attractive and leading to a 17.5% increase in average DRAM capacity and a 19.2% increase in NAND Flash capacity per smartphone. However, with no new applications expected in 2024, the growth rate in content per box for both DRAM and NAND Flash in smartphones is set to slow down, estimated at 14.1% and 9.3%, respectively.
The server industry, benefiting from rising demand for AI servers, has seen the introduction and mass production of advanced AI chips by key players such as NVIDIA, AMD, and CSP ASICs. Since training AI servers, which predominantly use DRAM for high-speed computing, currently lead the market, DRAM is expected to show a higher growth in content per box than NAND Flash with server DRAM anticipated to have a yearly growth rate of 17.3% and enterprise SSDs around 13.2%.
Lastly, in the notebook market, Microsoft’s AI PC specifications require CPUs with a capability of over 40 TOPS, met by processors like Qualcomm’s Snapdragon X Elite, AMD’s Ryzen 8000 series (Strix Point), and Intel’s Lunar Lake. However, notebooks equipped with these CPUs are expected to become widely available only in the latter half of 2024, thus providing limited short-term impetus for increasing memory capacity.
The primary requirement for AI PC hardware is expanding DRAM capacity to 16 GB, with no corresponding demand for a 1TB SSD. Therefore, the YoY growth rate for DRAM in laptops is projected to be around 12.4%. This growth is expected to be more pronounced in 2025 as AI PCs enter mass production. Meanwhile, client SSDs are also on an upward trend in terms of content per box, but due to a sharp rebound in NAND Flash prices, their annual growth rate is estimated to be only 9.7%.
Suggested Items
Industrial PC Market Size to Record $1.75 Billion Growth from 2023-2027
05/03/2024 | PRNewswireThe global industrial pc market size is estimated to grow by USD 1.75 billion from 2023 to 2027, according to Technavio. This growth is expected to occur at a Compound Annual Growth Rate (CAGR) of almost 6.29% during the forecast period.
Real Time with… IPC APEX EXPO 2024: Insight into Summit Interconnect's Success
04/30/2024 | Real Time with...IPC APEX EXPOShane Whiteside, CEO of Summit Interconnect, discusses the company's recent recognition as one of the best PCB fabricators in the industry by receiving IPC's Peter Sarmanian award. Whiteside touches on the impact of changes in the marketplace, such as the Defense Production Act and presidential determination, on their growth. Whiteside also shares the company's focus on mechanical and data automation to enhance manufacturing processes and anticipates more automation and evolution in the industry.
North American PCB Industry Sales Down 23.8% in March
04/29/2024 | IPCIPC announced the March 2024 findings from its North American Printed Circuit Board (PCB) Statistical Program. The book-to-bill ratio stands at 1.13.
North American EMS Industry Down 4% in March
04/29/2024 | IPCIPC announced the March 2024 findings from its North American Electronics Manufacturing Services (EMS) Statistical Program. The book-to-bill ratio stands at 1.31.
Guerrilla RF Completes Strategic Acquisition of GaN Device Portfolio from Gallium Semiconductor
04/29/2024 | BUSINESS WIREGuerrilla RF, Inc. has finalized the acquisition of Gallium Semiconductor's entire portfolio of GaN power amplifiers and front-end modules. Effective April 26th, 2024, GUER acquired all previously released components as well as new cores under development at Gallium Semiconductor.