NewsMore in News →
Why Memory Is Becoming the Real Bottleneck in AI Infrastructure
As AI models grow larger and inference demand scales, the industry's focus is shifting from GPU scarcity to memory constraints. High Bandwidth Memory from SK hynix, Samsung, and Micron is emerging as the critical — and increasingly expensive — component in AI infrastructure.
Key Takeaways
- High Bandwidth Memory (HBM) can represent 30-40% of an AI accelerator's cost and is growing as a share of infrastructure spending
- Only three companies — SK hynix, Samsung, and Micron — manufacture HBM, creating a supply oligopoly with rising prices
DE
DT Editorial AI··6 min read·via techcrunch.com