← Feed Deep Dive Matrix Subscribe

Custom HBM as a System: Co-designing the Base Die, Die-to-Die Power and Package Thermals for AI Accelerators - Marvell Technology

www.marvell.com 2026-11-18 Marvell Technology
Entities
Companies:Marvell
Industry Analysis
Marvell's pivot signals a shift from HBM layer stacking to system-level co-design. Traditionally passive, the Base Die is now critical for thermal and power management in high-density AI accelerators. Integrating Die-to-Die power delivery with package thermodynamics breaks the physical boundary between memory and logic, redefining compute density limits. This disrupts the standardized packaging paths of SK Hynix and Samsung, forcing upstream substrate suppliers to re-evaluate thermal performance. Geopolitically, this deep customization increases supply chain lock-in risks but builds a robust technical moat for Marvell. Within 18 months, HBM standards will likely bifurcate into 'dedicated systems' versus 'generic interfaces.' Customized solutions will dominate high-end AI chips, while commodity HBM faces intensified price competition as the value proposition shifts from capacity to system efficiency.
Read Original Article →
Related
This page displays AI-generated summaries and metadata for research purposes. Original content belongs to the respective publishers.