← Feed Deep Dive Matrix Subscribe

Vertical DRAM Stacking Expands Thermal Design Space Beyond HBM-on-GPU (imec)

semiengineering.com 2026-10-26
Entities
Companies:imec
Industry Analysis
imec's work strikes at the physical constraint capping AI compute density: 2.5D interposer thermal resistance. CoWoS bottlenecks NVIDIA's GB200 not on wafer supply but on lateral heat conduction through a flat interposer. By inserting cooling cavities between vertically rotated DRAM layers, imec flips thermal dissipation from horizontal conduction to vertical convection — a structural threat to SK Hynix and Samsung's HBM premium. If commodity DRAM, reoriented and packaged, displaces HBM dies, the 'dedicated memory' moat erodes architecturally, not on capacity. Upstream: the scheme sidesteps TSV and microbump interconnects, giving TSMC's CoWoS monopoly in China, Taiwan its first architecture-level substitute. Microfluidic cavity etching, however, concentrates in a few equipment vendors — a new single-point supply risk. Competitive: SK Hynix will rush HBM4 tape-out to lock customers before 3D alternatives hit yield maturity. NVIDIA won't abandon HBM short-term (CUDA memory-hierarchy coupling is too deep) but will reserve 3D-packaging interfaces in next-gen designs. 12–24 month tail: once imec publishes yield and power data, HBM pricing faces its first compression from architectural substitution rather than capacity competition. TSMC must develop a second interconnect pathway beyond CoWoS.
Read Original Article →
Related
This page displays AI-generated summaries and metadata for research purposes. Original content belongs to the respective publishers.