Researchers turn HBM on its side to tackle AI memory’s heat wall

As AI chip designs become increasingly complex, memory performance has emerged as a critical bottleneck limiting overall computing capabilities. Recently, research teams from South Korea and Japan hav... Read original →

The shift from vertical to horizontal HBM die orientation marks a thermodynamic inflection point in AI memory design. Technically, V-Die and MOSAIC approaches will marginalize Through-Silicon Vias, accelerating adoption of microfluidic cooling and inductive coupling—forcing EDA and wafer test equipment vendors to adapt. Regulatory risks loom as high-precision thermal integration may trigger tighter U.S.-EU export controls on cooling subsystems, raising overseas capex for SK Hynix and Samsung. Micron is likely to counter with aggressive iHBM patenting, while NVIDIA and AMD may reallocate CoWoS orders toward foundries compatible with horizontal HBM. Within 18 months, if validated at scale, HBM5 specifications could be rewritten—and Taiwan, China’s OSAT players lacking Heat Path Block capabilities risk exclusion from next-gen AI supply chains.