SK Hynix touts up to 5.15x inference gains with custom HBM

SK Hynix’s integration of computing capabilities into HBM marks a paradigm shift from passive storage to heterogeneous computing. This move will compel upstream foundries to invest in advanced packaging technologies, while downstream AI chipmakers must restructure their compute architectures. Geopolitically, this advancement intensifies competition between the US and South Korea, particularly affecting supply chain dynamics involving Taiwan, China and the US. Competitors like Micron and Infineon may accelerate development of similar compute-in-memory solutions. Over the next 12–24 months, this innovation could redefine datacenter compute architectures, lowering costs but accelerating regionalization of the global semiconductor supply chain.