Industry News

NVIDIA teams up with SK Hynix to try 3D stacking HBM memory onto GPU cores

Update time : 2023-12-16 12:39:29

SK Hynix has begun recruiting designers for logic semiconductors such as CPUs and GPUs in the hopes of integrating HBM4 directly onto chips via 3D stacking, according to Joongang.co.kr. SK Hynix is reportedly discussing its HBM4 integration design approach with several semiconductor companies, including Nvidia.

The foreign media believe that Nvidia and SK Hynix will likely jointly design this integrated chip, and with the help of TSMC for foundry, and then through TSMC's wafer bonding technology will SK Hynix's HBM4 chip stacked on the logic chip. Joint design is inevitable in order to realize the synergy between memory and logic chips. If SK Hynix is successful, this could change the way the industry operates to a great extent, as it will not only change the way logic and memory new chips are interconnected, but also the way they are manufactured.
At this stage, HBM stacking is primarily placed on an intermediary layer next to the CPU or GPU and connected to the logic chip using a 1024bit interface. SK Hynix aims to stack HBM4 directly onto the logic chip, eliminating the intermediary layer altogether. In a way, this approach is similar to AMD's 3D V-Cache stacking, where the L3 SRAM cache is packaged directly on the CPU chip, while HBM's allow for higher capacity and are cheaper (IT House note: HBMs are obviously slower than caches as well).
One of the main factors plaguing the industry at the moment is that HBM4 requires a 2048bit interface, so the intermediary layer of HBM4 is very complex and costly. Therefore, it would be economically feasible to stack memory and logic chips together, but this raises another issue: heat dissipation. Modern logic chips, such as the Nvidia H100, generate hundreds of watts of heat while delivering huge VRAM bandwidth thanks to the huge HBM3 memory. As a result, it can take a very sophisticated approach to heat dissipation for logic and memory package assemblies, even considering liquid cooling and/or immersion heat dissipation.
If the heat dissipation problem is solved in two to three generations, the HBM and GPU will be able to operate as one without the need for an intermediary layer," said Kim Jung-ho, a professor at the Korea Advanced Institute of Science and Technology (KAIST) Department of Electrical and Electronic Engineering. An industry insider told Joongang that "the 'rules of the game' for semiconductors could change in the next 10 years, and the difference between memory and logic semiconductors could become negligible".

Previous : Melexis Expanded Performance Limits with New Miniature 3D Magnetometer

Next : AMD Expands Ryzen Embedded Processor Family for High-Performance Industrial Automation, Machine Vision and Edge Applications

How to Identify Legitimate Sellers When Purchasing Electronic Components Online？

Dec .31.2024

Purchasing electronic components online is different from buying clothes online. One needs to understand various aspects. When shopping online for electronic components, one must have a basic knowledge of electronic components and know how to distinguish

Development Directions and Innovation Trends of the Electronic Components Market in 2025

Dec .31.2024

With the continuous progress of science and technology and the development of the global economy, the electronic components industry has shown a rapid development trend in recent years. From consumer electronics to industrial automation, from automotive e

Resistance Thermometer Temperature Sensors

Dec .31.2024

A resistance thermometer is a common temperature sensor that measures temperature by utilizing the property that the resistance of materials changes with temperature. Resistance thermometers are widely used in various fields, including industrial control,

Say Goodbye to Lag! Three Ways to Speed Up WiFi

Dec .31.2024

Don't worry. By learning the following three methods, your WiFi experience can be greatly improved! Let's improve the home WiFi signal from three aspects: transmission power, wireless channels, and location with the agency of Cirrus Logic. Say goodbye to

About Us

About Us What we do Quality People

Products

CHIP/IC Active devices Passive device Components OTHER

China electronic components supplier----Wah Luen Shing Electronic.----www.wlschip.com

Leave a message