Industry News

NVIDIA teams up with SK Hynix to try 3D stacking HBM memory onto GPU cores

Update time : 2023-12-16 12:39:29

SK Hynix has begun recruiting designers for logic semiconductors such as CPUs and GPUs in the hopes of integrating HBM4 directly onto chips via 3D stacking, according to Joongang.co.kr. SK Hynix is reportedly discussing its HBM4 integration design approach with several semiconductor companies, including Nvidia.

The foreign media believe that Nvidia and SK Hynix will likely jointly design this integrated chip, and with the help of TSMC for foundry, and then through TSMC's wafer bonding technology will SK Hynix's HBM4 chip stacked on the logic chip. Joint design is inevitable in order to realize the synergy between memory and logic chips. If SK Hynix is successful, this could change the way the industry operates to a great extent, as it will not only change the way logic and memory new chips are interconnected, but also the way they are manufactured.
At this stage, HBM stacking is primarily placed on an intermediary layer next to the CPU or GPU and connected to the logic chip using a 1024bit interface. SK Hynix aims to stack HBM4 directly onto the logic chip, eliminating the intermediary layer altogether. In a way, this approach is similar to AMD's 3D V-Cache stacking, where the L3 SRAM cache is packaged directly on the CPU chip, while HBM's allow for higher capacity and are cheaper (IT House note: HBMs are obviously slower than caches as well).
One of the main factors plaguing the industry at the moment is that HBM4 requires a 2048bit interface, so the intermediary layer of HBM4 is very complex and costly. Therefore, it would be economically feasible to stack memory and logic chips together, but this raises another issue: heat dissipation. Modern logic chips, such as the Nvidia H100, generate hundreds of watts of heat while delivering huge VRAM bandwidth thanks to the huge HBM3 memory. As a result, it can take a very sophisticated approach to heat dissipation for logic and memory package assemblies, even considering liquid cooling and/or immersion heat dissipation.
If the heat dissipation problem is solved in two to three generations, the HBM and GPU will be able to operate as one without the need for an intermediary layer," said Kim Jung-ho, a professor at the Korea Advanced Institute of Science and Technology (KAIST) Department of Electrical and Electronic Engineering. An industry insider told Joongang that "the 'rules of the game' for semiconductors could change in the next 10 years, and the difference between memory and logic semiconductors could become negligible".

Previous : Melexis Expanded Performance Limits with New Miniature 3D Magnetometer

Next : AMD Expands Ryzen Embedded Processor Family for High-Performance Industrial Automation, Machine Vision and Edge Applications

How many chips does a car need?

Sep .19.2024

Automotive chips can be divided into four types according to their functions: control (MCU and AI chips), power, sensors, and others (such as memory). The market is monopolized by international giants. The automotive chips people often talk about refer to

Position and Function of Main Automotive Sensors

Sep .18.2024

The function of the air flow sensor is to convert the amount of air inhaled into the engine into an electrical signal and provide it to the electronic control unit (ECU). It is the main basis for determining the basic fuel injection volume. Vane type: The

Chip: The increasingly intelligent electronic brain

Sep .14.2024

In this era of rapid technological development, we often marvel at how mobile phones can run various application software smoothly, how online classes can be free of lag and achieve zero latency, and how the functions of electronic devices are becoming mo

LDA100 Optocoupler: Outstanding Performance, Wide Applications

Sep .13.2024

In terms of characteristics, LDA100 is outstanding. It offers AC and DC input versions for optional selection, enabling it to work stably in different power supply environments. The small 6-pin DIP package not only saves space but also facilitates install

About Us

About Us What we do Quality People

Products

CHIP/IC Active devices Passive device Components OTHER

China electronic components supplier----Wah Luen Shing Electronic.----www.wlschip.com

Leave a message