Industry News

NVIDIA Releases H200, World's Most Powerful AI Chip: Performance Soars 90%, Doubles Llama 2 Inference Speed

Update time : 2023-12-09 10:24:38

November 13, 2011 - NVIDIA today unveiled the next generation of AI supercomputer chips that will play an important role in deep learning and large-scale language models (LLMs), such as OpenAI's GPT-4. The new chips represent a significant leap forward from the previous generation, and will be used in data centers and supercomputers to handle tasks such as weather and climate prediction, drug discovery, quantum computing, and more. and other tasks.

The key product release is the HGX H200 GPU, based on NVIDIA's "Hopper" architecture, which is the successor to the H100 GPU and the company's first chip to use HBM3e memory, which is faster and larger, and therefore better suited for large language models. According to NVIDIA, "With HBM3e, the NVIDIA H200 delivers 141GB of memory at 4.8 TB per second, nearly twice the capacity and a 2.4x increase in bandwidth compared to the A100." On the AI side, NVIDIA says the HGX H200 doubles the speed of inference on Llama 2 (70 billion parameter LLM) compared to the H100.The HGX H200 will be available in 4-way and 8-way configurations that are compatible with the software and hardware in the H100 system. It will be available for every type of data center (local, cloud, hybrid cloud and edge) and deployed by Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure, among others, and will be available in the second quarter of 2024.
Another key product announcement from NVIDIA was the GH200 Grace Hopper "superchip," which combines the HGX H200 GPU with the Arm-based NVIDIA Grace CPU via the company's NVLink-C2C interconnect, and is officially designed for supercomputers. Designed specifically for supercomputers, it allows "scientists and researchers to solve the world's most challenging problems by accelerating complex AI and HPC applications running terabytes of data. The GH200 will be used in "more than 40 AI supercomputers at research centers, system manufacturers and cloud providers around the world," including Dell, Eviden, Hewlett-Packard Enterprise (HPE), Lenovo, QCT, and Supermicro. Notably, HPE's Cray EX2500 supercomputer will use the quad GH200, which scales up to tens of thousands of Grace Hopper superchip nodes. Perhaps the largest Grace Hopper supercomputer will be the GH200. Perhaps the largest Grace Hopper supercomputer is JUPITER at the Jülich facility in Germany, which will be "the world's most powerful AI system" when installed in 2024. It uses a liquid-cooled architecture, and its enhancement module consists of nearly 24,000 NVIDIA GH200 supercomputers interconnected by NVIDIA's Quantum-2 InfiniBand networking platform.
NVIDIA says JUPITER will contribute to scientific breakthroughs in a number of areas, including climate and weather prediction, generating high-resolution climate and weather simulations with interactive visualizations. It will also be used in drug discovery, quantum computing and industrial engineering, many of which use customized NVIDIA software solutions that simplify development but also make supercomputing teams dependent on NVIDIA hardware. Last quarter, NVIDIA achieved record revenues of $10.32 billion ($13.51 billion total) in AI and data center alone, up 171 percent from a year ago, and NVIDIA is no doubt hoping that the new GPUs and supercomputing chips will help it continue that trend.

Previous : IBM Unveils First 1,000-qubit Quantum Chip

Next : Nexperia's First SiC MOSFETs Raise the Bar for Safety, Robustness and Reliability in Industrial Power Switching Applications

How to Identify Legitimate Sellers When Purchasing Electronic Components Online？

Dec .31.2024

Purchasing electronic components online is different from buying clothes online. One needs to understand various aspects. When shopping online for electronic components, one must have a basic knowledge of electronic components and know how to distinguish

Development Directions and Innovation Trends of the Electronic Components Market in 2025

Dec .31.2024

With the continuous progress of science and technology and the development of the global economy, the electronic components industry has shown a rapid development trend in recent years. From consumer electronics to industrial automation, from automotive e

Resistance Thermometer Temperature Sensors

Dec .31.2024

A resistance thermometer is a common temperature sensor that measures temperature by utilizing the property that the resistance of materials changes with temperature. Resistance thermometers are widely used in various fields, including industrial control,

Say Goodbye to Lag! Three Ways to Speed Up WiFi

Dec .31.2024

Don't worry. By learning the following three methods, your WiFi experience can be greatly improved! Let's improve the home WiFi signal from three aspects: transmission power, wireless channels, and location with the agency of Cirrus Logic. Say goodbye to

About Us

About Us What we do Quality People

Products

CHIP/IC Active devices Passive device Components OTHER

China electronic components supplier----Wah Luen Shing Electronic.----www.wlschip.com

Leave a message