Industry News

AMD Milestone: High-End AI Chip Instinct MI300X Officially Ships

Views : 25
Update time : 2024-01-31 10:42:28
        AMD's Instinct MI300X chip, developed specifically for AI and high-performance computing (HPC), has finally been officially delivered recently after much anticipation from the outside world. LaminiAI, an AI service provider that has been working with AMD for a long time, said that it has recently received a number of computing devices with eight MI300X chips built-in.
        AMD Instinct MI300 series products have been shipping since 2023, and AMD claims that the series is expected to become the fastest revenue breakthrough of $1 billion in the company's history, but the MI300X, which is claimed to outperform NVIDIA's H100 chip, has not yet been shipped, and this time it is the first time that a customer has confirmed that the MI300X has begun to ship in large quantities, symbolizing the important milestone that AMD has finally reached. milestone.
        LaminiAI, which specializes in training commercial large-scale language models, has purchased a number of computing devices with eight MI300X chips from AMD. 
        LaminiAI CEO posted a picture showing the first batch of AMD MI300X chips in action. The devices with 8 MI300X chips are now online and are as fresh as freshly baked bread.LaminiAI's new batch of large language models are now online. 
        AMD's previously launched MI300A chip is already data center grade, with a built-in x86 CPU and GPU, and a CDNA 3 architecture that supports AI computing. MI300X doesn't have a built-in CPU, but the number of CDNA 3 chips is much higher, with a total of 304 computing units, which is far better than the MI300A's 228 computing units. 
        The MI300X is seen as AMD's best weapon against NVIDIA's H100 chip because it has 192GB of built-in HBM3 memory, which is better than the H100's 80GB of HBM3 memory, and the MI300X has a memory bandwidth of up to 5.2TB per second, compared to the H100's 3.35TB per second. industry insiders have even suggested that the MI300X is good enough to match the H200 141GB chip in the H100's upcoming H200, which will be released in the near future. Industry insiders even consider MI300X to be a good match for NVIDIA's upcoming H200 141GB GPU. 
        On the customer side, Microsoft and Meta have already purchased large quantities of the MI300 series, and LaminiAI is the first customer to publicly adopt the MI300X.

 
Related News
Read More >>
How many chips does a car need? How many chips does a car need?
Sep .19.2024
Automotive chips can be divided into four types according to their functions: control (MCU and AI chips), power, sensors, and others (such as memory). The market is monopolized by international giants. The automotive chips people often talk about refer to
Position and Function of Main Automotive Sensors Position and Function of Main Automotive Sensors
Sep .18.2024
The function of the air flow sensor is to convert the amount of air inhaled into the engine into an electrical signal and provide it to the electronic control unit (ECU). It is the main basis for determining the basic fuel injection volume. Vane type: The
Chip: The increasingly intelligent electronic brain Chip: The increasingly intelligent electronic brain
Sep .14.2024
In this era of rapid technological development, we often marvel at how mobile phones can run various application software smoothly, how online classes can be free of lag and achieve zero latency, and how the functions of electronic devices are becoming mo
LDA100 Optocoupler: Outstanding Performance, Wide Applications LDA100 Optocoupler: Outstanding Performance, Wide Applications
Sep .13.2024
In terms of characteristics, LDA100 is outstanding. It offers AC and DC input versions for optional selection, enabling it to work stably in different power supply environments. The small 6-pin DIP package not only saves space but also facilitates install