Industry News

AMD has the strongest AI chip, 153 billion transistors, and a single GPU runs a large model

Views : 13
Update time : 2023-06-17 11:31:31
        It was reported on June 14 that in the early morning of this morning, AMD, Nvidia's number one competitor, finally released its long-awaited AI trick. As the generative AI hurricane swept the world, Nvidia GPUs were snapped up by major manufacturers, and the focus quickly shifted to AMD. Can AMD produce AI chips powerful enough to break Nvidia's near-monopoly market position and seize the new wave of AI? Today, AMD has now issued a phased response.
 
 
        The MI300X is a GPU-only version that uses AMD CDNA 3 technology and uses up to 192 GB of high bandwidth HBM3 memory to accelerate large language models and generative AI computing. Major AMD customers will begin MI300X trials in the third quarter and full production in the fourth quarter. Another model, the Instinct MI300A, is now on sale to customers.
AMD announced a new partnership with star AI unicorn Hugging Face to optimize their models for AMD's CPUs, GPUs and other AI hardware. In addition to AI chips, AMD also introduced a new EPYC server processor designed for cloud computing and hyperscale users, codenamed Bergamo, with up to 128 cores per slot and optimized for a variety of containerized workloads. Executives from Amazon's cloud computing divisions AWS, Oracle Cloud, Meta, and Microsoft Azure all came to the scene to share their feelings about using AMD chips and software in their data centers.
        Nvidia and Intel, the world's leading data center GPUs and CPUs, are both highlighting their power to accelerate AI. AMD, the "second child" of both tracks, is also racing to meet the growing demand for AI computing and challenge Nvidia's dominance in emerging markets by launching data center GPUs adapted to the latest demands. The boom in generative AI and large language models is pushing data centers to their limits. So far, Nvidia has the edge in providing the technology needed to handle these workloads. According to market research firm New Street Research, Nvidia holds 95% of the GPU market available for machine learning.
        "We are still in the very, very early stages of the AI lifecycle," Su said, predicting that the total addressable market for data center AI accelerators will grow fivefold by 2027, from about $30 billion this year at a compound annual growth rate of more than 50% to more than $150 billion by 2027. AMD did not disclose the price of the two new MI300 chips, but that could put some price pressure on Nvidia, where the H100 was previously rumored to be as high as $30,000 or more.

 
Related News
Read More >>
How many chips does a car need? How many chips does a car need?
Sep .19.2024
Automotive chips can be divided into four types according to their functions: control (MCU and AI chips), power, sensors, and others (such as memory). The market is monopolized by international giants. The automotive chips people often talk about refer to
Position and Function of Main Automotive Sensors Position and Function of Main Automotive Sensors
Sep .18.2024
The function of the air flow sensor is to convert the amount of air inhaled into the engine into an electrical signal and provide it to the electronic control unit (ECU). It is the main basis for determining the basic fuel injection volume. Vane type: The
Chip: The increasingly intelligent electronic brain Chip: The increasingly intelligent electronic brain
Sep .14.2024
In this era of rapid technological development, we often marvel at how mobile phones can run various application software smoothly, how online classes can be free of lag and achieve zero latency, and how the functions of electronic devices are becoming mo
LDA100 Optocoupler: Outstanding Performance, Wide Applications LDA100 Optocoupler: Outstanding Performance, Wide Applications
Sep .13.2024
In terms of characteristics, LDA100 is outstanding. It offers AC and DC input versions for optional selection, enabling it to work stably in different power supply environments. The small 6-pin DIP package not only saves space but also facilitates install