Industry News

Meta, Microsoft commit to buying AMD's new AI chip Instinct MI300X as NVIDIA GPU alternative

Update time : 2024-01-04 10:23:28

Meta, OpenAI and Microsoft said at an AMD investor event that they will all be using AMD's newly developed AI chip, the Instinct MI300X, suggesting that while NVIDIA's GPU chips are critical to the development and deployment of AI programs like ChatGPT, many tech companies are looking for alternatives. If AMD's latest high-end chip, the Instinct MI300X, can start shipping early next year and meet the needs of AI companies and related cloud service providers, it could lower the cost of developing AI models and put competitive pressure on NVIDIA's soaring AI chip business.

On Wednesday AMD Chief Executive Officer Zifeng Su said, "All the focus is on large processors and large GPUs used in cloud computing." AMD said the MI300X is based on a new architecture that delivers significant performance improvements. The chip's best feature is 192GB of high-performance HBM3 memory, which transfers data faster and can accommodate larger AI models. Su Zifeng directly compared the MI300X and the systems it builds to the H100, a mainstream AI GPU chip from NVIDIA. "This performance translates directly into a better user experience," said Zifeng Su. "When you ask a model a question, you always want it to respond faster, especially when the response is increasingly complex." The main question facing AMD is whether the company, which has been based on NVIDIA, will invest any more time and money in another GPU supplier. "Acceptance of AMD still needs to come down the pike," Suzie Fung said.
AMD told investors and partners Wednesday that the company has made improvements to its ROCm software suite. A key flaw has been addressed in order to compete with NVIDIA's CUDA software, which is the industry benchmark.That original flaw in the ROCm software suite has been one of the main reasons AI developers now prefer NVIDIA. Chip price is also important. On Wednesday AMD did not reveal pricing for the MI300X.
NVIDIA GPU chips currently sell for about $40,000 each, and Su said AMD's chips would have to be less expensive than NVIDIA's and have lower operating costs to convince customers to buy them. On Wednesday, AMD also said it had signed usage agreements with some of the companies that need GPU chips the most. According to a recent report from market research firm Omidia, Meta and Microsoft are the two biggest buyers of NVIDIA's H100 GPU chips in 2023. meta said it will use the MI300X chips for AI inference workloads such as AI stickers, image editing, and the operation of voice assistants. Kevin Scott, Microsoft's chief technology officer, said the company will provide access to the MI300X chips through Azure Web Services.

Previous : Infineon introduces first trench power MOSFET in OptiMOS™ 7 technology 15 V PQFN package

Next : Infineon Introduces New CoolSiC Portfolio in 62 mm Package for Higher Efficiency and Power Density

How many chips does a car need?

Sep .19.2024

Automotive chips can be divided into four types according to their functions: control (MCU and AI chips), power, sensors, and others (such as memory). The market is monopolized by international giants. The automotive chips people often talk about refer to

Position and Function of Main Automotive Sensors

Sep .18.2024

The function of the air flow sensor is to convert the amount of air inhaled into the engine into an electrical signal and provide it to the electronic control unit (ECU). It is the main basis for determining the basic fuel injection volume. Vane type: The

Chip: The increasingly intelligent electronic brain

Sep .14.2024

In this era of rapid technological development, we often marvel at how mobile phones can run various application software smoothly, how online classes can be free of lag and achieve zero latency, and how the functions of electronic devices are becoming mo

LDA100 Optocoupler: Outstanding Performance, Wide Applications

Sep .13.2024

In terms of characteristics, LDA100 is outstanding. It offers AC and DC input versions for optional selection, enabling it to work stably in different power supply environments. The small 6-pin DIP package not only saves space but also facilitates install

About Us

About Us What we do Quality People

Products

CHIP/IC Active devices Passive device Components OTHER

China electronic components supplier----Wah Luen Shing Electronic.----www.wlschip.com

Leave a message