Industry News

Amazon AWS unveils new AI chip, also offers NVIDIA H200

Update time : 2023-12-28 11:02:28

At its Reinvent conference on Tuesday, Amazon's cloud computing arm AWS unveiled new artificial intelligence (AI) chips for customers to build and run AI applications, and plans to offer NVIDIA's newest chip.AWS is trying to stand out as a cloud service provider with a variety of cost-effective options. However, it won't just be selling cheap Amazon branded products. Like Amazon's online retail marketplace, Amazon's cloud computing service will offer top products from other vendors, including GPUs from top artificial intelligence chipmaker NVIDIA.
Demand for NVIDIA GPUs has soared since AI startup OpenAI released its ChatGPT chatbot last year, which wowed people with its ability to summarize information and write text similar to that of real people. This has led to a shortage of chips for NVIDIA as companies race to integrate similar generative AI technology into their products. Amazon has opted for a two-pronged strategy of producing its own chips and allowing customers to use Nvidia's latest chips, which could help it take on Microsoft, its top rival in the cloud. Earlier this month, Microsoft took a similar approach, unveiling its first AI chip, the Maia 100, and saying that the Azure cloud would feature NVIDIA H200 GPUs.Specifically, AWS said it would offer NVIDIA's latest H200 AI graphics processing units. The company also announced a new Trainium2 AI chip and a general-purpose Graviton4 processor. The new H200 GPU is an upgraded version of the H100, which OpenAI used to train its state-of-the-art large language model, GPT-4. Large companies, startups and government agencies are all competing for a limited supply of chips, which means that there is also high demand for renting chips from cloud service providers such as Amazon. NVIDIA says the H200 will have nearly twice the output speed of the H100.
Amazon's own Trainium2 chip is designed for training AI models, including the underlying models that support AI chatbots like OpenAI ChatGPT and its competitors run. Amazon said startup Databricks and OpenAI competitor and Amazon-backed Anthropic plan to build models with the new Trainium2 chip, and that the new models will perform four times better than the original ones.The Graviton4 processor is based on the Arm architecture, which consumes less energy than chips from Intel or AMD. Graviton4 promises a 30 percent increase in performance over existing Graviton3 chips, resulting in what AWS says is higher price output. With inflation consistently higher than usual, which has prompted central banks to raise interest rates, organizations that want to continue to use AWS, but for a lower cloud service bill to better cope with the economy, may want to consider migrating to Graviton.

Previous : Ericsson Introduces New RAN Computing Processor on Intel 4 Process

Next : Renesas Launches Cloud-Based Development Environment to Accelerate Development and Evaluation of Automotive AI Software

How many chips does a car need?

Sep .19.2024

Automotive chips can be divided into four types according to their functions: control (MCU and AI chips), power, sensors, and others (such as memory). The market is monopolized by international giants. The automotive chips people often talk about refer to

Position and Function of Main Automotive Sensors

Sep .18.2024

The function of the air flow sensor is to convert the amount of air inhaled into the engine into an electrical signal and provide it to the electronic control unit (ECU). It is the main basis for determining the basic fuel injection volume. Vane type: The

Chip: The increasingly intelligent electronic brain

Sep .14.2024

In this era of rapid technological development, we often marvel at how mobile phones can run various application software smoothly, how online classes can be free of lag and achieve zero latency, and how the functions of electronic devices are becoming mo

LDA100 Optocoupler: Outstanding Performance, Wide Applications

Sep .13.2024

In terms of characteristics, LDA100 is outstanding. It offers AC and DC input versions for optional selection, enabling it to work stably in different power supply environments. The small 6-pin DIP package not only saves space but also facilitates install

About Us

About Us What we do Quality People

Products

CHIP/IC Active devices Passive device Components OTHER

China electronic components supplier----Wah Luen Shing Electronic.----www.wlschip.com

Leave a message