Industry News

Amazon AWS unveils new AI chip, also offers NVIDIA H200

Views : 28
Update time : 2023-12-28 11:02:28
        At its Reinvent conference on Tuesday, Amazon's cloud computing arm AWS unveiled new artificial intelligence (AI) chips for customers to build and run AI applications, and plans to offer NVIDIA's newest chip.AWS is trying to stand out as a cloud service provider with a variety of cost-effective options. However, it won't just be selling cheap Amazon branded products. Like Amazon's online retail marketplace, Amazon's cloud computing service will offer top products from other vendors, including GPUs from top artificial intelligence chipmaker NVIDIA.
        Demand for NVIDIA GPUs has soared since AI startup OpenAI released its ChatGPT chatbot last year, which wowed people with its ability to summarize information and write text similar to that of real people. This has led to a shortage of chips for NVIDIA as companies race to integrate similar generative AI technology into their products. Amazon has opted for a two-pronged strategy of producing its own chips and allowing customers to use Nvidia's latest chips, which could help it take on Microsoft, its top rival in the cloud. Earlier this month, Microsoft took a similar approach, unveiling its first AI chip, the Maia 100, and saying that the Azure cloud would feature NVIDIA H200 GPUs.Specifically, AWS said it would offer NVIDIA's latest H200 AI graphics processing units. The company also announced a new Trainium2 AI chip and a general-purpose Graviton4 processor. The new H200 GPU is an upgraded version of the H100, which OpenAI used to train its state-of-the-art large language model, GPT-4. Large companies, startups and government agencies are all competing for a limited supply of chips, which means that there is also high demand for renting chips from cloud service providers such as Amazon. NVIDIA says the H200 will have nearly twice the output speed of the H100.
        Amazon's own Trainium2 chip is designed for training AI models, including the underlying models that support AI chatbots like OpenAI ChatGPT and its competitors run. Amazon said startup Databricks and OpenAI competitor and Amazon-backed Anthropic plan to build models with the new Trainium2 chip, and that the new models will perform four times better than the original ones.The Graviton4 processor is based on the Arm architecture, which consumes less energy than chips from Intel or AMD. Graviton4 promises a 30 percent increase in performance over existing Graviton3 chips, resulting in what AWS says is higher price output. With inflation consistently higher than usual, which has prompted central banks to raise interest rates, organizations that want to continue to use AWS, but for a lower cloud service bill to better cope with the economy, may want to consider migrating to Graviton.

 
Related News
Read More >>
How to Identify Legitimate Sellers When Purchasing Electronic Components Online? How to Identify Legitimate Sellers When Purchasing Electronic Components Online?
Dec .31.2024
Purchasing electronic components online is different from buying clothes online. One needs to understand various aspects. When shopping online for electronic components, one must have a basic knowledge of electronic components and know how to distinguish
Development Directions and Innovation Trends of the Electronic Components Market in 2025 Development Directions and Innovation Trends of the Electronic Components Market in 2025
Dec .31.2024
With the continuous progress of science and technology and the development of the global economy, the electronic components industry has shown a rapid development trend in recent years. From consumer electronics to industrial automation, from automotive e
Resistance Thermometer Temperature Sensors Resistance Thermometer Temperature Sensors
Dec .31.2024
A resistance thermometer is a common temperature sensor that measures temperature by utilizing the property that the resistance of materials changes with temperature. Resistance thermometers are widely used in various fields, including industrial control,
​​​​​​​Say Goodbye to Lag! Three Ways to Speed Up WiFi ​​​​​​​Say Goodbye to Lag! Three Ways to Speed Up WiFi
Dec .31.2024
Don't worry. By learning the following three methods, your WiFi experience can be greatly improved! Let's improve the home WiFi signal from three aspects: transmission power, wireless channels, and location with the agency of Cirrus Logic. Say goodbye to