Published:

Nvidia and AWS Launch Fastest Cloud AI Supercomputer with 16,384 GH200 GPUs

Nvidia and AWS have collaborated to create the world's fastest cloud AI supercomputer, utilizing 16,384 GH200 GPUs. This groundbreaking system, part of Project Ceiba and housed in an AWS data center in the United States.

Nvidia has partnered with Amazon Web Services (AWS) to launch what is now the fastest cloud AI supercomputer. This cutting-edge system utilizes an impressive 16,384 GH200 GPUs, known as the Grace Hopper Superchip, setting a new benchmark in high-performance computing.

Since their collaboration began in 2010, Nvidia and AWS have both seen significant growth. Their latest venture is a strategic move to maintain their leadership positions in the rapidly evolving AI industry. The GH200 chip, which has recently seen a surge in demand, is expected to be deployed in large-scale systems globally.

This supercomputer, part of Project Ceiba, is based on Nvidia’s innovative “GH200 NVL32 Multi-Node Platform.” The design features 32 GH200 GPUs arranged in 16 trays within a single rack, accompanied by nine trays dedicated to NV-Link switches. The system’s liquid-cooled design ensures optimal performance in a compact space and will be offered as an Amazon EC2 instance. Project Ceiba, located in an AWS data centre in the United States — primarily serves Nvidia as a DGX cloud deployment platform for developing future solutions.

AWS customers will have access to a variety of Nvidia solutions, ranging from the GH200 racks to upcoming new solutions featuring the smaller Nvidia L40S and L4 GPUs. This diverse range of products ensures that AWS and Nvidia can meet the needs of various customer segments.

The collaboration between Nvidia and AWS is a significant step in the AI and cloud computing sectors. By combining Nvidia’s advanced GPU technology with AWS’s robust cloud infrastructure, they are redefining the standards for AI supercomputing in the cloud.

Amaya Simon
Amaya Simon
Amaya Simon is a seasoned programmer specializing in smart devices, AI, and machine learning. With a Master's in Computer Science and a decade of experience, she writes to demystify complex tech. Outside work, she's a robot-building, origami-loving mom.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.

More from this stream