Elon Musk will double and then triple the power of the xAI Colossus AI supercomputer – there will be 300 thousand Nvidia H100 and H200

Elon Musk is aiming to become a leader in the race to create the next generation of neural networks. To do this, he plans to double the xAI Colossus AI cluster, which currently includes 100 thousand Nvidia H100 graphics accelerators.

Image source: servethehome.com

This news came from Nvidia, and later Musk himself confirmed it on his account on the social network X, writing that the Colossus AI supercomputer is close to accommodating 200 thousand Nvidia H100 and H200 accelerators, which will be housed in a building with an area of ​​more than 7000 m² in Memphis, Tennessee. The Colossus supercomputer is notable for the fact that xAI employees were able to assemble it and put it into operation in an extremely short time. Supercomputers usually take years to build, but in this case, Musk said the entire process took 122 days from start to finish.

At the same time, xAI, owned by the billionaire, spent at least $3 billion on the creation of Colossus, since it now consists of 100 thousand Nvidia H100 accelerators, which usually cost around $30 thousand apiece. Now the businessman intends to modernize the cluster by using more powerful H200 accelerators, each of which costs about $40 thousand. Ultimately, Musk will have to spend several more billion dollars, not to mention the cost of electricity to maintain the cluster. The businessman’s ultimate goal is to increase the number of accelerators used to 300 thousand units by the summer of next year, and for further modernization it is planned to use the latest Nvidia Blackwell B200.

Musk is betting big on Nvidia’s AI accelerators to further develop xAI’s Grok chatbot and other neural network-based technologies. Earlier this week, a video appeared on the Internet showing the inside of an xAI AI cluster, in which you can see many server racks with Nvidia accelerators.

admin

Share
Published by
admin

Recent Posts

More than 13 thousand bloggers applied for registration on “State Services”

In four days after the launch of the application form for registering blogs with an…

6 mins ago

Bitcoin broke through $75,000 for the first time in history – the US elections triggered the growth of cryptocurrencies

The Bitcoin rate reached a new historical high, exceeding $75,000 per coin. This happened against…

56 mins ago

Nvidia has become the most valuable company in the world, again overtaking Apple in capitalization

For the first time, Nvidia overtook Apple in terms of capitalization in June of this…

1 hour ago

SMART Modular introduced industrial SSDs of the T6EN series with a capacity of up to 15.36 TB

SMART Modular has announced the T6EN family of SSDs, designed for use in the aerospace,…

2 hours ago

Innodisk introduced industrial modules DDR5-6400 with a capacity of 64 GB

Innodisk has announced 64GB DDR5-6400 memory modules designed for data-intensive tasks. These could be AI…

2 hours ago

How to maintain motivation to study and develop in your profession

Specialists striving for professional growth are constantly learning new things. However, relying solely on willpower…

2 hours ago