Twitter found an abandoned cluster of once scarce NVIDIA V100

Developer Tim Zaman, who worked at Twitter during the sale of the social network to Elon Musk, and has now moved to Google DeepMind, spoke about an unusual find, Tom’s Hardware reports. According to him, a few weeks after the deal, experts discovered a cluster of 700 idle NVIDIA V100 accelerators. Zaman himself described the discovery as “an honest attempt to build a cluster within the framework of Twitter 1.0.” Zaman was reminded of this event by the news about the xAI AI supercomputer consisting of 100 thousand NVIDIA H100 accelerators.

The discovery makes me sad that for years Twitter had 700 high-performance accelerators based on NVIDIA Volta architecture at its disposal, which were turned on but idle. They were in short supply at the time of release in 2017, and Zaman only discovered the dormant cluster in 2022. It is not surprising that around the same time it was decided to close some of the social network’s data centers. It is noteworthy that the cluster used PCIe cards, and not the SXM2 version of the V100 with NVLink, which are much more efficient in AI tasks.

Image source: Alexander Shatov/unsplash.com

Zaman also shared his thoughts about the “AI Gigafactory”. He suggested that using 100 thousand accelerators within one network fabric should be an epic challenge, since at such a scale failures are inevitable, which must be properly managed to maintain the functionality of the entire system. In his opinion, the system should be divided into independent domains (large clusters are designed this way). Zaman also wondered what the maximum number of accelerators could be within a single cluster. As companies build ever larger AI training systems, there will be both predictable and unexpected limits to how many accelerators can be combined.

admin

Share
Published by
admin

Recent Posts

GTX 750 Ti is no longer enough for the game: Ubisoft announced the system requirements of Rainbow Six Siege X

Publisher and developer Ubisoft has revealed the system requirements for Tom Clancy's Rainbow Six Siege…

19 hours ago

Asus Unveils ProArt GeForce RTX 5080 Graphics Cards with Wood Finish, USB-C, and M.2 Slot

Asus has brought wood grain textures to its graphics card lineup. The company has unveiled…

19 hours ago

AI agents: fas, profile, passwords, appearances

The perception of AI agents, their plans and hopes – as well as their impact…

19 hours ago

Asus Unveils GeForce RTX 5060 Gaming Laptops — $300-400 Cheaper Than RTX 5070 Models

Asus has refreshed its lineup of gaming laptops, introducing new configurations with Nvidia GeForce RTX…

19 hours ago

Microsoft Open Sources WSL, a Subsystem for Running Linux Applications on Windows

Microsoft has opened the source code of a set of tools that provide the Windows…

19 hours ago

Cisco’s quarterly results and outlook beat Wall Street expectations

Cisco Systems, an American supplier of enterprise networking equipment, announced results for the third quarter…

2 days ago