Terabyte GPUs: Panmnesia demonstrated CXL memory for AI accelerators

Panmnesia has been designing CXL DRAM pools for quite some time: in 2023, it demonstrated a system that leaves behind all RDMA-based solutions and provides access to 6 TB of RAM. But large amounts of memory today, in an era of increasingly complex AI models, are needed not only and not so much by processors, but by accelerators, which are a priori deprived of the ability to upgrade on-board RAM. At CES 2025, the company demonstrated a solution to this problem.

According to Panmnesia developers, performance when training large-scale AI models depends precisely on the volume of on-board memory of the accelerators: instead of tens of gigabytes, terabytes are required, and installing additional accelerators can be too expensive, given that the computing power will be redundant.

Source here and below: Panmnesia

The CXL system demonstrated at the exhibition is built on the latest Panmnesia controller with support for CXL 3.1. In bidirectional mode, access latency was less than 100 ns and is approximately 80 ns.

The key to success here lies in the proprietary implementation of CXL 3.1, including the software part, thanks to which GPUs can access a shared memory pool using the same load/store instructions as when accessing on-board HBM or GDDR.

However, the technology requires a proprietary CXL Root Complex controller on board the GPU, one of the most important parts of which is the HDM decoder, which is responsible for managing the memory address space (host physical address, HPA), so already released accelerators will not be able to work directly with the Panmnesia system.

However, the technology looks promising. It has already attracted attention from AI companies as a potential way to reduce the cost of data center infrastructure.

admin

Share
Published by
admin

Recent Posts

A demo of Dispatch, a comedy game about a superhero agency from the former developers of Tales from the Borderlands and The Wolf Among Us, has been released on Steam

Developers from the American AdHoc Studio, founded by former Telltale Games, Ubisoft and Night School…

2 hours ago

Digma DP-FHD800A LCD Full HD Projector Review: A Modern Approach

When you think about a home theater, you immediately imagine bulky projectors with a bunch…

2 hours ago

Lian Li Introduces HydroShift II LCD-C Liquid Cooling System with 360mm Radiator and Three Configurations

Lian Li has introduced a series of maintenance-free liquid cooling systems HydroShift II LCD-C. It…

2 hours ago

Apple: App Store App Developers to Earn $406 Billion in 2024

Amid mounting pressure from U.S. regulators, Apple has released the results of an independent study…

2 hours ago

ASRock Admits Its Motherboards Break Ryzen 9000 Processors

Following a report from YouTube channel Tech Yes City that ASRock linked Ryzen 9000 processor…

2 hours ago

Apple to Change OS Numbering: iOS 26 to Come This Year Instead of iOS 19

Apple is preparing a large-scale rebranding of its line of operating systems. This was reported…

1 day ago