The quadro cards appear to pool the memory?
Multi-GPU Technology Support
NVIDIA NVLink High Speed Interface
Connect a pair of Quadro RTX 5000 boards with NVLink to essentially double the amount of GPU memory available, double CUDA, RT and Tensor Core counts, and scale application performance by enabling GPU-to-GPU data transfers at rates up to 50 GB/Sec.
Available Accessories
- RTX5KNVLINKX8S2RKIT provides an NVLink connector for the RTX 5000 suitable for standard PCIe slot spacing motherboards, effectively fusing two physical boards into one logical entity with 6144 CUDA Cores, 768 Tensor Cores, 96 RT Cores, and 32 GB of GDDR6 memory, with a bandwidth of 50 GB/Sec. Order PN RTX5KNVLINKX8S2RKIT when ultimate performance and capabilities are required with two RTX 5000 boards (application support required).
GPU MEMORY MEMORY w/ NVLINK RAY TRACING CUDA CORES RT CORES TENSOR CORES
Quadro RTX 8000 48GB 96GB 10 GigaRays/sec 4,608 72 576
Quadro RTX 6000 24GB 48GB 10 GigaRays/sec 4,608 72 576
Quadro RTX 5000 16GB 32GB 8 GigaRays/sec 3,072 48 384
Quadro RTX 4000 8GB N/A 6 Giga Rays/Sec 2,304 36 288
https://www.pny.com/nvidia-quadro-rtx-5000