News Nvidia switches to 64 cores Epyc Rome for DXG A100

[moinmoin]

And that's quite the massive system they offer there: "the universal system for all AI workloads"

NVIDIA DGX A100 : The Universal System for AI Infrastructure

Essential Building Block of the AI Data Center & Offering Best Performance.

www.nvidia.com

• 8X NVIDIA A100 GPUS WITH 320 GB TOTAL GPU MEMORY
  12 NVLinks/GPU, 600 GB/s GPU-to-GPU Bi-directonal Bandwidth
• 6X NVIDIA NVSWITCHES
  4.8 TB/s Bi-directional Bandwidth, 2X More than Previous Generation NVSwitch
• 9x MELLANOX CONNECTX-6 200Gb/S NETWORK INTERFACE
  450 GB/s Peak Bi-directional Bandwidth
• DUAL 64-CORE AMD CPUs AND 1 TB SYSTEM MEMORY
  3.2X More Cores to Power the Most Intensive AI Jobs
• 15 TB GEN4 NVME SSD
  25GB/s Peak Bandwidth, 2X Faster than Gen3 NVME SSDs

Related yellow press reporting:

https://wccftech.com/nvidia-ditches-intel-xeon-goes-all-onboard-with-amds-epyc-cpus-with-next-gen-ampere-gpus/

 

[tamz_msc]

Not surprising as only AMD offers PCIe gen 4 connectivity as of now.

 

[moinmoin]

Not surprising as only AMD offers PCIe gen 4 connectivity as of now.

In a way that's the surprise actually. There are many players in the industry that seem to prefer making illogical compromises instead going for the least surprise. Nvidia clearly isn't one of them.

 

[DisEnchantment]

Not surprising as only AMD offers PCIe gen 4 connectivity as of now.

IBM also have PCIe Gen 4. And IBM and NV partnered for Summit. But they went with EPYC Rome.
But is fairly hard to acquire a few Power9 servers

IBM POWER9: Enhanced core and chip architecture for nextgen workloads Built from the ground-up for data intensive workloads, POWER9 is the only processor with state-of-the-art I/O subsystem technology, including next generation NVIDIA NVLink, PCIe Gen4 and OpenCAPI.

https://www.ibm.com/downloads/cas/KDQRVQRR

 

[aigomorla]

Can it run minecraft?

 

[tamz_msc]

IBM also have PCIe Gen 4. And IBM and NV partnered for Summit. But they went with EPYC Rome.
But is fairly hard to acquire a few Power9 servers

https://www.ibm.com/downloads/cas/KDQRVQRR

Oh yeah, simply forgot that IBM exists.

 

[aigomorla]

Oh yeah, simply forgot that IBM exists.

If im not mistaken they are more commonly known as Lenovo enterprise division now..

 

[DisEnchantment]

If im not mistaken they are more commonly known as Lenovo enterprise division now..

You are mistaken.
Lenovo DC is a different company.
IBM is still maintaining mainframes/servers/supercomputer business.

Large Enterprise Servers by IBM

Discover IBM large enterprise servers designed to meet mission-critical workloads while maintaining privacy across your entire hybrid cloud environment.

www.ibm.com

 

[tamz_msc]

If im not mistaken they are more commonly known as Lenovo enterprise division now..

The IBM that still manufactures Power and Z-series mainframes is different from Lenovo's enterprise division.

 

[piokos]

In a way that's the surprise actually. There are many players in the industry that seem to prefer making illogical compromises instead going for the least surprise. Nvidia clearly isn't one of them.

If you mean people who prefer Intel - there are quite a few reasons this both makes sense and is cheaper.

But not in case of something like DGX, which you buy for the GPUs and for AI-tasks (not general computing, running databases and ERP systems). CPU is almost transparent for the end user.
Nvidia needed PCIe 4.0, so Intel wasn't an option at all and AMD was almost surely much cheaper than IBM.
This may as well be the last DGX with x86. Nvidia is not hiding the fact they want to make these using in-house ARM chips (again: no PCIe 4.0 for now).

 

[jpiniero]

This may as well be the last DGX with x86. Nvidia is not hiding the fact they want to make these using in-house ARM chips (again: no PCIe 4.0 for now).

There's been a rumor they are working on their own chip that uses RISC-V.

 

[piokos]

There's been a rumor they are working on their own chip that uses RISC-V.

That's for an embedded chip in the GPU ("Falcon").

https://riscv.org/wp-content/uploads/2017/05/Tue1345pm-NVIDIA-Sijstermans.pdf

I meant the CPU that will run future deep learning servers. ARM is the natural choice - they're already using it in smaller products (Jetson, DRIVE), so all the necessary software already exists. They just need a really big one - at least Graviton2-like.
Also, I haven't seen any signs that ARM plans to support PCIe 4.0 at all. They may jump straight to 5.0.

 

[DrMrLordX]

An AMD system that supports NVLink? Never thought I'd see the day.

Can it run minecraft?

And how!

NVIDIA RTX Brings Your Minecraft Experiences To Life

Explore Minecraft Worlds in Stunning Realism With NVIDIA RTX

www.nvidia.com

(okay, it's still in beta, but whatever)