Question AMD 3970X & 256GB RAM

[Delo123]

Hi,

I know it's early days, but we we want to build some 3960/3970x workstation as soon as possible. We hope we can now finally install 256GB of RAM.
Are there some first ideas regarding memory? Gigabyte lists Corsair CMK64GX4M2D3000C16 ver3.40 as compatible but it doesn't seem to be a very fast ram.

Any advice yet?

 

[StefanR5R]

The only 32 GB ECC U-DIMMs which I am aware of are DDR4-2666 c19 ones from Samsung (M391A4G43MB1-CTD), but it may be hard to find.

Though since you consider non-ECC RAM, it seems these workstations are planned for special applications in which incorrect computations and silent file corruption are tolerable. In this case, there'd also be some DDR4-3200 c14 RAM from G.Skill at more than double the price of the Corsair RAM but unknown availability.

 

[Delo123]

We don#t really need ECC, but would take them if that's the only way to go. Price isn't the issue here, we just need to reach 256GB somehow... I emailed all the mobo manufacturers. I hope they can supply me with some information

 

[StefanR5R]

My understanding is that mainboard manufacturers are permitted to publish their specs now.

Asus are stating 256 GB RAM capacity for ROG Zenith II Extreme at the German product page, but somehow that data is still missing from their English page at this time. For ROG Strix TRX40-E Gaming, the spec is missing in either language. But their Prime TRX40 Pro page has got the 256 GB RAM specification listed. It looks they haven't uploaded QVLs yet, and it's probably too early for that.

MSI are stating 256 GB RAM capacity for TRX40 PRO 10G, TRX40 PRO WIFI, and Creator TRX40, but haven't published memory QVLs yet either.

 

[Delo123]

Just contacted Asus in Germany. Let's see Thx!

Yeah, the MSI would be great too at least having a 10GB Nic, saves a slot

 

[Soulkeeper]

Search results for: 'micron mta18adf2g72az 3g2 16gb ddr4 3200 pc4 25600'

We are manufacturer of NEMIX RAM™ memory upgrades and distributor of computer memory upgrades and IT equipment. We specialize in Apple, Dell, HP, IBM, Sun and Cisco products, and offer the best price and quality products for virtually any system

www.azmemory.com

That's the mem i'd get, but every place lists it as "call for price" they had a price listed at $90 per stick the other week
I guess this would only give you 128GB, but it's fast and ecc. I'm not seeing any 32GB sticks on the micron parts catalog

UDIMM part catalog

Browse UDIMM memory modules by Micron, ideal for desktops requiring unbuffered memory solutions

www.micron.com

 

[Delo123]

Yeah, but that's only 16Gb dimms, I need 32GBs...
Found these, but not really fast and no idea if supported. Wrote both G.Skill and Corsair, no answers yet...
https://www.scan.co.uk/products/256...0-2666-non-ecc-unbuffered-cas-16-18-18-35-xmp

 

[Topweasel]

Yeah, but that's only 16Gb dimms, I need 32GBs...
Found these, but not really fast and no idea if supported. Wrote both G.Skill and Corsair, no answers yet...
https://www.scan.co.uk/products/256...0-2666-non-ecc-unbuffered-cas-16-18-18-35-xmp

I don't think you will get much faster or be able to run it much faster. All chipsets/CPU usually have an upper supported limit on memory speed basically based on ranks (sides) of memory. You are talking about running 16 ranks of memory. I doubt you would even in best of circumstances run that at much faster then the rated memory buss of the CPU/chipset. I think that Ryzen 3k is rated for 2666, I assume that hold true for Threadripper. That isn't to say its hopeless, but until TR3 actually launches I wouldn't hold out to much hope for loading the board and getting 3200-3600.

Edit: Just checked Spec page for the Phantom Gaming X (X570). Please check supported memory speeds with a fully populated board.

Now also keep in mind 32GB NonECC U Dimms is like new new. So it will be a little bit before we see real performance solutions.

 

[StefanR5R]

I suspect the 32 GB UDIMMs are all based on the same Samsung 16 Gb chip type. Or are there any other makers of chips of this size yet?

Edit,
ah, I see Micron and SK Hynix have some out too.
https://www.anandtech.com/tag/16-gb
(Edit 3, Samsung had stacked 16 Gb devices earlier and finished monolithic ones last year. SK Hynix had 16 Gb chips made from stacks too; I don't know about Micron. Just recently this year, Micron and SK Hynix completed development of their own monolithic 16 Gb chips.)

Edit 2,
"There are a number of remarks to be made about 32 GB memory modules. Samsung’s mass-produced 16 Gb DDR4 memory chips are rated for 2133 MT/s, 2400 MT/s, and 2666 MT/s data transfer rates, yet even the company itself sells 32 GB DDR4-2933 memory modules. Meanwhile, its partners go all the way to DDR4-3000, albeit at 1.35 Volts. Micron's 16 Gb DDR4 devices are rated for 2933 and 3200 MT/s operation (which within JEDEC's DDR4 specification), but many modules based on these chips are rated at 2400 or 2666 MT/s at 1.2 Volts."
https://www.anandtech.com/show/14680/32-gb-unbuffered-dimms-listed

 

[Topweasel]

Even then they might be sticks capable of running at those speeds but I wouldn't expect a full populated board to be able to run at these higher speeds. It's not just about what the memory supports and what the board supports. dimms and ranks of the dimms populated have an effect on this.

 

[Markfw]

Sounds like a great build if you can make it all work out, (and pay for it). I'm saving up for a build with the new AMD 64 core Threadripper when it comes out.

Assuming they do it,be prepared to spend $4,000 or more for the chip. The 32 core is $2000

 

[Markfw]

Yeah, I'll probably have to come down to the 32 when I actually get around to it.

Well, there is also the 48 most likely.

 

[Markfw]

Well I still have some time to figure it out, I'll have to see what my budget turns out to be when I'm ready to build it.

Well, I know from personal experience (I have 2) the 2990wx is quite a beast, but a little handicapped in some situations on ram access. The 3970x will NOT have those, so even that 32 core beast will be a monster.

 

[Soulkeeper]

Maybe call kingston, since they source chips from all 3 players. I'd be surprised if they don't release 32GB ecc and non-ecc sticks soon.
With these new ryzen systems released, i'm sure you aren't alone in wanting them.
Probably tons of demand for 32GB sticks out there.

 

[StefanR5R]

Even then they might be sticks capable of running at those speeds but I wouldn't expect a full populated board to be able to run at these higher speeds. It's not just about what the memory supports and what the board supports. dimms and ranks of the dimms populated have an effect on this.

Also, firmware version.

Samsung's and Crucial's 32GB UDIMMs are dual-rank'ed. I haven't found this spec for the others at a quick glance, but I expect them to be the same.

Note, several of the G.Skill kits were made specially for a handful of mainboards which were capable to run a completely nonstandard 2-DIMM-per-channel config in a single DIMM slot. I understand that this type of DIMM is useless in any other mainboards than those listed compatible by the DIMM maker.

 

[Topweasel]

Also, firmware version.

Samsung's and Crucial's 32GB UDIMMs are dual-rank'ed. I haven't found this spec for the others at a quick glance, but I expect them to be the same.

Note, several of the G.Skill kits were made specially for a handful of mainboards which were capable to run a completely nonstandard 2-DIMM-per-channel config in a single DIMM slot. I understand that this type of DIMM is useless in any other mainboards than those listed compatible by the DIMM maker.

Yeah I was leaving those out. But yeah any 32GB legit stick of memory is going to be dual ranked. Also yes I could see early X399 boards to need firmware updates to recognize the increased density.

 

[Delo123]

Assuming they do it,be prepared to spend $4,000 or more for the chip. The 32 core is $2000

Money isn't the issue, getting the actual hardware is more of a hassle. Hope to get some answers from manufacturers today...

 

[Soulkeeper]

https://www.avnet.com/shop/us/c/mem...DR4+SDRAM"&facet=ads_f14006_ntk_cs:"16+Gbit"& lists 32GB sodimms with a min 100qty purchase (overpriced too).
technically you can get the sodimm adapter and run them in a desktop, just break out your $25,000
They have a search feature for 16gbit chips.

 

[JoeRambo]

I doubt money is a problem at all. Stuff like A-Data 32GB dual rank DIMMs costs ~100 EUR without VAT, so money is easiest part of this project I guess.

The real deal is ensuring stability at 2DPC filled with dual rank memory, heck even testing so much memory is gonna be difficult and would take substantial amount of time.

Hopefully OP will let us know the results, as 32 cores / 256GB with 4 channels of memory is a beefy platform for non FP work.

 

[TheGiant]

when I bought my 256GB of ECC DDR4 RAM for the broadwell xeon system, I bought exactly that was on supermicro site for the board
I wouldnt bother to buy anything else
So depending on your RAM, choose your board not the other way
I dont know if ecosystem for TR3 is developed enough to have 256GB of ECC memory certified

 

[Atari2600]

I know it's early days, but we we want to build some 3960/3970x workstation as soon as possible. We hope we can now finally install 256GB of RAM.

Any advice yet?

Be mindful of your workload.

If it is CFD (or even FEA using DRAM for scratch) then Threadripper is unsuitable.

In those instances, you need the additional memory bandwidth of the 8ch memory controller.

If you got a threadripper for CFD*, you'll not see scaling much beyond 12 cores, and certainly not beyond 16 cores.

*assuming problems are non-trivial given your memory requirements.


I don't know what your workload is - but you need to be sure you aren't just moving a bottleneck.