GPU Workstation for render/animation (second build).

[shambleresp]

Hi, im working in an around 4.000$ PC build, not gaming just for render/animate in Daz studio with Iray based on GPU, want to put 4 graphic cards or more if can..., and have any big doubts, just i put my first approach for your advice, ty:

1/ CPU: Intel Core i7-5960X 3.0GHz 8-Core Processor.

2/ CPU COOLER: Corsair H110i GT 113.0 CFM Liquid CPU Cooler (or just aircooler?)

3/ MOBO: ASRock X99 WS-E EATX LGA2011-3 Motherboard.

4/ MEMORY: Corsair Vengeance LPX 32GB (4 x 8GB) DDR4-2666 Memory. ( or 64GB now or
later)

5/ STORAGE: Samsung 850 Pro Series 512GB 2.5" Solid State Drive.
STORAGE 2: Seagate Barracuda 2TB 3.5" 7200RPM Internal Hard Drive. (Have another
external 2TB hard disk for backups.)

6/ VIDEO CARD-1: Asus GeForce GTX Titan X 12GB Maxwell Video Card (Own)
VIDEO CARD-2: Geforce GTX 1080. (will buy with this build.)
VIDEO CARD-3: Geforce GTX 1080. (to buy later.)
VIDEO CARD-4: Geforce GTX 1080. (to buy much later

)
VIDEO CARD-?: is possible to add any more ghaphic card? (NO ONE IN SLI)

7/ POWER SUPPLY: EVGA SuperNOVA T2 1600W 80+ Titanium Certified Fully-Modular ATX
Power Supply.

8/ OPTICAL DRIVE: Pioneer BDR-209DBK.

9/ CASE: Thermaltake Core X9 EATX Cube USB 3.0

10/ CASE FAN: Cooler Master R4-S4S-10AK-GP 60.9 CFM 140mm - 200mm Fan? (don't know if
put air or/and water coolers.)

11/ OPERATING SYSTEM: Microsoft Windows 10 Home OEM 64-bit. (Pro?)

Monitor, will use a 47" LED TV and a 50" 4K TV, and own the keyboard-s and mouse-s, to use with 1080p.

 

[mnewsham]

The limiting factors in more GPUs is going to be physical space and PCI lanes available.

If you really think you'll be using more than 4 GPUs I'd recommend taking a look at dual socket xeons (twice as many PCI lanes)

Also is there any reason for the 5960x? Assuming you're not CPU bound and you really do just need GPGPU functions can't you get by with a single lower clocked 6 core xeon or two lower clocked quad core xeons?

 

[shambleresp]

Tyvm mnewsham, sorry for the delay i was doing alot of research and think refined my build (i hope), any advice will be great:

1/ CPU's: 2 x Intel Xeon E5-2683v3 (used)

2/ CPU COOLER: 2 x Enermax Fit T.B. Silence

3/ MOBO: Supermicro X10DRX

4/ MEMORY: Kingston ValueRAM (ECC) 64GB 2133MHz DDR4 8x8GB.

5/ STORAGE: Samsung 850 Pro Series 512GB 2.5" Solid State Drive. (170 euros)
STORAGE 2: Seagate Barracuda 2TB 3.5" 7200RPM Internal Hard Drive. (71 euros) (Have another external 2TB hard disk for backups.)

6/ VIDEO CARD-1: Asus GeForce GTX Titan X 12GB Maxwell Video Card (Own)
VIDEO CARD-2: Geforce GTX 1070-1080. (will buy soon.)
VIDEO CARD-3 and 4: Geforce GTX 1070-1080. (to buy later.)
VIDEO CARD-5, 6..: Geforce GTX 1070-1080. (to buy much later

)

7/ POWER SUPPLY: Super flower Leadex 80 Plus Platinum 2000W Modular. (400 euros)

8/ OPTICAL DRIVE: Asus DRW-24F1MT DVD 24X M-DISC (16 euros)

9/ CASE: to make on my own to apply risers etc.

10/ OPERATING SYSTEM: Microsoft Windows 10 Home Pro 64-bit.

 

[mnewsham]

Looks good, a bit heavy on the PSU though, even with 4 GTX Titan X 12GB you'd struggle to use more than ~1200w I can't ever see you pulling 2000w.


As for the CPU situation, the V4's are a generation newer (14nm vs 22nm) and will run cooler and use less power.
In terms of performance they'll be fairly similar.

 

[shambleresp]

updated the micro, mobo, ram etc, what do you think mnewsham better now? with all those 10 PCIE 8x perhaps the PSU its fine now.

 

[mnewsham]

I suppose if you want 6-8 GTX Titans 2000w would be fine, but with only 4 GPUs, you'll never hit 2000w.

Also, since your CPUs are quad channel memory, you want 8 sticks of RAM. (4 per CPU). So you can go with 8x8GB for 64GB instead of your current 4x16GB.

 

[shambleresp]

Tyvm mnewsham, very important to know to avoid bottlenecks...

For all who work with Poser and Daz Studio just remember Renderosity is giving a present every day, it's called "Countdown to Christmas!" just click in the calendar, started yesterday...

Well, changed the RAM to 8x8GB, also changed Windows 10 Home to Windows 10 Pro, seems only Pro can manage 2 chips.

Maybe do you like this information: http://amfeltec.com/products/gpu-oriented-cluster/ ? and http://elasticpictures.com/1662/octane-render-render-node-expansion/

 

[shambleresp]

Hey guys, next step, my concern now is about the PSU, with the posibility to install a maximum of 10 GTX 1070-1080 or Titan X graphic cards that need a x6 and x8 PCIE pin connectors each one, can a PSU provide those 20 pin connectors? (x6+x8) or i need to install more than one PSU?

 

[mnewsham]

Hey guys, next step, my concern now is about the PSU, with the posibility to install a maximum of 10 GTX 1070-1080 or Titan X graphic cards that need a x6 and x8 PCIE pin connectors each one, can a PSU provide those 20 pin connectors? (x6+x8) or i need to install more than one PSU?

for 10 GPUs you'll want two PSUs. Probably in the 1200-1500w range.

The Corsair AX1500i has 6x 6+2 pin PCI power and 2x 8 pin PCI power for a total of 8 PCI power connections. That would still leave you 2 shy of 10. So a 1000-1200w unit would be a good 2ndary. That way you could do 6 GPUs and your CPU, motherboard, etc. on the 1500w, and the other 4 GPUs on the 2ndary 1000-1200w.

If you get the AX1500i now you will probably be fine until you need more than ~6 GPUs. Past that you'll want to get the 2nd PSU up and running.