• We’re currently investigating an issue related to the forum theme and styling that is impacting page layout and visual formatting. The problem has been identified, and we are actively working on a resolution. There is no impact to user data or functionality, this is strictly a front-end display issue. We’ll post an update once the fix has been deployed. Thanks for your patience while we get this sorted.

Question PCIe lanes

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.
Moggy

Moggy

Member
Hi! 🙂
I have a Asus Sage 10G (motherboard has 4x PCIe 16x slots + 3x PCIe 8x slots).
I want to use the build as file server and a little gaming sometimes.

On there I want to use 1x video card AMD Vega 64 (16 PCIe lanes) and
4x Adaptec 72405 RAID cards (8 PCIe lanes each) connected to 96 x 128GB sata SSD (=a total of 12TB in RAID 0)

--> so that is a lot of SSD data traffic over these lanes to the 2x 10Gb network...
______
Question is which Intel CPU to get; 7820X (28 lanes) or 7900X (44 lanes)
Does the lane count matter when populating with 4x 8 lane hungry & fast RAID cards?
_____
Thanks!
 
Last edited:
VirtualLarry said:
Yes. And statistically (only speaking of the drives, here, not the controllers, PSU, host system/DRAM, etc), he will have 96x the failure rate of a single drive.
Click to expand...
I've love to see the OP come back in response to this and see whats his plan. YouTube stardom...
 
LOUISSSSS said:
raid 0 = 1 drive fail = entire raid fail?
Click to expand...
yes LOUISSSSS
And it even is the same for 2 or 96 drives, imagine that!
Now go and look up the meaning of MTBF and the probability statistics for 1 drive and for RAID systems.
(I'll give you a hint my system = (₃₅C₄)/(₉₀C₄) = 476/23229 ≈ 0.020)
 
VirtualLarry said:
OP, have you considered the stripe size necessary for utilizing 96 SATA channels, and making effective use of that? I'm guessing that you haven't, and that you've just heard that "RAID-0 makes drives faster".

Well, not unless properly set up, and tuned. I ran chipset RAID-0 of a pair of 30GB SATA SSDs on a Core2-era P35 / ICH9R rig in Win7 64-bit when they were a new thing. Well, due to lack of proper TRIM support, the RAID-0's performance had dropped BELOW that of a single identical drive, within a week.
Click to expand...
🙂 wrong guess
And we're a "bit" past core 2 era where TRIM was an issue
 
sdifox said:
That is what happens on desktop platforms on the intel side.

That is why I mentioned TR3. You get 64 pcie lanes.
Click to expand...

???
O.P.; "Don't know how my car functions"
Support line; "It's because it has 4 wheels. Buy another car."

TR3 is just as much desktop my friend!! ----"Threadripper, which is geared for high end desktops (HEDT), wasn't developed as part of a business plan or a specific roadmap; instead a small enthusiast team inside AMD saw an opportunity that something could be developed between the Ryzen and Epyc cpu roadmaps... "

I think 99% of users on this forum know by now in 2020 that AMD is beating Intel around the ears. What is not mentioned in all these parrot talks is that TR has some other serious problems compared to Intel X299.
Anyway, please stop bleating about AMD and give a proper answer to my Intel problem....
 
Moggy said:
???
O.P.; "Don't know how my car functions"
Support line; "It's because it has 4 wheels. Buy another car."

TR3 is just as much desktop my friend!! ----"Threadripper, which is geared for high end desktops (HEDT), wasn't developed as part of a business plan or a specific roadmap; instead a small enthusiast team inside AMD saw an opportunity that something could be developed between the Ryzen and Epyc cpu roadmaps... "

I think 99% of users on this forum know by now in 2020 that AMD is beating Intel around the ears. What is not mentioned in all these parrot talks is that TR has some other serious problems compared to Intel X299.
Anyway, please stop bleating about AMD and give a proper answer to my Intel problem....
Click to expand...


I already did, puget says you can have 4 cards working at 16x. Or 1x16+5x8

www.pugetsystems.com

Parts

Puget Systems provides part information, advice, and tech specs for all of the computer hardware we use to configure our workstation PCs
www.pugetsystems.com www.pugetsystems.com
 
That is for a Asus WS C422 system, with Xeon CPU, not X299 with Skylake-X CPU's.
And does not explain to me if a CPU with 28 vs 44 lanes will have an impact on performance.
 
Moggy said:
That is for a Asus WS C422 system, with Xeon CPU, not X299 with Skylake-X CPU's.
And does not explain to me if a CPU with 28 vs 44 lanes will have an impact on performance.
Click to expand...
It's the same setup. No impact it looks like.

www.overclock3d.net

ASUS WS X299 Sage Work Station Motherboard Review - OC3D

Introduction It’s a bit of a change of scenery here at OC3D Towers today. Once upon a time, not so long ago, there was a little girl called Emily. Hang on, that’s Bagpuss. Let’s try again. Once upon a time, not so long ago, the majority of motherboards you purchased were enterprise based models...
www.overclock3d.net www.overclock3d.net
 
Well then it seems only 1 way to find out; test it myself
 

Attachments

  • 7820X - 7900X.jpg
    7820X - 7900X.jpg
    270.3 KB · Views: 22
  • Asus sage 10G.jpg
    Asus sage 10G.jpg
    203.5 KB · Views: 22
Each of those raid cards top out at 6.44GB/s. So one controller with 22 SSD will saturate your 2GB/s pipe.

I hope your psu is up to snuff.
 
I know
I need the IOPS in between the cards not on the outside pipe

In the picture you can see my PSU; 1600 Watt
 
Dear all boys and girls,

I'm not used to forums but am surprised the way this works.
Thanks to all for all your answers, even if it sometimes was only criticism.
(I'm surprised I did not read anyone giving an opinion about pizza).

Don't use Intel, take AMD TR (no thanks I have this intel mobo)
Do not use RAID 0 (I want IOPS, do not care about safety)
I can built a cheaper machine (no you can't)
This will fail (nope)
You want youtube fame (nope)
Use a blade server (yeah sure; 100.000$ for single use application)
You only have 2GB/s I/O (20Gb/s is actually 2.5GB/s and that is enough to the outside world,
but internal computation throughput needs to be faster, hence for the RAID cards)
I'm using 4x Adaptec 72405 that is 6 ports x 4 SSD in RAID 0 (x 4 cards= 96SSD)
 
Moggy said:
Dear all boys and girls,

I'm not used to forums but am surprised the way this works.
Thanks to all for all your answers, even if it sometimes was only criticism.
(I'm surprised I did not read anyone giving an opinion about pizza).

Don't use Intel, take AMD TR (no thanks I have this intel mobo)
Do not use RAID 0 (I want IOPS, do not care about safety)
I can built a cheaper machine (no you can't)
This will fail (nope)
You want youtube fame (nope)
Use a blade server (yeah sure; 100.000$ for single use application)
You only have 2GB/s I/O (20Gb/s is actually 2.5GB/s and that is enough to the outside world,
but internal computation throughput needs to be faster, hence for the RAID cards)
I'm using 4x Adaptec 72405 that is 6 ports x 4 SSD in RAID 0 (x 4 cards= 96SSD)
Click to expand...
There are overheads, that is why I rounded the 20gbps to 2GBps. You never mentioned you only cared about in system io until now...

But do put it on youtube, I guarantee there will be a lot of viewers, myself included.
 
@Moggy , I think this is a wonderful project. My earlier comments were regarding what we typically see.
I want to run COD at 1,000 frames per second so I'll set up this crazy complicated RAID array....
or
I have a small business and I need to store a bunch of customer data that is critical to my business, I want to set up an enormous RAID 0 cluster on a bunch of cheap ssd drives...

As a side project with minimal money invested and having the time and skill to do so, I am all for this project.
 
Fanatical Meat said:
@Moggy , I think this is a wonderful project. My earlier comments were regarding what we typically see.
I want to run COD at 1,000 frames per second so I'll set up this crazy complicated RAID array....
or
I have a small business and I need to store a bunch of customer data that is critical to my business, I want to set up an enormous RAID 0 cluster on a bunch of cheap ssd drives...

As a side project with minimal money invested and having the time and skill to do so, I am all for this project.
Click to expand...
Thank you!
To me it seems this is the first positive reply I get...
I certainly do not pretend to be the inventor or first one to have this idea but let's all be open to new or uncommon idea's from others.
If not, the airoplane would never have been invented 🙂
Have a nice day, all! 🙂
 

Are you a human?

www.newegg.com www.newegg.com

HP 1.4TB MLC Mainstream Endurance (ME) PCIe NAND SSD Workload Accelerator Gen8 - PCI Express 2.0 x8 - Solid State Drive - 3.30 GBps Maximum Read Transfer Rate - 729307-B21 | 729390-001

Limited time offer, ends 02/29 by inStock901

REFURBISHED


  • PCI Express 2.0 x8 SSD
  • Storage Capacity - 1.40 TB
  • Max Read Transfer Rate - 3.30 GBps
  • Maxi Write Transfer Rate - 615 MBps
  • Random 4KB Read - 120000IOPS
  • Random 4KB Write - 99000IOPS
  • MTTF: 2.0mil hr

Think that you can do better than that, for $649.49?
 
VirtualLarry said:

Are you a human?

www.newegg.com www.newegg.com

HP 1.4TB MLC Mainstream Endurance (ME) PCIe NAND SSD Workload Accelerator Gen8 - PCI Express 2.0 x8 - Solid State Drive - 3.30 GBps Maximum Read Transfer Rate - 729307-B21 | 729390-001

Limited time offer, ends 02/29 by inStock901

REFURBISHED


  • PCI Express 2.0 x8 SSD
  • Storage Capacity - 1.40 TB
  • Max Read Transfer Rate - 3.30 GBps
  • Maxi Write Transfer Rate - 615 MBps
  • Random 4KB Read - 120000IOPS
  • Random 4KB Write - 99000IOPS
  • MTTF: 2.0mil hr

Think that you can do better than that, for $649.49?
Click to expand...
I think I already did (better than that)...
Second hand controller 7245 = $65us (new +/-$400)
24 SSD in RAID 0 = 3 TB ; Read speed 6,400 MB/s and write speed 5229 MB/s & +/- 370.000 IOPS
per RAID card (there are 4 in the system = 12 TB)
🙂

And thanks for the link you sent, it is nice ; $3350us price reduction?! not bad
But only 1.4TB & 615 MB/s write speed
 
Last edited:
You must log in or register to reply here.

TRENDING THREADS

Back
Top