Question [LTT] Home NAS Server 'geek pr0n' - 12x NVME 4.0 8TB SSDs on unraid

[VirtualLarry]

Fun video, if you're into extreme overkill storage configs.

 

[ch33zw1z]

Ya know, I thought someone built a NAS to store their pr0n 😁

But this is awesome too, thanks Lar!

 

[KentState]

At the end, they hook it up to a 10Gbe network and average 8 Gb/s or less or actual bandwidth. Not sure what can be done since SMB is limited to a single thread. Face the same challenge with my setup even with 7200rpm hard drives.

 

[thecoolnessrune]

I don't know about UnRAID but Samba at this point can do SMB Multi-Channel if the Guest / Client support it. As far as I'm aware though Samba only supports Multi-Channel via the multi-subnet method (multiple ports, each on their own distinct network segment). As long as the "big consumers" are on all of these networks, you should see CPU utilization improvements. Likewise, as long as your NICs support RSS (and at 10Gb most if not all should), then as long as incoming connections are coming from different IPs, they should also get divided up on multiple CPU cores.

Still, in general agree that for file delivery with large consumers (vs. numerous small consumers) clock speed is generally king.

 

[sdifox]

At the end, they hook it up to a 10Gbe network and average 8 Gb/s or less or actual bandwidth. Not sure what can be done since SMB is limited to a single thread. Face the same challenge with my setup even with 7200rpm hard drives.

They used a 10gbe since it was a temporary connection.

 

[mxnerd]

Linus already did a file transfer using SMB 3.0 multichannel 5 years ago.

No multi-subnet requirement.

Deploy SMB Multichannel

 

[thecoolnessrune]

Linus already did a file transfer using SMB 3.0 multichannel 5 years and 8 months ago.

No multi-subnet requirement.

Deploy SMB Multichannel

Yeah, Microsoft SMB can do multi-channel without multi-subnet. But Samba I do not believe has ever implemented that. It still requires multiple subnets. Hell, 4.14 came out this year and Multichannel still isn’t on by default. Solutions not relying on an Enterprise Codebase (like NetApp ONTAP), and not Microsoft have a long way to go for feature parity multichannel With Microsoft’s own SMB solution. That would include anyone running UnRAID, or most *NIX and *BSD distros.

 

[mxnerd]

OK. Not familiar with Linux. Thought Samba was same as SMB.

 

[mv2devnull]

OK. Not familiar with Linux. Thought Samba was same as SMB.

SMB protocol is from Microsoft. MS was not so keen on sharing, so open source people came up with something that manages to talk that protocol. They call it Samba ...
Obviously MS has kept the target moving, so compatibility could be better.

 

[mxnerd]

Yeah, Microsoft SMB can do multi-channel without multi-subnet. But Samba I do not believe has ever implemented that. It still requires multiple subnets. Hell, 4.14 came out this year and Multichannel still isn’t on by default. Solutions not relying on an Enterprise Codebase (like NetApp ONTAP), and not Microsoft have a long way to go for feature parity multichannel With Microsoft’s own SMB solution. That would include anyone running UnRAID, or most *NIX and *BSD distros.

So, found 2 posts regarding samba 4.4 still requires multi-subnet to make multichannel to work on Linux.

A How To Guide: Setting up SMB3.0 Multichannel on FreeNAS

This guide has been written by someone who is NOT a certified expert. If any information is inaccurate or could be phrased better do contact me so I can update it. A step by step guide to setting up SMB3.0 Multichannel on FreeNAS. What is Multichannel? Multichannel, which is a feature of SMB3.0 (...

linustechtips.com

Setting up SMB Multi-Channel between FreeNAS (or any BSD/Linux) and Windows for 20Gbps transfers

SMB Multi-Channel is a useful performance feature that distributes SMB traffic over multiple network connections, allowing it to scale across multiple network adapters, as well as multiple CPU core…

codeinsecurity.wordpress.com