• We’re currently investigating an issue related to the forum theme and styling that is impacting page layout and visual formatting. The problem has been identified, and we are actively working on a resolution. There is no impact to user data or functionality, this is strictly a front-end display issue. We’ll post an update once the fix has been deployed. Thanks for your patience while we get this sorted.

Back up speed dilemma. What to do?

nk215

Senior member
Hi guys,
I have a small dilemma about backup speed. As I get more and more data, I need a speedy backup solution.

Currently, My 2 options are
1) USB3 enclosure – this is limited by the speed of the HHD in the enclosure itself.
2) NAS 1Gbit, this option is limited by the LAN speed.

At the end, I get about the same speed between the 2 options (80-90MB/sec).

Some data can’t be backed up incrementally, VMware virtual machines for example.

What would you guy recommend? 10Gbit Ethernet NAS (or DIY Nas/Windows machines) are available. Is there a fast DAS RAID USB3 box available? Should I just get another RAID card and put in a few more HDDs onto the same server box and call that a day?

I only have 1 PCIx (x4) slot left.
 
I would just schedule the backup to happen when I went to bed and not worry about it.
 
Adding to corkyg's recommendation, I like network backup. Actually, I use both.

I have a weekly backup scheduled one night a week, to my file server.

Every month or so I plug in an external drive and back up my backup. At all other times the external sits in the closet, and hopefully lasting a very long time, as it spends a vast majority of its life doing nothing.
 
I was getting 180MB/sec writing to my USB3.0 dual-bay HDD dock, with a G3258 rig with Intel USB3.0 ports, and a Toshiba 3TB 7200RPM HDD plugged into it.

I am surprised to hear that you are only getting 80MB/sec writing to a USB3.0 external.
 
I was getting 180MB/sec writing to my USB3.0 dual-bay HDD dock, with a G3258 rig with Intel USB3.0 ports, and a Toshiba 3TB 7200RPM HDD plugged into it.

I am surprised to hear that you are only getting 80MB/sec writing to a USB3.0 external.

Yeah, it's weird - almost as if not all hard drives are the same, and USB 3 is only part of the equation. 😛 😀
 
so his USB3.0 enclosure chipset must be bogging down the works.

How do you know that? You don't know what model of hard drives the OP is using and you don't know what kind of workloads and directory structures they're backing up.

It's easy to get great transfer rates when you're moving around giant tarballs or writing from /dev/zero to /dev/null, but you may not get anywhere near the same transfer rates when you move around the non-tar'd directory structures.
 
The speed I quoted was the calculated speed from around 1.5TB worth of data. About 1TB of that are pictures (raw and jpg), the rest are general files with a couple of large VMware vhds.

I'll take a closer look to see if I can do something to better the USB3 speed. It may very well be the bad implementation of USB3 ports on my computer or the enclosure (WD Mybook 4TB). I use the 4 USB3 port PCI card from newegg. My mother board is too old to have any native USB3.
 
try copy some large files (>500mb) and 100mb worth of small files (<5mb per file). i dont think all HDD can sustain peak datarate when handling tons of tiny files. so from the above you know the max-min speed ... or sort of :twisted:

on a A5000 mini ITX board i am experimenting. datarate can vary from 60mb/s - 150mb/s. imo the datarate fluctuation is from the data chunk size --> but im not sure somebody pls correct me

*edit : when trying to copy large files on internal SATA2 thru USB2 to a 1TB 2.5" external, the average speed i got was average around 28.5mb/s 🙁 i guess it is maxing out (using A5000 low power board). however when connected to a USB3 port, the speed goes down to 25mb/s :hmm:
 
Last edited:
Back
Top