Hello,
We currently have an SQL server that backs up about 300gigs of data to another server (serv4). Serv4 also hosts a VM server instant that backs up (about 60gigs) to the same drive on serv4 (A 750gig RAID 5 array). We are trying to do a remote backup solution, such that our data is stored off site. We don't really have a network solution (we have a special long distance wireless connection to our other site, but its less then 1mbit). And the fastest internet we can realistically afford is only 2mbit up.
So we have been thinking of using a standard external USB or eSATA drive with truecrypt (for security). The problems with this is speed. Its way too slow, but I'm not sure what is causing it.
If I plug a USB drive in directly to the server, and try to copy the data, it goes fast, then slow, then fast (as in the time remaining counter on the transfer window will go from 30min to 300min and jump around in that range (to copy ~60gigs). Also you can watch the memory of running processes shrink when it starts, something that typically happens when a large program starts or loads a huge file. I'm guessing Windows (more likely a driver) is allocating a huge chunk of buffer space that slows down the server in general.
The server has gigabit, and so I've tried copying over that. On a Sunday I was able to sustain about 50megs/sec to copy the data over, generally I can get about 22megs/sec, but today for some un-explained reason, its only 5megs/sec. This is kind of a pain when you're talking about moving almost 400gigs of data.
What are typical gigabit speeds? Is there anyway to speed things up?
What would be a better way to approach this? We are a non-profit, so costs need to be minimized.
We currently have an SQL server that backs up about 300gigs of data to another server (serv4). Serv4 also hosts a VM server instant that backs up (about 60gigs) to the same drive on serv4 (A 750gig RAID 5 array). We are trying to do a remote backup solution, such that our data is stored off site. We don't really have a network solution (we have a special long distance wireless connection to our other site, but its less then 1mbit). And the fastest internet we can realistically afford is only 2mbit up.
So we have been thinking of using a standard external USB or eSATA drive with truecrypt (for security). The problems with this is speed. Its way too slow, but I'm not sure what is causing it.
If I plug a USB drive in directly to the server, and try to copy the data, it goes fast, then slow, then fast (as in the time remaining counter on the transfer window will go from 30min to 300min and jump around in that range (to copy ~60gigs). Also you can watch the memory of running processes shrink when it starts, something that typically happens when a large program starts or loads a huge file. I'm guessing Windows (more likely a driver) is allocating a huge chunk of buffer space that slows down the server in general.
The server has gigabit, and so I've tried copying over that. On a Sunday I was able to sustain about 50megs/sec to copy the data over, generally I can get about 22megs/sec, but today for some un-explained reason, its only 5megs/sec. This is kind of a pain when you're talking about moving almost 400gigs of data.
What are typical gigabit speeds? Is there anyway to speed things up?
What would be a better way to approach this? We are a non-profit, so costs need to be minimized.
Facebook
Twitter