What backup method to archive 4-5 Terabytes for 10 years?
- Thread starter mcveigh
- Start date
Usually there are only two options I would consider for this sort of thing. Raid 5 arrays of DLT drives (I choose these for various reasons) or a tape library. It depends a lot on specifics. Like how much you will be backing up per day, week, month, and so on. And if its all from one source or multiple servers etc. But the DLT arrays and tape libraries should be your starting point.
Tape in general is probably the option that provides the best combination of reliability and capacity and ease of use.
I would say hard drives as well, except that that's probably more expensive, and I don't know how reliable a drive would be sitting in storage (even environmentally controlled) for 10 years. Even though it isn't in use, things like breakdown of lubricant might happen.
Hope you don't have to back up this data more than once! Although, really, you SHOULD back it up twice and store it at different places.
What system is already in use? I would hope that the company is already doing a backup of some sort, if they're already at 5 terabytes of data.
I would say hard drives as well, except that that's probably more expensive, and I don't know how reliable a drive would be sitting in storage (even environmentally controlled) for 10 years. Even though it isn't in use, things like breakdown of lubricant might happen.
Hope you don't have to back up this data more than once! Although, really, you SHOULD back it up twice and store it at different places.
What system is already in use? I would hope that the company is already doing a backup of some sort, if they're already at 5 terabytes of data.
I would say hard drives as well, except that that's probably more expensive, and I don't know how reliable a drive would be sitting in storage
Yeah, I would definetly rule out hard drives for this. Mainly for shelf life. Its also easier to keep various revisions (if you need that sort of thing) with multiple tape sets. In my situation I use 3 dedicated backup servers each having 5 DLT drives on it in a RAID 5 array. They back up around .75 TB a night from about 80 different servers around the network. Total cost was around 100k including the backup servers (Netware), tape drives (Compaq, though they are made by quantum really, who was making almost all DLT drives for awhile), software (Arcserve) and excluding the tapes.
A large reason I went that way is
1. I have the bandwidth to centralize my backups and do it over the network.
a.) I have OC-12 fiber connecting the 3 nodes (each node goes to its own backup server)
b.) From the nodes to the other locations its OC-3
2. I am backing up multiple servers from multiple locations. This is mainly why I didn't want just one huge tape library. Having 3 seperate backup servers gives me a lot of flexibility.
Thats one way to do it. But depending on your situation it may be better to go with one huge library. If you can give some more detail on your situation I'll try to be more helpful
Yeah, I would definetly rule out hard drives for this. Mainly for shelf life. Its also easier to keep various revisions (if you need that sort of thing) with multiple tape sets. In my situation I use 3 dedicated backup servers each having 5 DLT drives on it in a RAID 5 array. They back up around .75 TB a night from about 80 different servers around the network. Total cost was around 100k including the backup servers (Netware), tape drives (Compaq, though they are made by quantum really, who was making almost all DLT drives for awhile), software (Arcserve) and excluding the tapes.
A large reason I went that way is
1. I have the bandwidth to centralize my backups and do it over the network.
a.) I have OC-12 fiber connecting the 3 nodes (each node goes to its own backup server)
b.) From the nodes to the other locations its OC-3
2. I am backing up multiple servers from multiple locations. This is mainly why I didn't want just one huge tape library. Having 3 seperate backup servers gives me a lot of flexibility.
Thats one way to do it. But depending on your situation it may be better to go with one huge library. If you can give some more detail on your situation I'll try to be more helpful
- Dec 20, 2000
- 6,457
- 6
- 81
I pretty much ruled out hard drives due to shelf life concerns. I feel it's got to be tape.
there is no system right now. becuse this whole thing is just startign to come online, the first of 6 medical labs opens next week.
are there any real differences between the types of tape drives? dds4 vs LTO . etc?
I'm trying to keep the annual cost under 10000
there is no system right now. becuse this whole thing is just startign to come online, the first of 6 medical labs opens next week.
are there any real differences between the types of tape drives? dds4 vs LTO . etc?
I'm trying to keep the annual cost under 10000
Soulkeeper
Diamond Member
- Nov 23, 2001
- 6,731
- 155
- 106
you could hire hundreds of chinese monks and have them copy it by hand with pen and paper.......
or you could just not......
or you could just not......
Soulkeeper
Diamond Member
- Nov 23, 2001
- 6,731
- 155
- 106
Definitely. Forget dds - that's 4mm technology and will not give you the speed or data per tape capacity that you are going to need. SDLT or LTO is really the only way to go.
That may not be realistic depending on your frequency of backup needs, etc. Blank LTO tapes run > $100 each.
- Dec 20, 2000
- 6,457
- 6
- 81
I'm planning on building a 1-2 terabyte storage server to let people access the data for about a month. They really shouldn't need it too much after that, that's when I plan on archiving, hopefully with some BIG tapes. after that they'll go into storage somewhere.
I'm trying to keep the annual cost under 10000
This will most likely not be possible. At least not for initial set up. Unless you like switching tapes, A LOT. And even then the tape cost will go make it go past 10k (20 pack of SDLT tapes = over 3k). A single SDLT320 drive will run you over 4k just for the drive. In my example each of the backup servers were abit over 30k. about 25k for the 5 DLT drives and another 6 or 7 for the server hardware and software. And I probably have another 20 or 30 grand in tapes. If you want to go tape library you will be looking around 20k+ for just the library hardware for abit over 4TB native. If you want to get a library with abit over 8TB native you will be looking at abit over 30k. If you are just meaning 10k annual AFTER initial setup that shouldnt be a problem. Unless you are buying tapes like a mad man, heh.
This will most likely not be possible. At least not for initial set up. Unless you like switching tapes, A LOT. And even then the tape cost will go make it go past 10k (20 pack of SDLT tapes = over 3k). A single SDLT320 drive will run you over 4k just for the drive. In my example each of the backup servers were abit over 30k. about 25k for the 5 DLT drives and another 6 or 7 for the server hardware and software. And I probably have another 20 or 30 grand in tapes. If you want to go tape library you will be looking around 20k+ for just the library hardware for abit over 4TB native. If you want to get a library with abit over 8TB native you will be looking at abit over 30k. If you are just meaning 10k annual AFTER initial setup that shouldnt be a problem. Unless you are buying tapes like a mad man, heh.
If you have a fiber channel infrastructure or willing to upgrade to one, Quantum has a new backup solution you really should consider.
Quantum DX30
Then you could get a DLT autoloader and archive at your leisure and still have the data available for quick access.
techfuzz
Quantum DX30
Then you could get a DLT autoloader and archive at your leisure and still have the data available for quick access.
techfuzz
Magnetic storage will be wiped clean by an electro-magnetic pulse. If you are expecting a large electro-magnetic pulse within the next ten years, then stay away from tape, HD, or any other magnetic media.
An electro-magnetic pulse can be generated by certain types of munitions ("coming to a city near you").
Against this eventuality, you should use a physical medium, such as burnt DVD's, because they store the data physically (pits), and are immune to electro-magnetic pulses.
So, when the bomb goes off, and everything is wiped clean, just remember I told you.
An electro-magnetic pulse can be generated by certain types of munitions ("coming to a city near you").
Against this eventuality, you should use a physical medium, such as burnt DVD's, because they store the data physically (pits), and are immune to electro-magnetic pulses.
So, when the bomb goes off, and everything is wiped clean, just remember I told you.
So, when the bomb goes off, and everything is wiped clean, just remember I told you.
Lmao, true. Though if you are that worried about it you can just sehild your stuff. Out of all the places I have worked (including Sprint, and I am scared to think of total storage space there. The main tape room I was in once probably covered a few acres of floor space) that backup up large amounts of data not a single one used DVDs or anything of that nature. The capacity is WAY to small. There are a number of reasons various tape types are standard for large long term back ups. And as I said, if you are that worried about nukes going off near you just shield your stuff, lol. Going back to another Sprint memory, some of the locations they have are basically bomb shelters. Designed against both EMP and physical (they drop a bomb on you) attack.
Edit = I suppose for all the systems I work on I'll add the addendum *In event of nuclear attack results may vary* hehe
Lmao, true. Though if you are that worried about it you can just sehild your stuff. Out of all the places I have worked (including Sprint, and I am scared to think of total storage space there. The main tape room I was in once probably covered a few acres of floor space) that backup up large amounts of data not a single one used DVDs or anything of that nature. The capacity is WAY to small. There are a number of reasons various tape types are standard for large long term back ups. And as I said, if you are that worried about nukes going off near you just shield your stuff, lol. Going back to another Sprint memory, some of the locations they have are basically bomb shelters. Designed against both EMP and physical (they drop a bomb on you) attack.
Edit = I suppose for all the systems I work on I'll add the addendum *In event of nuclear attack results may vary* hehe
ultimatebob
Lifer
- Jul 1, 2001
- 25,134
- 2,450
- 126
An Super DLT 320 Autoloader, like the ATL SuperLoader would probably be the best choice for backing up that much data.
- Dec 20, 2000
- 6,457
- 6
- 81
the funny thing is I used to work for this guy. he left the old company after I did and starts his own. I really hope the hospital group he contracted with is paying for this because i'm up to like 20 grand now and don't have everything done The only good thing is the software package they are using in these labs costs anywhere from 25000-75000 per bed. so maybe this is chump change to him
I think I need a removable system, not a tape library on site. Are SDLT drives the largest capacity? Dell has PowerVault 110T SDLT for 4300 throw in 15 tapes for aout $7000 total.
The space comes from a video recording 6-8 hours. I'm trying to find out if I can change the video codec to decrease the size, on a competitors system I can.
For legal purposes I may be able to get rid of the video for archiving. That may make this whole thread moot, and my job a lot easier.
Thanks for the good input people
The only good thing is the software package they are using in these labs costs anywhere from 25000-75000 per bed. so maybe this is chump change to himI think I need a removable system, not a tape library on site. Are SDLT drives the largest capacity? Dell has PowerVault 110T SDLT for 4300 throw in 15 tapes for aout $7000 total.
The space comes from a video recording 6-8 hours. I'm trying to find out if I can change the video codec to decrease the size, on a competitors system I can.
For legal purposes I may be able to get rid of the video for archiving. That may make this whole thread moot, and my job a lot easier.
Thanks for the good input people
TRENDING THREADS
-
Discussion Zen 5 Speculation (EPYC Turin and Strix Point/Granite Ridge - Ryzen 9000)- Started by DisEnchantment
- Replies: 24K
-
Discussion Intel Meteor, Arrow, Lunar & Panther Lakes Discussion Threads
- Started by Tigerick
- Replies: 19K
-
-
-
Facebook
Twitter