SD cards as backup device?

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Red Squirrel

No Lifer
May 24, 2003
70,039
13,498
126
www.anyf.ca
They're not more reliable, especially outside of a environmentally controlled room. Tape storage, humidity, dirt / dust / debris. R/w heads need cleaning regular, the list goes on.

For my customers, tape falls into two categories. Those who do it as their process to meet audit requirements, and those who just do it cause that's how they do it.

Interesting so is it just one of those things that's that way just because it is, rather than because it's better? Looking at prices on Ebay for (what I presume is used) tapes and they actually arn't THAT cheap. So yeah, guess my hard drive rotation is not so bad after all.
 

ch33zw1z

Lifer
Nov 4, 2004
39,349
20,046
146
Interesting so is it just one of those things that's that way just because it is, rather than because it's better? Looking at prices on Ebay for (what I presume is used) tapes and they actually arn't THAT cheap. So yeah, guess my hard drive rotation is not so bad after all.

The industry is definitely moving away from physical tape to virtual at least in the Enterprise environment, midrange slowly following.
 

paperfist

Diamond Member
Nov 30, 2000
6,539
286
126
www.the-teh.com
Actually you can. It's not widely advertised but plugging some modern NAS's (eg, Synology) directly into a modern PC via the LAN port will show the same "connected over a network" result as plugging it into a router. You don't need "cross-over cables" anymore (LAN chips have had have auto-sensing for years), and you probably already need them both pre-configured to use Static IP's (eg, 192.168.1.2 for PC and 192.168.1.3 for NAS - as long as they're on the same Subnet and don't need to use DHCP). This also works with modern PC to PC transfers, eg, the other day I needed to backup a lot of data from a laptop with slow Wi-Fi to desktop. Since both have static IP's and are in the same room, I connected them both directly via 3m Ethernet cable and they instantly saw each other's shared folders and transferred at max +100MB/s speed first time. So technically, you can use some NAS's offline like external drives but using direct Ethernet cable instead of USB, without having them pass through the router. Of course, whether this is convenient or not depends on their location from each other and whether the PC's Ethernet port is already in use / you don't mind plugging / unplugging between backup vs Internet.

As for flash technology, it's literally the worst medium of all for long-term unpowered data retention / cold storage. The only reason some people still had readable photo's on very old 32-128MB (yes, Megabyte) SD cards pulled from a digital camera after a year or two unpowered was that the early cards were SLC / MLC and large node (+40nm) based. The old "1 year guaranteed JEDEC SSD chart (showing unpowered data retention in weeks vs temperature) that everyone loves to quote was based on 2013-2015 era Intel MLC SSD drives that use larger nodes and are now woefully outdated in 2018. Modern consumer flash is now all TLC and smaller node. The "future" is QLC, and PR statements of new QLC stuff sent to tech sites is "missing" its node-size and durability ratings for a reason (QLC PE cycles are down to just 100-300 cycles vs 50k-100k of SLC / 5k-10k of MLC / 1k-3k of TLC). For a small amount of data you write-once, throw in the back of a cupboard for several years and forget about, even burning 25GB HTL / MDISC BD-R's is far better than using anything based on increasingly leaky flash.

That's really a fantastic post! I really appreciate your take on it and explaining how off-line is possible.

Indeed, good post. Also note, any nodes I dont want accessible from the internet, I config with static IPs and no default gateway....no dg means no internet, but works just fine on your lan. Sounds like that won't work for the OP though, bookkeeper remotes in.

I think I can work around her logging in or at least move her to a more scheduled time. She only logs in maybe 2x a month anyway. She really only needs to access my Quickbooks, the other data she does not.

If I'm understanding correctly I can store the data in a NAS 'off-line' even (through Ethernet) though it would be connected to the server. I would also at least be able to keep backups of Quickbooks files in there too. The live file she would have access to.

I think I need to hire you to lock my network down :)
 
Last edited:

Red Squirrel

No Lifer
May 24, 2003
70,039
13,498
126
www.anyf.ca
The industry is definitely moving away from physical tape to virtual at least in the Enterprise environment, midrange slowly following.

What are they doing to replace tapes though, I assume virtual means spinning disks, but don't they also want to have cold storage? Or do they actually do away with that completely? If there is a huge virus or hack or what not, they could technically lose all data including the backups. I guess if everything is secured right this is a minimal risk they are willing to take. I presume the backups would also be offsite/"cloud". But the network still needs access to it (ex: persistent vpn tunnel) so if the main network is hacked it would still have access to the backups.
 

ch33zw1z

Lifer
Nov 4, 2004
39,349
20,046
146
What are they doing to replace tapes though, I assume virtual means spinning disks, but don't they also want to have cold storage? Or do they actually do away with that completely? If there is a huge virus or hack or what not, they could technically lose all data including the backups. I guess if everything is secured right this is a minimal risk they are willing to take. I presume the backups would also be offsite/"cloud". But the network still needs access to it (ex: persistent vpn tunnel) so if the main network is hacked it would still have access to the backups.

Typically the virtual libraries are in pairs, and data is replicated between them. Multiple copies of each tape, local encryption key managers ( sometimes on the network). Network security taken seriously, failed disks dont leave the building, and the virtual libraries can be far away from each other, hundreds or even thousands of miles.
 
Last edited:

paperfist

Diamond Member
Nov 30, 2000
6,539
286
126
www.the-teh.com
Typically the virtual libraries are in pairs, and data is replicated between them. Multiple copies of each tape, local encryption key managers ( sometimes on the network). Network security taken seriously, failed disks dont leave the building, and the virtual libraries can be far away from each other, hundreds or even thousands of miles.

So no RAID, just a backup of a backup?
 

ch33zw1z

Lifer
Nov 4, 2004
39,349
20,046
146
So no RAID, just a backup of a backup?

The storage is setup in RAID arrays. LUNs are presented as virtual tape drives.

There's quite a few different solutions in the open systems environment, so you may find someone else odd ball disk pooling. Some new Enterprise stuff isn't using traditional arrays anymore either. That's starting to get into the specific internal workings of a vtl, here's a general overview

https://en.m.wikipedia.org/wiki/Virtual_tape_library?wprov=sfla1
 
Last edited:

Glaring_Mistake

Senior member
Mar 2, 2015
310
117
126
Anyone know how reliable they are?

I didn't know till now that they have wireless SD cards and was just thinking how easy and low power it would be to set a few of them up as file storage. They would also let me setup a place to store files slightly away from my internet connection and hackers.

Any thoughts would be appreciated!

Shall have to join the others here in saying that they aren't too reliable and should preferably not be relied on as backup.
Now as some of you here may know I have tested a number of SSDs, seeing if read speeds drop and how much and/or if they suffer retention failures.
But I have also tested a few usb drives/memory cards though that has been a bit more ad hoc meaning that basically they were just some I was using and not tested in similar ways or after a set amount of time.
Results for them have been mixed, some have barely slowed down at all even when they've been powered down for a long time while others have slowed down or even suffered retention failures though none of them have just been blank after connecting them to the computer.


As for flash technology, it's literally the worst medium of all for long-term unpowered data retention / cold storage. The only reason some people still had readable photo's on very old 32-128MB (yes, Megabyte) SD cards pulled from a digital camera after a year or two unpowered was that the early cards were SLC / MLC and large node (+40nm) based.

Have had flash drives with readable files after being unpowered for probably like 5+ years that were around 4-8 GB so some larger capacities also used decent NAND.
They did suffer from a bit of voltage drift however which isn't all that surprising.

Yes, type of NAND (SLC/MLC/TLC) is very important in terms of retention even if it doesn't tell the whole truth.
Think size of the node is not equally important however - have seen drives with NAND built on a small node impress and drives with NAND built on a large node that are not that impressive.

The old "1 year guaranteed JEDEC SSD chart (showing unpowered data retention in weeks vs temperature) that everyone loves to quote was based on 2013-2015 era Intel MLC SSD drives that use larger nodes and are now woefully outdated in 2018. Modern consumer flash is now all TLC and smaller node.

JEDEC updated their paper on their requirements for SSDs (JESD218B to JESD218B.01) in 2016 and they still have similar chart included so if it was so outdated they certainly had opportunity to update the chart with more accurate information.
They do note that one of the differences between JESD218A and JESD218B is: "Refine the low-temperature data retention flow to accommodate the realities of the SILC retention mechanism in modern NAND" but I don't know quite when they updated JESD218A to JESD218B.

Think the chart is accurate - it's just that you hit the point where wear is going to cause retention to go below one year significantly faster with MLC NAND than with SLC NAND and so on and so on.
And, well...there's also the question if manufacturers actually make sure that those standards are actually met.
Had a test result recently with one drive that really makes me doubt that they have made sure it is up to snuff.

The "future" is QLC, and PR statements of new QLC stuff sent to tech sites is "missing" its node-size and durability ratings for a reason (QLC PE cycles are down to just 100-300 cycles vs 50k-100k of SLC / 5k-10k of MLC / 1k-3k of TLC). For a small amount of data you write-once, throw in the back of a cupboard for several years and forget about, even burning 25GB HTL / MDISC BD-R's is far better than using anything based on increasingly leaky flash.

While neither of them have mentioned the size of the node both Intel/Micron and Toshiba/WD have said that their 3D QLC NAND is specced for 1000 P/E.
Though if that's what enterprise drives using 3D QLC NAND are specced for then consumer drives may be specced for less than that.
Samsung however has been pretty silent on both counts though as far as I can remember.
Now even if endurance may not be the best retention could be decent (have read that 3D QLC NAND is supposed to be similar to 2D TLC NAND at 15nm), there's one drive I'm testing with fairly low endurance that has been fairly resistant to voltage drift that could possibly endure twice what it's been specced for and still stay within JEDEC specs.
Will want to see how it does in the current test to say anything more definitive than that though.

Well Samsung's first gen 850 3D NAND was 40nm. Since then though there have been rumors that Samsung has been shrinking it down to nearer 20nm again for the 860/960's. That would certainly explain the shrinking warranty sizes and lack of node-size info for newer drives (eg, 5-10 year 850 series vs only 3-5 year 860/960 series), not to mention how 860 ends up much cheaper than 850 (and close in price to the MX500 which is said to be using the 16-20nm 3D Intel/Micron process).

Where have you heard anything about the litography being shrunk for the 860/970?
I've heard that it is in their plans to do that at some point but not that they have already done so.
Regarding one way that can at least partly explain why the 860 EVO is close in price to the MX500: http://thememoryguy.com/how-samsung-will-improve-3d-nand-costs/
And according to the same person 3D NAND of a smaller lithography can match 2D NAND at larger lithographies: http://thememoryguy.com/how-3d-nand-shrinks-ecc-requirements/

I thought that was due to the increase from 32 layers in the first gen to 64 layers in the fourth gen NAND. Not shrinking geometries. The new 64 layer NAND also has tremendous write endurance for a consumer drive (1200TB for the 1TB 860/970pro). That's 1200 P/E cycles guaranteed.

That's just the TBW though which can have a pretty loose connection to the endurance.
Samsung says that their 64-layer 3D TLC NAND can take 7000-20000 P/E (think their 48-layer 3D TLC NAND had similar endurance) which is significantly higher than 1200 P/E.
Of course they don't mention how they get those numbers or if that NAND is binned well and if so is the NAND in 860/970 EVO of similar quality.

It's said to be both increasing layers and shrinking nodes. Hence why they go into great detail when layers get increased yet have quietly removed all detail about the node size latter for post 850 series marketing or explained why warranties have halved for premium PRO's. 1.2PB endurance is impressive for the PRO's, but that's MLC which is expected (even 16nm planar MLC of old MX100/200's or 19nm Samsung 830's also hit +1PB in endurance tests).

Think that the reason they have have halved the warranty period for their Pro drives is that they didn't consider it necessary seeing as noone else does either.
If I remember correctly (not entirely sure about that) then originally they intended to have a five year warranty for the 850 Pro but then they decided to up that since the SanDisk Extreme Pro had a 10 year warranty and they couldn't lose to SanDisk now could they?
I kind of miss the fact that they would mention the lithography more than the 10 year warranty to be honest.

Regarding endurance test results, those conducting endurance tests don't really tend to test retention which is a pretty important part.

If anyone here is using SSD's in external USB 3 enclosures as a backup drive, make sure you plug it in at least once every 2-3 months.

Probably more often than strictly necessary but it is good to check that nothing has been corrupted now and then.



Hey, I'm going to test an 850 EVO (Gen 1) after it's been powered down for a year.
Still a few months until then but would you be interested in seeing the results?
 
  • Like
Reactions: cbn

ch33zw1z

Lifer
Nov 4, 2004
39,349
20,046
146
I think I can work around her logging in or at least move her to a more scheduled time. She only logs in maybe 2x a month anyway. She really only needs to access my Quickbooks, the other data she does not.

If I'm understanding correctly I can store the data in a NAS 'off-line' even (through Ethernet) though it would be connected to the server. I would also at least be able to keep backups of Quickbooks files in there too. The live file she would have access to.

I think I need to hire you to lock my network down :)

Yea, you're understanding it correctly. A couple different ways to do it. QuickBooks has that backup company file option, just point it at the NAS for once a day or whatever you're comfortable with.
 

BSim500

Golden Member
Jun 5, 2013
1,480
216
106
Samsung says that their 64-layer 3D TLC NAND can take 7000-20000 P/E (think their 48-layer 3D TLC NAND had similar endurance) which is significantly higher than 1200 P/E.

Whilst one Samsung 850 PRO did get 35k cycles (9PB on a 256GB drive) with uncorrectable errors, the few tests that have been done on the TLC-based EVO drives were barely 1/10th of that. Eg, Nordic Hardware's endurance test on the 850 EVO died after 4094 P/E cycles (1PB on 250GB drive) again with CRC errors:-

"We saved 75 gigabytes of mixed files and then made a MD5 hash. We then hidden the units in a box in the office and then picked them up two months later. We have now unlocked the devices and tried to verify the hash for all the files. About 1 percent of the files checked did not have the same hash value as when the data was saved two months ago. This means that the file is corrupted in one way or another."


In reality data corruption tends to creep in long before death / the last possible write cycle (quite often a 0% life drive just randomly dies on a daily power up cycle, which is something even these continuous power / write tests also don't measure). This is why I really don't give much credence at all for marketing figures which are up to quintuple of what endurance testers are seeing failures at (both P/E cycles & data corruption) in the real world. Samsung doubling their previous "2K" estimates to 4K for TLC is already an over-estimation for data integrity. Adding a 0 on the end though, is pushing believability well past breaking point.

Edit - And if Samsung's "7k-20k" TLC P/E claim ends up nearer 3k-4k in reality, then I can quite easily see their "1000-1200" P/E QLC claim ending up far more in line with other brands supposed 100-500 P/E cycles in practise.

Hey, I'm going to test an 850 EVO (Gen 1) after it's been powered down for a year. Still a few months until then but would you be interested in seeing the results?
I'd be absolutely interested. You are literally the only person I know (on any site) even attempting to keep on the ball for this stuff post 2015. "Tech sites" have really gone downhill over the past 3 years with anything storage related (I mean beyond the usual junk synthetic / "trace" suite's). Imagine if they all said "No in-depth Coffee Lake or Ryzen benchmarks other than a single PCMark score. Why? We already gave you one for Sandy Bridge a few years back and we're sure not much has changed since then", and now swap CPU's for SSD's... :rolleyes:
 
Last edited:
  • Like
Reactions: cbn

Insert_Nickname

Diamond Member
May 6, 2012
4,971
1,695
136
Hey, I'm going to test an 850 EVO (Gen 1) after it's been powered down for a year.
Still a few months until then but would you be interested in seeing the results?

Absolutely.

In reality data corruption tends to creep in long before death / the last possible write cycle (quite often a 0% life drive just randomly dies on a daily power up cycle, which is something even these continuous power / write tests also don't measure). This is why I really don't give much credence at all for marketing figures which are up to quintuple of what endurance testers are seeing failures at (both P/E cycles & data corruption) in the real world. Samsung doubling their previous "2K" estimates to 4K for TLC is already an over-estimation for data integrity. Adding a 0 on the end though, is pushing believability well past breaking point.

Therein lies the real problem. Data integrity. Worse, it's becoming a bigger and bigger problem with the current growth in dataset sizes.

Of course there are ways of ensuring that, but we're moving a bit beyond the consumer segment then. Which is a shame really, because (some) people do have TB's worth of irreplaceable data even today.
 
  • Like
Reactions: cbn

Glaring_Mistake

Senior member
Mar 2, 2015
310
117
126
Whilst one Samsung 850 PRO did get 35k cycles (9PB on a 256GB drive) with uncorrectable errors, the few tests that have been done on the TLC-based EVO drives were barely 1/10th of that. Eg, Nordic Hardware's endurance test on the 850 EVO died after 4094 P/E cycles (1PB on 250GB drive) again with CRC errors:-

"We saved 75 gigabytes of mixed files and then made a MD5 hash. We then hidden the units in a box in the office and then picked them up two months later. We have now unlocked the devices and tried to verify the hash for all the files. About 1 percent of the files checked did not have the same hash value as when the data was saved two months ago. This means that the file is corrupted in one way or another."

No need to translate that to English on my account, am quite fluent in the language.
Do remember the results of that test too, was a bit surprised that the 840 EVO lasted longer than the 850 EVO did.

There's one site with a lot of endurance tests even if they haven't tested retention properly (only two weeks which is not nearly long enough): https://3dnews.ru/938764
They have drives using 3D TLC NAND by Samsung enduring a great deal more but that may well be down to the fact that they don't really test retention properly as I previously mentioned.

However; it looks like they either have been unlucky with drives using Toshiba/WD's 3D TLC NAND or their NAND has pretty low endurance.
Not sure if the values for those drives have been reported correctly so wear could have been higher than CDI reports.

For that site however; translation is necessary, not quite as fluent in Russian.

In reality data corruption tends to creep in long before death / the last possible write cycle (quite often a 0% life drive just randomly dies on a daily power up cycle, which is something even these continuous power / write tests also don't measure).

Depends on whether we're talking about a drive worn down to 0% of endurance or one that has seen even more wear.
Have tested a few drives that have been worn down to within the last 5% of endurance and results haven't been too bad.
As well as two drives that happened to be far more worn than they were specced for (due to SMART for both not properly reporting what endurance was like).
Of those two one passed and the other failed the retention test, the one that failed did not just randomly die or even try to go into a read-only state which I thought it might have after seeing that trying to write anything to it resulted in corrupted files.
And all of those were powered down for a year, this test is a bit more lenient than the JEDEC specs demand however; seeing as I don't keep my apartment at a constant balmy 30C.

This is why I really don't give much credence at all for marketing figures which are up to quintuple of what endurance testers are seeing failures at (both P/E cycles & data corruption) in the real world. Samsung doubling their previous "2K" estimates to 4K for TLC is already an over-estimation for data integrity. Adding a 0 on the end though, is pushing believability well past breaking point.

Well, that is why I said that they don't mention how they arrived at those numbers.
Like how the tests were run or what the binning was like.
For example, don't know exactly what a PM863 is specced for but my guess would be similar to 850 Pro so like 6K and that is closer to at least 7K than the 2K the 850 EVO was specced for.
With my PM863 the Wear Levelling Count went down from 100 to 99 after 20 P/E so that made me initially think that it had similar endurance to the 850 EVO but as wear increased WLC did not decrease further even after 50 P/E.

Agree with taking marketing figures with a grain of salt though.

Edit - And if Samsung's "7k-20k" TLC P/E claim ends up nearer 3k-4k in reality, then I can quite easily see their "1000-1200" P/E QLC claim ending up far more in line with other brands supposed 100-500 P/E cycles in practise.

Haven't seen Samsung claim endurance for their 3D QLC NAND is 1000 P/E or any specific claims.
The others have claimed to get around 1000 P/E for their 3D QLC NAND however.

I'd be absolutely interested. You are literally the only person I know (on any site) even attempting to keep on the ball for this stuff post 2015. "Tech sites" have really gone downhill over the past 3 years with anything storage related (I mean beyond the usual junk synthetic / "trace" suite's). Imagine if they all said "No in-depth Coffee Lake or Ryzen benchmarks other than a single PCMark score. Why? We already gave you one for Sandy Bridge a few years back and we're sure not much has changed since then", and now swap CPU's for SSD's... :rolleyes:

Yeah, don't know anyone else conducting tests like these either.
Think Billy Tallis (or someone else at Anandtech) mentioned that they were thinking about testing retention for 3D QLC NAND though.

Regarding the 850 EVO I would like you to keep the results to yourself until I write up something about the drive so as not to spoil the surprise for the few others who would be interested in seeing how it did.

Absolutely.

Same condition for you, would like you to keep the results for the 850 EVO to yourself until I write up something about the drive so as not to spoil the surprise for the few others who would be interested in seeing how it did.
 
  • Like
Reactions: cbn

Insert_Nickname

Diamond Member
May 6, 2012
4,971
1,695
136
Same condition for you, would like you to keep the results for the 850 EVO to yourself until I write up something about the drive so as not to spoil the surprise for the few others who would be interested in seeing how it did.

If you're publishing something, I'm good with waiting for the "official" write-up. But if you give something beforehand I'll keep whatever you tell under the rug.
 

BSim500

Golden Member
Jun 5, 2013
1,480
216
106
Regarding the 850 EVO I would like you to keep the results to yourself until I write up something about the drive so as not to spoil the surprise for the few others who would be interested in seeing how it did.
Sure, not a problem at all.
 

Glaring_Mistake

Senior member
Mar 2, 2015
310
117
126
If you're publishing something, I'm good with waiting for the "official" write-up. But if you give something beforehand I'll keep whatever you tell under the rug.

Yeah, it's just unclear how long that would take.
I've been planning to write something about two other drives before then (they're actually not as far along with their tests but is necessary to do so that when I refer to them when writing about other drives people would get the comparison).
And it has been months and I'm no further along.
Because you know, for some reason trying to condense hundreds of data points in a way that is informative without overwhelming people with detail for two drives and in two different languages is a prospect that feels somewhat daunting.
 

Glaring_Mistake

Senior member
Mar 2, 2015
310
117
126
If you're publishing something, I'm good with waiting for the "official" write-up. But if you give something beforehand I'll keep whatever you tell under the rug.
Sure, not a problem at all.

Ok, so apparently I was a bit too subtle earlier: I've tested the 850 EVO (among other drives) so let me know if you want to see how it performed.
 
Last edited: