Copying massive amounts of data HD-->HD

[Muse]

CIFS is the "windows shares" part. It is sounding more and more like the system did a fsck internally and was purging the corrupt stuff. I am not sure that is good though.

Maybe running WDLGD is a good idea, I'm now doing the extended test on the 2TB USB WD ELEMENTS HD. Presumably it will fix (or offer to fix) the problems. Well, if I lose all that data, it's not the end of the world, I have other more important data, however that's already been copied to the NAS, and for all I know there could be issues with some of the files. However, Windows did copy it over and didn't throw errors like it did with the 5 or so ~Tri files.

Edit: Looks like DLGDIAG's extended test is going to take around 20 more hours.

 

[Muse]

Muse, you would need to take the drives out of the NAS and run the WDLD tool on the disk via a PC.

I can't do that. My best desktop machine's SATA controller won't run them. Upgrading that machine is one of my high priority projects.

 

[Muse]

I can't do that. My best desktop machine's SATA controller won't run them. Upgrading that machine is one of my high priority projects.

Actually, on second thought, I bought a Rosewill 3.5" external HD enclosure. I've had it sitting empty for a while, I bought it in order to test WD ELEMENTS USB HD's in the event I get future problems (I've had several!). I figure it's the only way to find out if one of those external drives failing is really a HD failure or has to do with the ELEMENTS enclosure circuitry.

I guess I could run tests on those HDs. I guess the first thing is to let DLGDIAG finish on the 2TB USB HD with the original data. Then, maybe I should recopy everything, maybe after first testing the NAS HD's (running DLGDIAG extended test, I suppose... could also run crystaldiskinfo)!

 

[Muse]

I figure odds are the problem is due to data corruption in the data copied over from the USB HD, not in the new 3TB WD Red HDs, but I know I should not take that for granted.

 

[Captain_WD]

Hello again,

As imagoon said, you should take the drives out of the NAS and attach them directly to your computer in order to perform a complete test with the WD DLGD, including the SMART part. I have personally tested a couple of my portable drives full of info with the extended test and none of the data was lost or changed (even though it took hours and hours to complete the test) so you should not have any trouble with your Elements drive.
Have you tried scanning the problem folders for any malware? Maybe something is preventing them from being handled with?
In case WD DLGD comes clean, I would consider defragmentation. Sometimes Windows gets lost in searching during huge Copy/Paste operations.

Keep us posted with how things are resolving,

Captain_WD

 

[Muse]

Hello again,

As imagoon said, you should take the drives out of the NAS and attach them directly to your computer in order to perform a complete test with the WD DLGD, including the SMART part. I have personally tested a couple of my portable drives full of info with the extended test and none of the data was lost or changed (even though it took hours and hours to complete the test) so you should not have any trouble with your Elements drive.
Have you tried scanning the problem folders for any malware? Maybe something is preventing them from being handled with?
In case WD DLGD comes clean, I would consider defragmentation. Sometimes Windows gets lost in searching during huge Copy/Paste operations.

Keep us posted with how things are resolving,

Captain_WD

The extended test of the 2TB ELEMENTS USB HD finished this morning. It passed. No other info was provided, I poked around looking for specifics, data, indications of whether or not bad sectors were discovered, whatever but couldn't find any more info in WDDLD. Ah... I just brought up the SMART disk info. There are 6 X's, the rest checks. I don't know how to interpret the info. Crystaldiskinfo calls the disk "Good."

I still can't delete the temp files that alerted me to an issue, that stopped Windows Copy command from completing.

Perhaps ( ) some data is now in better shape? I have no way of knowing, no reason to think so, but maybe it is. I can copy data back to the NAS from the just _scanned_ USB HD, this time using something more helpful than the Copy command. What do you think?

Edit: I suppose I should do as you suggest and test the NAS's HDs, presumably by running the WDLDIAG extended test on them? That appears to not provide feedback other than PASSED or not passed, right? Are there other diagnostic techniques that would be better used here?

Edit2: I'm considering copying everything on the USB drive (there's only around 360GB total on the USB HD) to a different USB drive, I have several, before defragmenting. I suppose it would be an extra step that would decrease the chances of losing anything. In copying (or robocopying or whatever) I imagine that the data will be automatically defragmented as placed on the copied-to HD. I'd have an extra version of the data in case something goes wrong. All this likely before testing the NAS HDs.

 

[Captain_WD]

The extended test of the 2TB ELEMENTS USB HD finished this morning. It passed. No other info was provided, I poked around looking for specifics, data, indications of whether or not bad sectors were discovered, whatever but couldn't find any more info in WDDLD. Ah... I just brought up the SMART disk info. There are 6 X's, the rest checks. I don't know how to interpret the info. Crystaldiskinfo calls the disk "Good."

I still can't delete the temp files that alerted me to an issue, that stopped Windows Copy command from completing.

Perhaps ( ) some data is now in better shape? I have no way of knowing, no reason to think so, but maybe it is. I can copy data back to the NAS from the just _scanned_ USB HD, this time using something more helpful than the Copy command. What do you think?

Edit: I suppose I should do as you suggest and test the NAS's HDs, presumably by running the WDLDIAG extended test on them? That appears to not provide feedback other than PASSED or not passed, right? Are there other diagnostic techniques that would be better used here?

Edit2: I'm considering copying everything on the USB drive (there's only around 360GB total on the USB HD) to a different USB drive, I have several, before defragmenting. I suppose it would be an extra step that would decrease the chances of losing anything. In copying (or robocopying or whatever) I imagine that the data will be automatically defragmented as placed on the copied-to HD. I'd have an extra version of the data in case something goes wrong. All this likely before testing the NAS HDs.

:thumbsup:
When your test with WD DLGD is complete and you have passed it, this means that you are safe from bad sectors. The Quick test brings up the SMART log.
Could you please post here screenshots of the info that pops after the tests (extended and S.M.A.R.T.)?
Can you still access and copy all the other files from your disk?
Concerning the drives in the NAS, I would definitely check all the drives with the extended test just to make sure they are in good shape so you don't jeopardize your data. Another test that you can do is the Windows CHKDSK/ r to again check for any bad sectors in your drive. Have in mind that if there are and you have info written on them, Windows will close those sectors and you will lose your data on them!
It is always a good idea to have an additional backup, especially when your drives have problems. You can try copying the rest of your data in small pieces to secure it and to see if it is still accessible.

Keep me posted on how the situation is developing.

Captain_WD.

 

[Muse]

:thumbsup:
When your test with WD DLGD is complete and you have passed it, this means that you are safe from bad sectors. The Quick test brings up the SMART log.
Could you please post here screenshots of the info that pops after the tests (extended and S.M.A.R.T.)?

Can you still access and copy all the other files from your disk?
Concerning the drives in the NAS, I would definitely check all the drives with the extended test just to make sure they are in good shape so you don't jeopardize your data. Another test that you can do is the Windows CHKDSK/ r to again check for any bad sectors in your drive. Have in mind that if there are and you have info written on them, Windows will close those sectors and you will lose your data on them!
It is always a good idea to have an additional backup, especially when your drives have problems. You can try copying the rest of your data in small pieces to secure it and to see if it is still accessible.

Keep me posted on how the situation is developing.

Captain_WD.

Kind of funny stuff going on. We're talking about the ~2.5 year old WD ELEMENTS 2TB HD that's been the repository for my networked data for a while, the one I copied over the data from to the RAID1 NAS, running 2 WD 3TB Red HDs. This morning I open WDDLDiag and it showed FAIL for the ELEMENTS HD! I then ran the Quick test again on it and it then showed PASS, well it did after restarting WDDLDiag. Hmm.

Could you please post here screenshots of the info that pops after the tests (extended and S.M.A.R.T.)?

Doesn't seem to be working, this:

http://bayfiles.net/file/1jsZj/CjWJNS/SMART1.bmp

That is, displaying here, but I think you can maybe download it from that...

Maybe you can hit this, I can...

https://plus.google.com/photos/1100...6047874219592993058&oid=110090306825051457033



After the extended test I couldn't find any info other than the fact it passed. I poked around looking for more but couldn't find any. Can you tell me where I would find that? Of course, the test took ~20 hours. the SMART data is shown in this image, which includes it all (unscrolled and unscrolled), as well as the FAIL which is showing again for the drive. That's just confusing. Now it shows FAIL, then PASS, and currently FAIL again.

Can you still access and copy all the other files from your disk?

I don't know. AFAIK, yes, but I will not be surprised if it turns out that there are other problems, a lot of problems.

So, here's a question: DSM has its own storage checking program, in which I can do a Quick test and an Extended test, on either of the two mirrored HDs. Of course, it would be easier to run that than take each drive in turn out of the enclosure and put it in my 3.5" USB enclosure and test using Windows PC, running either WDDLDiag or chkdsk. I think before I copy data over to the NAS again, I'll copy to a different HD entirely. I have such a drive available, 3TB USB.

http://bayfiles.net/file/1jsZj/CjWJNS/SMART1.bmp

<a href="http://bayfiles.net/file/1jsZj/CjWJNS/SMART1.bmp">http://bayfiles.net/file/1jsZj/CjWJNS/SMART1.bmp</a>

http://bayfiles.net/file/1jsZj/CjWJNS/SMART1.bmp

 

[Muse]

SyncToy. Free tool from MS. I use it to backup to my external hdd (4 TB). But it can be also used to copy over to the NAS and in the future to backup the nas.

This tool, which I just downloaded and installed, looks pretty good. Nice interface, evidently intuitive, easy to use, very simple to install.

I've been having problems copying data from the problem drive to another USB HD, which I want to do before moving data to the NAS. The problems involve Windows Copy command balking repeatedly, and this mystifies me because I copied that data over to the HD in the first place with no problems using Windows Copy command. I get errors mostly concerning excessively long file/folder names. I fix the problem, start all over, another such problem happens, it's a bitch.

After I finally get all the data to the other USB HD, I plan to run Synology's own Storage Manager disk checking, both Quick and Extended to gain some assurance that it's HDs are OK, then I will copy data anew and have fingers crossed that these problems are behind me.

I have SyncToy running right now, copying the folder (with many many subfolders) that's been giving me a lot of problems, doing an "Echo" to a folder on the other USB HD, the folder that wasn't getting everything using Copy. Presumably it will not choke on the same problems.

I figure I'll either use SyncToy to copy data from the NAS to USB HDs to be stored off site or possibly Synology's own apps to do that, if they are nice and functional, I suppose that exists. But SyncToy may be all I need for that. A Synology support guy the other day told me to use Windows Explorer to copy/move/etc. files, folders, whatever, not Synology's File Station. He didn't elaborate, he obviously was pretty burned out on explaining things to people, he preferred to just tell you what to do. I get the feeling that Synology may not be the swingingest, happiest place to work. I used to do tech support, did so twice. The first time the people I dealt with were by and large very technically astute people, and it was software, the second time they were employees of the company I worked for and I was the expert, again software (and I knew the code, had written a lot of it). Both were good experiences. But doing tech support for customers of a hardware+softwares product like Synology's NAS's, that must be very complex.

 

[Muse]

OMG, both the 2TB WD Elements USB HD and the drive I've been copying to, a WD 3TB My Book HD are showing a FAIL SMART Status right now in WD DLG Diag.

WD sent me the MyBook as a replacement for a 3TB USB HD I bought in July 2013 that went bad. I received the drive around middle of June of this year. It's hardly been used. Power on count is 102, Power on hours is 34 hours! Crystaldiskinfo says both drives are good, though. WTF is going on?

 

[Captain_WD]

Hello again,

It is very uncommon to have 2 drives fail at the same time. I would stop doing anything more to preserve any data on them and any further possible damage and contact our live support over the phone or e-mail. The team should give you guidance on how to proceed with fixing and transferring your data safely.
Here's a link: http://support.wdc.com/contact/index.asp?lang=en

Captain_WD.

 

[Muse]

Hello again,

It is very uncommon to have 2 drives fail at the same time. I would stop doing anything more to preserve any data on them and any further possible damage and contact our live support over the phone or e-mail. The team should give you guidance on how to proceed with fixing and transferring your data safely.
Here's a link: http://support.wdc.com/contact/index.asp?lang=en

Captain_WD.

Strange behavior indeed, especially the fact that one moment the 2TB USB HD showed FAIL, then a few minutes later PASS, then later FAIL.

So, today I move both HDs from the Windows laptop where I was seeing that crazy stuff to a different Windows machine, my desktop. I bring the machine out of suspend, open WD DLG Diag, and both HDs show PASS, the SMART data is nothing like what was displayed on the other machine.

I just don't know what to think. I really don't know WTH's going on. What do you think? Contact WD support at the link you have there?

 

[Doomer]

Obviously you need guidance. I'd contact WD.

 

[Captain_WD]

Strange behavior indeed, especially the fact that one moment the 2TB USB HD showed FAIL, then a few minutes later PASS, then later FAIL.

So, today I move both HDs from the Windows laptop where I was seeing that crazy stuff to a different Windows machine, my desktop. I bring the machine out of suspend, open WD DLG Diag, and both HDs show PASS, the SMART data is nothing like what was displayed on the other machine.

I just don't know what to think. I really don't know WTH's going on. What do you think? Contact WD support at the link you have there?

Yes, I would contact our support via phone or e-mail. All the info is at the link
Keep us posed on how it's resolving.

 

[Muse]

Yes, I would contact our support via phone or e-mail. All the info is at the link
Keep us posed on how it's resolving.

I'm going to call them in a few minutes. Running WDDLDiag from one machine it shows PASS for the two HDs. I then ask the program to show SMART data, it looks screwy for both HDs and after closing the SMART data screen, each drive shows FAIL. On my desktop machine that didn't happen. I just moved the HDs back to the first machine and again PASS turned into FAIL for both HDs after displaying SMART data.

I'll post back here after interaction with WD support.

 

[Muse]

So, I call WD support and get a guy who calls himself Michael, I'm guessing Indian, has strong accent.

I explain some of this, giving him the model and SN of the MyBook 3TB HD, which he says is warranted until Nov. 2014. Didn't get around to the info on the other HD. Explained that one one computer I get much different SMART data than the other, it's weird looking as well (~1/2 the attributes are "unknown"), and AFTER displaying SMART data the SMART Status turns from PASS to FAIL. This happens every time. On the other computer, the SMART data appears entirely different. He agrees that the SMART data is stored on the HD, so it should show the same regardless of the machine. He postulates after going away for ~5 minutes that there's a problem with an incompatibility of the particular machine where I'm seeing this problem and the diagnostic software. Therefore he recommends trying other SMART data information evaluation software on this machine. He gives me a case number. I asked him for an email address, and I'm sending a link to the image that shows the weird data displayed for one of the HD's, the 2TB WD Elements:

Weird data

I asked him if he could see that and he said he didn't have access and said support would evaluate. Well, I told him I only sent the link (so he could see it), didn't explain things in that email, so I'm going to resend the link along with an extensive explanation of the problems. Well, I don't know how much detail I'm going to go into. I guess I'll provide a link to this thread and a basic rundown of the SMART data display snafu...

 

[Muse]

I compose a message to WD Support, linking this thread and the screenshots. Then I decide to uninstall and reinstall WDDLDiag on the laptop (it had version 1.25, the desktop has version 1.24). The new version is 1.27. Now the SMART data does NOT look screwy, there are no "unknown" attributes, and the SMART Status remains PASS after showing SMART data. Hmm. I can only conclude that specific installs of WDDLDiag can go _crazy_ and may NOT display SMART data correctly.

 

[taltamir]

Personally I use second copy for such a transfer.
it is a simply and straightforward backup software. it will copy what it can, skip what it can't. and if there were any errors it will tell you which files and you have the option of just running the processes again for it to compare the two drives and then recopy what is missing.

 

[Auric]

I recently experienced same SMART screwiness with WinDLG 1.25 on USB drives. However, WinDFT and SeaTools reported okay and since they were not WD but Samsung drives I just ignored it. Now "thanks" to your problem I find the explanation in the 1.27 release notes:

...
Version 1.26:
Resolved Issues:
&#61623; Resolved a problem that caused SMART Attributes to be reported improperly for external drives connected via USB or IEEE 1394 (FireWire).
...

Another potential problem, and the reason for checking with the non-manufacturers' tools was due to intermittent test failures caused by overloading a USB Root Hub.

I would also recommend TeraCopy or perhaps better FreeFileSync for such jobs.

 

[exar333]

robocopy c:\thesource d:\thedestination *.* /s /e /MIR /tee /log:c:\thelogfile.txt /r:1 /w:1 /copyall

is pretty much all you ever need. Make sure to run it as an admin command prompt. It will do the copy, retry a file once then spit it out to a log file that you can scan for the error in. No need for extra apps etc.

As for corrupted files there isn't much you really can do about that other than hope chkdsk repairs them.

This is awesome!

Will be using this today when I copy over ~2.5TB to my new 4TB RAID NAS setup.

 

[imagoon]

This is awesome!

Will be using this today when I copy over ~2.5TB to my new 4TB RAID NAS setup.

If your device can support it, look at /MT:8 (2-128 is the number of threads / copies) as that will do multithreaded copies on windows 7 and above. It doesn't help much if you are copying 200 8gig files but is fantastic for photos and tons of other small files.

FYI /MIR is mirror so if you delete from the source, it will delete from the destination. The command is resumable thought so just run it again if the copy stopped in the middle etc.

/L is "test" if you want to run a simulation and see what happens.

 

[Muse]

I recently experienced same SMART screwiness with WinDLG 1.25 on USB drives. However, WinDFT and SeaTools reported okay and since they were not WD but Samsung drives I just ignored it. Now "thanks" to your problem I find the explanation in the 1.27 release notes:

...
Version 1.26:
Resolved Issues:
&#61623; Resolved a problem that caused SMART Attributes to be reported improperly for external drives connected via USB or IEEE 1394 (FireWire).
...

Another potential problem, and the reason for checking with the non-manufacturers' tools was due to intermittent test failures caused by overloading a USB Root Hub.

I would also recommend TeraCopy or perhaps better FreeFileSync for such jobs.

Aha! This susses out the issue. The only suggestion of the CSR I spoke to yesterday was to install non-manufacturer's tools and see what they came up with, that and contact WD support by email with the link to the screenshots linked here (which I did). I figured non-manufacturer software wouldn't have an issue, because crystaldiskinfo's screen seemed benign enough. I figured why not go ahead and uninstall/reinstall. I couldn't figure out what version of WDDLDiag I had been running, poking around in the program. Seemed totally opaque. However, when I went to uninstall the program it said that I was going to uninstall version 1.25, that's how I found out that bit of info. Installing fresh from WD online, I was offered version 1.27.

 

[Auric]

For WinDLG, right-click on the title bar for the About window with version number or alternatively the exe Properties Details tab.

Not sure about RoboCopy (or RichCopy) but an oddly common shortcoming with copy/sync proggies is not preserving folder creation dates. I have been using an old version (3.17) of FreeFileSync for that but the function has returned as of 6.1 (current 6.8).