Odd issue I'm seeing with a SSD based ZFS pool:
I have a 3 week old pool of 4x850 Evo in a stripe of mirrored vdevs under the latest build of FreeNAS. It's running on an older LSI based onboard SAS controller flashed to IT mode, then a SFF 8087 split out cable. As soon as I yank my 16 1 TB SATA drives they'll get a newer SATA 6Gb controller + SAS backplane but for now they're running at SATA 3G speeds.
The very first time I powered them on i noticed that the detection order was odd - Three SSDs were detected sequentially, then all my spinning drives, then the last 850 Evo. It worked fine, and has ran flawlessly for the last 3 weeks.
Yesterday I restarted FreeNAS to run updates and it came back with one drive missing. I started an rsync to mirror that datastore off onto spinning disk until I could figure out WTF was going on. Thirty minutes or so into the copy I realized that the drive was back and working fine again. FreeNAS brought it right back into the pool and the pool returned to healthy status. Looking at the console of the VM you can see the drive pop in as if it were hot inserted.
I've power cycled the entire machine several times since then and each time the same results - One drive comes in at least a few minutes after boot. It's always the same drive, and once it's there it's fine until the next restart.
Where should I be looking for solutions to this? I'm going to replace the controller and all cables in a day or two, but it's odd to me that I don't see it drop out - It just seems like it takes it anywhere from 5 to 30 mins to start functioning after a restart, then it's completely fine.
Anybody seen anything like this? Any suggestions on what I should be googling that will result in useful data?
Viper GTS
I have a 3 week old pool of 4x850 Evo in a stripe of mirrored vdevs under the latest build of FreeNAS. It's running on an older LSI based onboard SAS controller flashed to IT mode, then a SFF 8087 split out cable. As soon as I yank my 16 1 TB SATA drives they'll get a newer SATA 6Gb controller + SAS backplane but for now they're running at SATA 3G speeds.
The very first time I powered them on i noticed that the detection order was odd - Three SSDs were detected sequentially, then all my spinning drives, then the last 850 Evo. It worked fine, and has ran flawlessly for the last 3 weeks.
Yesterday I restarted FreeNAS to run updates and it came back with one drive missing. I started an rsync to mirror that datastore off onto spinning disk until I could figure out WTF was going on. Thirty minutes or so into the copy I realized that the drive was back and working fine again. FreeNAS brought it right back into the pool and the pool returned to healthy status. Looking at the console of the VM you can see the drive pop in as if it were hot inserted.
I've power cycled the entire machine several times since then and each time the same results - One drive comes in at least a few minutes after boot. It's always the same drive, and once it's there it's fine until the next restart.
Where should I be looking for solutions to this? I'm going to replace the controller and all cables in a day or two, but it's odd to me that I don't see it drop out - It just seems like it takes it anywhere from 5 to 30 mins to start functioning after a restart, then it's completely fine.
Anybody seen anything like this? Any suggestions on what I should be googling that will result in useful data?
Viper GTS