30 terabytes of data per night.

[TGS]

Originally posted by: spidey07

Originally posted by: tanishalfelven
i wouild honestly be more concerned about read/write speed. my hdd can barely manage 40 GB/s write. how the hell do you write 30 terabyted in one night.

Read the links I provided on storage. When the read/write speeds are spread over dozens of disks with multiple platters and all stored in the storage systems memory first you can achive very fast speeds.

The bottleneck winds up being the fibre channel adapter in the host. Not necessarily the physical disk.

High end storage arrays, are writting to massive amounts of staging cache before they even have the changed track data destaged to the physical disks. On top of which you take a high end storage device like a DMX 3, and you have a server farm filled with such units. You could easily have petabytes worth of storage available, with plenty of room to scale. When you achieve your intended performance benchmark on reads and writes, you then transfer the data to inexpensive disk systems for archival purposes. Something this large would either require backups to a secondary disk system, or massive tape silos.

 

[Skud]

I would think that the data (images) would be highly compressable. Even while using a lossless format.

If you think about it, one of the ways data is compressed is to replace multiple occurrances with one occurance..

And even though there is alot of stuff in the sky, there is still alot of black and white...

Riley