Data deduplication software?

[Jeff7181]

Does anyone know of a simple piece of software that does data deduplication? What I'm looking for is something that basically creates a share that you can write data to, and it dedupes against all other data in the share. Block level deduplication would be preferable.

 

[Emulex]

ZFS assuming you want cheap.

 

[Phynaz]

How about a little more info...This for home? Small business? Enterprise Business?

What hardware do you have? Operating systems?

 

[ForumMaster]

you can read this link.

frankly, i think dedicated hardware will probably be more efficient, although obviously more expensive. we use EMC's DataDomain.

 

[Jeff7181]

I'm looking at something geared more toward SOHO/consumer level. I'm running Server 2008 R2 (VMWare ESXi guest) and would like to have Windows clients (specifically Windows 7) writing to the share, but I suppose I could get around having multiple clients write to the share by having them write to a standard network share and having a process run on the server to move the data to a "deduplication share."

Does Windows Storage Server do deduplication? I have access to that via technet...

 

[corkyg]

This is also a worthwhile read . . . http://blogs.sun.com/bonwick/entry/zfs_dedup

 

[MerlinRML]

Windows Storage Server can do single instance storage. It's deduplication done at the file level, as opposed to the lower-level approaches of taking portions of a file or even individual blocks.

I wanted to try it out and see how well it worked, but I never quite got that far...

 

[Jeff7181]

Windows Storage Server can do single instance storage. It's deduplication done at the file level, as opposed to the lower-level approaches of taking portions of a file or even individual blocks.

I wanted to try it out and see how well it worked, but I never quite got that far...

Sounds like a less effective method, but with lower overhead.

*EDIT* Actually looks like it's the same technology that was used in WHS v1, but file level rather than block level.