I've recently written a small piece of software which I've open-sourced and decided to host on codeplex. The address for this application is ...

Big Data is making life increasingly complicated for lawyers. In ediscovery, a big part of the challenge is simply eliminating duplicate copies of stuff – emails, Word documents, spreadsheets, files, ...

Are there any open-source, block-level de-duplication applications out there? <BR><BR>I have a friend who works for a non-profit with lots and lots of data that would be very de-dupe friendly, but ...