mpibzip2 - parallel bzip2 for cluster machines
Posted by Sachin Garg on 20th August 2007 | Permanent Link
Jeff Gilchrist has released mpibzip2, a parallel implementation of the popular bzip2 block-sorting file compressor that uses MPI and achieves significant speedup on cluster machines.
Similar to his pbzip2 multi-threaded bzip2, the output is fully compatible with bzip2. The results show a near linear speed-up for upto 30 nodes.
Source code is available under BSD style license.