[Zlib-devel] Zlib-devel Digest, Vol 37, Issue 2

[David F. Bakker]

Cool. I just got my quad core installed. This will give me something to
play with.

-David


-----Original Message-----
From: zlib-devel-bounces at madler.net
[mailto:zlib-devel-bounces at madler.net] On Behalf Of
zlib-devel-request at madler.net
Sent: Monday, February 26, 2007 12:00 PM
To: zlib-devel at madler.net
Subject: Zlib-devel Digest, Vol 37, Issue 2

Send Zlib-devel mailing list submissions to
	zlib-devel at madler.net

To subscribe or unsubscribe via the World Wide Web, visit
	http://madler.net/mailman/listinfo/zlib-devel_madler.net
or, via email, send a message with subject or body 'help' to
	zlib-devel-request at madler.net

You can reach the person managing the list at
	zlib-devel-owner at madler.net

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Zlib-devel digest..."


Today's Topics:

   1. Parallel gzip (Mark Adler)
   2. Re: Parallel gzip (Greg Roelofs)
   3. Re: Parallel gzip (Mark Adler)


----------------------------------------------------------------------

Message: 1
Date: Sun, 25 Feb 2007 22:57:18 -0800
From: Mark Adler <madler at alumni.caltech.edu>
Subject: [Zlib-devel] Parallel gzip
To: zlib-devel at zlib.net
Message-ID: <63620D94-7F0D-4F42-9999-98C2A725EBBF at alumni.caltech.edu>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed

All,

I have written a parallel implementation of gzip called pigz  
(pronounced "pigs").  It does compression over multiple threads in  
order to make use of multiple processors and/or cores.  If you would  
like to test it, you can get it here:

     http://zlib.net/pigz13.c

It should be linked with zlib 1.2.3 and a pthread library.  (This may  
require a -lpthread on the compile command.)

If you do test it, let me know how it goes.  Thanks.

Mark




------------------------------

Message: 2
Date: Mon, 26 Feb 2007 07:59:26 -0800
From: Greg Roelofs <newt at pobox.com>
Subject: Re: [Zlib-devel] Parallel gzip
To: zlib-devel at zlib.net
Message-ID: <200702261559.l1QFxQR5031315 at bolt.sonic.net>

>      http://zlib.net/pigz13.c

s/concantenated/concatenated/
s/calcuation/calculation/

If you give it lots of sub-128KB files on the command line, does it
do them in parallel, or is the parallelism good only for large files?
(I'm guessing the latter.)

Greg



------------------------------

Message: 3
Date: Mon, 26 Feb 2007 08:51:50 -0800
From: Mark Adler <madler at alumni.caltech.edu>
Subject: Re: [Zlib-devel] Parallel gzip
To: zlib-devel at zlib.net
Message-ID: <0D4653A2-65B6-4074-98A6-0E6062D24770 at alumni.caltech.edu>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed

On Feb 26, 2007, at 7:59 AM, Greg Roelofs wrote:
> If you give it lots of sub-128KB files on the command line, does it
> do them in parallel, or is the parallelism good only for large files?


The parallelism is only good for large files.  I might add the  
ability to do multiple files at the same time.

Mark




------------------------------

_______________________________________________
Zlib-devel mailing list
Zlib-devel at madler.net
http://madler.net/mailman/listinfo/zlib-devel_madler.net


End of Zlib-devel Digest, Vol 37, Issue 2
*****************************************