Tip: ontape + gzip parallel compress

Hi people, This is a tip for who work with multi-core Linux machines, have a good I/O (fast) and want try improve the ontape time of your backups. I executed some tests with the PIGZ - parallel implementation of gzip . http://www.zlib.net/pigz/ This program use the advantage of multi-cores to compacting . In a test environment, where I have a 8 cores with 2 threads each (16 cpus from linux point of view) running red hat, with emc storage where I got  I/O average of 280MB/s  and an archive without compact of 280GB . Running just with ontape : 45 minutes Running with ontape + gzip -1 (fast compact):  1h15m Running with ontape + pigz -1 (fast compact),: 35 minutes (using the 16 cores and blocks of 1MB) time ontape -s -L 0 -v -t STDIO | pigz -1c -b 1024 > archive.L0.gz .... real 35m21.294s The generated file is 100% gzip , with size of 67 GB . Regards Cesar

Great stuff. Have you tested a restore using the same? I'd be curious how that goes, since the restore will be the most time critical process if and when it's used. Nick

Hi Nick, I just uncompress (with gzip and pigz) the file and checked with md5sum and archecker , don't execute the complete process of restore, yet. Check the IIUG forum : http://www.iiug.org/forums/ids/index.cgi/noframes/read/21476 I got a feedback from other guy what already use the pigz with Informix. I'm still testing it . Regards Cesar --- Em qua, 29/9/10, Nick <milesnmiles@gmail.com> escreveu: De: Nick <milesnmiles@gmail.com> Assunto: Re: Tip: ontape + gzip parallel compress Para: informix-list@iiug.org Data: Quarta-feira, 29 de Setembro de 2010, 18:17 Great stuff.  Have you tested a restore using the same? I'd be curious how that goes, since the restore will be the most time critical process if and when it's used. Nick _______________________________________________ Informix-list mailing list Informix-list@iiug.org http://www.iiug.org/mailman/listinfo/informix-list