Tuesday, 15 September 2015

linux - multi cpu core gzip a big file -



linux - multi cpu core gzip a big file -

how can utilize cpu cores in server(has 4 cores) linux debian on openvz gzipping faster one big file?

i trying utilize these commands can not set pieces together

get number of cores cores=$(grep -c '^processor' /proc/cpuinfo)

this split big file in more split -b100 file.big

this utilize gzip command multiple core find /source -type f -print0 | xargs -0 -n 1 -p $cores gzip --best

i don't know if best way optimize gzip process of big files..

use pigz, parallel gzip implementation.

unlike parallel gzip, pigz produces single gzip stream.

linux compression gzip cpu-cores

No comments:

Post a Comment