linux - multi cpu core gzip a big file -
how can utilize cpu cores in server(has 4 cores) linux debian on openvz gzipping faster one big file?
i trying utilize these commands can not set pieces together
get number of cores cores=$(grep -c '^processor' /proc/cpuinfo)
this split big file in more split -b100 file.big
this utilize gzip command multiple core find /source -type f -print0 | xargs -0 -n 1 -p $cores gzip --best
i don't know if best way optimize gzip process of big files..
use pigz
, parallel gzip implementation.
unlike parallel
gzip
, pigz
produces single gzip stream.
linux compression gzip cpu-cores
No comments:
Post a Comment