I’ve heard of pigz, but it seems like it produces slightly larger files due to splitting the file up for processing. I’ve also heard it is rather inefficient, especially with RAM. Besides, that’s mainly for using multiple CPU threads to compress one file, and that isn’t really necessary here. Log files are almost certainly not going to be larger than a few megabytes, but there are potentially many of them.
Also, GNU Parallel is wonderful and should be installed on everything anyway. It can show progress bars with ETAs, output job logs, and even distribute work across multiple systems using SSH and rsync.
Last edited by Saklad5; 08-10-2018 at 01:34 PM.