SQLDump tests for Einstein@home

On einstein-db1 the following was found:

# no compresion
/usr/bin/mysqldump --opt --master-data=2 EinsteinAtHome | mbuffer > /dev/null
in @ 90.3 MB/s, out @ 90.3 MB/s, 56.3 GB total, buffer   0% full
summary: 56.4 GByte in 19 min 10.9 sec - average of 50.1 MB/s

# gzip
root@einstein-db1:~# /usr/bin/mysqldump --opt --master-data=2 EinsteinAtHome | gzip -c | mbuffer > /dev/null
in @ 5754 kB/s, out @ 5754 kB/s, 5264 MB total, buffer   0% full
summary: 5266 MByte in 15 min 57.6 sec - average of 5631 kB/s

# bzip2, NOT use, stopped 
 /usr/bin/mysqldump --opt --master-data=2 EinsteinAtHome | pbzip2 -9 -p4 -c | mbuffer > /dev/null
in @  0.0 kB/s, out @  0.0 kB/s, 2054 MB total, buffer   0% full^C
 *Control-C or similar caught [sig=2], quitting...
Terminator thread: premature exit requested - quitting...

summary: 2054 MByte in 1 h 07 min  518 kB/s
mbuffer: warning: error during output to <stdout>: canceled

# parallel gzip
root@einstein-db1:~# /usr/bin/mysqldump --opt --master-data=2 EinsteinAtHome | pigz --best -p 4 -c | mbuffer > /dev/null
in @ 9654 kB/s, out @ 9654 kB/s, 5091 MB total, buffer   0% full
summary: 5093 MByte in 10 min 22.1 sec - average of 8384 kB/s

-- CarstenAulbert - 24 Jul 2014

This topic: ATLAS > WebHome > SqlDumpEinsteinAtHome
Topic revision: 24 Jul 2014, CarstenAulbert
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback