IOZone ZFS performance benchmark

On s01 with a ZFS layout like this one:
        atlashome
          raidz2 
            c0t0d0 c1t0d0 c4t0d0 c6t0d0 c7t0d0 c0t1d0 c1t1d0 c4t1d0 c5t1d0 c6t1d0 c7t1d0 c0t2d0 c1t2d0 c4t2d0 c5t2d0
          raidz2
            c6t2d0 c7t2d0 c0t3d0 c1t3d0 c4t3d0 c5t3d0 c6t3d0 c7t3d0 c0t4d0 c1t4d0 c4t4d0 c6t4d0 c7t4d0 c0t5d0 c1t5d0
          raidz2
            c4t5d0 c5t5d0 c6t5d0 c7t5d0 c0t6d0 c1t6d0 c4t6d0 c5t6d0 c6t6d0 c7t6d0 c0t7d0 c1t7d0 c4t7d0 c5t7d0 c6t7d0 c7t7d0

is benchmarked against s13 with a layout as this one:
        atlashome
          raidz1
            c0t0d0 c1t0d0 c5t0d0 c7t0d0 c8t0d0
          raidz1
            c0t1d0 c1t1d0 c5t1d0 c6t1d0 c7t1d0 c8t1d0
          raidz1
            c0t2d0 c1t2d0 c5t2d0 c6t2d0 c7t2d0 c8t2d0
          raidz1
            c0t3d0 c1t3d0 c5t3d0 c6t3d0 c7t3d0 c8t3d0
          raidz1
            c0t4d0 c1t4d0 c5t4d0 c6t4d0 c7t4d0 c8t4d0
          raidz1
            c0t5d0 c1t5d0 c5t5d0 c6t5d0 c7t5d0 c8t5d0
          raidz1
            c0t6d0 c1t6d0 c5t6d0 c6t6d0 c7t6d0 c8t6d0
          raidz1
            c0t7d0 c1t7d0 c5t7d0 c6t7d0 c7t7d0 c8t7d0

Command line

The iozone benchmark is run with the follwoing parameters: iozone -b /root/iozone-1.wks -R -e -s 2g -t 32 -M -r 128k -f /atlashome/carstenbench/iozone

Results

And the results are:

s01

Iozone: Performance Test of File I/O
                Version $Revision: 1.3 $
                Compiled for 32 bit mode.
                Build: Solaris

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million,
                     Jean-Marc Zucconi, Jeff Blomberg,
                     Erik Habbinga, Kris Strecker.

        Run began: Thu Feb  5 14:57:23 2009

        Excel chart generation enabled
        Include fsync in write timing
        File size set to 2097152 KB

        Machine = SunOS s01 5.10 Generic_137112-07 i86pc i386 i86pc
        Record Size 128 KB
        Command line used: iozone -b /root/iozone-1.wks -R -e -s 2g -t 32 -M -r 128k -f /atlashome/carstenbench/iozone
        Output is in Kbytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 Kbytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
        Throughput test with 32 processes
        Each process writes a 2097152 Kbyte file in 128 Kbyte records

        Children see throughput for 32 initial writers  =  303030.83 KB/sec
        Parent sees throughput for 32 initial writers   =  254853.29 KB/sec
        Min throughput per process                      =    8213.69 KB/sec
        Max throughput per process                      =   11158.59 KB/sec
        Avg throughput per process                      =    9469.71 KB/sec
        Min xfer                                        = 1592448.00 KB

        Children see throughput for 32 rewriters        =  297421.56 KB/sec
        Parent sees throughput for 32 rewriters         =  287962.40 KB/sec
        Min throughput per process                      =    7314.05 KB/sec
        Max throughput per process                      =   11513.37 KB/sec
        Avg throughput per process                      =    9294.42 KB/sec
        Min xfer                                        = 1359616.00 KB

        Children see throughput for 32 readers          =  582761.82 KB/sec
        Parent sees throughput for 32 readers           =  582564.54 KB/sec
        Min throughput per process                      =   14038.59 KB/sec
        Max throughput per process                      =   22704.21 KB/sec
        Avg throughput per process                      =   18211.31 KB/sec
        Min xfer                                        = 1296896.00 KB

        Children see throughput for 32 re-readers       =  588422.38 KB/sec
        Parent sees throughput for 32 re-readers        =  585008.27 KB/sec
        Min throughput per process                      =   14404.95 KB/sec
        Max throughput per process                      =   23449.97 KB/sec
        Avg throughput per process                      =   18388.20 KB/sec
        Min xfer                                        = 1281792.00 KB

        Children see throughput for 32 reverse readers  =  467907.16 KB/sec
        Parent sees throughput for 32 reverse readers   =  467714.43 KB/sec
        Min throughput per process                      =   13319.77 KB/sec
        Max throughput per process                      =   16940.78 KB/sec
        Avg throughput per process                      =   14622.10 KB/sec
        Min xfer                                        = 1649024.00 KB

        Children see throughput for 32 stride readers   =   78428.53 KB/sec
        Parent sees throughput for 32 stride readers    =   78380.81 KB/sec
        Min throughput per process                      =    2307.09 KB/sec
        Max throughput per process                      =    2634.90 KB/sec
        Avg throughput per process                      =    2450.89 KB/sec
        Min xfer                                        = 1836672.00 KB

        Children see throughput for 32 random readers   =   49504.08 KB/sec
        Parent sees throughput for 32 random readers    =   49501.33 KB/sec
        Min throughput per process                      =    1491.76 KB/sec
        Max throughput per process                      =    1599.05 KB/sec
        Avg throughput per process                      =    1547.00 KB/sec
        Min xfer                                        = 1956480.00 KB

        Children see throughput for 32 random mix       =  251974.78 KB/sec
        Parent sees throughput for 32 random mix        =  221624.68 KB/sec
        Min throughput per process                      =    1023.33 KB/sec
        Max throughput per process                      =   16551.95 KB/sec
        Avg throughput per process                      =    7874.21 KB/sec
        Min xfer                                        =  129664.00 KB

        Children see throughput for 32 random writers   =  256973.55 KB/sec
        Parent sees throughput for 32 random writers    =  153659.88 KB/sec
        Min throughput per process                      =    5599.82 KB/sec
        Max throughput per process                      =   14509.78 KB/sec
        Avg throughput per process                      =    8030.42 KB/sec
        Min xfer                                        =  897408.00 KB

"Throughput report Y-axis is type of test X-axis is number of processes"
"Record size = 128 Kbytes "
"Output is in Kbytes/sec"

"  Initial write " 303030.83
"        Rewrite " 297421.56
"           Read " 582761.82
"        Re-read " 588422.38
"   Reverse Read " 467907.16
"    Stride read "  78428.53
"    Random read "  49504.08
"     Random mix " 251974.78
"   Random write " 256973.55

s13

        Iozone: Performance Test of File I/O
                Version $Revision: 1.3 $
                Compiled for 32 bit mode.
                Build: Solaris

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million,
                     Jean-Marc Zucconi, Jeff Blomberg,
                     Erik Habbinga, Kris Strecker.

        Run began: Thu Feb  5 13:58:40 2009

        Excel chart generation enabled
        Include fsync in write timing
        File size set to 2097152 KB

        Machine = SunOS s13 5.10 Generic_137138-09 i86pc i386 i86pc
        Record Size 128 KB
        Command line used: /root/iozone -b /root/iozone-13.wks -R -e -s 2g -t 32 -M -r 128k -f /atlashome/bench/iozone
        Output is in Kbytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 Kbytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
        Throughput test with 32 processes
        Each process writes a 2097152 Kbyte file in 128 Kbyte records

        Children see throughput for 32 initial writers  =  644723.93 KB/sec
        Parent sees throughput for 32 initial writers   =  435545.44 KB/sec
        Min throughput per process                      =   14243.83 KB/sec
        Max throughput per process                      =   29925.00 KB/sec
        Avg throughput per process                      =   20147.62 KB/sec
        Min xfer                                        =  984960.00 KB

        Children see throughput for 32 rewriters        =  666201.70 KB/sec
        Parent sees throughput for 32 rewriters         =  651618.36 KB/sec
        Min throughput per process                      =   17246.33 KB/sec
        Max throughput per process                      =   25629.38 KB/sec
        Avg throughput per process                      =   20818.80 KB/sec
        Min xfer                                        = 1417728.00 KB

        Children see throughput for 32 readers          =  962098.59 KB/sec
        Parent sees throughput for 32 readers           =  961521.04 KB/sec
        Min throughput per process                      =   22862.14 KB/sec
        Max throughput per process                      =   45255.91 KB/sec
        Avg throughput per process                      =   30065.58 KB/sec
        Min xfer                                        = 1060096.00 KB

        Children see throughput for 32 re-readers       =  991434.28 KB/sec
        Parent sees throughput for 32 re-readers        =  987321.00 KB/sec
        Min throughput per process                      =   22891.90 KB/sec
        Max throughput per process                      =   40989.84 KB/sec
        Avg throughput per process                      =   30982.32 KB/sec
        Min xfer                                        = 1171328.00 KB

        Children see throughput for 32 reverse readers  = 1041276.87 KB/sec
        Parent sees throughput for 32 reverse readers   = 1040907.96 KB/sec
        Min throughput per process                      =   23385.75 KB/sec
        Max throughput per process                      =   43736.88 KB/sec
        Avg throughput per process                      =   32539.90 KB/sec
        Min xfer                                        = 1121664.00 KB

        Children see throughput for 32 stride readers   =  413532.63 KB/sec
        Parent sees throughput for 32 stride readers    =  411907.72 KB/sec
        Min throughput per process                      =   11896.62 KB/sec
        Max throughput per process                      =   15152.88 KB/sec
        Avg throughput per process                      =   12922.89 KB/sec
        Min xfer                                        = 1646976.00 KB

        Children see throughput for 32 random readers   =  192450.23 KB/sec
        Parent sees throughput for 32 random readers    =  192437.56 KB/sec
        Min throughput per process                      =    5880.06 KB/sec
        Max throughput per process                      =    6142.64 KB/sec
        Avg throughput per process                      =    6014.07 KB/sec
        Min xfer                                        = 2007552.00 KB

        Children see throughput for 32 random mix       =  681287.70 KB/sec
        Parent sees throughput for 32 random mix        =  619076.79 KB/sec
        Min throughput per process                      =    1809.51 KB/sec
        Max throughput per process                      =   44995.99 KB/sec
        Avg throughput per process                      =   21290.24 KB/sec
        Min xfer                                        =   84224.00 KB

        Children see throughput for 32 random writers   =  664852.25 KB/sec
        Parent sees throughput for 32 random writers    =  524740.65 KB/sec
        Min throughput per process                      =   16825.80 KB/sec
        Max throughput per process                      =   26932.96 KB/sec
        Avg throughput per process                      =   20776.63 KB/sec
        Min xfer                                        = 1356160.00 KB

"Throughput report Y-axis is type of test X-axis is number of processes"
"Record size = 128 Kbytes "
"Output is in Kbytes/sec"

"  Initial write " 644723.93
"        Rewrite " 666201.70
"           Read " 962098.59
"        Re-read " 991434.28
"   Reverse Read "1041276.87
"    Stride read " 413532.63
"    Random read " 192450.23
"     Random mix " 681287.70
"   Random write " 664852.25

graphical comparison

  • iozone-comparison-s01-s13.png:
    iozone-comparison-s01-s13.png

-- CarstenAulbert - 05 Feb 2009

Topic attachments
I Attachment Action Size Date Who Comment
explorer.0b65ce3c.s13-2009.02.16.09.28.tar.gzgz explorer.0b65ce3c.s13-2009.02.16.09.28.tar.gz manage 968 K 16 Feb 2009 - 10:54 CarstenAulbert Explorer host s13 (new vdev structure)
explorer.2246e302.s05-2009.02.16.10.39.tar.gzgz explorer.2246e302.s05-2009.02.16.10.39.tar.gz manage 1 MB 16 Feb 2009 - 10:54 CarstenAulbert Explorer host s05 (old vdev structure - equivalent to s01)
iozone-comparison-s01-s13.pngpng iozone-comparison-s01-s13.png manage 25 K 05 Feb 2009 - 15:17 CarstenAulbert  
Topic revision: r3 - 24 Apr 2012, CarstenAulbert
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback