Runnning bonnie++ on a head node in various configurations

Headnode parts:
  • dual socket, quad-core CPUs (E5342)
  • 16 GB RAM
  • Areca 1261ML
  • 4 or 8 Hitachi UltraStar 750GB drives

Tests performed

4 disks, RAID6

single process

Version 1.03d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
h4              32G 77218  99 113092  11 48936   6 72405  86 122947   9 315.7   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 24652  97 +++++ +++ 24591  99 25995  96 +++++ +++ 23283  95
h4,32G,77218,99,113092,11,48936,6,72405,86,122947,9,315.7,0,16,24652,97,+++++,+++,24591,99,25995,96,+++++,+++,23283,95

4 processes

h4,32G,24423,32,24065,4,8446,1,14806,19,14881,1,73.3,0,16,6545,29,+++++,+++,6435,32,3559,17,+++++,+++,6107,30
h4,32G,25115,32,24095,4,8461,1,14898,18,14905,1,73.0,0,16,6488,34,+++++,+++,6411,30,6343,36,+++++,+++,5200,27
h4,32G,24277,33,24021,4,8459,1,14836,19,14891,1,74.6,0,16,6342,32,+++++,+++,6477,35,6007,25,+++++,+++,3320,22
h4,32G,25121,32,24587,4,8444,1,14796,18,14872,1,74.3,0,16,6477,28,+++++,+++,6380,36,6471,30,+++++,+++,3314,19

8 disks, RAID6 + RAID6

single process

Stripe size 4kB:
Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
h4              32G 77489  99 115104  11 51285   7 71091  86 130646   9 219.0   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 26206  94 +++++ +++ 24056  99 26709 101 +++++ +++ 23437  98
h4,32G,77489,99,115104,11,51285,7,71091,86,130646,9,219.0,0,16,26206,94,+++++,+++,24056,99,26709,101,+++++,+++,23437,98
Stripe size 64kB:
Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
h4              32G 69961  89 115677  11 51757   7 69763  86 131715   9 358.8   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 25197  99 +++++ +++ 25014 100 25088  99 +++++ +++ 23463 100
h4,32G,69961,89,115677,11,51757,7,69763,86,131715,9,358.8,0,16,25197,99,+++++,+++,25014,100,25088,99,+++++,+++,23463,100

4 processes (2 on each RAID6)

First two are with 4kB, last two with 64 kB stripe size
h4,32G,41127,54,43171,6,16163,3,30384,39,31783,3,81.6,0,16,10852,56,+++++,+++,10555,55,9331,46,+++++,+++,8950,53
h4,32G,42166,55,43207,6,16162,3,30431,39,31849,3,81.5,0,16,10970,44,+++++,+++,10602,53,9293,56,+++++,+++,8904,44
h4,32G,39436,52,43523,6,16155,3,30599,39,31783,3,118.4,0,16,11009,49,+++++,+++,11156,51,11097,47,+++++,+++,9301,47
h4,32G,40261,52,44980,7,16198,3,30334,40,31797,3,118.4,0,16,11109,56,+++++,+++,11012,53,10977,51,+++++,+++,9138,46

8 disks, RAID6

single process

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
h4              32G 77126  98 334727  32 143819  20 71603  87 462015  36 386.8   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 24974  99 +++++ +++ 24829 100 24816  98 +++++ +++ 23593  97
h4,32G,77126,98,334727,32,143819,20,71603,87,462015,36,386.8,0,16,24974,99,+++++,+++,24829,100,24816,98,+++++,+++,23593,97

four processes

h4,32G,73706,96,64258,11,28224,6,47617,62,52237,5,88.9,0,16,6508,32,+++++,+++,6529,32,6512,31,+++++,+++,5740,30
h4,32G,73545,96,63494,10,27908,6,47089,62,51784,5,89.1,0,16,6448,29,+++++,+++,6578,35,6481,31,+++++,+++,5902,33
h4,32G,75608,97,64917,11,27890,6,47356,62,51749,5,90.7,0,16,6409,32,+++++,+++,6621,35,6498,28,+++++,+++,5811,34
h4,32G,75368,98,63503,11,27965,6,47285,62,51838,5,89.8,0,16,6463,33,+++++,+++,6489,32,6529,34,+++++,+++,5743,35

Summary

Single Process

Setup Sequential Output Sequential Input Random Seeks Sequential Create Random Create
# disks /Chr Block Rewrite /Chr Block Seeks Create Read Delete Create Read Delete
(stripe[kB]) K/s CPU K/s CPU K/s CPU K/s CPU K/s CPU K/s CPU /s CPU /s CPU /s CPU /s CPU /s CPU /s CPU
A 77218 99 113092 11 48936 6 72405 86 122947 9 315.7 0 24652 97 +++++ +++ 24591 99 25995 96 +++++ +++ 23283 95
B 77489 99 115104 11 51285 7 71091 86 130646 9 219.0 0 26206 94 +++++ +++ 24056 99 26709 101 +++++ +++ 23437 98
C 69961 89 115677 11 51757 7 69763 86 131715 9 358.8 0 25197 99 +++++ +++ 25014 100 25088 99 +++++ +++ 23463 100
D 77126 98 334727 32 143819 20 71603 87 462015 36 386.8 0 24974 99 +++++ +++ 24829 100 24816 98 +++++ +++ 23593 97

4 Processes

Setup Sequential Output Sequential Input Random Seeks Sequential Create Random Create
# disks /Chr Block Rewrite /Chr Block Seeks Create Read Delete Create Read Delete
(stripe[kB]) K/s CPU K/s CPU K/s CPU K/s CPU K/s CPU K/s CPU /s CPU /s CPU /s CPU /s CPU /s CPU /s CPU
A 98936 129 96768 16 33810 4 59336 74 59549 4 295.2 - 25852 123 - - 25703 133 22380 108 - - 17941 98
B+C 162990 213 174881 25 64678 12 121748 157 127212 12 399.9 - 43940 205 - - 43325 212 40698 200 - - 36293 190
D 298227 387 256172 43 111987 24 189347 248 207608 20 358.5 - 25828 126 - - 26217 134 26020 124 - - 23196 132

Setup

A
4 disks, RAID6, 16kB stripe
B
4 disks, RAID6, 4kB stripe
C
4 disks, RAID6, 64kB stripe
D
8 disks, RAID6, 4kB stripe
-- CarstenAulbert - 29 Nov 2008
Topic revision: r14 - 02 Dec 2008, CarstenAulbert
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback