Runnning bonnie++ on a head node in various configurations
Headnode parts:
- dual socket, quad-core CPUs (E5342)
- 16 GB RAM
- Areca 1261ML
- 4 or 8 Hitachi UltraStar 750GB drives
4 disks, RAID6
single process
Version 1.03d ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
h4 32G 77218 99 113092 11 48936 6 72405 86 122947 9 315.7 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 24652 97 +++++ +++ 24591 99 25995 96 +++++ +++ 23283 95
h4,32G,77218,99,113092,11,48936,6,72405,86,122947,9,315.7,0,16,24652,97,+++++,+++,24591,99,25995,96,+++++,+++,23283,95
4 processes
h4,32G,24423,32,24065,4,8446,1,14806,19,14881,1,73.3,0,16,6545,29,+++++,+++,6435,32,3559,17,+++++,+++,6107,30
h4,32G,25115,32,24095,4,8461,1,14898,18,14905,1,73.0,0,16,6488,34,+++++,+++,6411,30,6343,36,+++++,+++,5200,27
h4,32G,24277,33,24021,4,8459,1,14836,19,14891,1,74.6,0,16,6342,32,+++++,+++,6477,35,6007,25,+++++,+++,3320,22
h4,32G,25121,32,24587,4,8444,1,14796,18,14872,1,74.3,0,16,6477,28,+++++,+++,6380,36,6471,30,+++++,+++,3314,19
8 disks, RAID6 + RAID6
single process
Stripe size 4kB:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
h4 32G 77489 99 115104 11 51285 7 71091 86 130646 9 219.0 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 26206 94 +++++ +++ 24056 99 26709 101 +++++ +++ 23437 98
h4,32G,77489,99,115104,11,51285,7,71091,86,130646,9,219.0,0,16,26206,94,+++++,+++,24056,99,26709,101,+++++,+++,23437,98
Stripe size 64kB:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
h4 32G 69961 89 115677 11 51757 7 69763 86 131715 9 358.8 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 25197 99 +++++ +++ 25014 100 25088 99 +++++ +++ 23463 100
h4,32G,69961,89,115677,11,51757,7,69763,86,131715,9,358.8,0,16,25197,99,+++++,+++,25014,100,25088,99,+++++,+++,23463,100
4 processes (2 on each RAID6)
First two are with 4kB, last two with 64 kB stripe size
h4,32G,41127,54,43171,6,16163,3,30384,39,31783,3,81.6,0,16,10852,56,+++++,+++,10555,55,9331,46,+++++,+++,8950,53
h4,32G,42166,55,43207,6,16162,3,30431,39,31849,3,81.5,0,16,10970,44,+++++,+++,10602,53,9293,56,+++++,+++,8904,44
h4,32G,39436,52,43523,6,16155,3,30599,39,31783,3,118.4,0,16,11009,49,+++++,+++,11156,51,11097,47,+++++,+++,9301,47
h4,32G,40261,52,44980,7,16198,3,30334,40,31797,3,118.4,0,16,11109,56,+++++,+++,11012,53,10977,51,+++++,+++,9138,46
8 disks, RAID6
single process
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
h4 32G 77126 98 334727 32 143819 20 71603 87 462015 36 386.8 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 24974 99 +++++ +++ 24829 100 24816 98 +++++ +++ 23593 97
h4,32G,77126,98,334727,32,143819,20,71603,87,462015,36,386.8,0,16,24974,99,+++++,+++,24829,100,24816,98,+++++,+++,23593,97
four processes
h4,32G,73706,96,64258,11,28224,6,47617,62,52237,5,88.9,0,16,6508,32,+++++,+++,6529,32,6512,31,+++++,+++,5740,30
h4,32G,73545,96,63494,10,27908,6,47089,62,51784,5,89.1,0,16,6448,29,+++++,+++,6578,35,6481,31,+++++,+++,5902,33
h4,32G,75608,97,64917,11,27890,6,47356,62,51749,5,90.7,0,16,6409,32,+++++,+++,6621,35,6498,28,+++++,+++,5811,34
h4,32G,75368,98,63503,11,27965,6,47285,62,51838,5,89.8,0,16,6463,33,+++++,+++,6489,32,6529,34,+++++,+++,5743,35
Summary
Single Process
Setup |
Sequential Output |
Sequential Input |
Random Seeks |
Sequential Create |
Random Create |
# disks |
/Chr |
Block |
Rewrite |
/Chr |
Block |
Seeks |
Create |
Read |
Delete |
Create |
Read |
Delete |
(stripe[kB]) |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
A |
77218 |
99 |
113092 |
11 |
48936 |
6 |
72405 |
86 |
122947 |
9 |
315.7 |
0 |
24652 |
97 |
+++++ |
+++ |
24591 |
99 |
25995 |
96 |
+++++ |
+++ |
23283 |
95 |
B |
77489 |
99 |
115104 |
11 |
51285 |
7 |
71091 |
86 |
130646 |
9 |
219.0 |
0 |
26206 |
94 |
+++++ |
+++ |
24056 |
99 |
26709 |
101 |
+++++ |
+++ |
23437 |
98 |
C |
69961 |
89 |
115677 |
11 |
51757 |
7 |
69763 |
86 |
131715 |
9 |
358.8 |
0 |
25197 |
99 |
+++++ |
+++ |
25014 |
100 |
25088 |
99 |
+++++ |
+++ |
23463 |
100 |
D |
77126 |
98 |
334727 |
32 |
143819 |
20 |
71603 |
87 |
462015 |
36 |
386.8 |
0 |
24974 |
99 |
+++++ |
+++ |
24829 |
100 |
24816 |
98 |
+++++ |
+++ |
23593 |
97 |
4 Processes
Setup |
Sequential Output |
Sequential Input |
Random Seeks |
Sequential Create |
Random Create |
# disks |
/Chr |
Block |
Rewrite |
/Chr |
Block |
Seeks |
Create |
Read |
Delete |
Create |
Read |
Delete |
(stripe[kB]) |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
K/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
/s |
CPU |
A |
98936 |
129 |
96768 |
16 |
33810 |
4 |
59336 |
74 |
59549 |
4 |
295.2 |
- |
25852 |
123 |
- |
- |
25703 |
133 |
22380 |
108 |
- |
- |
17941 |
98 |
B+C |
162990 |
213 |
174881 |
25 |
64678 |
12 |
121748 |
157 |
127212 |
12 |
399.9 |
- |
43940 |
205 |
- |
- |
43325 |
212 |
40698 |
200 |
- |
- |
36293 |
190 |
D |
298227 |
387 |
256172 |
43 |
111987 |
24 |
189347 |
248 |
207608 |
20 |
358.5 |
- |
25828 |
126 |
- |
- |
26217 |
134 |
26020 |
124 |
- |
- |
23196 |
132 |
Setup
- A
- 4 disks, RAID6, 16kB stripe
- B
- 4 disks, RAID6, 4kB stripe
- C
- 4 disks, RAID6, 64kB stripe
- D
- 8 disks, RAID6, 4kB stripe
--
CarstenAulbert - 29 Nov 2008