 |
|
You are here: Foswiki>ATLAS Web>ZpoolTests2017 (22 Nov 2017, CarstenAulbert)Edit Attach
Simple zpool tests on w8501
raidz1
zpool created as 8*(2+1) raidz1:
zpool status
pool: srv
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
srv ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy0-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy1-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy10-lun-0 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy11-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy2-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy28-lun-0 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy29-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy3-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy30-lun-0 ONLINE 0 0 0
raidz1-3 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy31-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy32-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy33-lun-0 ONLINE 0 0 0
raidz1-4 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy34-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy35-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy36-lun-0 ONLINE 0 0 0
raidz1-5 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy37-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy38-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy39-lun-0 ONLINE 0 0 0
raidz1-6 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy4-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy5-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy6-lun-0 ONLINE 0 0 0
raidz1-7 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy7-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy8-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy9-lun-0 ONLINE 0 0 0
logs
nvme0n1p1 ONLINE 0 0 0
Initially filled with 100 16 GByte large files in at around 2.2GByte/s (728s). Data distribution after initial fill (zpool iostat -v|grep raidz):
raidz1 298G 16.0T 0 1.05K 15.3K 125M raidz1 296G 16.0T 0 1.05K 15.2K 124M raidz1 299G 16.0T 0 1.05K 15.0K 124M raidz1 297G 16.0T 0 1.05K 14.4K 124M raidz1 293G 16.0T 0 1.03K 14.3K 122M raidz1 302G 16.0T 0 1.06K 14.8K 126M raidz1 296G 16.0T 0 1.04K 15.0K 123M raidz1 296G 16.0T 0 1.04K 15.4K 123MForce drive to resilver:
zpool offline srv pci-0000:01:00.0-sas-exp0x500304801813363f-phy32-lun-0 zpool export srv zpool labelclear -f pci-0000:01:00.0-sas-exp0x500304801813363f-phy32-lun-0 zpool import srv zpool replace srv pci-0000:01:00.0-sas-exp0x500304801813363f-phy32-lun-0While resilvering was underway, creating 10 and 25 files new files yield a write speed of 855MB/s and 787MB/s respectively.
Mirrored set-up
pool: work
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
work ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy0-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy1-lun-0 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy10-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy11-lun-0 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy2-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy28-lun-0 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy29-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy3-lun-0 ONLINE 0 0 0
mirror-4 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy30-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy31-lun-0 ONLINE 0 0 0
mirror-5 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy32-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy33-lun-0 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy34-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy35-lun-0 ONLINE 0 0 0
mirror-7 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy36-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy37-lun-0 ONLINE 0 0 0
mirror-8 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy38-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy39-lun-0 ONLINE 0 0 0
mirror-9 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy4-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy5-lun-0 ONLINE 0 0 0
mirror-10 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy6-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy7-lun-0 ONLINE 0 0 0
mirror-11 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy8-lun-0 ONLINE 0 0 0
pci-0000:01:00.0-sas-exp0x500304801813363f-phy9-lun-0 ONLINE 0 0 0
logs
nvme0n1p1 ONLINE 0 0 0
For this set-up the initial write time was 802s (1995MB/s) (system was more idle during the process, about 47% instead of 15% during raidz1 test).
During resilvering (this time with detach/attach) the write rates were 231s (692MB/s) and 641s (624MB/s) for 10 and 25 files respectively.
raidz2 (6+2)
Initial filling already took 1107s (1445MB/s) -- CarstenAulbert - 22 Nov 2017Edit | Attach | Print version | History: r1 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r1 - 22 Nov 2017, CarstenAulbert
ATLAS
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback