测试环境 :
测试结果 :
/dev/rbd0 985G 72M 935G 1% /ceph
网卡带宽 : 10GB*2 bond
ceph 服务端， SSD 1G 吞吐量.
fs ext4测试结果 :
32KB块顺序、随机读延迟0.37毫秒，顺序、随机写延迟1.8毫秒。
$./iozone -Ra -I -+u -y 32k -q 16m -g 2G -n 2G -f /ceph/iozonetest/test -b /ceph/iozonetest/test.wks
Iozone: Performance Test of File I/O
Version $Revision: 3.434 $
Compiled for 64 bit mode.
Build: linux-AMD64
Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
Al Slater, Scott Rhine, Mike Wisner, Ken Goss
Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
Vangel Bojaxhi, Ben England, Vikentsi Lapa,
Alexey Skidanov.
Run began: Wed Dec 2 13:04:44 2015
Excel chart generation enabled
Auto Mode
O_DIRECT feature enabled
CPU utilization Resolution = 0.001 seconds.
CPU utilization Excel chart enabled
Using Minimum Record Size 32 kB
Using Maximum Record Size 16384 kB
Using maximum file size of 2097152 kilobytes.
Using minimum file size of 2097152 kilobytes.
Command line used: ./iozone -Ra -I -+u -y 32k -q 16m -g 2G -n 2G -f /ceph/iozonetest/test -b /ceph/iozonetest/test.wks
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
2097152 32 16837 17330 82042 82292 86115 17769 81825 16464 81260 1507394 1858269 5789863 5915555
2097152 64 25942 26311 113004 113826 117864 27524 113007 27850 118204 1509605 1904657 6098285 6123482
2097152 128 43516 43060 188937 194879 191912 46021 192163 43341 191418 1578785 1932914 6312027 6264903
2097152 256 61213 60939 255776 278176 275277 67895 274584 67193 272133 1568071 1897452 5675540 5758181
2097152 512 83586 89019 308476 358444 363983 106371 368574 109011 360477 1607116 1882729 5848163 5896623
2097152 1024 122570 142160 284832 340925 449685 158097 253670 162425 390532 1490313 1798201 5991808 6019572
2097152 2048 92152 99509 293267 296896 318353 105191 332447 94433 266747 1393140 1635588 5859308 5922936
2097152 4096 121253 135114 511027 635880 648796 130120 657575 160099 652214 1322685 1543500 5927219 5984612
2097152 8192 151559 160201 701197 806772 814461 166572 826014 188116 828550 1223658 1410437 5810509 5878115
2097152 16384 199821 198856 728265 856718 856336 211464 840417 284697 851910 1187476 1365279 3363126 3374643
iozone test complete.
Excel output is below:
"Writer report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 16837 25942 43516 61213 83586 122570 92152 121253 151559 199821
"Re-writer report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 17330 26311 43060 60939 89019 142160 99509 135114 160201 198856
"Reader report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 82042 113004 188937 255776 308476 284832 293267 511027 701197 728265
"Re-Reader report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 82292 113826 194879 278176 358444 340925 296896 635880 806772 856718
"Random read report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 86115 117864 191912 275277 363983 449685 318353 648796 814461 856336
"Random write report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 17769 27524 46021 67895 106371 158097 105191 130120 166572 211464
"Backward read report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 81825 113007 192163 274584 368574 253670 332447 657575 826014 840417
"Record rewrite report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 16464 27850 43341 67193 109011 162425 94433 160099 188116 284697
"Stride read report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 81260 118204 191418 272133 360477 390532 266747 652214 828550 851910
"Fwrite report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1507394 1509605 1578785 1568071 1607116 1490313 1393140 1322685 1223658 1187476
"Re-Fwrite report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1858269 1904657 1932914 1897452 1882729 1798201 1635588 1543500 1410437 1365279
"Fread report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 5789863 6098285 6312027 5675540 5848163 5991808 5859308 5927219 5810509 3363126
"Re-Fread report"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 5915555 6123482 6264903 5758181 5896623 6019572 5922936 5984612 5878115 3374643
"Writer CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1.58 1.33 1.39 1.32 1.39 1.76 1.21 1.54 1.85 2.49
"Re-writer CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1.08 0.91 0.99 1.02 1.22 1.76 1.15 1.51 1.77 2.18
"Reader CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 3.50 2.83 3.45 3.70 3.88 3.39 3.34 5.66 7.76 8.31
"Re-Reader CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 3.52 2.85 3.58 4.06 4.53 4.06 3.38 7.11 9.00 9.75
"Random read CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 4.00 3.12 3.65 4.08 4.63 5.36 3.63 7.21 9.09 9.92
"Random write CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1.13 0.96 1.07 1.14 1.46 1.97 1.22 1.45 1.83 2.37
"Backward read CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 3.64 2.88 3.56 4.03 4.67 3.11 3.79 7.27 9.17 9.73
"Record rewrite CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 1.00 0.97 1.00 1.13 1.50 2.14 1.10 1.79 2.07 3.16
"Stride read CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 3.21 3.07 3.58 4.02 4.59 4.79 3.04 7.25 9.21 9.67
"Fwrite CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 22.48 23.61 21.47 23.04 21.66 21.67 22.89 24.52 26.04 25.07
"Re-Fwrite CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 18.42 17.95 18.62 17.03 17.57 19.43 20.07 20.69 22.77 22.91
"Fread CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 99.93 100.00 100.00 100.00 100.00 99.96 100.00 100.00 100.00 99.94
"Re-Fread CPU utilization report (Zero values should be ignored)"
"32" "64" "128" "256" "512" "1024" "2048" "4096" "8192" "16384"
"2097152" 99.66 99.65 99.57 99.46 98.71 99.69 98.27 99.36 99.50 99.76
