...
Mon Oct 6 11:06:36 PDT 2014 sgpdd-survey on /dev/raw/raw1 /dev/raw/raw2 /dev/raw/raw3 /dev/raw/raw4 from fermi-gpfs01
total_size 33554432K rsz 1024 crg 4 thr 4 write 1328.92 MB/s 4 x 332.39 = 1329.57 MB/s read 2911.00 MB/s 4 x 728.76 = 2915.04 MB/s
total_size 33554432K rsz 1024 crg 4 thr 8 write 1454.79 MB/s 4 x 364.14 = 1456.57 MB/s read 2895.55 MB/s 4 x 724.64 = 2898.56 MB/s
total_size 33554432K rsz 1024 crg 4 thr 16 write 1456.28 MB/s 4 x 364.27 = 1457.10 MB/s read 2458.23 MB/s 4 x 615.12 = 2460.48 MB/s
total_size 33554432K rsz 1024 crg 4 thr 32 write 1445.62 MB/s 4 x 361.72 = 1446.88 MB/s read 2994.64 MB/s 4 x 749.94 = 2999.76 MB/s
total_size 33554432K rsz 1024 crg 4 thr 64 write 1434.84 MB/s 4 x 358.97 = 1435.89 MB/s read 2740.28 MB/s 4 x 685.58 = 2742.31 MB/s
total_size 33554432K rsz 1024 crg 8 thr 8 write 2001.29 MB/s 8 x 250.36 = 2002.87 MB/s read 1639.01 MB/s 8 x 204.96 = 1639.71 MB/s
total_size 33554432K rsz 1024 crg 8 thr 16 write 1980.60 MB/s 8 x 247.88 = 1983.03 MB/s read 1440.08 MB/s 8 x 180.07 = 1440.58 MB/s
total_size 33554432K rsz 1024 crg 8 thr 32 write 1947.07 MB/s 8 x 243.69 = 1949.54 MB/s read 1661.00 MB/s 8 x 207.72 = 1661.76 MB/s
total_size 33554432K rsz 1024 crg 8 thr 64 write 2016.98 MB/s 8 x 252.47 = 2019.73 MB/s read 1715.79 MB/s 8 x 214.57 = 1716.54 MB/s
total_size 33554432K rsz 1024 crg 8 thr 128 write 1961.61 MB/s 8 x 245.53 = 1964.26 MB/s read 1682.21 MB/s 8 x 210.47 = 1683.73 MB/s
total_size 33554432K rsz 1024 crg 16 thr 16 write 2097.46 MB/s 16 x 131.28 = 2100.52 MB/s read 2379.03 MB/s 16 x 148.78 = 2380.52 MB/s
total_size 33554432K rsz 1024 crg 16 thr 32 write 2078.31 MB/s 16 x 130.00 = 2080.08 MB/s read 2389.99 MB/s 16 x 149.53 = 2392.43 MB/s
total_size 33554432K rsz 1024 crg 16 thr 64 write 2075.24 MB/s 16 x 129.81 = 2077.03 MB/s read 2193.77 MB/s 16 x 137.20 = 2195.13 MB/s
total_size 33554432K rsz 1024 crg 16 thr 128 write 2088.21 MB/s 16 x 130.62 = 2090.00 MB/s read 2206.04 MB/s 16 x 137.96 = 2207.34 MB/s
total_size 33554432K rsz 1024 crg 16 thr 256 write 2085.91 MB/s 16 x 130.49 = 2087.86 MB/s read 2393.09 MB/s 16 x 149.68 = 2394.87 MB/s
total_size 33554432K rsz 1024 crg 32 thr 32 write 2008.13 MB/s 32 x 62.81 = 2009.89 MB/s read 3197.92 MB/s 32 x 100.09 = 3202.82 MB/s
total_size 33554432K rsz 1024 crg 32 thr 64 write 1979.69 MB/s 32 x 61.92 = 1981.51 MB/s read 3190.03 MB/s 32 x 99.79 = 3193.36 MB/s
total_size 33554432K rsz 1024 crg 32 thr 128 write 1997.90 MB/s 32 x 62.49 = 1999.82 MB/s read 3237.11 MB/s 32 x 101.26 = 3240.36 MB/s
total_size 33554432K rsz 1024 crg 32 thr 256 write 2005.33 MB/s 32 x 62.71 = 2006.84 MB/s read 3213.86 MB/s 32 x 100.64 = 3220.52 MB/s
total_size 33554432K rsz 1024 crg 32 thr 512 write 1981.90 MB/s 32 x 62.00 = 1983.95 MB/s read 3277.99 MB/s 32 x 102.53 = 3280.94 MB/s
total_size 33554432K rsz 1024 crg 64 thr 64 write 1986.19 MB/s 64 x 31.06 = 1987.92 MB/s read 3835.45 MB/s 64 x 60.01 = 3840.33 MB/s
total_size 33554432K rsz 1024 crg 64 thr 128 write 1985.35 MB/s 64 x 31.06 = 1987.92 MB/s read 3804.40 MB/s 64 x 59.53 = 3809.81 MB/s
total_size 33554432K rsz 1024 crg 64 thr 256 write 2009.90 MB/s 64 x 31.47 = 2014.16 MB/s read 3827.19 MB/s 64 x 59.99 = 3839.11 MB/s
total_size 33554432K rsz 1024 crg 64 thr 512 write 1986.98 MB/s 64 x 31.09 = 1989.75 MB/s read 3876.90 MB/s 64 x 60.76 = 3888.55 MB/s
total_size 33554432K rsz 1024 crg 64 thr 1024 write 1978.71 MB/s 64 x 30.96 = 1981.20 MB/s read 3807.05 MB/s 64 x 59.57 = 3812.26 MB/s
total_size 33554432K rsz 1024 crg 128 thr 128 write 1999.93 MB/s 128 x 15.65 = 2003.17 MB/s read 3608.74 MB/s 128 x 28.24 = 3614.50 MB/s
total_size 33554432K rsz 1024 crg 128 thr 256 write 2016.86 MB/s 128 x 15.80 = 2022.71 MB/s read 3600.97 MB/s 128 x 28.17 = 3605.96 MB/s
total_size 33554432K rsz 1024 crg 128 thr 512 write 2012.85 MB/s 128 x 15.75 = 2016.60 MB/s read 3541.17 MB/s 128 x 27.71 = 3547.36 MB/s
total_size 33554432K rsz 1024 crg 128 thr 1024 write 2012.09 MB/s 128 x 15.75 = 2016.60 MB/s read 3506.41 MB/s 128 x 27.54 = 3525.39 MB/s
total_size 33554432K rsz 1024 crg 256 thr 256 write 1868.84 MB/s 256 x 7.61 = 1948.24 MB/s read 2809.95 MB/s 256 x 11.05 = 2829.59 MB/s
total_size 33554432K rsz 1024 crg 256 thr 512 write 1944.84 MB/s 256 x 7.65 = 1958.01 MB/s read 2729.52 MB/s 256 x 10.76 = 2753.91 MB/s
total_size 33554432K rsz 1024 crg 256 thr 1024 write 1960.35 MB/s 256 x 7.69 = 1967.77 MB/s read 2814.37 MB/s 256 x 11.07 = 2834.47 MB/s
total_size 33554432K rsz 1024 crg 512 thr 512 write 1671.90 MB/s 512 x 3.29 = 1684.57 MB/s read 2378.45 MB/s 512 x 4.67 = 2392.58 MB/s
total_size 33554432K rsz 1024 crg 512 thr 1024 write 1637.35 MB/s 512 x 3.22 = 1650.39 MB/s read 2373.27 MB/s 512 x 4.68 = 2397.46 MB/s
total_size 33554432K rsz 1024 crg 1024 thr 1024 write 1231.95 MB/s 1024 x 1.20 = 1230.47 MB/s read 2094.72 MB/s 1024 x 2.06 = 2109.38 MB/s
Eight 15-disk LUNs
Max write ~2GB/sec , Max read ~5.5GB/sec
Mon Oct 6 11:27:15 PDT 2014 sgpdd-survey on /dev/raw/raw1 /dev/raw/raw2 /dev/raw/raw3 /dev/raw/raw4 /dev/raw/raw5 /dev/raw/raw6 /dev/raw/raw7 /dev/raw/raw8 from fermi-gpfs01total_size 67108864K rsz 1024 crg 8 thr 8 write 1922.79 MB/s 8 x 240.58 = 1924.67 MB/s read 3002.11 MB/s 8 x 375.48 = 3003.85 MB/s
total_size 67108864K rsz 1024 crg 8 thr 16 write 1954.89 MB/s 8 x 244.51 = 1956.10 MB/s read 3067.43 MB/s 8 x 383.64 = 3069.15 MB/s
total_size 67108864K rsz 1024 crg 8 thr 32 write 1945.17 MB/s 8 x 243.23 = 1945.88 MB/s read 3554.62 MB/s 8 x 444.55 = 3556.37 MB/s
total_size 67108864K rsz 1024 crg 8 thr 64 write 1963.69 MB/s 8 x 245.61 = 1964.87 MB/s read 3241.54 MB/s 8 x 405.60 = 3244.78 MB/s
total_size 67108864K rsz 1024 crg 8 thr 128 write 1952.31 MB/s 8 x 244.34 = 1954.73 MB/s read 3438.20 MB/s 8 x 430.24 = 3441.93 MB/s
total_size 67108864K rsz 1024 crg 16 thr 16 write 2012.85 MB/s 16 x 125.86 = 2013.70 MB/s read 3145.18 MB/s 16 x 196.70 = 3147.13 MB/s
total_size 67108864K rsz 1024 crg 16 thr 32 write 1994.44 MB/s 16 x 124.70 = 1995.24 MB/s read 3025.56 MB/s 16 x 189.17 = 3026.73 MB/s
total_size 67108864K rsz 1024 crg 16 thr 64 write 2004.65 MB/s 16 x 125.36 = 2005.77 MB/s read 3004.32 MB/s 16 x 187.85 = 3005.52 MB/s
total_size 67108864K rsz 1024 crg 16 thr 128 write 2007.39 MB/s 16 x 125.61 = 2009.74 MB/s read 3039.40 MB/s 16 x 190.05 = 3040.77 MB/s
total_size 67108864K rsz 1024 crg 16 thr 256 write 1997.99 MB/s 16 x 125.04 = 2000.58 MB/s read 3112.63 MB/s 16 x 194.82 = 3117.07 MB/s
total_size 67108864K rsz 1024 crg 32 thr 32 write 2013.20 MB/s 32 x 62.95 = 2014.47 MB/s read 4255.10 MB/s 32 x 133.25 = 4263.92 MB/s
total_size 67108864K rsz 1024 crg 32 thr 64 write 2045.06 MB/s 32 x 64.00 = 2048.03 MB/s read 3722.31 MB/s 32 x 116.44 = 3726.20 MB/s
total_size 67108864K rsz 1024 crg 32 thr 128 write 2047.41 MB/s 32 x 64.08 = 2050.48 MB/s read 3978.66 MB/s 32 x 124.47 = 3983.15 MB/s
total_size 67108864K rsz 1024 crg 32 thr 256 write 2041.97 MB/s 32 x 63.89 = 2044.37 MB/s read 4020.13 MB/s 32 x 125.73 = 4023.44 MB/s
total_size 67108864K rsz 1024 crg 32 thr 512 write 2047.79 MB/s 32 x 64.11 = 2051.39 MB/s read 3841.14 MB/s 32 x 120.11 = 3843.38 MB/s
total_size 67108864K rsz 1024 crg 64 thr 64 write 2037.39 MB/s 64 x 31.90 = 2041.63 MB/s read 5316.71 MB/s 64 x 83.33 = 5333.25 MB/s
total_size 67108864K rsz 1024 crg 64 thr 128 write 2051.62 MB/s 64 x 32.08 = 2053.22 MB/s read 5470.01 MB/s 64 x 85.74 = 5487.67 MB/s
total_size 67108864K rsz 1024 crg 64 thr 256 write 2057.33 MB/s 64 x 32.18 = 2059.33 MB/s read 5499.66 MB/s 64 x 86.01 = 5504.76 MB/s
total_size 67108864K rsz 1024 crg 64 thr 512 write 2054.44 MB/s 64 x 32.13 = 2056.27 MB/s read 5356.79 MB/s 64 x 83.97 = 5374.15 MB/s
total_size 67108864K rsz 1024 crg 64 thr 1024 write 2062.91 MB/s 64 x 32.26 = 2064.82 MB/s read 5516.21 MB/s 64 x 86.26 = 5520.63 MB/s
total_size 67108864K rsz 1024 crg 128 thr 128 write 2067.42 MB/s 128 x 16.17 = 2070.31 MB/s read 4584.08 MB/s 128 x 35.94 = 4600.83 MB/s
total_size 67108864K rsz 1024 crg 128 thr 256 write 2060.90 MB/s 128 x 16.11 = 2061.77 MB/s read 4556.67 MB/s 128 x 35.69 = 4567.87 MB/s
total_size 67108864K rsz 1024 crg 128 thr 512 write 2065.59 MB/s 128 x 16.16 = 2067.87 MB/s read 4671.71 MB/s 128 x 36.60 = 4685.06 MB/s
total_size 67108864K rsz 1024 crg 128 thr 1024 write 2067.70 MB/s 128 x 16.16 = 2069.09 MB/s read 4517.05 MB/s 128 x 35.47 = 4539.79 MB/s
total_size 67108864K rsz 1024 crg 128 thr 2048 write 2070.00 MB/s 128 x 16.21 = 2075.20 MB/s read 4738.98 MB/s 128 x 37.17 = 4758.30 MB/s
total_size 67108864K rsz 1024 crg 256 thr 256 write 2073.01 MB/s 256 x 8.12 = 2077.64 MB/s read 4380.17 MB/s 256 x 17.19 = 4401.86 MB/s
total_size 67108864K rsz 1024 crg 256 thr 512 write 2071.51 MB/s 256 x 8.10 = 2072.75 MB/s read 4316.17 MB/s 256 x 16.96 = 4340.82 MB/s
total_size 67108864K rsz 1024 crg 256 thr 1024 write 2064.41 MB/s 256 x 8.09 = 2070.31 MB/s read 4915.45 MB/s 256 x 19.34 = 4951.17 MB/s
total_size 67108864K rsz 1024 crg 256 thr 2048 write 2064.69 MB/s 256 x 8.08 = 2067.87 MB/s read 4284.50 MB/s 256 x 16.87 = 4318.85 MB/s
total_size 67108864K rsz 1024 crg 512 thr 512 write 2027.22 MB/s 512 x 3.96 = 2026.37 MB/s read 5133.79 MB/s 512 x 10.04 = 5141.60 MB/s
total_size 67108864K rsz 1024 crg 512 thr 1024 write 2033.61 MB/s 512 x 3.98 = 2036.13 MB/s read 5157.11 MB/s 512 x 10.09 = 5166.02 MB/s
total_size 67108864K rsz 1024 crg 512 thr 2048 write 2049.99 MB/s 512 x 4.01 = 2050.78 MB/s read 5086.87 MB/s 512 x 10.05 = 5146.48 MB/s
total_size 67108864K rsz 1024 crg 1024 thr 1024 write 1813.79 MB/s 1024 x 1.77 = 1816.41 MB/s read 4298.05 MB/s 1024 x 4.28 = 4384.77 MB/s
total_size 67108864K rsz 1024 crg 1024 thr 2048 write 1718.45 MB/s 1024 x 1.68 = 1718.75 MB/s read 4311.54 MB/s 1024 x 4.29 = 4394.53 MB/s
total_size 67108864K rsz 1024 crg 2048 thr 2048 write 1247.56 MB/s 2048 x 0.63 = 1289.06 MB/s read 3850.62 MB/s 2048 x 1.92 = 3925.78 MB/s
Eight
...
15-disk
...
LUNs
...
without cache
...
mirroring
...
(NOT
...
RECOMMENDED
...
)
Max write ~4.2GB/sec , Max read ~5.5GB/sec
...