nbd_fio_read_512_uncompressed_direct: (g=0): rw=read, bs=(R) 512B-512B, (W) 512B-512B, (T) 512B-512B, ioengine=psync, iodepth=1 fio-3.15 Starting 1 process nbd_fio_read_512_uncompressed_direct: (groupid=0, jobs=1): err= 0: pid=2887: Thu Aug 29 22:22:50 2019 read: IOPS=25.2k, BW=12.3MiB/s (12.9MB/s)(622MiB/50486msec) clat (usec): min=20, max=848, avg=38.40, stdev= 4.66 lat (usec): min=20, max=848, avg=38.55, stdev= 4.67 clat percentiles (usec): | 1.00th=[ 27], 5.00th=[ 35], 10.00th=[ 36], 20.00th=[ 37], | 30.00th=[ 37], 40.00th=[ 37], 50.00th=[ 38], 60.00th=[ 39], | 70.00th=[ 40], 80.00th=[ 41], 90.00th=[ 43], 95.00th=[ 48], | 99.00th=[ 52], 99.50th=[ 56], 99.90th=[ 73], 99.95th=[ 81], | 99.99th=[ 116] bw ( KiB/s): min=11122, max=18188, per=99.97%, avg=12610.66, stdev=840.58, samples=100 iops : min=22244, max=36376, avg=25221.32, stdev=1681.16, samples=100 lat (usec) : 50=98.57%, 100=1.41%, 250=0.02%, 500=0.01%, 1000=0.01% cpu : usr=6.36%, sys=15.47%, ctx=2300012, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1273856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=12.3MiB/s (12.9MB/s), 12.3MiB/s-12.3MiB/s (12.9MB/s-12.9MB/s), io=622MiB (652MB), run=50486-50486msec Disk stats (read/write): nbd0: ios=1270881/0, merge=0/0, ticks=42620/0, in_queue=0, util=99.84%