nbd_fio_read_512_compressed_direct: (g=0): rw=read, bs=(R) 512B-512B, (W) 512B-512B, (T) 512B-512B, ioengine=psync, iodepth=1 fio-3.15 Starting 1 process nbd_fio_read_512_compressed_direct: (groupid=0, jobs=1): err= 0: pid=2876: Thu Aug 29 22:21:41 2019 read: IOPS=15.3k, BW=7643KiB/s (7827kB/s)(622MiB/83334msec) clat (usec): min=21, max=867, avg=64.15, stdev=81.25 lat (usec): min=21, max=867, avg=64.30, stdev=81.26 clat percentiles (usec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 36], 20.00th=[ 37], | 30.00th=[ 37], 40.00th=[ 38], 50.00th=[ 38], 60.00th=[ 40], | 70.00th=[ 41], 80.00th=[ 45], 90.00th=[ 60], 95.00th=[ 297], | 99.00th=[ 375], 99.50th=[ 416], 99.90th=[ 494], 99.95th=[ 529], | 99.99th=[ 611] bw ( KiB/s): min= 1398, max=18193, per=100.00%, avg=7655.06, stdev=4078.26, samples=166 iops : min= 2796, max=36386, avg=15310.13, stdev=8156.53, samples=166 lat (usec) : 50=88.12%, 100=2.68%, 250=0.34%, 500=8.77%, 750=0.09% lat (usec) : 1000=0.01% cpu : usr=3.97%, sys=9.80%, ctx=2274090, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1273856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=7643KiB/s (7827kB/s), 7643KiB/s-7643KiB/s (7827kB/s-7827kB/s), io=622MiB (652MB), run=83334-83334msec Disk stats (read/write): nbd1: ios=1271533/0, merge=0/0, ticks=74998/0, in_queue=0, util=99.91%