nbd_fio_randread_512_compressed_direct: (g=0): rw=randread, bs=(R) 512B-512B, (W) 512B-512B, (T) 512B-512B, ioengine=psync, iodepth=1 fio-3.15 Starting 1 process nbd_fio_randread_512_compressed_direct: (groupid=0, jobs=1): err= 0: pid=1933: Fri Aug 30 10:41:54 2019 read: IOPS=12.9k, BW=6470KiB/s (6625kB/s)(622MiB/98449msec) clat (usec): min=21, max=1801, avg=75.34, stdev=92.39 lat (usec): min=21, max=1801, avg=75.52, stdev=92.39 clat percentiles (usec): | 1.00th=[ 31], 5.00th=[ 37], 10.00th=[ 39], 20.00th=[ 40], | 30.00th=[ 41], 40.00th=[ 43], 50.00th=[ 46], 60.00th=[ 49], | 70.00th=[ 51], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 347], | 99.00th=[ 420], 99.50th=[ 457], 99.90th=[ 529], 99.95th=[ 562], | 99.99th=[ 635] bw ( KiB/s): min= 5576, max= 7294, per=99.96%, avg=6466.22, stdev=372.79, samples=196 iops : min=11152, max=14588, avg=12932.45, stdev=745.58, samples=196 lat (usec) : 50=66.44%, 100=24.13%, 250=0.37%, 500=8.87%, 750=0.20% lat (usec) : 1000=0.01% lat (msec) : 2=0.01% cpu : usr=4.62%, sys=9.95%, ctx=2199257, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1273856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=6470KiB/s (6625kB/s), 6470KiB/s-6470KiB/s (6625kB/s-6625kB/s), io=622MiB (652MB), run=98449-98449msec Disk stats (read/write): nbd1: ios=1272891/0, merge=0/0, ticks=88018/0, in_queue=0, util=99.94%