]> www.infradead.org Git - nvme.git/commit
io_uring/rsrc: send exact nr_segs for fixed buffer
authorNitesh Shetty <nj.shetty@samsung.com>
Thu, 17 Apr 2025 09:32:34 +0000 (10:32 +0100)
committerJens Axboe <axboe@kernel.dk>
Thu, 17 Apr 2025 13:42:14 +0000 (07:42 -0600)
commit80c7378f94cf193cb3bd2101bbcd5aea78d0e211
tree9e9565cdcb473a4f827e504bef795e6b2a1ebe22
parent59852ebad954c8a3ac8b746930c2ea60febe797a
io_uring/rsrc: send exact nr_segs for fixed buffer

Sending exact nr_segs, avoids bio split check and processing in
block layer, which takes around 5%[1] of overall CPU utilization.

In our setup, we see overall improvement of IOPS from 7.15M to 7.65M [2]
and 5% less CPU utilization.

[1]
     3.52%  io_uring         [kernel.kallsyms]     [k] bio_split_rw_at
     1.42%  io_uring         [kernel.kallsyms]     [k] bio_split_rw
     0.62%  io_uring         [kernel.kallsyms]     [k] bio_submit_split

[2]
sudo taskset -c 0,1 ./t/io_uring -b512 -d128 -c32 -s32 -p1 -F1 -B1 -n2
-r4 /dev/nvme0n1 /dev/nvme1n1

Signed-off-by: Nitesh Shetty <nj.shetty@samsung.com>
[Pavel: fixed for kbuf, rebased and reworked on top of cleanups]
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/7a1a49a8d053bd617c244291d63dbfbc07afde36.1744882081.git.asml.silence@gmail.com
[axboe: fold in fix factoring in buf reg offset]
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/rsrc.c