]> www.infradead.org Git - users/jedix/linux-maple.git/commit
arm64: vDSO: Wire up getrandom() vDSO implementation
authorAdhemerval Zanella <adhemerval.zanella@linaro.org>
Tue, 3 Sep 2024 12:09:17 +0000 (12:09 +0000)
committerJason A. Donenfeld <Jason@zx2c4.com>
Fri, 13 Sep 2024 15:28:36 +0000 (17:28 +0200)
commit712676ea2bb3882a852bcf49862c4247317fc9b2
tree17d406ce2b8c3ee29444e36f3ff9ba9abaabc22d
parent2c2ca3416b4090aef8c646adccfc3be4b712db8a
arm64: vDSO: Wire up getrandom() vDSO implementation

Hook up the generic vDSO implementation to the aarch64 vDSO data page.
The _vdso_rng_data required data is placed within the _vdso_data vvar
page, by using a offset larger than the vdso_data.

The vDSO function requires a ChaCha20 implementation that does not write
to the stack, and that can do an entire ChaCha20 permutation.  The one
provided uses NEON on the permute operation, with a fallback to the
syscall for chips that do not support AdvSIMD.

This also passes the vdso_test_chacha test along with
vdso_test_getrandom. The vdso_test_getrandom bench-single result on
Neoverse-N1 shows:

   vdso: 25000000 times in 0.783884250 seconds
   libc: 25000000 times in 8.780275399 seconds
syscall: 25000000 times in 8.786581518 seconds

A small fixup to arch/arm64/include/asm/mman.h was required to avoid
pulling kernel code into the vDSO, similar to what's already done in
arch/arm64/include/asm/rwonce.h.

Signed-off-by: Adhemerval Zanella <adhemerval.zanella@linaro.org>
Reviewed-by: Ard Biesheuvel <ardb@kernel.org>
Acked-by: Will Deacon <will@kernel.org>
Signed-off-by: Jason A. Donenfeld <Jason@zx2c4.com>
12 files changed:
arch/arm64/Kconfig
arch/arm64/include/asm/mman.h
arch/arm64/include/asm/vdso/getrandom.h [new file with mode: 0644]
arch/arm64/include/asm/vdso/vsyscall.h
arch/arm64/kernel/vdso.c
arch/arm64/kernel/vdso/Makefile
arch/arm64/kernel/vdso/vdso.lds.S
arch/arm64/kernel/vdso/vgetrandom-chacha.S [new file with mode: 0644]
arch/arm64/kernel/vdso/vgetrandom.c [new file with mode: 0644]
tools/arch/arm64/vdso [new symlink]
tools/include/linux/compiler.h
tools/testing/selftests/vDSO/Makefile