]> www.infradead.org Git - users/jedix/linux-maple.git/commit
x86/mm: Only do broadcast flush from reclaim if pages were unmapped
authorRik van Riel <riel@surriel.com>
Wed, 19 Mar 2025 17:25:20 +0000 (13:25 -0400)
committerIngo Molnar <mingo@kernel.org>
Wed, 19 Mar 2025 20:56:42 +0000 (21:56 +0100)
commit0b7eb55cb706e92d6073e4ab63ccd4d219cf2cda
treeb9019c69321ed206c823c2ccb9e244c5f594ef86
parentde844ef582e3a5e0cbd429c68b6079eeb87394e5
x86/mm: Only do broadcast flush from reclaim if pages were unmapped

Track whether pages were unmapped from any MM (even ones with a currently
empty mm_cpumask) by the reclaim code, to figure out whether or not
broadcast TLB flush should be done when reclaim finishes.

The reason any MM must be tracked, and not only ones contributing to the
tlbbatch cpumask, is that broadcast ASIDs are expected to be kept up to
date even on CPUs where the MM is not currently active.

This change allows reclaim to avoid doing TLB flushes when only clean page
cache pages and/or slab memory were reclaimed, which is fairly common.

( This is a simpler alternative to the code that was in my INVLPGB series
  before, and it seems to capture most of the benefit due to how common
  it is to reclaim only page cache. )

Signed-off-by: Rik van Riel <riel@surriel.com>
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Cc: Dave Hansen <dave.hansen@linux.intel.com>
Cc: Andy Lutomirski <luto@kernel.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Link: https://lore.kernel.org/r/20250319132520.6b10ad90@fangorn
arch/x86/include/asm/tlbbatch.h
arch/x86/include/asm/tlbflush.h
arch/x86/mm/tlb.c