mm: vmscan: ignore non-LRU-based reclaim in memcg reclaim

We keep track of different types of reclaimed pages through
reclaim_state->reclaimed, and we add them to the reported number of
reclaimed pages.  For non-memcg reclaim, this makes sense.  For memcg
reclaim, we have no clue if those pages are charged to the memcg under
reclaim.

Slab pages are shared by different memcgs, so a freed slab page may have
only been partially charged to the memcg under reclaim.  The same goes for
clean file pages from pruned inodes (on highmem systems) or xfs buffer
pages, there is no simple way to currently link them to the memcg under
reclaim.

Stop reporting those freed pages as reclaimed pages during memcg reclaim.
This should make the return value of writing to memory.reclaim, and may
help reduce unnecessary reclaim retries during memcg charging.  Writing to
memory.reclaim on the root memcg is considered as cgroup_reclaim(), but
for this case we want to include any freed pages, so use the
global_reclaim() check instead.

Generally, this should make the return value of
try_to_free_mem_cgroup_pages() more accurate.  In some limited cases (e.g.
freed a slab page that was mostly charged to the memcg under reclaim),
the return value of try_to_free_mem_cgroup_pages() can be underestimated,
but this should be fine.  The freed pages will be uncharged anyway, and we
can charge the memcg the next time around as we usually do memcg reclaim
in a retry loop.

Link: https://lkml.kernel.org/r/20230404001353.468224-4-yosryahmed@google.com
Signed-off-by: Yosry Ahmed <yosryahmed@google.com>
Cc: Christoph Lameter <cl@linux.com>
Cc: Darrick J. Wong <djwong@kernel.org>
Cc: Dave Chinner <david@fromorbit.com>
Cc: David Hildenbrand <david@redhat.com>
Cc: David Rientjes <rientjes@google.com>
Cc: Hyeonggon Yoo <42.hyeyoo@gmail.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Joonsoo Kim <iamjoonsoo.kim@lge.com>
Cc: Matthew Wilcox (Oracle) <willy@infradead.org>
Cc: Miaohe Lin <linmiaohe@huawei.com>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: NeilBrown <neilb@suse.de>
Cc: Peter Xu <peterx@redhat.com>
Cc: Roman Gushchin <roman.gushchin@linux.dev>
Cc: Shakeel Butt <shakeelb@google.com>
Cc: Vlastimil Babka <vbabka@suse.cz>
Cc: Yu Zhao <yuzhao@google.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>

diff --git a/mm/vmscan.c b/mm/vmscan.c
index 7437fb63e1accfca415982af8890662519316ddd..58618a7d84bfb5d0545131bfc06d81770bef83d5 100644 (file)
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -535,7 +535,35 @@ static void set_task_reclaim_state(struct task_struct *task,
 static void flush_reclaim_state(struct scan_control *sc,
                                struct reclaim_state *rs)
 {
-       if (rs) {
+       /*
+        * Currently, reclaim_state->reclaimed includes three types of pages
+        * freed outside of vmscan:
+        * (1) Slab pages.
+        * (2) Clean file pages from pruned inodes.
+        * (3) XFS freed buffer pages.
+        *
+        * For all of these cases, we have no way of finding out whether these
+        * pages were related to the memcg under reclaim. For example, a freed
+        * slab page could have had only a single object charged to the memcg
+        * under reclaim. Also, populated inodes are not on shrinker LRUs
+        * anymore except on highmem systems.
+        *
+        * Instead of over-reporting the reclaimed pages in a memcg reclaim,
+        * only count such pages in global reclaim. This prevents unnecessary
+        * retries during memcg charging and false positive from proactive
+        * reclaim (memory.reclaim).
+        *
+        * For uncommon cases were the freed pages were actually significantly
+        * charged to the memcg under reclaim, and we end up under-reporting, it
+        * should be fine. The freed pages will be uncharged anyway, even if
+        * they are not reported properly, and we will be able to make forward
+        * progress in charging (which is usually in a retry loop).
+        *
+        * We can go one step further, and report the uncharged objcg pages in
+        * memcg reclaim, to make reporting more accurate and reduce
+        * under-reporting, but it's probably not worth the complexity for now.
+        */
+       if (rs && global_reclaim(sc)) {
                sc->nr_reclaimed += rs->reclaimed;
                rs->reclaimed = 0;
        }