Commit 6ffef5d8bfc16845e25a7ee784426382b5c82c20

Authored by Mel Gorman
Committed by Jiri Slaby
1 parent fa6d2dd222

mm: do not use unnecessary atomic operations when adding pages to the LRU

commit 6fb81a17d21f2a138b8f424af4cf379f2b694060 upstream.

When adding pages to the LRU we clear the active bit unconditionally.
As the page could be reachable from other paths we cannot use unlocked
operations without risk of corruption such as a parallel
mark_page_accessed.  This patch tests if is necessary to clear the
active flag before using an atomic operation.  This potentially opens a
tiny race when PageActive is checked as mark_page_accessed could be
called after PageActive was checked.  The race already exists but this
patch changes it slightly.  The consequence is that that the page may be
promoted to the active list that might have been left on the inactive
list before the patch.  It's too tiny a race and too marginal a
consequence to always use atomic operations for.

Signed-off-by: Mel Gorman <mgorman@suse.de>
Acked-by: Johannes Weiner <hannes@cmpxchg.org>
Cc: Vlastimil Babka <vbabka@suse.cz>
Cc: Jan Kara <jack@suse.cz>
Cc: Michal Hocko <mhocko@suse.cz>
Cc: Hugh Dickins <hughd@google.com>
Cc: Dave Hansen <dave.hansen@intel.com>
Cc: Theodore Ts'o <tytso@mit.edu>
Cc: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
Cc: Oleg Nesterov <oleg@redhat.com>
Cc: Rik van Riel <riel@redhat.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Mel Gorman <mgorman@suse.de>
Signed-off-by: Jiri Slaby <jslaby@suse.cz>

Showing 1 changed file with 4 additions and 2 deletions Side-by-side Diff

... ... @@ -565,13 +565,15 @@
565 565 */
566 566 void lru_cache_add_anon(struct page *page)
567 567 {
568   - ClearPageActive(page);
  568 + if (PageActive(page))
  569 + ClearPageActive(page);
569 570 __lru_cache_add(page);
570 571 }
571 572  
572 573 void lru_cache_add_file(struct page *page)
573 574 {
574   - ClearPageActive(page);
  575 + if (PageActive(page))
  576 + ClearPageActive(page);
575 577 __lru_cache_add(page);
576 578 }
577 579 EXPORT_SYMBOL(lru_cache_add_file);