Mark Johnston 99d92d732f Ensure that queue state is cleared when vm_page_dequeue() returns. ... Per-page queue state is updated non-atomically, with either the page lock or the page queue lock held. When vm_page_dequeue() is called without the page lock, in rare cases a different thread may be concurrently dequeuing the page with the pagequeue lock held. Because of the non-atomic update, vm_page_dequeue() might return before queue state is completely updated, which can lead to race conditions. Restrict the vm_page_dequeue() interface so that it must be called either with the page lock held or on a free page, and busy wait when a different thread is concurrently updating queue state, which must happen in a critical section. While here, do some related cleanup: inline vm_page_dequeue_locked() into its only caller and delete a prototype for the unimplemented vm_page_requeue_locked(). Replace the volatile qualifier for "queue" added in r333703 with explicit uses of atomic_load_8() where required. Reported and tested by: pho Reviewed by: alc Differential Revision: https://reviews.freebsd.org/D15980		2018-08-23 20:34:22 +00:00
..
_vm_radix.h	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
default_pager.c	SPDX: wrong license.	2017-11-30 15:45:42 +00:00
device_pager.c	sys: further adoption of SPDX licensing ID tags.	2017-11-20 19:43:44 +00:00
memguard.c	Eliminate kmem_arena and kmem_object in preparation for further NUMA commits.	2017-11-28 23:40:54 +00:00
memguard.h	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
phys_pager.c	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
pmap.h	Add pmap_is_valid_memattr(9).	2018-08-01 18:45:51 +00:00
redzone.c	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
redzone.h	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
sg_pager.c	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
swap_pager.c	Defer and aggregate swap_pager_meta_build frees.	2018-08-08 02:30:34 +00:00
swap_pager.h	sys: further adoption of SPDX licensing ID tags.	2017-11-20 19:43:44 +00:00
uma_core.c	Eliminate kmem_malloc()'s unused arena parameter. (The arena parameter	2018-08-21 16:43:46 +00:00
uma_dbg.c	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
uma_dbg.h	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
uma_int.h	Sort uma_zone fields according to 64 byte cache line with adjacent line	2018-06-23 08:10:09 +00:00
uma.h	Back pcpu zone with domain correct pages	2018-07-06 02:06:03 +00:00
vm_domainset.c	Use the canonical check for reservation support.	2018-05-19 23:49:13 +00:00
vm_domainset.h	Implement several enhancements to NUMA policies.	2018-03-29 02:54:50 +00:00
vm_extern.h	Eliminate kmem_malloc()'s unused arena parameter. (The arena parameter	2018-08-21 16:43:46 +00:00
vm_fault.c	Add support for pmap_enter(..., psind=1) to the armv6 pmap. In other words,	2018-08-08 16:55:01 +00:00
vm_glue.c	Account the size of the vslock-ed memory by the thread.	2018-03-24 13:51:27 +00:00
vm_init.c	Eliminate kmem_malloc()'s unused arena parameter. (The arena parameter	2018-08-21 16:43:46 +00:00
vm_kern.c	Eliminate kmem_malloc()'s unused arena parameter. (The arena parameter	2018-08-21 16:43:46 +00:00
vm_kern.h	Make UMA and malloc(9) return non-executable memory in most cases.	2018-06-13 17:04:41 +00:00
vm_map.c	To date, mlockall(MCL_FUTURE) has had the unfortunate side effect of	2018-07-28 04:06:33 +00:00
vm_map.h	inline atomics and allow tied modules to inline locks	2018-07-02 19:48:38 +00:00
vm_meter.c	vm: move vm_cnt to __read_mostly now that it is not written to	2018-04-27 05:36:02 +00:00
vm_mmap.c	For compat32, emulate the same wraparound check as occurs on the real	2018-07-31 18:00:47 +00:00
vm_object.c	Allow vm object coalescing to occur in the midst of a vm object when the	2018-07-31 17:41:48 +00:00
vm_object.h	Use per-domain locks for vm page queue free. Move paging control from	2018-02-06 22:10:07 +00:00
vm_page.c	Ensure that queue state is cleared when vm_page_dequeue() returns.	2018-08-23 20:34:22 +00:00
vm_page.h	Ensure that queue state is cleared when vm_page_dequeue() returns.	2018-08-23 20:34:22 +00:00
vm_pageout.c	Account for the lowmem handlers in the inactive queue scan target.	2018-08-09 18:25:49 +00:00
vm_pageout.h	Fix GCC build: Remove redundant pagedaemon_wakeup declaration	2018-03-16 07:05:09 +00:00
vm_pagequeue.h	Make UMA and malloc(9) return non-executable memory in most cases.	2018-06-13 17:04:41 +00:00
vm_pager.c	SPDX: Consider code from Carnegie-Mellon University.	2017-11-30 15:48:35 +00:00
vm_pager.h	sys: further adoption of SPDX licensing ID tags.	2017-11-20 19:43:44 +00:00
vm_param.h	SPDX: Consider code from Carnegie-Mellon University.	2017-11-30 15:48:35 +00:00
vm_phys.c	Rename VM_FREELIST_ISADMA to VM_FREELIST_LOWMEM.	2018-07-27 18:34:20 +00:00
vm_phys.h	Update the physical page selection strategy used by vm_page_import() so	2018-06-26 18:29:56 +00:00
vm_radix.c	vm: stop passing M_ZERO when allocating radix nodes	2018-06-24 13:08:05 +00:00
vm_radix.h	sys: general adoption of SPDX licensing ID tags.	2017-11-27 15:23:17 +00:00
vm_reserv.c	Use the ticks since the last update to reduce hysteresis in the partpopq and	2018-07-07 01:54:45 +00:00
vm_reserv.h	Lock reservations with a dedicated lock in each reservation. Protect the	2018-03-22 19:21:11 +00:00
vm_swapout_dummy.c	SPDX: Consider code from Carnegie-Mellon University.	2017-11-30 15:48:35 +00:00
vm_swapout.c	Prevent some parallel swap-ins, rate-limit swapper swap-ins.	2018-08-13 16:48:46 +00:00
vm_unix.c	Use __riscv to determine building for RISC-V	2018-07-23 19:49:54 +00:00
vm.h	Move vm_ndomains to vm.h where it can be used with a single header include	2018-03-27 03:27:02 +00:00
vnode_pager.c	Implement several enhancements to NUMA policies.	2018-03-29 02:54:50 +00:00
vnode_pager.h	sys: further adoption of SPDX licensing ID tags.	2017-11-20 19:43:44 +00:00