Konstantin Belousov afe55ca373 Implement 'fast path' for the vm page fault handler. Or, it could be ... called a scalable path. When several preconditions hold, the vm object lock for the object containing the faulted page is taken in read mode, instead of write, which allows parallel faults processing in the region. Namely, the fast path is taken when the faulted page already exists and does not need copy on write, is already fully valid, and not busy. For technical reasons, fast path is avoided when the fault is the first write on the vnode object, or when the fault is for wiring or debugger read or write. On the fast path, pmap_enter(9) is passed the PMAP_ENTER_NOSLEEP flag, since object lock is kept. Pmap might fail to create the entry, in which case the fallback to slow path is performed. Reviewed by: alc Tested by: pho (previous version) Hardware provided and hosted by: The FreeBSD Foundation and Sentex Data Communications Sponsored by: The FreeBSD Foundation MFC after: 2 week		2014-08-15 07:30:14 +00:00
..
_vm_radix.h	On all the architectures, avoid to preallocate the physical memory	2013-08-09 11:28:55 +00:00
default_pager.c	Switch the vm_object mutex to be a rwlock. This will enable in the	2013-03-09 02:32:23 +00:00
device_pager.c	Initialize paddr to handle the case of zero size.	2014-03-12 16:38:55 +00:00
memguard.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
memguard.h	Replace kernel virtual address space allocation with vmem. This provides	2013-08-07 06:21:20 +00:00
phys_pager.c	The soft and hard busy mechanism rely on the vm object lock to work.	2013-08-09 11:11:11 +00:00
pmap.h	Change pmap_enter(9) interface to take flags parameter and superpage	2014-08-08 17:12:03 +00:00
redzone.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
redzone.h
sg_pager.c	Different consumers of the struct vm_page abuse pageq member to keep	2013-08-10 17:36:42 +00:00
swap_pager.c	Add sysctl OIDs showing the actual size and capacity of the swap zone.	2014-04-26 12:18:17 +00:00
swap_pager.h	Do not map the swap i/o pbufs if the geom provider for the swap	2013-03-19 14:39:27 +00:00
uma_core.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
uma_dbg.c	- Add a per-zone lock for zones without kegs.	2013-06-20 19:08:12 +00:00
uma_dbg.h
uma_int.h	Implement soft pressure on UMA cache bucket sizes.	2013-11-19 10:05:53 +00:00
uma.h	Create two public UMA_ZONE_PCPU zones: 64 bit sized and pointer sized.	2014-02-10 19:59:46 +00:00
vm_extern.h	Handle wiring failures in vm_map_wire() with the new functions	2014-08-02 16:10:24 +00:00
vm_fault.c	Implement 'fast path' for the vm page fault handler. Or, it could be	2014-08-15 07:30:14 +00:00
vm_glue.c	If vm_page_grab() allocates a new page, the page is not inserted into	2014-08-13 05:44:08 +00:00
vm_init.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
vm_kern.c	Change pmap_enter(9) interface to take flags parameter and superpage	2014-08-08 17:12:03 +00:00
vm_kern.h	- Add a statically allocated memguard arena since it is needed very early	2013-08-13 22:40:43 +00:00
vm_map.c	Rewrite a loop in vm_map_wire() so that gcc doesn't think that the variable	2014-08-02 17:58:20 +00:00
vm_map.h	Add MAP_EXCL flag for mmap(2). It should be combined with MAP_FIXED,	2014-06-19 05:00:39 +00:00
vm_meter.c	Rename global cnt to vm_cnt to avoid shadowing.	2014-03-22 10:26:09 +00:00
vm_mmap.c	Remove ia64.	2014-07-07 00:27:09 +00:00
vm_object.c	When unwiring a region of an address space, do not assume that the	2014-07-26 18:10:18 +00:00
vm_object.h	Add wrappers to assert that vm object is unlocked and for try upgrade.	2014-08-06 19:30:35 +00:00
vm_page.c	Adapt vm_page_aflag_set(PGA_WRITEABLE) to the locking of	2014-08-09 05:00:34 +00:00
vm_page.h	Adapt vm_page_aflag_set(PGA_WRITEABLE) to the locking of	2014-08-09 05:00:34 +00:00
vm_pageout.c	Remove ia64.	2014-07-07 00:27:09 +00:00
vm_pageout.h
vm_pager.c	- Add a general purpose resource allocator, vmem, from NetBSD. It was	2013-06-28 03:51:20 +00:00
vm_pager.h	The vm_pager_page_unswapped() pager op is only implemented for the	2014-08-06 19:34:03 +00:00
vm_param.h	Rename global cnt to vm_cnt to avoid shadowing.	2014-03-22 10:26:09 +00:00
vm_phys.c	vm_phys: improve robustness of fictitious ranges	2014-08-05 10:29:01 +00:00
vm_phys.h	Rename global cnt to vm_cnt to avoid shadowing.	2014-03-22 10:26:09 +00:00
vm_radix.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
vm_radix.h	Eliminate a redundant parameter to vm_radix_replace().	2013-12-08 20:07:02 +00:00
vm_reserv.c	Correct a bug in the management of the population map on big-endian	2014-06-11 16:11:12 +00:00
vm_reserv.h	Refactor vm_page_alloc()'s interactions with vm_reserv_alloc_page() and	2013-05-12 16:50:18 +00:00
vm_unix.c	Remove ia64.	2014-07-07 00:27:09 +00:00
vm_zeroidle.c	Pull in r267961 and r267973 again. Fix for issues reported will follow.	2014-06-28 03:56:17 +00:00
vm.h	rename scheduler->swapper and SI_SUB_RUN_SCHEDULER->SI_SUB_LAST	2013-07-24 09:45:31 +00:00
vnode_pager.c	Rename global cnt to vm_cnt to avoid shadowing.	2014-03-22 10:26:09 +00:00
vnode_pager.h