Mateusz Guzik 1c0b34417b Move vmmeter atomic counters into dedicated cache lines ...

Prior to the change they were subject to extreme false sharing.
In particular this change shaves about 3 seconds real time of -j 80 buildkernel.

Reviewed by:	alc, markj
Differential Revision:	https://reviews.freebsd.org/D12281

2017-09-10 19:00:38 +00:00

..

_vm_radix.h

Add pctrie_init() and vm_radix_init() to initialize generic pctrie and

2017-07-19 20:52:47 +00:00

default_pager.c

Provide introductory description of the default pager.

2016-12-14 23:36:32 +00:00

device_pager.c

All these files need sys/vmmeter.h, but now they got it implicitly

2017-04-17 17:07:00 +00:00

memguard.c

All these files need sys/vmmeter.h, but now they got it implicitly

2017-04-17 17:07:00 +00:00

memguard.h

…

phys_pager.c

Implement the populate() pager method for phys pager.

2016-12-08 11:35:53 +00:00

pmap.h

Add support for pmap_enter(..., psind=1) to the amd64 pmap. In other words,

2017-07-23 06:33:58 +00:00

redzone.c

…

redzone.h

…

sg_pager.c

All these files need sys/vmmeter.h, but now they got it implicitly

2017-04-17 17:07:00 +00:00

swap_pager.c

To analyze the allocation of swap blocks by blist functions, add a method

2017-09-10 17:46:03 +00:00

swap_pager.h

Make the swap_pager_full variable static.

2017-08-30 09:44:05 +00:00

uma_core.c

Start annotating global _padalign locks with __exclusive_cache_line

2017-09-06 20:28:18 +00:00

uma_dbg.c

Fix memguard(9) in kernels with INVARIANTS enabled.

2016-06-01 22:31:35 +00:00

uma_dbg.h

…

uma_int.h

uma: eliminate uk_slabsize field

2017-03-11 16:35:36 +00:00

uma.h

Update a comment to reflect reality.

2017-03-13 18:45:25 +00:00

vm_domain.c

Remove cpu_spinwait after seq_consistent.

2016-12-30 06:26:17 +00:00

vm_domain.h

…

vm_extern.h

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm_fault.c

Switching from a global hash table to per-vm_object radix tries for mapping

2017-08-28 16:55:43 +00:00

vm_glue.c

Modify vm_page_grab_pages() to handle VM_ALLOC_NOWAIT.

2017-08-11 16:29:22 +00:00

vm_init.c

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm_kern.c

Add vm_page_alloc_after().

2017-08-15 16:39:49 +00:00

vm_kern.h

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm_map.c

Disable stack growth when accessed by AIO daemons.

2017-07-19 19:00:32 +00:00

vm_map.h

Treat the addr argument for mmap(2) request without MAP_FIXED flag as

2017-06-28 04:02:36 +00:00

vm_meter.c

Move vmmeter atomic counters into dedicated cache lines

2017-09-10 19:00:38 +00:00

vm_mmap.c

Treat the addr argument for mmap(2) request without MAP_FIXED flag as

2017-06-28 04:02:36 +00:00

vm_object.c

Add a vm_page_change_lock() helper, the common code to not relock page

2017-09-09 17:35:19 +00:00

vm_object.h

Replace global swhash in swap pager with per-object trie to track swap

2017-08-25 23:13:21 +00:00

vm_page.c

Add a vm_page_change_lock() helper, the common code to not relock page

2017-09-09 17:35:19 +00:00

vm_page.h

Add a vm_page_change_lock() helper, the common code to not relock page

2017-09-09 17:35:19 +00:00

vm_pageout.c

Synchronize page laundering with pmap_extract_and_hold().

2017-08-28 22:10:15 +00:00

vm_pageout.h

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm_pager.c

Start annotating global _padalign locks with __exclusive_cache_line

2017-09-06 20:28:18 +00:00

vm_pager.h

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm_param.h

Commit the 64-bit inode project.

2017-05-23 09:29:05 +00:00

vm_phys.c

Speed up vm_page_array initialization.

2017-09-07 21:43:39 +00:00

vm_phys.h

Speed up vm_page_array initialization.

2017-09-07 21:43:39 +00:00

vm_radix.c

Add pctrie_init() and vm_radix_init() to initialize generic pctrie and

2017-07-19 20:52:47 +00:00

vm_radix.h

Add pctrie_init() and vm_radix_init() to initialize generic pctrie and

2017-07-19 20:52:47 +00:00

vm_reserv.c

Utilize pmap_enter(..., psind=1) in vm_fault_soft_fast() on amd64. (The

2017-07-23 16:28:13 +00:00

vm_reserv.h

Utilize pmap_enter(..., psind=1) in vm_fault_soft_fast() on amd64. (The

2017-07-23 16:28:13 +00:00

vm_unix.c

Renumber copyright clause 4

2017-02-28 23:42:47 +00:00

vm.h

Implement address space guards.

2017-06-24 17:01:11 +00:00

vnode_pager.c

Mark pages after EOF as clean after pageout.

2017-07-26 20:07:05 +00:00

vnode_pager.h

Mark pages after EOF as clean after pageout.

2017-07-26 20:07:05 +00:00