d/freebsd-skq
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
freebsd-skq/sys/kern
History
mjg 6090f91124 vfs: convert struct mount counters to per-cpu 
There are 3 counters modified all the time in this structure - one for
keeping the structure alive, one for preventing unmount and one for
tracking active writers. Exact values of these counters are very rarely
needed, which makes them a prime candidate for conversion to a per-cpu
scheme, resulting in much better performance.

Sample benchmark performing fstatfs (modifying 2 out of 3 counters) on
a 104-way 2 socket Skylake system:
before:   852393 ops/s
after:  76682077 ops/s

Reviewed by:	kib, jeff
Tested by:	pho
Sponsored by:	The FreeBSD Foundation
Differential Revision:	https://reviews.freebsd.org/D21637
2019-09-16 21:37:47 +00:00
..
bus_if.m
Add necessary bits for Linux KPI to work correctly on powerpc
2019-08-04 19:28:10 +00:00
capabilities.conf
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
clock_if.m
…
cpufreq_if.m
…
device_if.m
…
genassym.sh
…
genoffset.c
With epoch not inlined, there is no point in using _lite KPI. While here,
2018-11-13 23:45:38 +00:00
genoffset.sh
expose thread_lite definition to tied modules
2018-07-03 02:50:07 +00:00
imgact_aout.c
Switch to use shared vnode locks for text files during image activation.
2019-05-05 11:20:43 +00:00
imgact_binmisc.c
Add helper functions to copy strings into struct image_args.
2018-11-29 21:00:56 +00:00
imgact_elf32.c
…
imgact_elf64.c
…
imgact_elf.c
When loading ELF interpreter, initialize whole nested image_params with zero.
2019-09-07 16:03:26 +00:00
imgact_shell.c
Add helper functions to copy strings into struct image_args.
2018-11-29 21:00:56 +00:00
init_main.c
Update comment explaining create_init().
2019-08-08 16:42:53 +00:00
init_sysent.c
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
kern_acct.c
…
kern_alq.c
…
kern_clock.c
Update td_runtime of running thread on each statclock().
2019-06-14 01:09:10 +00:00
kern_clocksource.c
Rename hardclock_cnt() to hardclock() and remove the old implementation.
2018-09-06 02:10:59 +00:00
kern_condvar.c
…
kern_conf.c
Bump SPECNAMELEN to MAXNAMLEN.
2019-01-27 00:46:06 +00:00
kern_cons.c
Replace ttyprintf with sbuf_printf and tty drain routine
2018-10-20 18:31:36 +00:00
kern_context.c
Remove superfluous bzero in getcontext/swapcontext/sendsig
2018-11-26 20:56:05 +00:00
kern_cpu.c
kern_cpu: When adding abs frequency allow for unordered insertion
2018-07-19 11:28:14 +00:00
kern_cpuset.c
Remove a redundant NULL pointer check in cpuset_modify_domain().
2019-09-12 16:47:38 +00:00
kern_ctf.c
Convert DDB_CTF to use newer version of ZLIB.
2019-08-08 07:27:49 +00:00
kern_descrip.c
Check and avoid overflow when incrementing fp->f_count in
2019-07-21 15:07:12 +00:00
kern_dtrace.c
systrace: track it like sdt probes
2018-04-27 15:16:34 +00:00
kern_dump.c
Move phys_avail definition into MI code. It is consumed in the MI layer and
2019-08-16 00:45:14 +00:00
kern_environment.c
Follow up r352244: kenv: tighten up assertions
2019-09-12 14:34:46 +00:00
kern_et.c
…
kern_event.c
Avoid relying on header pollution from sys/refcount.h.
2019-07-29 20:26:01 +00:00
kern_exec.c
Change synchonization rules for vm_page reference counting.
2019-09-09 21:32:42 +00:00
kern_exit.c
proc: clear pid bitmap entry after dropping proctree lock
2019-09-02 12:46:43 +00:00
kern_fail.c
…
kern_ffclock.c
…
kern_fork.c
Add procctl(PROC_STACKGAP_CTL)
2019-09-03 18:56:25 +00:00
kern_hhook.c
…
kern_idle.c
…
kern_intr.c
Disable intr_storm_threshold mechanism by default
2019-05-24 22:33:14 +00:00
kern_jail.c
Replace hand-rolled unrefs if > 1 with refcount_release_if_not_last
2018-12-07 16:11:45 +00:00
kern_kcov.c
Change synchonization rules for vm_page reference counting.
2019-09-09 21:32:42 +00:00
kern_khelp.c
…
kern_kthread.c
proc: always store parent pid in p_oppid
2018-11-16 17:07:54 +00:00
kern_ktr.c
Drop "All rights reserved" from my copyright statements.
2019-03-06 22:11:45 +00:00
kern_ktrace.c
Reduce overhead of ktrace checks in the common case.
2018-05-09 00:00:47 +00:00
kern_linker.c
Add flags variants to linker_files / stack(9) symbol resolution
2018-10-20 18:08:43 +00:00
kern_lock.c
Add lockmgr(9) probes to the lockstat DTrace provider.
2019-08-21 23:43:58 +00:00
kern_lockf.c
lockf: annotate LOCKF_DEBUG only var
2018-05-19 05:04:38 +00:00
kern_lockstat.c
Add lockmgr(9) probes to the lockstat DTrace provider.
2019-08-21 23:43:58 +00:00
kern_loginclass.c
Replace hand-rolled unrefs if > 1 with refcount_release_if_not_last
2018-12-07 16:11:45 +00:00
kern_malloc.c
Handle overflow in calculating max kmem size.
2019-01-14 07:31:19 +00:00
kern_mbuf.c
Extend uma_reclaim() to permit different reclamation targets.
2019-09-01 22:22:43 +00:00
kern_mib.c
Add missing include of sys/boot.h
2019-06-24 20:52:21 +00:00
kern_module.c
Use NULL for SYSINIT's last arg, which is a pointer type
2018-05-18 17:58:09 +00:00
kern_mtxpool.c
Increase MTX_POOL_SLEEP_SIZE from 128 to 1024.
2018-12-24 23:52:35 +00:00
kern_mutex.c
INVARIANTS: treat LA_LOCKED as the same of LA_XLOCKED in mtx_assert.
2019-08-23 06:39:40 +00:00
kern_ntptime.c
Clear pad bytes in the struct exported by kern.ntp_pll.gettime.
2018-11-20 20:32:10 +00:00
kern_osd.c
…
kern_physio.c
Allocate pager bufs from UMA instead of 80-ish mutex protected linked list.
2019-01-15 01:02:16 +00:00
kern_pmc.c
Add malloc_domainset(9) and _domainset variants to other allocator KPIs.
2018-10-30 18:26:34 +00:00
kern_poll.c
…
kern_priv.c
Check for probes enabled in priv_check_cred before evaluting the error.
2018-12-19 23:28:29 +00:00
kern_proc.c
proc: eliminate the zombproc list
2019-08-28 16:18:23 +00:00
kern_procctl.c
Add procctl(PROC_STACKGAP_CTL)
2019-09-03 18:56:25 +00:00
kern_prot.c
Only enable COMPAT_43 changes for syscalls ABI for a.out processes.
2019-08-11 19:16:07 +00:00
kern_racct.c
proc: eliminate the zombproc list
2019-08-28 16:18:23 +00:00
kern_rangelock.c
rangelock: add rangelock_cookie_assert
2019-09-15 02:59:53 +00:00
kern_rctl.c
call racct_proc_ucred_changed() under the proc lock
2018-04-20 13:08:04 +00:00
kern_resource.c
Fix a typo introduced in r344133
2019-03-18 12:41:42 +00:00
kern_rmlock.c
Make no assertions about lock state when the scheduler is stopped.
2018-11-13 20:48:05 +00:00
kern_rwlock.c
Drop "All rights reserved" from my copyright statements.
2019-03-06 22:11:45 +00:00
kern_sdt.c
…
kern_sema.c
…
kern_sendfile.c
Change synchonization rules for vm_page reference counting.
2019-09-09 21:32:42 +00:00
kern_sharedpage.c
Move most of the contents of opt_compat.h to opt_global.h.
2018-04-06 17:35:35 +00:00
kern_shutdown.c
shutdown_halt: make sure that watchdog timer is stopped
2019-09-04 13:26:59 +00:00
kern_sig.c
Only enable COMPAT_43 changes for syscalls ABI for a.out processes.
2019-08-11 19:16:07 +00:00
kern_switch.c
make critical_{enter, exit} inline
2018-07-03 01:55:09 +00:00
kern_sx.c
sx: retire SX_NOADAPTIVE
2018-12-05 16:43:03 +00:00
kern_synch.c
Add a blocking wait bit to refcount. This allows refs to be used as a simple
2019-08-18 11:43:58 +00:00
kern_syscalls.c
fix a typo resulting in a wrong variable in kern_syscall_deregister
2018-08-02 09:41:55 +00:00
kern_sysctl.c
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
kern_tc.c
Initialize timehands linkage much earlier.
2019-09-09 12:42:48 +00:00
kern_thr.c
Don't acquire evclass_lock with a spinlock held
2018-07-11 19:38:42 +00:00
kern_thread.c
Always set td_errno to the error value of a system call.
2019-07-15 21:16:01 +00:00
kern_time.c
Disallow excessively small times of day in clock_settime(2).
2019-05-03 21:26:44 +00:00
kern_timeout.c
Save the last callout function executed on each CPU
2019-07-03 19:22:44 +00:00
kern_tslog.c
…
kern_ubsan.c
Teach the kernel KUBSAN runtime about alignment_assumption
2019-05-28 09:12:15 +00:00
kern_umtx.c
Make umtxq_check_susp() to correctly handle thread exit requests.
2019-08-01 14:34:27 +00:00
kern_uuid.c
Use sbuf_cat() in GEOM confxml generation.
2019-06-19 15:36:02 +00:00
kern_xxx.c
Normalize COMPAT_43 syscall declarations.
2018-12-04 16:48:47 +00:00
ksched.c
…
link_elf_obj.c
Convert DDB_CTF to use newer version of ZLIB.
2019-08-08 07:27:49 +00:00
link_elf.c
Convert DDB_CTF to use newer version of ZLIB.
2019-08-08 07:27:49 +00:00
linker_if.m
…
Make.tags.inc
Remove a couple of harmless stray references to nandfs.
2019-06-25 16:39:25 +00:00
Makefile
Don't use an .OBJDIR for 'make sysent'.
2018-01-29 19:14:15 +00:00
makesyscalls.sh
Reorganise conditionals to reduce duplication.
2019-08-22 10:21:07 +00:00
md4c.c
…
md5c.c
…
msi_if.m
…
p1003_1b.c
…
pic_if.m
…
posix4_mib.c
Use NULL for SYSINIT's last arg, which is a pointer type
2018-05-18 17:58:09 +00:00
sched_4bsd.c
Reduce umtx-related work on exec and exit
2019-05-08 16:30:38 +00:00
sched_ule.c
Move scheduler state into the per-cpu area where it can be allocated on the
2019-08-13 04:54:02 +00:00
serdev_if.m
…
stack_protector.c
Revert r346292 (permit_nonrandom_stackcookies)
2019-05-13 23:37:44 +00:00
subr_acl_nfs4.c
Remove unused argument to priv_check_cred.
2018-12-11 19:32:16 +00:00
subr_acl_posix1e.c
Remove unused argument to priv_check_cred.
2018-12-11 19:32:16 +00:00
subr_autoconf.c
…
subr_blist.c
Address problems in blist_alloc introduced in r349777. The swap block allocator could become corrupted
2019-07-11 20:52:39 +00:00
subr_boot.c
When parsing command line stuff, treat tabs and spaces the same.
2019-04-18 22:52:12 +00:00
subr_bufring.c
…
subr_bus_dma.c
Add an external mbuf buffer type that holds multiple unmapped pages.
2019-06-29 00:48:33 +00:00
subr_bus.c
Add necessary bits for Linux KPI to work correctly on powerpc
2019-08-04 19:28:10 +00:00
subr_busdma_bufalloc.c
Add malloc_domainset(9) and _domainset variants to other allocator KPIs.
2018-10-30 18:26:34 +00:00
subr_capability.c
kern_sendit: use pre-initialized rights
2018-05-23 01:48:09 +00:00
subr_clock.c
Kill tz_minuteswest and tz_dsttime.
2019-03-12 04:49:47 +00:00
subr_compressor.c
GZIO: Update to use zlib 1.2.11.
2019-08-25 07:50:44 +00:00
subr_counter.c
Fix pre-SI_SUB_CPU initialization of per-CPU counters.
2018-07-10 00:18:12 +00:00
subr_coverage.c
Extract the coverage sanitizer KPI to a new file.
2019-01-29 11:04:17 +00:00
subr_devmap.c
Raise the size of L3 table for early devmap on arm64
2018-07-19 21:58:06 +00:00
subr_devstat.c
devstat(9): Constify function parameters that can be const
2018-08-23 01:42:45 +00:00
subr_disk.c
Fix botched merge with 355066
2019-03-12 05:10:41 +00:00
subr_dummy_vdso_tc.c
Move most of the contents of opt_compat.h to opt_global.h.
2018-04-06 17:35:35 +00:00
subr_early.c
Add a file missed in r339321
2018-10-12 00:32:45 +00:00
subr_epoch.c
Fix the turnstile_lock() KPI.
2019-07-24 23:04:59 +00:00
subr_eventhandler.c
Include ktr.h in more compilation units
2019-05-21 20:38:48 +00:00
subr_fattime.c
Use const pointers for input data not modified by clock utility functions.
2018-02-06 22:17:01 +00:00
subr_firmware.c
…
subr_gtaskqueue.c
Make taskqgroup_attach{,_cpu}(9) work across architectures
2019-02-12 21:23:59 +00:00
subr_hash.c
Unsign some values related to allocation.
2018-01-22 02:08:10 +00:00
subr_hints.c
res_find: Fix fallback logic
2018-08-18 19:45:56 +00:00
subr_intr.c
Extract eventfilter declarations to sys/_eventfilter.h
2019-05-20 00:38:23 +00:00
subr_kdb.c
Always stop the scheduler when entering kdb
2018-10-30 14:54:15 +00:00
subr_kobj.c
Prevent some kobj memory allocation failures from panicking the system.
2019-01-31 22:27:39 +00:00
subr_lock.c
Drop "All rights reserved" from my copyright statements.
2019-03-06 22:11:45 +00:00
subr_log.c
…
subr_mchain.c
…
subr_module.c
Have preload_delete_name() free pages backing preloaded data.
2018-07-19 20:00:28 +00:00
subr_msgbuf.c
msgbuf: Light detailing (const'ify and bool'itize)
2018-08-09 17:42:27 +00:00
subr_param.c
riscv: restore default HZ=1000, keep QEMU at HZ=100
2019-09-07 05:13:31 +00:00
subr_pcpu.c
vfs: manage mnt_ref with atomics
2019-09-16 21:31:02 +00:00
subr_pctrie.c
kern/subr_pctrie: Fix mismatched signedness in assertion comparison
2019-04-06 21:56:24 +00:00
subr_pidctrl.c
When pidctrl_daemon() is called multiple times within an interval, it
2018-06-07 07:48:50 +00:00
subr_power.c
Extract eventfilter declarations to sys/_eventfilter.h
2019-05-20 00:38:23 +00:00
subr_prf.c
device_printf: Use sbuf for more coherent prints on SMP
2019-05-07 17:47:20 +00:00
subr_prof.c
ANSIfy sys/kern
2018-06-01 13:26:45 +00:00
subr_rangeset.c
Implement rangesets.
2019-02-20 09:38:19 +00:00
subr_rman.c
add support for marking interrupt handlers as suspended
2018-12-17 17:11:00 +00:00
subr_rtc.c
Improve error messages from clock_if.m method failures.
2018-09-02 20:17:51 +00:00
subr_sbuf.c
sbuf(9): Add sbuf_nl_terminate() API
2019-08-07 19:27:14 +00:00
subr_scanf.c
Add support for 'j', 't' and 'z' flags to kernel sscanf().
2019-08-16 19:46:22 +00:00
subr_sfbuf.c
Remove SFBUF_OPTIONAL_DIRECT_MAP and such hacks, replacing them across the
2018-01-19 17:46:31 +00:00
subr_sglist.c
Add an external mbuf buffer type that holds multiple unmapped pages.
2019-06-29 00:48:33 +00:00
subr_sleepqueue.c
Add wakeup_any(), cheaper wakeup_one() for taskqueue(9).
2019-06-20 01:15:33 +00:00
subr_smp.c
x86: Implement MWAIT support for stopping a CPU
2019-05-04 20:34:26 +00:00
subr_stack.c
stack(9): Drop unused API mode and comment that referenced it
2019-03-15 22:39:55 +00:00
subr_syscall.c
Don't pass error from syscallenter() to syscallret().
2019-07-15 21:25:16 +00:00
subr_taskqueue.c
Add wakeup_any(), cheaper wakeup_one() for taskqueue(9).
2019-06-20 01:15:33 +00:00
subr_terminal.c
teken, vt(4): New callbacks to lock the terminal once
2018-05-16 09:01:02 +00:00
subr_trap.c
assert that td_lk_slocks is not leaked upon return from kernel
2019-08-19 11:18:36 +00:00
subr_turnstile.c
Fix the turnstile_lock() KPI.
2019-07-24 23:04:59 +00:00
subr_uio.c
simplify control flow so that gcc knows we never pass save to curthread_pflags_restore
2018-05-19 04:04:44 +00:00
subr_unit.c
Implement unr64
2018-11-20 14:58:41 +00:00
subr_vmem.c
Extend uma_reclaim() to permit different reclamation targets.
2019-09-01 22:22:43 +00:00
subr_witness.c
Only check the blessings table for known LORs.
2019-08-02 18:01:47 +00:00
sys_capability.c
Let kern.trap_enotcap be set as a tunable.
2018-12-06 17:29:37 +00:00
sys_generic.c
Check and avoid overflow when incrementing fp->f_count in
2019-07-21 15:07:12 +00:00
sys_getrandom.c
Move most of the contents of opt_compat.h to opt_global.h.
2018-04-06 17:35:35 +00:00
sys_pipe.c
Modify pipe_poll() to properly check for pending direct writes.
2019-08-21 19:35:04 +00:00
sys_procdesc.c
procdesc: fix the function name
2019-08-05 20:31:17 +00:00
sys_process.c
Change synchonization rules for vm_page reference counting.
2019-09-09 21:32:42 +00:00
sys_socket.c
Ensure that the vnet is set when calling pru_sockaddr() and
2018-01-11 20:26:17 +00:00
syscalls.c
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
syscalls.master
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
systrace_args.c
Add sysctlbyname system call
2019-09-03 04:16:30 +00:00
sysv_ipc.c
sysv: get rid of fork/exit hooks if the code is compiled in
2019-05-04 19:05:30 +00:00
sysv_msg.c
ANSIfy sys/kern
2018-06-01 13:26:45 +00:00
sysv_sem.c
Move most of the contents of opt_compat.h to opt_global.h.
2018-04-06 17:35:35 +00:00
sysv_shm.c
sysv: get rid of fork/exit hooks if the code is compiled in
2019-05-04 19:05:30 +00:00
tty_compat.c
Move most of the contents of opt_compat.h to opt_global.h.
2018-04-06 17:35:35 +00:00
tty_info.c
Avoid fixing the tty_info() buffer size in tty.h.
2018-11-06 23:41:44 +00:00
tty_inq.c
tty: use __unused annotation instead to silence warnings
2018-05-19 04:48:26 +00:00
tty_outq.c
tty: use __unused annotation instead to silence warnings
2018-05-19 04:48:26 +00:00
tty_pts.c
Move 32-bit compat support for FIODGNAME to the right place.
2018-10-26 17:59:25 +00:00
tty_tty.c
Extract eventfilter declarations to sys/_eventfilter.h
2019-05-20 00:38:23 +00:00
tty_ttydisc.c
Replace ttyprintf with sbuf_printf and tty drain routine
2018-10-20 18:31:36 +00:00
tty.c
Defer funsetown() calls for a TTY to tty_rel_free().
2019-07-04 15:42:02 +00:00
uipc_accf.c
…
uipc_debug.c
Load balance sockets with new SO_REUSEPORT_LB option.
2018-06-06 15:45:57 +00:00
uipc_domain.c
…
uipc_ktls.c
Add kernel-side support for in-kernel TLS.
2019-08-27 00:01:56 +00:00
uipc_mbuf2.c
In m_pulldown(), before trying to prepend bytes to the subsequent mbuf,
2019-08-09 05:18:59 +00:00
uipc_mbuf.c
Change synchonization rules for vm_page reference counting.
2019-09-09 21:32:42 +00:00
uipc_mbufhash.c
…
uipc_mqueue.c
mqueuefs: fix compat32 struct file leak
2019-08-20 17:44:03 +00:00
uipc_sem.c
Remove unused argument to priv_check_cred.
2018-12-11 19:32:16 +00:00
uipc_shm.c
Replace redundant code with a few new vm_page_grab facilities:
2019-09-10 19:08:01 +00:00
uipc_sockbuf.c
Add kernel-side support for in-kernel TLS.
2019-08-27 00:01:56 +00:00
uipc_socket.c
Add kernel-side support for in-kernel TLS.
2019-08-27 00:01:56 +00:00
uipc_syscalls.c
Only enable COMPAT_43 changes for syscalls ABI for a.out processes.
2019-08-11 19:16:07 +00:00
uipc_usrreq.c
Check and avoid overflow when incrementing fp->f_count in
2019-07-21 15:07:12 +00:00
vfs_acl.c
Reduce duplication in __acl_*_(file|link).
2018-02-15 21:24:43 +00:00
vfs_aio.c
Allocate pager bufs from UMA instead of 80-ish mutex protected linked list.
2019-01-15 01:02:16 +00:00
vfs_bio.c
Use REFCOUNT_COUNT() to obtain refcount where appropriate.
2019-09-12 16:26:59 +00:00
vfs_cache.c
cache: avoid excessive relocking on entry removal during lookup
2019-09-10 20:19:29 +00:00
vfs_cluster.c
Use an atomic reference count for paging in progress so that callers do not
2019-08-19 23:09:38 +00:00
vfs_default.c
vfs: convert struct mount counters to per-cpu
2019-09-16 21:37:47 +00:00
vfs_export.c
Ensure that directory entry padding bytes are zeroed.
2018-11-23 22:24:59 +00:00
vfs_extattr.c
extattr_list_vp: Narrow locked section somewhat
2019-02-05 04:47:21 +00:00
vfs_hash.c
vfs: implement usecount implying holdcnt
2019-09-03 15:42:11 +00:00
vfs_init.c
Only call sigdeferstop() for NFS.
2018-10-23 21:43:41 +00:00
vfs_lookup.c
NDFREE(): Fix unlocking for LOCKPARENT|LOCKLEAF and ndp->ni_dvp == ndp->ni_vp.
2019-05-21 15:12:13 +00:00
vfs_mount.c
vfs: convert struct mount counters to per-cpu
2019-09-16 21:37:47 +00:00
vfs_mountroot.c
vfs: manage mnt_ref with atomics
2019-09-16 21:31:02 +00:00
vfs_subr.c
vfs: convert struct mount counters to per-cpu
2019-09-16 21:37:47 +00:00
vfs_syscalls.c
vfs: stop always overwriting ->mnt_stat in VFS_STATFS
2019-08-18 18:40:12 +00:00
vfs_vnops.c
vfs: convert struct mount counters to per-cpu
2019-09-16 21:37:47 +00:00
vnode_if.src
vfs: add VOP_NEED_INACTIVE
2019-08-28 20:34:24 +00:00