mav 0e425be7bb MFC r271604, r271616: ...

Add couple memory barriers to order tdq_cpu_idle and tdq_load accesses.

This change fixes transient performance drops in some of my benchmarks,
vanishing as soon as I am trying to collect any stats from the scheduler.
It looks like reordered access to those variables sometimes caused loss of
IPI_PREEMPT, that delayed thread execution until some later interrupt.

Approved by:	re (marius)

2014-09-17 14:06:21 +00:00

..

bus_if.m

…

capabilities.conf

Sort properly.

2013-09-07 19:16:02 +00:00

clock_if.m

…

cpufreq_if.m

…

device_if.m

…

genassym.sh

…

imgact_aout.c

…

imgact_binmisc.c

MFC r264269, r264282, r264280, r264291, r264276, r264314

2014-05-16 21:56:33 +00:00

imgact_elf32.c

…

imgact_elf64.c

…

imgact_elf.c

Revert MFC r266925 because it can lead to instant panic at fexecve():

2014-06-17 05:21:48 +00:00

imgact_gzip.c

Add a mmap flag (MAP_32BIT) on 64-bit platforms to request that a mapping use

2013-09-09 18:11:59 +00:00

imgact_shell.c

…

inflate.c

…

init_main.c

Extend the support for exempting processes from being killed when swap is

2013-09-19 18:53:42 +00:00

init_sysent.c

Regen.

2013-09-19 18:56:00 +00:00

kern_acct.c

acct: create a special plimit object and set it for exiting processes

2013-06-30 19:08:06 +00:00

kern_alq.c

MFC r264151:

2014-04-12 06:50:11 +00:00

kern_clock.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

kern_clocksource.c

MFC 264019, 264041, 264048, 264049, 264050, 264051

2014-05-17 20:10:12 +00:00

kern_condvar.c

Fix lc_lock/lc_unlock() support for rmlocks held in shared mode. With

2013-09-20 23:06:21 +00:00

kern_conf.c

MFC r256885:

2014-01-05 23:02:03 +00:00

kern_cons.c

MFC automatic vt(4) selection for UEFI boot

2014-09-02 22:01:14 +00:00

kern_context.c

…

kern_cpu.c

MFC r265876:

2014-05-15 18:07:35 +00:00

kern_cpuset.c

Several improvements to rmlock(9). Many of these are based on patches

2013-06-25 18:44:15 +00:00

kern_ctf.c

…

kern_descrip.c

MFC r268505, r268507:

2014-08-17 07:00:47 +00:00

kern_dtrace.c

MFC r266826, r266827

2014-08-09 14:05:01 +00:00

kern_environment.c

MFC Alexander Motin's direct dispatch, multi-queue, and finer-grained

2014-01-07 01:51:48 +00:00

kern_et.c

MFC 264019, 264041, 264048, 264049, 264050, 264051

2014-05-17 20:10:12 +00:00

kern_event.c

MFC r264146:

2014-04-12 14:08:53 +00:00

kern_exec.c

MFC r269907:

2014-08-20 08:24:37 +00:00

kern_exit.c

MFC r270993 (by mjg):

2014-09-11 11:25:10 +00:00

kern_fail.c

…

kern_ffclock.c

…

kern_fork.c

Commit forgotten chunk of r270264.

2014-08-21 12:30:01 +00:00

kern_gzio.c

…

kern_hhook.c

Move hhook's per-vnet initialisation to an earlier SYSINIT SI_SUB stage to

2013-06-15 10:08:34 +00:00

kern_idle.c

…

kern_intr.c

Merge from project branch via main. Uninteresting commits are trimmed.

2013-10-12 15:31:36 +00:00

kern_jail.c

MFC r271317:

2014-09-15 13:01:47 +00:00

kern_khelp.c

Cleanup and simplification in khelp_{register|deregister}_helper(). No

2013-06-15 06:45:17 +00:00

kern_kthread.c

Do not use potentially stale thread in kthread_add()

2013-08-17 17:02:43 +00:00

kern_ktr.c

MFC 261517,261520:

2014-02-18 20:27:17 +00:00

kern_ktrace.c

MFC r267162: ktrace: Use designated initializers for the data_lengths array.

2014-06-13 12:39:06 +00:00

kern_linker.c

MFC r264173:

2014-04-12 14:18:25 +00:00

kern_lock.c

Add function and wrapper to switch lockmgr and vnode lock back to

2014-09-05 13:22:28 +00:00

kern_lockf.c

MFC r268384:

2014-07-24 10:43:15 +00:00

kern_lockstat.c

…

kern_loginclass.c

MFC r266007:

2014-06-17 13:14:31 +00:00

kern_malloc.c

MFC r269963+269964:

2014-08-29 13:12:45 +00:00

kern_mbuf.c

Ignore attempts to set the nmbcluster sysctls to their current value

2013-10-10 16:11:34 +00:00

kern_mib.c

Partial MFC of r267961, r267973, r267985, r267992, r267993 and r268005:

2014-08-02 20:58:46 +00:00

kern_module.c

…

kern_mtxpool.c

…

kern_mutex.c

Fix lc_lock/lc_unlock() support for rmlocks held in shared mode. With

2013-09-20 23:06:21 +00:00

kern_ntptime.c

rename scheduler->swapper and SI_SUB_RUN_SCHEDULER->SI_SUB_LAST

2013-07-24 09:45:31 +00:00

kern_osd.c

…

kern_physio.c

Fix some issues in change 254760 pointed out by Bruce Evans:

2013-08-29 16:41:40 +00:00

kern_pmc.c

…

kern_poll.c

MFC r256945:

2014-01-29 21:57:00 +00:00

kern_priv.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

kern_proc.c

MFC r269656:

2014-08-21 10:46:19 +00:00

kern_prot.c

…

kern_racct.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

kern_rangelock.c

Change the queue of locks in kern_rangelock.c from holding lock requests in

2013-08-15 20:19:17 +00:00

kern_rctl.c

…

kern_resource.c

MFC r259330,r259331:

2014-02-20 21:52:39 +00:00

kern_rmlock.c

Fix lc_lock/lc_unlock() support for rmlocks held in shared mode. With

2013-09-20 23:06:21 +00:00

kern_rwlock.c

MFC 261517,261520:

2014-02-18 20:27:17 +00:00

kern_sdt.c

MFC r262325:

2014-03-18 00:55:19 +00:00

kern_sema.c

…

kern_sharedpage.c

Remove the deprecated VM_ALLOC_RETRY flag for the vm_page_grab(9).

2013-08-22 07:39:53 +00:00

kern_shutdown.c

MFC r258893, r258956:

2014-01-08 02:19:39 +00:00

kern_sig.c

MFC r270321:

2014-08-29 08:38:34 +00:00

kern_switch.c

…

kern_sx.c

Consistently use the same value to indicate exclusively-held and

2013-09-22 14:09:07 +00:00

kern_synch.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

kern_syscalls.c

…

kern_sysctl.c

Merge r261590, r261592 from head:

2014-03-04 14:01:12 +00:00

kern_tc.c

- Make callout(9) tickless, relying on eventtimers(4) as backend for

2013-03-04 11:09:56 +00:00

kern_thr.c

…

kern_thread.c

MFC r271000:

2014-09-10 09:47:16 +00:00

kern_time.c

MFC r269669:

2014-08-16 12:59:47 +00:00

kern_timeout.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

kern_umtx.c

MFC r270345:

2014-08-29 08:42:20 +00:00

kern_uuid.c

MFC: r261858

2014-02-20 08:55:59 +00:00

kern_xxx.c

…

ksched.c

…

link_elf_obj.c

Add a mmap flag (MAP_32BIT) on 64-bit platforms to request that a mapping use

2013-09-09 18:11:59 +00:00

link_elf.c

Add a mmap flag (MAP_32BIT) on 64-bit platforms to request that a mapping use

2013-09-09 18:11:59 +00:00

linker_if.m

…

Make.tags.inc

- Trim an unused and bogus Makefile for mount_smbfs.

2013-06-28 21:00:08 +00:00

Makefile

…

makesyscalls.sh

Omit "__restrict" when generating syscall argument strings. DTrace doesn't

2013-09-21 23:05:44 +00:00

md4c.c

…

md5c.c

…

p1003_1b.c

…

posix4_mib.c

…

sched_4bsd.c

MFC r270423:

2014-09-06 15:26:38 +00:00

sched_ule.c

MFC r271604, r271616:

2014-09-17 14:06:21 +00:00

serdev_if.m

…

stack_protector.c

…

subr_acl_nfs4.c

…

subr_acl_posix1e.c

…

subr_autoconf.c

…

subr_blist.c

…

subr_bufring.c

…

subr_bus_dma.c

MFC r257228:

2013-12-17 13:38:21 +00:00

subr_bus.c

MFC r264114, r264310, r268570:

2014-08-17 07:16:03 +00:00

subr_busdma_bufalloc.c

Replace kernel virtual address space allocation with vmem. This provides

2013-08-07 06:21:20 +00:00

subr_capability.c

MFC r258148,r258149,r258150,r258152,r258153,r258154,r258181,r258182:

2013-11-18 22:37:01 +00:00

subr_clock.c

MFC r265201

2014-05-08 16:12:38 +00:00

subr_counter.c

Merge r261722, r261723, r261724, r261725 from head:

2014-03-04 14:46:30 +00:00

subr_devstat.c

MFC r263690

2014-04-16 17:57:08 +00:00

subr_disk.c

…

subr_dummy_vdso_tc.c

…

subr_eventhandler.c

…

subr_fattime.c

MFC 264694: Fix a comment typo; conversion tables are for leap years.

2014-05-17 22:03:44 +00:00

subr_firmware.c

…

subr_hash.c

…

subr_hints.c

MFC r261901:

2014-06-26 08:41:54 +00:00

subr_kdb.c

MFC r257214:

2013-11-03 16:04:36 +00:00

subr_kobj.c

…

subr_lock.c

MFC 261517,261520:

2014-02-18 20:27:17 +00:00

subr_log.c

MFcalloutng (r244255 by mav, with minor changes):

2013-03-04 16:07:55 +00:00

subr_mbpool.c

Give (*ext_free) an int return value allowing for very sophisticated

2013-08-25 10:57:09 +00:00

subr_mchain.c

…

subr_module.c

…

subr_msgbuf.c

…

subr_param.c

Merge r257996,r258001,r258069 from head: fixes for HyperV guest.

2013-11-14 09:33:54 +00:00

subr_pcpu.c

Merge r261722, r261723, r261724, r261725 from head:

2014-03-04 14:46:30 +00:00

subr_pctrie.c

- Add a new general purpose path-compressed radix trie which can be used

2013-05-12 04:05:01 +00:00

subr_power.c

…

subr_prf.c

MFC r261786, r261789

2014-05-15 21:41:32 +00:00

subr_prof.c

…

subr_rman.c

MFC r268780

2014-08-01 15:04:46 +00:00

subr_rtc.c

…

subr_sbuf.c

Always request zeroed memory, in case we're dumb enough to leak it later.

2013-09-22 23:47:56 +00:00

subr_scanf.c

…

subr_sglist.c

MFC r260581: Add sglist_append_bio(9) to append a struct bio's data to

2014-01-18 18:36:41 +00:00

subr_sleepqueue.c

MFC 261517,261520:

2014-02-18 20:27:17 +00:00

subr_smp.c

Merge r264984

2014-05-07 20:28:27 +00:00

subr_stack.c

…

subr_syscall.c

…

subr_taskqueue.c

MFC r258713,262062: add taskqueue_drain_all

2014-02-17 15:32:08 +00:00

subr_terminal.c

MFC: r267978

2014-06-30 09:59:23 +00:00

subr_trap.c

MFC r263475:

2014-03-28 15:38:38 +00:00

subr_turnstile.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

subr_uio.c

Remove zero-copy sockets code. It only worked for anonymous memory,

2013-09-16 06:25:54 +00:00

subr_unit.c

Move the definition of the struct unrhdr into a separate header file,

2013-08-30 07:37:45 +00:00

subr_vmem.c

MFC r259232:

2014-01-04 23:31:34 +00:00

subr_witness.c

MFC r265098

2014-08-19 23:08:47 +00:00

sys_capability.c

This looks like a typo that breaks the build. Yell at me if this isn't the

2013-09-05 03:36:57 +00:00

sys_generic.c

MFC r267710:

2014-07-06 22:54:17 +00:00

sys_pipe.c

MFC r265206:

2014-07-06 22:47:18 +00:00

sys_procdesc.c

Change the cap_rights_t type from uint64_t to a structure that we can extend

2013-09-05 00:09:56 +00:00

sys_process.c

MFC r269656:

2014-08-21 10:46:19 +00:00

sys_socket.c

Make sendfile() a method in the struct fileops. Currently only

2013-08-15 07:54:31 +00:00

syscalls.c

Regen.

2013-09-19 18:56:00 +00:00

syscalls.master

Extend the support for exempting processes from being killed when swap is

2013-09-19 18:53:42 +00:00

systrace_args.c

Regenerate syscall argument strings after r255777.

2013-09-21 23:06:36 +00:00

sysv_ipc.c

…

sysv_msg.c

…

sysv_sem.c

…

sysv_shm.c

Add a mmap flag (MAP_32BIT) on 64-bit platforms to request that a mapping use

2013-09-09 18:11:59 +00:00

tty_compat.c

…

tty_info.c

…

tty_inq.c

…

tty_outq.c

…

tty_pts.c

Make sendfile() a method in the struct fileops. Currently only

2013-08-15 07:54:31 +00:00

tty_tty.c

…

tty_ttydisc.c

…

tty.c

MFC r259441:

2014-02-16 20:37:39 +00:00

uipc_accf.c

…

uipc_debug.c

Fix socket buffer timeouts precision using the new sbintime_t KPI instead

2013-09-01 23:34:53 +00:00

uipc_domain.c

- Implement two new system calls:

2013-03-02 21:11:30 +00:00

uipc_mbuf2.c

…

uipc_mbuf.c

Merge r258128 from head:

2013-11-22 19:27:17 +00:00

uipc_mqueue.c

MFC r258148,r258149,r258150,r258152,r258153,r258154,r258181,r258182:

2013-11-18 22:37:01 +00:00

uipc_sem.c

Change the cap_rights_t type from uint64_t to a structure that we can extend

2013-09-05 00:09:56 +00:00

uipc_shm.c

MFC 270823,270825,270829:

2014-09-10 15:45:18 +00:00

uipc_sockbuf.c

Fix kernel memory disclosure in control message and SCTP notifications.

2014-07-08 21:54:50 +00:00

uipc_socket.c

MFC r269502:

2014-08-20 17:26:05 +00:00

uipc_syscalls.c

MFC r256847:

2013-10-29 07:33:55 +00:00

uipc_usrreq.c

MFC r269020:

2014-08-17 07:24:23 +00:00

vfs_acl.c

Change the cap_rights_t type from uint64_t to a structure that we can extend

2013-09-05 00:09:56 +00:00

vfs_aio.c

The fget() function now takes pointer to cap_rights_t, so change 0 to NULL.

2013-09-05 11:59:23 +00:00

vfs_bio.c

MFC of 269533 (by mckusick):

2014-08-18 22:53:48 +00:00

vfs_cache.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

vfs_cluster.c

When allocating a pbuf for the cluster write, do not sleep waiting

2013-08-27 01:31:12 +00:00

vfs_default.c

- Convert the bufobj lock to rwlock.

2013-05-31 00:43:41 +00:00

vfs_export.c

MFC

2013-02-21 21:59:35 +00:00

vfs_extattr.c

Change the cap_rights_t type from uint64_t to a structure that we can extend

2013-09-05 00:09:56 +00:00

vfs_hash.c

…

vfs_init.c

MFC r269457:

2014-08-17 09:07:21 +00:00

vfs_lookup.c

MFC r258622: dtrace sdt: remove the ugly sname parameter of SDT_PROBE_DEFINE

2014-01-17 10:58:59 +00:00

vfs_mount.c

MFC r270096:

2014-08-31 21:18:23 +00:00

vfs_mountroot.c

MFC r267351:

2014-06-22 21:21:27 +00:00

vfs_subr.c

MFC r269457:

2014-08-17 09:07:21 +00:00

vfs_syscalls.c

MFC r268764:

2014-07-30 03:56:17 +00:00

vfs_vnops.c

MFC r268612:

2014-07-28 01:11:29 +00:00

vnode_if.src

MFC r257899:

2013-12-13 06:12:21 +00:00