Ryan Stone 09ae7c4814 Check for preemption after lowering a thread's priority ...

When a high-priority thread is waiting for a mutex held by a
low-priority thread, it temporarily lends its priority to the
low-priority thread to prevent priority inversion.  When the mutex
is released, the lent priority is revoked and the low-priority
thread goes back to its original priority.

When the priority of that thread is lowered (through a call to
sched_priority()), the schedule was not checking whether
there is now a high-priority thread in the run queue.  This can
cause threads with real-time priority to be starved in the run
queue while the low-priority thread finishes its quantum.

Fix this by explicitly checking whether preemption is necessary
when a thread's priority is lowered.

Sponsored by: Dell EMC Isilon
Obtained from: Sandvine Inc
Differential Revision:	https://reviews.freebsd.org/D9518
Reviewed by: Jeff Roberson (ule)
MFC after: 1 month

2017-02-16 19:41:13 +00:00

..

bus_if.m

"Buses" is the preferred plural of "bus"

2017-01-15 17:54:01 +00:00

capabilities.conf

Update capabilities.conf comment

2016-09-08 14:04:04 +00:00

clock_if.m

…

cpufreq_if.m

…

device_if.m

Import the 'iflib' API library for network drivers. From the author:

2016-05-18 04:35:58 +00:00

genassym.sh

…

imgact_aout.c

Implement vsyscall hack. Prior to 2.13 glibc uses vsyscall

2016-01-09 20:18:53 +00:00

imgact_binmisc.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

imgact_elf32.c

…

imgact_elf64.c

…

imgact_elf.c

Copy the e_machine and e_flags fields from the binary into an ELF core dump.

2017-02-07 20:34:03 +00:00

imgact_gzip.c

…

imgact_shell.c

…

inflate.c

ANSIfy inflate.c

2016-10-04 17:57:30 +00:00

init_main.c

Bump struct thread alignment to 32.

2017-02-07 17:03:22 +00:00

init_sysent.c

Regenerate all the system call tables to drop "created from" lines.

2017-02-10 19:45:02 +00:00

kern_acct.c

Revert r312119 and reword the intent to fix -Wshadow issues

2017-01-15 09:25:33 +00:00

kern_alq.c

Use SI_SUB_LAST instead of SI_SUB_SMP as the "catch-all" subsystem.

2016-03-11 23:18:06 +00:00

kern_clock.c

Initialize 'ticks' earlier in boot after 'hz' is set.

2016-11-22 01:02:59 +00:00

kern_clocksource.c

Fix for race leading to endless timer interrupts related to

2017-01-20 17:40:31 +00:00

kern_condvar.c

cv: do a lockless check for no waiters in cv_signal and cv_broadcastpri

2016-09-06 17:16:59 +00:00

kern_conf.c

Undo r309891. Konstantin is right in that this condition normally

2016-12-12 19:11:04 +00:00

kern_cons.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

kern_context.c

…

kern_cpu.c

Add an EARLY_AP_STARTUP option to start APs earlier during boot.

2016-05-14 18:22:52 +00:00

kern_cpuset.c

Add kern_cpuset_getaffinity() and kern_cpuset_getaffinity(),

2017-02-05 13:24:54 +00:00

kern_ctf.c

Fix improper use of "its".

2016-11-08 23:59:41 +00:00

kern_descrip.c

fd: switch fget_unlocked to atomic_fcmpset

2017-02-05 01:40:27 +00:00

kern_dtrace.c

…

kern_dump.c

Add support for encrypted kernel crash dumps.

2016-12-10 16:20:39 +00:00

kern_environment.c

Create wrappers for uint64_t and int64_t for the tunables. While not

2016-04-15 03:09:55 +00:00

kern_et.c

Add labels to sysctls related to clocks.

2016-12-14 12:56:58 +00:00

kern_event.c

Add kevent EVFILT_EMPTY for notification when a client has received all data

2017-01-16 08:25:33 +00:00

kern_exec.c

Apply MADV_FREE to exec_map entries only after a lowmem event.

2017-02-15 01:50:58 +00:00

kern_exit.c

When a zombie gets reparented due to the parent exit, send SIGCHLD to

2016-12-12 11:11:50 +00:00

kern_fail.c

Fix some cosmetic issues in kern_fail.c omitted from r296927.

2016-06-09 13:17:08 +00:00

kern_ffclock.c

kernel: use our nitems() macro when it is available through param.h.

2016-04-19 23:48:27 +00:00

kern_fork.c

vfs: add vrefact, to be used when the vnode has to be already active

2016-12-12 15:37:11 +00:00

kern_gzio.c

…

kern_hhook.c

Get closer to a VIMAGE network stack teardown from top to bottom rather

2016-06-21 13:48:49 +00:00

kern_idle.c

…

kern_intr.c

…

kern_jail.c

Move IPv4-specific jail functions to new file netinet/in_jail.c

2016-08-09 02:16:21 +00:00

kern_khelp.c

…

kern_kthread.c

Re-schedule signals after kthread exits, since apparently there are

2016-08-10 13:47:12 +00:00

kern_ktr.c

Fix the logic in the ddb command 'show ktr /a'. Prior to r118269 it would

2016-01-31 17:32:20 +00:00

kern_ktrace.c

ANSYfy kern_ktrace.c and remove archaic register keyword

2017-01-20 14:59:56 +00:00

kern_linker.c

kern_linker: Handle module-loading failures in preloaded .ko files

2016-10-13 02:06:23 +00:00

kern_lock.c

lockmgr: implement fast path

2017-02-12 09:49:44 +00:00

kern_lockf.c

put very expensive sanity checks of advisory locks under DIAGNOSTIC

2017-01-30 15:20:13 +00:00

kern_lockstat.c

Sprinkle __read_mostly on backoff and lock profiling code.

2017-01-27 15:03:51 +00:00

kern_loginclass.c

…

kern_malloc.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

kern_mbuf.c

Import the 'iflib' API library for network drivers. From the author:

2016-05-18 04:35:58 +00:00

kern_mib.c

Mark a bunch of mpsafe sysctls as such.

2016-10-19 19:42:01 +00:00

kern_module.c

…

kern_mtxpool.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

kern_mutex.c

locks: tidy up unlock fallback paths

2017-02-09 08:19:30 +00:00

kern_ntptime.c

ANSIfy kern_ntptime.c

2017-01-25 20:22:32 +00:00

kern_numa.c

…

kern_osd.c

osd(9): Change array pointer to array pointer type from void*

2016-04-26 19:57:35 +00:00

kern_physio.c

Add four new RCTL resources - readbps, readiops, writebps and writeiops,

2016-04-07 04:23:25 +00:00

kern_pmc.c

hwpmc: annotate pmc_hook and pmc_intr as __read_mostly

2017-01-27 22:14:42 +00:00

kern_poll.c

…

kern_priv.c

…

kern_proc.c

Export the whole thread name in kinfo_proc

2016-12-07 15:04:22 +00:00

kern_procctl.c

reaper: Make REAPER_KILL_SUBTREE actually work.

2016-12-14 22:49:20 +00:00

kern_prot.c

proc: perform a lockless check in sys_issetugid

2017-01-24 21:48:57 +00:00

kern_racct.c

try to fix RACCT_RSS accounting

2017-02-14 13:54:05 +00:00

kern_rangelock.c

…

kern_rctl.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

kern_resource.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

kern_rmlock.c

Revert r313037

2017-02-04 06:24:49 +00:00

kern_rwlock.c

rwlock: fix r313454

2017-02-09 13:32:19 +00:00

kern_sdt.c

…

kern_sema.c

…

kern_sendfile.c

Move bogus_page declaration to vm_page.h and initialization to vm_page.c.

2017-01-04 22:27:19 +00:00

kern_sharedpage.c

Split kerne timekeep ABI structure vdso_sv_tk out of the struct

2015-11-23 07:09:35 +00:00

kern_shutdown.c

Revert crap accidentally committed

2017-01-28 16:31:23 +00:00

kern_sig.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

kern_switch.c

Add comments explaining unobvious td_critnest adjustments in

2017-01-22 19:41:42 +00:00

kern_sx.c

locks: tidy up unlock fallback paths

2017-02-09 08:19:30 +00:00

kern_synch.c

disambiguate msleep KASSERT diagnostics

2017-01-16 20:34:42 +00:00

kern_syscalls.c

…

kern_sysctl.c

Document the existence of the {0, 6, ...} sysctl.

2016-12-15 15:45:11 +00:00

kern_tc.c

Add labels to sysctls related to clocks.

2016-12-14 12:56:58 +00:00

kern_thr.c

thr_set_name(): silently truncate the given name as needed

2016-12-03 01:14:21 +00:00

kern_thread.c

Bump struct thread alignment to 32.

2017-02-07 17:03:22 +00:00

kern_time.c

Use time_t for intermediate values to avoid overflow in clock_ts_to_ct

2017-01-24 18:05:29 +00:00

kern_timeout.c

Permit timed sleeps for threads other than thread0 before timers are working.

2016-11-25 18:02:43 +00:00

kern_umtx.c

[mips] make UMTX_CHAINS configurable at compile time.

2016-11-15 01:34:38 +00:00

kern_uuid.c

…

kern_xxx.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

ksched.c

…

link_elf_obj.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

link_elf.c

kern: for pointers replace 0 with NULL.

2016-04-15 16:10:11 +00:00

linker_if.m

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

Make.tags.inc

…

Makefile

Don't create pointless backups of generated files in "make sysent".

2016-07-28 21:29:04 +00:00

makesyscalls.sh

Drop the "created from" line from files generated by makesyscalls.sh.

2017-02-10 19:25:52 +00:00

md4c.c

crypto routines: Hint minimum buffer sizes to the compiler

2016-05-26 19:29:29 +00:00

md5c.c

crypto routines: Hint minimum buffer sizes to the compiler

2016-05-26 19:29:29 +00:00

msi_if.m

Introduce MSI and MSI-X support to intrng. This adds a new msi device

2016-05-16 09:11:40 +00:00

p1003_1b.c

…

pic_if.m

INTRNG: Rework handling with resources. Partially revert r301453.

2016-08-19 10:52:39 +00:00

posix4_mib.c

posix4_mib: Don't overrun facility_initialized array

2016-04-27 00:10:32 +00:00

sched_4bsd.c

Check for preemption after lowering a thread's priority

2017-02-16 19:41:13 +00:00

sched_ule.c

Check for preemption after lowering a thread's priority

2017-02-16 19:41:13 +00:00

serdev_if.m

…

stack_protector.c

…

subr_acl_nfs4.c

…

subr_acl_posix1e.c

…

subr_autoconf.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_blist.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_bufring.c

…

subr_bus_dma.c

Fix a bug introduced in r291716:

2016-01-11 20:38:39 +00:00

subr_bus.c

"Buses" is the preferred plural of "bus"

2017-01-15 17:54:01 +00:00

subr_busdma_bufalloc.c

…

subr_capability.c

capsicum: plug spurious memset in __cap_rights_init

2015-12-01 02:48:42 +00:00

subr_clock.c

Use time_t for intermediate values to avoid overflow in clock_ts_to_ct

2017-01-24 18:05:29 +00:00

subr_counter.c

Zero return value when counter_rate() switches over to next second and

2016-12-13 20:11:45 +00:00

subr_devmap.c

Include machine/acle-compat.h in cdefs.h on arm if the compiler doesn't

2016-05-25 19:44:26 +00:00

subr_devstat.c

Add support for managing Shingled Magnetic Recording (SMR) drives.

2016-05-19 14:08:36 +00:00

subr_disk.c

…

subr_dummy_vdso_tc.c

…

subr_eventhandler.c

…

subr_fattime.c

…

subr_firmware.c

Fix improper use of "its".

2016-11-08 23:59:41 +00:00

subr_gtaskqueue.c

A few more style bugs lying around in here.

2017-01-26 13:48:45 +00:00

subr_hash.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_hints.c

…

subr_intr.c

Only allow the pic type to be either a PIC or MSI type. All interrupt

2017-02-06 13:08:48 +00:00

subr_kdb.c

…

subr_kobj.c

…

subr_lock.c

locks: follow up r313386

2017-02-07 16:01:07 +00:00

subr_log.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_mbpool.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

subr_mchain.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_module.c

…

subr_msgbuf.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

subr_param.c

Initialize 'ticks' earlier in boot after 'hz' is set.

2016-11-22 01:02:59 +00:00

subr_pcpu.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_pctrie.c

sys: extend use of the howmany() macro when available.

2016-04-26 15:38:17 +00:00

subr_power.c

…

subr_prf.c

Include <stdarg.h> instead of <machine/stdarg.h> when compiled as

2016-10-24 18:03:04 +00:00

subr_prof.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_rman.c

Add new bus methods for mapping resources.

2016-05-20 17:57:47 +00:00

subr_rtc.c

Make resettodr_lock accessible outside subr_rtc.c. Protect

2016-09-21 10:15:08 +00:00

subr_sbuf.c

…

subr_scanf.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

subr_sfbuf.c

subr_sfbus.c need sys/proc.h for struct thread definition.

2017-02-07 17:31:24 +00:00

subr_sglist.c

Add sglist functions for working with arrays of VM pages.

2016-05-20 23:28:43 +00:00

subr_sleepqueue.c

sleepq_catch_signals: do thread suspension before signal check

2017-02-14 17:13:23 +00:00

subr_smp.c

Handle broadcast NMIs.

2016-10-24 16:40:27 +00:00

subr_stack.c

Add support for a configurable output channel to witness(4).

2015-11-19 05:56:59 +00:00

subr_syscall.c

Add PROC_TRAPCAP procctl(2) controls and global sysctl kern.trap_enocap.

2016-09-21 08:23:33 +00:00

subr_taskqueue.c

While draining a timeout task prevent the taskqueue_enqueue_timeout()

2016-09-29 10:38:20 +00:00

subr_terminal.c

…

subr_trap.c

The assertion re-added in r302614 was triggered when stopping signal

2016-07-18 10:53:47 +00:00

subr_turnstile.c

ddb(4): Add sleepchains to "show allchains"

2016-10-22 18:02:20 +00:00

subr_uio.c

Switch copyout_map() to use vm_mmap_object() instead of vm_mmap().

2017-02-12 20:54:31 +00:00

subr_unit.c

Clean up trailing whitespace

2017-01-14 04:16:13 +00:00

subr_vmem.c

subr_vmem: Fix double-free in error case of vmem_create

2016-05-11 23:16:11 +00:00

subr_witness.c

Make witness_warn() always print to the console.

2017-02-05 02:27:04 +00:00

sys_capability.c

capsicum: perform copyout without the fildesc lock held in sys_cap_ioctls_get

2016-10-21 16:12:23 +00:00

sys_generic.c

Add kern_pread() and kern_pwrite(), and use it in compats instead

2017-01-31 15:35:18 +00:00

sys_pipe.c

Generate syscall tables and update pipe() implementation after r302094.

2016-06-22 21:18:19 +00:00

sys_procdesc.c

Hide the boottime and bootimebin globals, provide the getboottime(9)

2016-07-27 11:08:59 +00:00

sys_process.c

Don't set P2_PTRACE_FSTP in a process that invokes ptrace(PT_TRACE_ME).

2016-08-19 17:57:14 +00:00

sys_socket.c

Set MORETOCOME for AIO write requests on a socket.

2017-01-06 23:41:45 +00:00

syscalls.c

Regenerate all the system call tables to drop "created from" lines.

2017-02-10 19:45:02 +00:00

syscalls.master

Rename the 'flags' argument to getfsstat() to 'mode' and validate it.

2016-12-27 20:21:11 +00:00

systrace_args.c

Regen after r310638.

2016-12-27 20:22:17 +00:00

sysv_ipc.c

…

sysv_msg.c

Remove a comment that was part of copied code, and is misleading in

2016-06-09 15:34:33 +00:00

sysv_sem.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

sysv_shm.c

Add shmatt_t.

2016-07-26 17:23:49 +00:00

tty_compat.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

tty_info.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

tty_inq.c

Check tty_gone() after allocating IO buffers. The tty lock has to be

2017-01-13 16:37:38 +00:00

tty_outq.c

Check tty_gone() after allocating IO buffers. The tty lock has to be

2017-01-13 16:37:38 +00:00

tty_pts.c

sys/kern: spelling fixes in comments.

2016-04-29 22:15:33 +00:00

tty_tty.c

…

tty_ttydisc.c

Don't clear the software flow control flag before draining for last

2016-01-26 14:46:39 +00:00

tty.c

Correct the comments about how much buffer is allocated.

2017-01-13 17:03:23 +00:00

uipc_accf.c

Use correct size type in do_setopt_accept_filter

2016-10-12 00:56:49 +00:00

uipc_debug.c

Refactor the AIO subsystem to permit file-type-specific handling and

2016-03-01 18:12:14 +00:00

uipc_domain.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

uipc_mbuf2.c

Remove writability requirement for single-mbuf, contiguous-range

2017-01-12 06:38:03 +00:00

uipc_mbuf.c

Suppress a warning about m_assertbuf being unused.

2017-01-15 03:53:20 +00:00

uipc_mbufhash.c

…

uipc_mqueue.c

Initialize reserved bytes in struct mq_attr and its 32compat

2016-11-14 13:20:10 +00:00

uipc_sem.c

Clean up some style(9) violations.

2016-04-14 17:07:26 +00:00

uipc_shm.c

Consistently handle negative or wrapping offsets in the mmap(2) syscalls.

2017-02-12 21:05:44 +00:00

uipc_sockbuf.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

uipc_socket.c

Merge filt_soread and filt_solisten and decide what to do when checking

2017-02-01 13:12:07 +00:00

uipc_syscalls.c

Add kern_listen(), kern_shutdown(), and kern_socket(), and use them

2017-01-30 12:57:22 +00:00

uipc_usrreq.c

For non-listening AF_UNIX sockets return error code EOPNOTSUPP to match

2017-01-25 22:26:45 +00:00

vfs_acl.c

…

vfs_aio.c

Rework r313352.

2017-02-13 09:04:38 +00:00

vfs_bio.c

Do not set BIO_DONE if the BIO specifies a completion handler.

2017-01-10 21:41:28 +00:00

vfs_cache.c

cache: use vrefact for '.' lookups and refing the rdir in fullpath

2017-01-30 03:20:05 +00:00

vfs_cluster.c

Move bogus_page declaration to vm_page.h and initialization to vm_page.c.

2017-01-04 22:27:19 +00:00

vfs_default.c

lockmgr: implement fast path

2017-02-12 09:49:44 +00:00

vfs_export.c

Fix build when no INET and INET6 in kernel config.

2016-11-17 16:13:30 +00:00

vfs_extattr.c

…

vfs_hash.c

Add vfs_hash_ref(9) function, which finds a vnode by the hash value

2016-05-11 06:32:22 +00:00

vfs_init.c

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00

vfs_lookup.c

Provide fallback VOP methods for crossmp vnode.

2017-01-22 19:36:02 +00:00

vfs_mount.c

Do not allocate struct statfs on kernel stack.

2017-01-05 17:19:26 +00:00

vfs_mountroot.c

Make root_mount_hold() work after boot. This is important for two

2017-02-06 20:44:34 +00:00

vfs_subr.c

vfs: use atomic_fcmpset in vfs_refcount_*

2017-02-05 03:23:16 +00:00

vfs_syscalls.c

Replace calls to sys_truncate() with kern_truncate().

2017-01-31 15:19:44 +00:00

vfs_vnops.c

Consistently handle negative or wrapping offsets in the mmap(2) syscalls.

2017-02-12 21:05:44 +00:00

vnode_if.src

Renumber license clauses in sys/kern to avoid skipping #3

2016-09-15 13:16:20 +00:00