freebsd with flexible iflib nic queues
Go to file
John Baldwin f3215338ef Refactor the AIO subsystem to permit file-type-specific handling and
improve cancellation robustness.

Introduce a new file operation, fo_aio_queue, which is responsible for
queueing and completing an asynchronous I/O request for a given file.
The AIO subystem now exports library of routines to manipulate AIO
requests as well as the ability to run a handler function in the
"default" pool of AIO daemons to service a request.

A default implementation for file types which do not include an
fo_aio_queue method queues requests to the "default" pool invoking the
fo_read or fo_write methods as before.

The AIO subsystem permits file types to install a private "cancel"
routine when a request is queued to permit safe dequeueing and cleanup
of cancelled requests.

Sockets now use their own pool of AIO daemons and service per-socket
requests in FIFO order.  Socket requests will not block indefinitely
permitting timely cancellation of all requests.

Due to the now-tight coupling of the AIO subsystem with file types,
the AIO subsystem is now a standard part of all kernels.  The VFS_AIO
kernel option and aio.ko module are gone.

Many file types may block indefinitely in their fo_read or fo_write
callbacks resulting in a hung AIO daemon.  This can result in hung
user processes (when processes attempt to cancel all outstanding
requests during exit) or a hung system.  To protect against this, AIO
requests are only permitted for known "safe" files by default.  AIO
requests for all file types can be enabled by setting the new
vfs.aio.enable_usafe sysctl to a non-zero value.  The AIO tests have
been updated to skip operations on unsafe file types if the sysctl is
zero.

Currently, AIO requests on sockets and raw disks are considered safe
and are enabled by default.  aio_mlock() is also enabled by default.

Reviewed by:	cem, jilles
Discussed with:	kib (earlier version)
Sponsored by:	Chelsio Communications
Differential Revision:	https://reviews.freebsd.org/D5289
2016-03-01 18:12:14 +00:00
bin dump(1) -> dump(8). 2016-02-29 17:17:10 +00:00
cddl DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
contrib Restore configuration for RISC-V. 2016-03-01 17:43:06 +00:00
crypto Document our modified default value for PermitRootLogin. 2016-02-02 10:02:38 +00:00
etc network.subr: avoid unnecessary reinitialization 2016-02-29 20:21:54 +00:00
gnu Convert casperd(8) daemon to the libcasper. 2016-02-25 18:23:40 +00:00
include Update jemalloc to 4.1.0. 2016-02-29 19:10:32 +00:00
kerberos5 DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
lib Add two comments explaining the fine points of the hash 2016-03-01 15:21:01 +00:00
libexec Remove reaming files of the Casper daemon. 2016-02-27 14:45:32 +00:00
release Increase efiboot.img size used in ISO creation 2016-01-13 14:47:13 +00:00
rescue Fix the build after ifconfig was converted over to lib80211 in r291470 2015-11-30 16:34:13 +00:00
sbin carp(8) -> carp(4) 2016-02-29 17:28:05 +00:00
secure DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
share Refactor the AIO subsystem to permit file-type-specific handling and 2016-03-01 18:12:14 +00:00
sys Refactor the AIO subsystem to permit file-type-specific handling and 2016-03-01 18:12:14 +00:00
targets Update dependencies. 2016-02-26 22:14:15 +00:00
tests Refactor the AIO subsystem to permit file-type-specific handling and 2016-03-01 18:12:14 +00:00
tools Fix section numbers for autofs(5), kbdcontrol(1), vidcontrol(1), quota(1), 2016-03-01 11:36:10 +00:00
usr.bin Implement process-shared locks support for libthr.so.3, without 2016-02-28 17:52:33 +00:00
usr.sbin Fix typo. 2016-02-29 17:40:37 +00:00
.arcconfig Add repository.callsign, to help arcanist figure out what repo it's 2015-07-02 22:23:52 +00:00
.arclint phabricator related changes: 2015-04-20 20:33:22 +00:00
COPYRIGHT Bump copyright year. 2015-12-31 11:21:45 +00:00
LOCKS
MAINTAINERS Add interests/maintainerships + notes 2015-12-28 19:29:05 +00:00
Makefile Add order for installworld/installkernel. 2016-02-24 22:27:25 +00:00
Makefile.inc1 Convert casperd(8) daemon to the libcasper. 2016-02-25 18:23:40 +00:00
ObsoleteFiles.inc Remove taskqueue_enqueue_fast(). 2016-03-01 17:47:32 +00:00
README Import OpenSSL 1.0.2f. 2016-01-28 18:41:59 +00:00
UPDATING Correct date on ELF Tool Chain UPDATING entry 2016-02-27 12:34:51 +00:00

This is the top level of the FreeBSD source directory.  This file
was last revised on:
$FreeBSD$

For copyright information, please see the file COPYRIGHT in this
directory (additional copyright information also exists for some
sources in this tree - please see the specific source directories for
more information).

The Makefile in this directory supports a number of targets for
building components (or all) of the FreeBSD source tree.  See build(7)
and http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/makeworld.html
for more information, including setting make(1) variables.

The `buildkernel` and `installkernel` targets build and install
the kernel and the modules (see below).  Please see the top of
the Makefile in this directory for more information on the
standard build targets and compile-time flags.

Building a kernel is a somewhat more involved process.  See build(7), config(8),
and http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig.html
for more information.

Note: If you want to build and install the kernel with the
`buildkernel` and `installkernel` targets, you might need to build
world before.  More information is available in the handbook.

The kernel configuration files reside in the sys/<arch>/conf
sub-directory.  GENERIC is the default configuration used in release builds.
NOTES contains entries and documentation for all possible
devices, not just those commonly used.


Source Roadmap:
---------------

bin		System/user commands.

cddl		Various commands and libraries under the Common Development
		and Distribution License.

contrib		Packages contributed by 3rd parties.

crypto		Cryptography stuff (see crypto/README).

etc		Template files for /etc.

games		Amusements.

gnu		Various commands and libraries under the GNU Public License.
		Please see gnu/COPYING* for more information.

include		System include files.

kerberos5	Kerberos5 (Heimdal) package.

lib		System libraries.

libexec		System daemons.

release		Release building Makefile & associated tools.

rescue		Build system for statically linked /rescue utilities.

sbin		System commands.

secure		Cryptographic libraries and commands.

share		Shared resources.

sys		Kernel sources.

tests		Regression tests which can be run by Kyua.  See tests/README
		for additional information.

tools		Utilities for regression testing and miscellaneous tasks.

usr.bin		User commands.

usr.sbin	System administration commands.


For information on synchronizing your source tree with one or more of
the FreeBSD Project's development branches, please see:

  http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/synching.html