2002-03-11 21:42:35 +00:00
|
|
|
/*-
|
2017-11-27 15:17:37 +00:00
|
|
|
* SPDX-License-Identifier: BSD-3-Clause
|
|
|
|
*
|
2002-03-11 21:42:35 +00:00
|
|
|
* Copyright (c) 2002 Poul-Henning Kamp
|
|
|
|
* Copyright (c) 2002 Networks Associates Technology, Inc.
|
|
|
|
* All rights reserved.
|
|
|
|
*
|
|
|
|
* This software was developed for the FreeBSD Project by Poul-Henning Kamp
|
|
|
|
* and NAI Labs, the Security Research Division of Network Associates, Inc.
|
|
|
|
* under DARPA/SPAWAR contract N66001-01-C-8035 ("CBOSS"), as part of the
|
|
|
|
* DARPA CHATS research program.
|
|
|
|
*
|
|
|
|
* Redistribution and use in source and binary forms, with or without
|
|
|
|
* modification, are permitted provided that the following conditions
|
|
|
|
* are met:
|
|
|
|
* 1. Redistributions of source code must retain the above copyright
|
|
|
|
* notice, this list of conditions and the following disclaimer.
|
|
|
|
* 2. Redistributions in binary form must reproduce the above copyright
|
|
|
|
* notice, this list of conditions and the following disclaimer in the
|
|
|
|
* documentation and/or other materials provided with the distribution.
|
|
|
|
* 3. The names of the authors may not be used to endorse or promote
|
|
|
|
* products derived from this software without specific prior written
|
|
|
|
* permission.
|
|
|
|
*
|
|
|
|
* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
|
|
|
|
* ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
|
|
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
|
|
* ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
|
|
|
|
* FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
|
|
* DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
|
|
* OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
|
|
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
|
|
* LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
|
|
* OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
|
|
* SUCH DAMAGE.
|
|
|
|
*
|
|
|
|
* $FreeBSD$
|
|
|
|
*/
|
|
|
|
|
2002-04-22 19:54:17 +00:00
|
|
|
#ifndef _GEOM_GEOM_H_
|
|
|
|
#define _GEOM_GEOM_H_
|
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
#include <sys/lock.h>
|
|
|
|
#include <sys/mutex.h>
|
|
|
|
#include <sys/sx.h>
|
|
|
|
#include <sys/queue.h>
|
2002-04-23 19:54:02 +00:00
|
|
|
#include <sys/ioccom.h>
|
2011-03-24 08:37:48 +00:00
|
|
|
#include <sys/conf.h>
|
2003-05-31 18:13:07 +00:00
|
|
|
#include <sys/module.h>
|
2002-03-11 21:42:35 +00:00
|
|
|
|
2002-03-26 21:40:06 +00:00
|
|
|
struct g_class;
|
2002-03-11 21:42:35 +00:00
|
|
|
struct g_geom;
|
|
|
|
struct g_consumer;
|
|
|
|
struct g_provider;
|
2003-02-08 13:03:57 +00:00
|
|
|
struct g_stat;
|
2002-03-11 21:42:35 +00:00
|
|
|
struct thread;
|
|
|
|
struct bio;
|
|
|
|
struct sbuf;
|
2003-03-27 14:35:00 +00:00
|
|
|
struct gctl_req;
|
2002-11-06 20:05:15 +00:00
|
|
|
struct g_configargs;
|
Add support for managing Shingled Magnetic Recording (SMR) drives.
This change includes support for SCSI SMR drives (which conform to the
Zoned Block Commands or ZBC spec) and ATA SMR drives (which conform to
the Zoned ATA Command Set or ZAC spec) behind SAS expanders.
This includes full management support through the GEOM BIO interface, and
through a new userland utility, zonectl(8), and through camcontrol(8).
This is now ready for filesystems to use to detect and manage zoned drives.
(There is no work in progress that I know of to use this for ZFS or UFS, if
anyone is interested, let me know and I may have some suggestions.)
Also, improve ATA command passthrough and dispatch support, both via ATA
and ATA passthrough over SCSI.
Also, add support to camcontrol(8) for the ATA Extended Power Conditions
feature set. You can now manage ATA device power states, and set various
idle time thresholds for a drive to enter lower power states.
Note that this change cannot be MFCed in full, because it depends on
changes to the struct bio API that break compatilibity. In order to
avoid breaking the stable API, only changes that don't touch or depend on
the struct bio changes can be merged. For example, the camcontrol(8)
changes don't depend on the new bio API, but zonectl(8) and the probe
changes to the da(4) and ada(4) drivers do depend on it.
Also note that the SMR changes have not yet been tested with an actual
SCSI ZBC device, or a SCSI to ATA translation layer (SAT) that supports
ZBC to ZAC translation. I have not yet gotten a suitable drive or SAT
layer, so any testing help would be appreciated. These changes have been
tested with Seagate Host Aware SATA drives attached to both SAS and SATA
controllers. Also, I do not have any SATA Host Managed devices, and I
suspect that it may take additional (hopefully minor) changes to support
them.
Thanks to Seagate for supplying the test hardware and answering questions.
sbin/camcontrol/Makefile:
Add epc.c and zone.c.
sbin/camcontrol/camcontrol.8:
Document the zone and epc subcommands.
sbin/camcontrol/camcontrol.c:
Add the zone and epc subcommands.
Add auxiliary register support to build_ata_cmd(). Make sure to
set the CAM_ATAIO_NEEDRESULT, CAM_ATAIO_DMA, and CAM_ATAIO_FPDMA
flags as appropriate for ATA commands.
Add a new get_ata_status() function to parse ATA result from SCSI
sense descriptors (for ATA passthrough over SCSI) and ATA I/O
requests.
sbin/camcontrol/camcontrol.h:
Update the build_ata_cmd() prototype
Add get_ata_status(), zone(), and epc().
sbin/camcontrol/epc.c:
Support for ATA Extended Power Conditions features. This includes
support for all features documented in the ACS-4 Revision 12
specification from t13.org (dated February 18, 2016).
The EPC feature set allows putting a drive into a power power mode
immediately, or setting timeouts so that the drive will
automatically enter progressively lower power states after various
idle times.
sbin/camcontrol/fwdownload.c:
Update the firmware download code for the new build_ata_cmd()
arguments.
sbin/camcontrol/zone.c:
Implement support for Shingled Magnetic Recording (SMR) drives
via SCSI Zoned Block Commands (ZBC) and ATA Zoned Device ATA
Command Set (ZAC).
These specs were developed in concert, and are functionally
identical. The primary differences are due to SCSI and ATA
differences. (SCSI is big endian, ATA is little endian, for
example.)
This includes support for all commands defined in the ZBC and
ZAC specs.
sys/cam/ata/ata_all.c:
Decode a number of additional ATA command names in ata_op_string().
Add a new CCB building function, ata_read_log().
Add ata_zac_mgmt_in() and ata_zac_mgmt_out() CCB building
functions. These support both DMA and NCQ encapsulation.
sys/cam/ata/ata_all.h:
Add prototypes for ata_read_log(), ata_zac_mgmt_out(), and
ata_zac_mgmt_in().
sys/cam/ata/ata_da.c:
Revamp the ada(4) driver to support zoned devices.
Add four new probe states to gather information needed for zone
support.
Add a new adasetflags() function to avoid duplication of large
blocks of flag setting between the async handler and register
functions.
Add new sysctl variables that describe zone support and paramters.
Add support for the new BIO_ZONE bio, and all of its subcommands:
DISK_ZONE_OPEN, DISK_ZONE_CLOSE, DISK_ZONE_FINISH, DISK_ZONE_RWP,
DISK_ZONE_REPORT_ZONES, and DISK_ZONE_GET_PARAMS.
sys/cam/scsi/scsi_all.c:
Add command descriptions for the ZBC IN/OUT commands.
Add descriptions for ZBC Host Managed devices.
Add a new function, scsi_ata_pass() to do ATA passthrough over
SCSI. This will eventually replace scsi_ata_pass_16() -- it
can create the 12, 16, and 32-byte variants of the ATA
PASS-THROUGH command, and supports setting all of the
registers defined as of SAT-4, Revision 5 (March 11, 2016).
Change scsi_ata_identify() to use scsi_ata_pass() instead of
scsi_ata_pass_16().
Add a new scsi_ata_read_log() function to facilitate reading
ATA logs via SCSI.
sys/cam/scsi/scsi_all.h:
Add the new ATA PASS-THROUGH(32) command CDB. Add extended and
variable CDB opcodes.
Add Zoned Block Device Characteristics VPD page.
Add ATA Return SCSI sense descriptor.
Add prototypes for scsi_ata_read_log() and scsi_ata_pass().
sys/cam/scsi/scsi_da.c:
Revamp the da(4) driver to support zoned devices.
Add five new probe states, four of which are needed for ATA
devices.
Add five new sysctl variables that describe zone support and
parameters.
The da(4) driver supports SCSI ZBC devices, as well as ATA ZAC
devices when they are attached via a SCSI to ATA Translation (SAT)
layer. Since ZBC -> ZAC translation is a new feature in the T10
SAT-4 spec, most SATA drives will be supported via ATA commands
sent via the SCSI ATA PASS-THROUGH command. The da(4) driver will
prefer the ZBC interface, if it is available, for performance
reasons, but will use the ATA PASS-THROUGH interface to the ZAC
command set if the SAT layer doesn't support translation yet.
As I mentioned above, ZBC command support is untested.
Add support for the new BIO_ZONE bio, and all of its subcommands:
DISK_ZONE_OPEN, DISK_ZONE_CLOSE, DISK_ZONE_FINISH, DISK_ZONE_RWP,
DISK_ZONE_REPORT_ZONES, and DISK_ZONE_GET_PARAMS.
Add scsi_zbc_in() and scsi_zbc_out() CCB building functions.
Add scsi_ata_zac_mgmt_out() and scsi_ata_zac_mgmt_in() CCB/CDB
building functions. Note that these have return values, unlike
almost all other CCB building functions in CAM. The reason is
that they can fail, depending upon the particular combination
of input parameters. The primary failure case is if the user
wants NCQ, but fails to specify additional CDB storage. NCQ
requires using the 32-byte version of the SCSI ATA PASS-THROUGH
command, and the current CAM CDB size is 16 bytes.
sys/cam/scsi/scsi_da.h:
Add ZBC IN and ZBC OUT CDBs and opcodes.
Add SCSI Report Zones data structures.
Add scsi_zbc_in(), scsi_zbc_out(), scsi_ata_zac_mgmt_out(), and
scsi_ata_zac_mgmt_in() prototypes.
sys/dev/ahci/ahci.c:
Fix SEND / RECEIVE FPDMA QUEUED in the ahci(4) driver.
ahci_setup_fis() previously set the top bits of the sector count
register in the FIS to 0 for FPDMA commands. This is okay for
read and write, because the PRIO field is in the only thing in
those bits, and we don't implement that further up the stack.
But, for SEND and RECEIVE FPDMA QUEUED, the subcommand is in that
byte, so it needs to be transmitted to the drive.
In ahci_setup_fis(), always set the the top 8 bits of the
sector count register. We need it in both the standard
and NCQ / FPDMA cases.
sys/geom/eli/g_eli.c:
Pass BIO_ZONE commands through the GELI class.
sys/geom/geom.h:
Add g_io_zonecmd() prototype.
sys/geom/geom_dev.c:
Add new DIOCZONECMD ioctl, which allows sending zone commands to
disks.
sys/geom/geom_disk.c:
Add support for BIO_ZONE commands.
sys/geom/geom_disk.h:
Add a new flag, DISKFLAG_CANZONE, that indicates that a given
GEOM disk client can handle BIO_ZONE commands.
sys/geom/geom_io.c:
Add a new function, g_io_zonecmd(), that handles execution of
BIO_ZONE commands.
Add permissions check for BIO_ZONE commands.
Add command decoding for BIO_ZONE commands.
sys/geom/geom_subr.c:
Add DDB command decoding for BIO_ZONE commands.
sys/kern/subr_devstat.c:
Record statistics for REPORT ZONES commands. Note that the
number of bytes transferred for REPORT ZONES won't quite match
what is received from the harware. This is because we're
necessarily counting bytes coming from the da(4) / ada(4) drivers,
which are using the disk_zone.h interface to communicate up
the stack. The structure sizes it uses are slightly different
than the SCSI and ATA structure sizes.
sys/sys/ata.h:
Add many bit and structure definitions for ZAC, NCQ, and EPC
command support.
sys/sys/bio.h:
Convert the bio_cmd field to a straight enumeration. This will
yield more space for additional commands in the future. After
change r297955 and other related changes, this is now possible.
Converting to an enumeration will also prevent use as a bitmask
in the future.
sys/sys/disk.h:
Define the DIOCZONECMD ioctl.
sys/sys/disk_zone.h:
Add a new API for managing zoned disks. This is very close to
the SCSI ZBC and ATA ZAC standards, but uses integers in native
byte order instead of big endian (SCSI) or little endian (ATA)
byte arrays.
This is intended to offer to the complete feature set of the ZBC
and ZAC disk management without requiring the application developer
to include SCSI or ATA headers. We also use one set of headers
for ioctl consumers and kernel bio-level consumers.
sys/sys/param.h:
Bump __FreeBSD_version for sys/bio.h command changes, and inclusion
of SMR support.
usr.sbin/Makefile:
Add the zonectl utility.
usr.sbin/diskinfo/diskinfo.c
Add disk zoning capability to the 'diskinfo -v' output.
usr.sbin/zonectl/Makefile:
Add zonectl makefile.
usr.sbin/zonectl/zonectl.8
zonectl(8) man page.
usr.sbin/zonectl/zonectl.c
The zonectl(8) utility. This allows managing SCSI or ATA zoned
disks via the disk_zone.h API. You can report zones, reset write
pointers, get parameters, etc.
Sponsored by: Spectra Logic
Differential Revision: https://reviews.freebsd.org/D6147
Reviewed by: wblock (documentation)
2016-05-19 14:08:36 +00:00
|
|
|
struct disk_zone_args;
|
2002-03-11 21:42:35 +00:00
|
|
|
|
2002-11-06 20:05:15 +00:00
|
|
|
typedef int g_config_t (struct g_configargs *ca);
|
2003-06-01 13:47:51 +00:00
|
|
|
typedef void g_ctl_req_t (struct gctl_req *, struct g_class *cp, char const *verb);
|
2003-03-27 14:35:00 +00:00
|
|
|
typedef int g_ctl_create_geom_t (struct gctl_req *, struct g_class *cp, struct g_provider *pp);
|
|
|
|
typedef int g_ctl_destroy_geom_t (struct gctl_req *, struct g_class *cp, struct g_geom *gp);
|
2003-04-22 21:01:46 +00:00
|
|
|
typedef int g_ctl_config_geom_t (struct gctl_req *, struct g_geom *gp, const char *verb);
|
2003-05-31 18:13:07 +00:00
|
|
|
typedef void g_init_t (struct g_class *mp);
|
|
|
|
typedef void g_fini_t (struct g_class *mp);
|
2003-09-01 20:45:32 +00:00
|
|
|
typedef struct g_geom * g_taste_t (struct g_class *, struct g_provider *, int flags);
|
2004-12-12 10:09:05 +00:00
|
|
|
typedef int g_ioctl_t(struct g_provider *pp, u_long cmd, void *data, int fflag, struct thread *td);
|
2002-03-11 21:42:35 +00:00
|
|
|
#define G_TF_NORMAL 0
|
|
|
|
#define G_TF_INSIST 1
|
|
|
|
#define G_TF_TRANSPARENT 2
|
|
|
|
typedef int g_access_t (struct g_provider *, int, int, int);
|
|
|
|
/* XXX: not sure about the thread arg */
|
2002-03-26 22:07:38 +00:00
|
|
|
typedef void g_orphan_t (struct g_consumer *);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
|
|
|
typedef void g_start_t (struct bio *);
|
|
|
|
typedef void g_spoiled_t (struct g_consumer *);
|
Plumb device physical path reporting from CAM devices, through GEOM and
DEVFS, and make it accessible via the diskinfo utility.
Extend GEOM's generic attribute query mechanism into generic disk consumers.
sys/geom/geom_disk.c:
sys/geom/geom_disk.h:
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Allow disk providers to implement a new method which can override
the default BIO_GETATTR response, d_getattr(struct bio *). This
function returns -1 if not handled, otherwise it returns 0 or an
errno to be passed to g_io_deliver().
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Don't copy the serial number to dp->d_ident anymore, as the CAM XPT
is now responsible for returning this information via
d_getattr()->(a)dagetattr()->xpt_getatr().
sys/geom/geom_dev.c:
- Implement a new ioctl, DIOCGPHYSPATH, which returns the GEOM
attribute "GEOM::physpath", if possible. If the attribute request
returns a zero-length string, ENOENT is returned.
usr.sbin/diskinfo/diskinfo.c:
- If the DIOCGPHYSPATH ioctl is successful, report physical path
data when diskinfo is executed with the '-v' option.
Submitted by: will
Reviewed by: gibbs
Sponsored by: Spectra Logic Corporation
Add generic attribute change notification support to GEOM.
sys/sys/geom/geom.h:
Add a new attrchanged method field to both g_class
and g_geom.
sys/sys/geom/geom.h:
sys/geom/geom_event.c:
- Provide the g_attr_changed() function that providers
can use to advertise attribute changes.
- Perform delivery of attribute change notifications
from a thread context via the standard GEOM event
mechanism.
sys/geom/geom_subr.c:
Inherit the attrchanged method from class to geom (class instance).
sys/geom/geom_disk.c:
Provide disk_attr_changed() to provide g_attr_changed() access
to consumers of the disk API.
sys/cam/scsi/scsi_pass.c:
sys/cam/scsi/scsi_da.c:
sys/geom/geom_dev.c:
sys/geom/geom_disk.c:
Use attribute changed events to track updates to physical path
information.
sys/cam/scsi/scsi_da.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, and
the updated buffer type references our physical path
attribute, emit a GEOM attribute changed event via the
disk_attr_changed() API.
sys/cam/scsi/scsi_pass.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, update
the physical patch devfs alias for this pass instance.
Submitted by: gibbs
Sponsored by: Spectra Logic Corporation
2011-06-14 17:10:32 +00:00
|
|
|
typedef void g_attrchanged_t (struct g_consumer *, const char *attr);
|
Fix a bug which causes a panic in daopen(). The panic is caused by
a da(4) instance going away while GEOM is still probing it.
In this case, the GEOM disk class instance has been created by
disk_create(), and the taste of the disk is queued in the GEOM
event queue.
While that event is queued, the da(4) instance goes away. When the
open call comes into the da(4) driver, it dereferences the freed
(but non-NULL) peripheral pointer provided by GEOM, which results
in a panic.
The solution is to add a callback to the GEOM disk code that is
called when all of its resources are cleaned up. This is
implemented inside GEOM by adding an optional callback that is
called when all consumers have detached from a provider, and the
provider is about to be deleted.
scsi_cd.c,
scsi_da.c: In the register routine for the cd(4) and da(4)
routines, acquire a reference to the CAM peripheral
instance just before we call disk_create().
Use the new GEOM disk d_gone() callback to register
a callback (dadiskgonecb()/cddiskgonecb()) that
decrements the peripheral reference count once GEOM
has finished cleaning up its resources.
In the cd(4) driver, clean up open and close
behavior slightly. GEOM makes sure we only get one
open() and one close call, so there is no need to
set an open flag and decrement the reference count
if we are not the first open.
In the cd(4) driver, use cam_periph_release_locked()
in a couple of error scenarios to avoid extra mutex
calls.
geom.h: Add a new, optional, providergone callback that
is called when a provider is about to be deleted.
geom_disk.h: Add a new d_gone() callback to the GEOM disk
interface.
Bump the DISK_VERSION to version 2. This probably
should have been done after a couple of previous
changes, especially the addition of the d_getattr()
callback.
geom_disk.c: Add a providergone callback for the disk class,
g_disk_providergone(), that calls the user's
d_gone() callback if it exists.
Bump the DISK_VERSION to 2.
geom_subr.c: In g_destroy_provider(), call the providergone
callback if it has been provided.
In g_new_geomf(), propagate the class's
providergone callback to the new geom instance.
blkfront.c: Callers of disk_create() are supposed to pass in
DISK_VERSION, not an explicit disk API version
number. Update the blkfront driver to do that.
disk.9: Update the disk(9) man page to include information
on the new d_gone() callback, as well as the
previously added d_getattr() callback, d_descr
field, and HBA PCI ID fields.
MFC after: 5 days
2012-06-24 04:29:03 +00:00
|
|
|
typedef void g_provgone_t (struct g_provider *);
|
2002-12-16 22:33:27 +00:00
|
|
|
typedef void g_dumpconf_t (struct sbuf *, const char *indent, struct g_geom *,
|
2002-03-11 21:42:35 +00:00
|
|
|
struct g_consumer *, struct g_provider *);
|
2012-07-07 20:13:40 +00:00
|
|
|
typedef void g_resize_t(struct g_consumer *cp);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
|
|
|
/*
|
2002-03-26 21:40:06 +00:00
|
|
|
* The g_class structure describes a transformation class. In other words
|
|
|
|
* all BSD disklabel handlers share one g_class, all MBR handlers share
|
|
|
|
* one common g_class and so on.
|
|
|
|
* Certain operations are instantiated on the class, most notably the
|
2002-11-06 20:05:15 +00:00
|
|
|
* taste and config_geom functions.
|
2002-03-11 21:42:35 +00:00
|
|
|
*/
|
2002-03-26 21:40:06 +00:00
|
|
|
struct g_class {
|
2002-12-16 22:33:27 +00:00
|
|
|
const char *name;
|
2004-08-08 06:46:27 +00:00
|
|
|
u_int version;
|
2011-07-17 20:35:30 +00:00
|
|
|
u_int spare0;
|
2002-03-11 21:42:35 +00:00
|
|
|
g_taste_t *taste;
|
2002-11-06 20:05:15 +00:00
|
|
|
g_config_t *config;
|
2003-06-01 13:47:51 +00:00
|
|
|
g_ctl_req_t *ctlreq;
|
2003-05-31 18:13:07 +00:00
|
|
|
g_init_t *init;
|
|
|
|
g_fini_t *fini;
|
2003-03-27 14:35:00 +00:00
|
|
|
g_ctl_destroy_geom_t *destroy_geom;
|
2004-08-08 06:46:27 +00:00
|
|
|
/*
|
2005-09-03 11:03:10 +00:00
|
|
|
* Default values for geom methods
|
2004-08-08 06:46:27 +00:00
|
|
|
*/
|
|
|
|
g_start_t *start;
|
|
|
|
g_spoiled_t *spoiled;
|
Plumb device physical path reporting from CAM devices, through GEOM and
DEVFS, and make it accessible via the diskinfo utility.
Extend GEOM's generic attribute query mechanism into generic disk consumers.
sys/geom/geom_disk.c:
sys/geom/geom_disk.h:
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Allow disk providers to implement a new method which can override
the default BIO_GETATTR response, d_getattr(struct bio *). This
function returns -1 if not handled, otherwise it returns 0 or an
errno to be passed to g_io_deliver().
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Don't copy the serial number to dp->d_ident anymore, as the CAM XPT
is now responsible for returning this information via
d_getattr()->(a)dagetattr()->xpt_getatr().
sys/geom/geom_dev.c:
- Implement a new ioctl, DIOCGPHYSPATH, which returns the GEOM
attribute "GEOM::physpath", if possible. If the attribute request
returns a zero-length string, ENOENT is returned.
usr.sbin/diskinfo/diskinfo.c:
- If the DIOCGPHYSPATH ioctl is successful, report physical path
data when diskinfo is executed with the '-v' option.
Submitted by: will
Reviewed by: gibbs
Sponsored by: Spectra Logic Corporation
Add generic attribute change notification support to GEOM.
sys/sys/geom/geom.h:
Add a new attrchanged method field to both g_class
and g_geom.
sys/sys/geom/geom.h:
sys/geom/geom_event.c:
- Provide the g_attr_changed() function that providers
can use to advertise attribute changes.
- Perform delivery of attribute change notifications
from a thread context via the standard GEOM event
mechanism.
sys/geom/geom_subr.c:
Inherit the attrchanged method from class to geom (class instance).
sys/geom/geom_disk.c:
Provide disk_attr_changed() to provide g_attr_changed() access
to consumers of the disk API.
sys/cam/scsi/scsi_pass.c:
sys/cam/scsi/scsi_da.c:
sys/geom/geom_dev.c:
sys/geom/geom_disk.c:
Use attribute changed events to track updates to physical path
information.
sys/cam/scsi/scsi_da.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, and
the updated buffer type references our physical path
attribute, emit a GEOM attribute changed event via the
disk_attr_changed() API.
sys/cam/scsi/scsi_pass.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, update
the physical patch devfs alias for this pass instance.
Submitted by: gibbs
Sponsored by: Spectra Logic Corporation
2011-06-14 17:10:32 +00:00
|
|
|
g_attrchanged_t *attrchanged;
|
2004-08-08 06:46:27 +00:00
|
|
|
g_dumpconf_t *dumpconf;
|
|
|
|
g_access_t *access;
|
|
|
|
g_orphan_t *orphan;
|
|
|
|
g_ioctl_t *ioctl;
|
2012-06-25 04:26:10 +00:00
|
|
|
g_provgone_t *providergone;
|
2012-07-07 20:13:40 +00:00
|
|
|
g_resize_t *resize;
|
2012-07-17 22:16:10 +00:00
|
|
|
void *spare1;
|
2012-07-16 16:50:28 +00:00
|
|
|
void *spare2;
|
2002-04-04 09:54:13 +00:00
|
|
|
/*
|
2003-05-31 16:59:27 +00:00
|
|
|
* The remaining elements are private
|
|
|
|
*/
|
2002-03-26 21:40:06 +00:00
|
|
|
LIST_ENTRY(g_class) class;
|
2002-03-11 21:42:35 +00:00
|
|
|
LIST_HEAD(,g_geom) geom;
|
|
|
|
};
|
|
|
|
|
2017-08-07 21:12:28 +00:00
|
|
|
/*
|
|
|
|
* The g_geom_alias is a list node for aliases for the geom name
|
|
|
|
* for device node creation.
|
|
|
|
*/
|
|
|
|
struct g_geom_alias {
|
|
|
|
LIST_ENTRY(g_geom_alias) ga_next;
|
|
|
|
const char *ga_alias;
|
|
|
|
};
|
|
|
|
|
2004-08-08 06:46:27 +00:00
|
|
|
#define G_VERSION_00 0x19950323
|
2004-12-12 10:09:05 +00:00
|
|
|
#define G_VERSION_01 0x20041207 /* add fflag to g_ioctl_t */
|
|
|
|
#define G_VERSION G_VERSION_01
|
2004-08-08 06:46:27 +00:00
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
/*
|
2002-03-26 21:40:06 +00:00
|
|
|
* The g_geom is an instance of a g_class.
|
2002-03-11 21:42:35 +00:00
|
|
|
*/
|
|
|
|
struct g_geom {
|
|
|
|
char *name;
|
2002-03-26 21:40:06 +00:00
|
|
|
struct g_class *class;
|
2002-03-11 21:42:35 +00:00
|
|
|
LIST_ENTRY(g_geom) geom;
|
|
|
|
LIST_HEAD(,g_consumer) consumer;
|
|
|
|
LIST_HEAD(,g_provider) provider;
|
|
|
|
TAILQ_ENTRY(g_geom) geoms; /* XXX: better name */
|
|
|
|
int rank;
|
|
|
|
g_start_t *start;
|
|
|
|
g_spoiled_t *spoiled;
|
Plumb device physical path reporting from CAM devices, through GEOM and
DEVFS, and make it accessible via the diskinfo utility.
Extend GEOM's generic attribute query mechanism into generic disk consumers.
sys/geom/geom_disk.c:
sys/geom/geom_disk.h:
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Allow disk providers to implement a new method which can override
the default BIO_GETATTR response, d_getattr(struct bio *). This
function returns -1 if not handled, otherwise it returns 0 or an
errno to be passed to g_io_deliver().
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Don't copy the serial number to dp->d_ident anymore, as the CAM XPT
is now responsible for returning this information via
d_getattr()->(a)dagetattr()->xpt_getatr().
sys/geom/geom_dev.c:
- Implement a new ioctl, DIOCGPHYSPATH, which returns the GEOM
attribute "GEOM::physpath", if possible. If the attribute request
returns a zero-length string, ENOENT is returned.
usr.sbin/diskinfo/diskinfo.c:
- If the DIOCGPHYSPATH ioctl is successful, report physical path
data when diskinfo is executed with the '-v' option.
Submitted by: will
Reviewed by: gibbs
Sponsored by: Spectra Logic Corporation
Add generic attribute change notification support to GEOM.
sys/sys/geom/geom.h:
Add a new attrchanged method field to both g_class
and g_geom.
sys/sys/geom/geom.h:
sys/geom/geom_event.c:
- Provide the g_attr_changed() function that providers
can use to advertise attribute changes.
- Perform delivery of attribute change notifications
from a thread context via the standard GEOM event
mechanism.
sys/geom/geom_subr.c:
Inherit the attrchanged method from class to geom (class instance).
sys/geom/geom_disk.c:
Provide disk_attr_changed() to provide g_attr_changed() access
to consumers of the disk API.
sys/cam/scsi/scsi_pass.c:
sys/cam/scsi/scsi_da.c:
sys/geom/geom_dev.c:
sys/geom/geom_disk.c:
Use attribute changed events to track updates to physical path
information.
sys/cam/scsi/scsi_da.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, and
the updated buffer type references our physical path
attribute, emit a GEOM attribute changed event via the
disk_attr_changed() API.
sys/cam/scsi/scsi_pass.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, update
the physical patch devfs alias for this pass instance.
Submitted by: gibbs
Sponsored by: Spectra Logic Corporation
2011-06-14 17:10:32 +00:00
|
|
|
g_attrchanged_t *attrchanged;
|
2002-03-11 21:42:35 +00:00
|
|
|
g_dumpconf_t *dumpconf;
|
2002-04-04 09:54:13 +00:00
|
|
|
g_access_t *access;
|
|
|
|
g_orphan_t *orphan;
|
2003-09-01 20:45:32 +00:00
|
|
|
g_ioctl_t *ioctl;
|
2012-06-25 04:26:10 +00:00
|
|
|
g_provgone_t *providergone;
|
2012-07-07 20:13:40 +00:00
|
|
|
g_resize_t *resize;
|
2012-07-17 22:16:10 +00:00
|
|
|
void *spare0;
|
2012-07-16 16:50:28 +00:00
|
|
|
void *spare1;
|
2002-03-11 21:42:35 +00:00
|
|
|
void *softc;
|
|
|
|
unsigned flags;
|
g_access: deal with races created by geoms that drop the topology lock
The problem is that g_access() must be called with the GEOM topology
lock held. And that gives a false impression that the lock is indeed
held across the call. But this isn't always true because many classes,
ZVOL being one of the many, need to drop the lock. It's either to
perform an I/O on the first open or to acquire a different lock (like in
g_mirror_access).
That, of course, can break many assumptions. For example,
g_slice_access() adds an extra exclusive count on the first open. As
described above, an underlying geom may drop the topology lock and that
would open a race with another thread that would also request another
extra exclusive count. In general, two consumers may be granted
incompatible accesses.
To avoid this problem the code is changed to mark a geom with special
flag before calling its access method and clear the flag afterwards. If
another thread sees that flag, then it means that the topology lock has
been dropped (either by the geom in question or downstream from it), so
it is not safe to make another access call. So, the second thread would
use g_topology_sleep() to wait until the flag is cleared and only then
would it proceed with the access.
Also see http://docs.freebsd.org/cgi/mid.cgi?809d9254-ee56-59d8-69a4-08838e985cea
PR: 225960
Reported by: asomers
Reviewed by: markj, mav
MFC after: 3 weeks
Differential Revision: https://reviews.freebsd.org/D14533
2018-03-15 09:16:10 +00:00
|
|
|
#define G_GEOM_WITHER 0x01
|
|
|
|
#define G_GEOM_VOLATILE_BIO 0x02
|
|
|
|
#define G_GEOM_IN_ACCESS 0x04
|
|
|
|
#define G_GEOM_ACCESS_WAIT 0x08
|
2017-08-07 21:12:28 +00:00
|
|
|
LIST_HEAD(,g_geom_alias) aliases;
|
2002-03-11 21:42:35 +00:00
|
|
|
};
|
|
|
|
|
|
|
|
/*
|
|
|
|
* The g_bioq is a queue of struct bio's.
|
|
|
|
* XXX: possibly collection point for statistics.
|
|
|
|
* XXX: should (possibly) be collapsed with sys/bio.h::bio_queue_head.
|
|
|
|
*/
|
|
|
|
struct g_bioq {
|
|
|
|
TAILQ_HEAD(, bio) bio_queue;
|
|
|
|
struct mtx bio_queue_lock;
|
|
|
|
int bio_queue_length;
|
|
|
|
};
|
|
|
|
|
|
|
|
/*
|
|
|
|
* A g_consumer is an attachment point for a g_provider. One g_consumer
|
|
|
|
* can only be attached to one g_provider, but multiple g_consumers
|
|
|
|
* can be attached to one g_provider.
|
|
|
|
*/
|
|
|
|
|
|
|
|
struct g_consumer {
|
|
|
|
struct g_geom *geom;
|
|
|
|
LIST_ENTRY(g_consumer) consumer;
|
|
|
|
struct g_provider *provider;
|
|
|
|
LIST_ENTRY(g_consumer) consumers; /* XXX: better name */
|
|
|
|
int acr, acw, ace;
|
2012-07-29 11:51:48 +00:00
|
|
|
int flags;
|
|
|
|
#define G_CF_SPOILED 0x1
|
|
|
|
#define G_CF_ORPHAN 0x4
|
Merge GEOM direct dispatch changes from the projects/camlock branch.
When safety requirements are met, it allows to avoid passing I/O requests
to GEOM g_up/g_down thread, executing them directly in the caller context.
That allows to avoid CPU bottlenecks in g_up/g_down threads, plus avoid
several context switches per I/O.
The defined now safety requirements are:
- caller should not hold any locks and should be reenterable;
- callee should not depend on GEOM dual-threaded concurency semantics;
- on the way down, if request is unmapped while callee doesn't support it,
the context should be sleepable;
- kernel thread stack usage should be below 50%.
To keep compatibility with GEOM classes not meeting above requirements
new provider and consumer flags added:
- G_CF_DIRECT_SEND -- consumer code meets caller requirements (request);
- G_CF_DIRECT_RECEIVE -- consumer code meets callee requirements (done);
- G_PF_DIRECT_SEND -- provider code meets caller requirements (done);
- G_PF_DIRECT_RECEIVE -- provider code meets callee requirements (request).
Capable GEOM class can set them, allowing direct dispatch in cases where
it is safe. If any of requirements are not met, request is queued to
g_up or g_down thread same as before.
Such GEOM classes were reviewed and updated to support direct dispatch:
CONCAT, DEV, DISK, GATE, MD, MIRROR, MULTIPATH, NOP, PART, RAID, STRIPE,
VFS, ZERO, ZFS::VDEV, ZFS::ZVOL, all classes based on g_slice KPI (LABEL,
MAP, FLASHMAP, etc).
To declare direct completion capability disk(9) KPI got new flag equivalent
to G_PF_DIRECT_SEND -- DISKFLAG_DIRECT_COMPLETION. da(4) and ada(4) disk
drivers got it set now thanks to earlier CAM locking work.
This change more then twice increases peak block storage performance on
systems with manu CPUs, together with earlier CAM locking changes reaching
more then 1 million IOPS (512 byte raw reads from 16 SATA SSDs on 4 HBAs to
256 user-level threads).
Sponsored by: iXsystems, Inc.
MFC after: 2 months
2013-10-22 08:22:19 +00:00
|
|
|
#define G_CF_DIRECT_SEND 0x10
|
|
|
|
#define G_CF_DIRECT_RECEIVE 0x20
|
2003-03-18 09:42:33 +00:00
|
|
|
struct devstat *stat;
|
2003-03-09 09:58:36 +00:00
|
|
|
u_int nstart, nend;
|
2004-02-12 20:32:11 +00:00
|
|
|
|
|
|
|
/* Two fields for the implementing class to use */
|
|
|
|
void *private;
|
|
|
|
u_int index;
|
2002-03-11 21:42:35 +00:00
|
|
|
};
|
|
|
|
|
|
|
|
/*
|
|
|
|
* A g_provider is a "logical disk".
|
|
|
|
*/
|
|
|
|
struct g_provider {
|
|
|
|
char *name;
|
|
|
|
LIST_ENTRY(g_provider) provider;
|
|
|
|
struct g_geom *geom;
|
|
|
|
LIST_HEAD(,g_consumer) consumers;
|
|
|
|
int acr, acw, ace;
|
|
|
|
int error;
|
|
|
|
TAILQ_ENTRY(g_provider) orphan;
|
2002-04-04 09:58:20 +00:00
|
|
|
off_t mediasize;
|
2002-10-20 19:18:07 +00:00
|
|
|
u_int sectorsize;
|
2003-02-11 14:57:34 +00:00
|
|
|
u_int stripesize;
|
|
|
|
u_int stripeoffset;
|
2003-03-18 09:42:33 +00:00
|
|
|
struct devstat *stat;
|
2003-03-09 09:58:36 +00:00
|
|
|
u_int nstart, nend;
|
2003-02-11 11:55:40 +00:00
|
|
|
u_int flags;
|
2003-10-06 09:05:44 +00:00
|
|
|
#define G_PF_WITHER 0x2
|
2003-12-07 10:04:43 +00:00
|
|
|
#define G_PF_ORPHAN 0x4
|
Implement the concept of the unmapped VMIO buffers, i.e. buffers which
do not map the b_pages pages into buffer_map KVA. The use of the
unmapped buffers eliminate the need to perform TLB shootdown for
mapping on the buffer creation and reuse, greatly reducing the amount
of IPIs for shootdown on big-SMP machines and eliminating up to 25-30%
of the system time on i/o intensive workloads.
The unmapped buffer should be explicitely requested by the GB_UNMAPPED
flag by the consumer. For unmapped buffer, no KVA reservation is
performed at all. The consumer might request unmapped buffer which
does have a KVA reserve, to manually map it without recursing into
buffer cache and blocking, with the GB_KVAALLOC flag.
When the mapped buffer is requested and unmapped buffer already
exists, the cache performs an upgrade, possibly reusing the KVA
reservation.
Unmapped buffer is translated into unmapped bio in g_vfs_strategy().
Unmapped bio carry a pointer to the vm_page_t array, offset and length
instead of the data pointer. The provider which processes the bio
should explicitely specify a readiness to accept unmapped bio,
otherwise g_down geom thread performs the transient upgrade of the bio
request by mapping the pages into the new bio_transient_map KVA
submap.
The bio_transient_map submap claims up to 10% of the buffer map, and
the total buffer_map + bio_transient_map KVA usage stays the
same. Still, it could be manually tuned by kern.bio_transient_maxcnt
tunable, in the units of the transient mappings. Eventually, the
bio_transient_map could be removed after all geom classes and drivers
can accept unmapped i/o requests.
Unmapped support can be turned off by the vfs.unmapped_buf_allowed
tunable, disabling which makes the buffer (or cluster) creation
requests to ignore GB_UNMAPPED and GB_KVAALLOC flags. Unmapped
buffers are only enabled by default on the architectures where
pmap_copy_page() was implemented and tested.
In the rework, filesystem metadata is not the subject to maxbufspace
limit anymore. Since the metadata buffers are always mapped, the
buffers still have to fit into the buffer map, which provides a
reasonable (but practically unreachable) upper bound on it. The
non-metadata buffer allocations, both mapped and unmapped, is
accounted against maxbufspace, as before. Effectively, this means that
the maxbufspace is forced on mapped and unmapped buffers separately.
The pre-patch bufspace limiting code did not worked, because
buffer_map fragmentation does not allow the limit to be reached.
By Jeff Roberson request, the getnewbuf() function was split into
smaller single-purpose functions.
Sponsored by: The FreeBSD Foundation
Discussed with: jeff (previous version)
Tested by: pho, scottl (previous version), jhb, bf
MFC after: 2 weeks
2013-03-19 14:13:12 +00:00
|
|
|
#define G_PF_ACCEPT_UNMAPPED 0x8
|
Merge GEOM direct dispatch changes from the projects/camlock branch.
When safety requirements are met, it allows to avoid passing I/O requests
to GEOM g_up/g_down thread, executing them directly in the caller context.
That allows to avoid CPU bottlenecks in g_up/g_down threads, plus avoid
several context switches per I/O.
The defined now safety requirements are:
- caller should not hold any locks and should be reenterable;
- callee should not depend on GEOM dual-threaded concurency semantics;
- on the way down, if request is unmapped while callee doesn't support it,
the context should be sleepable;
- kernel thread stack usage should be below 50%.
To keep compatibility with GEOM classes not meeting above requirements
new provider and consumer flags added:
- G_CF_DIRECT_SEND -- consumer code meets caller requirements (request);
- G_CF_DIRECT_RECEIVE -- consumer code meets callee requirements (done);
- G_PF_DIRECT_SEND -- provider code meets caller requirements (done);
- G_PF_DIRECT_RECEIVE -- provider code meets callee requirements (request).
Capable GEOM class can set them, allowing direct dispatch in cases where
it is safe. If any of requirements are not met, request is queued to
g_up or g_down thread same as before.
Such GEOM classes were reviewed and updated to support direct dispatch:
CONCAT, DEV, DISK, GATE, MD, MIRROR, MULTIPATH, NOP, PART, RAID, STRIPE,
VFS, ZERO, ZFS::VDEV, ZFS::ZVOL, all classes based on g_slice KPI (LABEL,
MAP, FLASHMAP, etc).
To declare direct completion capability disk(9) KPI got new flag equivalent
to G_PF_DIRECT_SEND -- DISKFLAG_DIRECT_COMPLETION. da(4) and ada(4) disk
drivers got it set now thanks to earlier CAM locking work.
This change more then twice increases peak block storage performance on
systems with manu CPUs, together with earlier CAM locking changes reaching
more then 1 million IOPS (512 byte raw reads from 16 SATA SSDs on 4 HBAs to
256 user-level threads).
Sponsored by: iXsystems, Inc.
MFC after: 2 months
2013-10-22 08:22:19 +00:00
|
|
|
#define G_PF_DIRECT_SEND 0x10
|
|
|
|
#define G_PF_DIRECT_RECEIVE 0x20
|
2004-02-12 20:32:11 +00:00
|
|
|
|
|
|
|
/* Two fields for the implementing class to use */
|
|
|
|
void *private;
|
|
|
|
u_int index;
|
2002-03-11 21:42:35 +00:00
|
|
|
};
|
|
|
|
|
2009-06-11 09:55:26 +00:00
|
|
|
/*
|
|
|
|
* Descriptor of a classifier. We can register a function and
|
|
|
|
* an argument, which is called by g_io_request() on bio's
|
|
|
|
* that are not previously classified.
|
|
|
|
*/
|
|
|
|
struct g_classifier_hook {
|
|
|
|
TAILQ_ENTRY(g_classifier_hook) link;
|
|
|
|
int (*func)(void *arg, struct bio *bp);
|
|
|
|
void *arg;
|
|
|
|
};
|
|
|
|
|
2011-03-24 19:23:42 +00:00
|
|
|
/* BIO_GETATTR("GEOM::setstate") argument values. */
|
|
|
|
#define G_STATE_FAILED 0
|
|
|
|
#define G_STATE_REBUILD 1
|
|
|
|
#define G_STATE_RESYNC 2
|
|
|
|
#define G_STATE_ACTIVE 3
|
|
|
|
|
2002-10-25 18:42:42 +00:00
|
|
|
/* geom_dev.c */
|
2004-06-16 09:47:26 +00:00
|
|
|
struct cdev;
|
2003-06-07 15:46:53 +00:00
|
|
|
void g_dev_print(void);
|
Plumb device physical path reporting from CAM devices, through GEOM and
DEVFS, and make it accessible via the diskinfo utility.
Extend GEOM's generic attribute query mechanism into generic disk consumers.
sys/geom/geom_disk.c:
sys/geom/geom_disk.h:
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Allow disk providers to implement a new method which can override
the default BIO_GETATTR response, d_getattr(struct bio *). This
function returns -1 if not handled, otherwise it returns 0 or an
errno to be passed to g_io_deliver().
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Don't copy the serial number to dp->d_ident anymore, as the CAM XPT
is now responsible for returning this information via
d_getattr()->(a)dagetattr()->xpt_getatr().
sys/geom/geom_dev.c:
- Implement a new ioctl, DIOCGPHYSPATH, which returns the GEOM
attribute "GEOM::physpath", if possible. If the attribute request
returns a zero-length string, ENOENT is returned.
usr.sbin/diskinfo/diskinfo.c:
- If the DIOCGPHYSPATH ioctl is successful, report physical path
data when diskinfo is executed with the '-v' option.
Submitted by: will
Reviewed by: gibbs
Sponsored by: Spectra Logic Corporation
Add generic attribute change notification support to GEOM.
sys/sys/geom/geom.h:
Add a new attrchanged method field to both g_class
and g_geom.
sys/sys/geom/geom.h:
sys/geom/geom_event.c:
- Provide the g_attr_changed() function that providers
can use to advertise attribute changes.
- Perform delivery of attribute change notifications
from a thread context via the standard GEOM event
mechanism.
sys/geom/geom_subr.c:
Inherit the attrchanged method from class to geom (class instance).
sys/geom/geom_disk.c:
Provide disk_attr_changed() to provide g_attr_changed() access
to consumers of the disk API.
sys/cam/scsi/scsi_pass.c:
sys/cam/scsi/scsi_da.c:
sys/geom/geom_dev.c:
sys/geom/geom_disk.c:
Use attribute changed events to track updates to physical path
information.
sys/cam/scsi/scsi_da.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, and
the updated buffer type references our physical path
attribute, emit a GEOM attribute changed event via the
disk_attr_changed() API.
sys/cam/scsi/scsi_pass.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, update
the physical patch devfs alias for this pass instance.
Submitted by: gibbs
Sponsored by: Spectra Logic Corporation
2011-06-14 17:10:32 +00:00
|
|
|
void g_dev_physpath_changed(void);
|
2004-06-16 09:47:26 +00:00
|
|
|
struct g_provider *g_dev_getprovider(struct cdev *dev);
|
2002-10-25 18:42:42 +00:00
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
/* geom_dump.c */
|
2002-12-16 22:33:27 +00:00
|
|
|
void g_trace(int level, const char *, ...);
|
2002-03-11 21:42:35 +00:00
|
|
|
# define G_T_TOPOLOGY 1
|
|
|
|
# define G_T_BIO 2
|
|
|
|
# define G_T_ACCESS 4
|
|
|
|
|
2002-03-24 11:21:41 +00:00
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
/* geom_event.c */
|
2003-04-23 20:46:12 +00:00
|
|
|
typedef void g_event_t(void *, int flag);
|
2003-04-02 21:10:04 +00:00
|
|
|
#define EV_CANCEL 1
|
2003-04-23 20:46:12 +00:00
|
|
|
int g_post_event(g_event_t *func, void *arg, int flag, ...);
|
2003-04-23 21:28:27 +00:00
|
|
|
int g_waitfor_event(g_event_t *func, void *arg, int flag, ...);
|
2003-04-02 21:10:04 +00:00
|
|
|
void g_cancel_event(void *ref);
|
Plumb device physical path reporting from CAM devices, through GEOM and
DEVFS, and make it accessible via the diskinfo utility.
Extend GEOM's generic attribute query mechanism into generic disk consumers.
sys/geom/geom_disk.c:
sys/geom/geom_disk.h:
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Allow disk providers to implement a new method which can override
the default BIO_GETATTR response, d_getattr(struct bio *). This
function returns -1 if not handled, otherwise it returns 0 or an
errno to be passed to g_io_deliver().
sys/cam/scsi/scsi_da.c:
sys/cam/ata/ata_da.c:
- Don't copy the serial number to dp->d_ident anymore, as the CAM XPT
is now responsible for returning this information via
d_getattr()->(a)dagetattr()->xpt_getatr().
sys/geom/geom_dev.c:
- Implement a new ioctl, DIOCGPHYSPATH, which returns the GEOM
attribute "GEOM::physpath", if possible. If the attribute request
returns a zero-length string, ENOENT is returned.
usr.sbin/diskinfo/diskinfo.c:
- If the DIOCGPHYSPATH ioctl is successful, report physical path
data when diskinfo is executed with the '-v' option.
Submitted by: will
Reviewed by: gibbs
Sponsored by: Spectra Logic Corporation
Add generic attribute change notification support to GEOM.
sys/sys/geom/geom.h:
Add a new attrchanged method field to both g_class
and g_geom.
sys/sys/geom/geom.h:
sys/geom/geom_event.c:
- Provide the g_attr_changed() function that providers
can use to advertise attribute changes.
- Perform delivery of attribute change notifications
from a thread context via the standard GEOM event
mechanism.
sys/geom/geom_subr.c:
Inherit the attrchanged method from class to geom (class instance).
sys/geom/geom_disk.c:
Provide disk_attr_changed() to provide g_attr_changed() access
to consumers of the disk API.
sys/cam/scsi/scsi_pass.c:
sys/cam/scsi/scsi_da.c:
sys/geom/geom_dev.c:
sys/geom/geom_disk.c:
Use attribute changed events to track updates to physical path
information.
sys/cam/scsi/scsi_da.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, and
the updated buffer type references our physical path
attribute, emit a GEOM attribute changed event via the
disk_attr_changed() API.
sys/cam/scsi/scsi_pass.c:
Add AC_ADVINFO_CHANGED to the registered asynchronous CAM
events for this driver. When this event occurs, update
the physical patch devfs alias for this pass instance.
Submitted by: gibbs
Sponsored by: Spectra Logic Corporation
2011-06-14 17:10:32 +00:00
|
|
|
int g_attr_changed(struct g_provider *pp, const char *attr, int flag);
|
2012-07-29 11:51:48 +00:00
|
|
|
int g_media_changed(struct g_provider *pp, int flag);
|
|
|
|
int g_media_gone(struct g_provider *pp, int flag);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_orphan_provider(struct g_provider *pp, int error);
|
2004-11-09 23:20:50 +00:00
|
|
|
void g_waitidlelock(void);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
|
|
|
/* geom_subr.c */
|
2004-02-12 22:42:11 +00:00
|
|
|
int g_access(struct g_consumer *cp, int nread, int nwrite, int nexcl);
|
2002-03-11 21:42:35 +00:00
|
|
|
int g_attach(struct g_consumer *cp, struct g_provider *pp);
|
2011-04-27 00:10:26 +00:00
|
|
|
int g_compare_names(const char *namea, const char *nameb);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_destroy_consumer(struct g_consumer *cp);
|
|
|
|
void g_destroy_geom(struct g_geom *pp);
|
|
|
|
void g_destroy_provider(struct g_provider *pp);
|
2002-06-09 10:57:34 +00:00
|
|
|
void g_detach(struct g_consumer *cp);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_error_provider(struct g_provider *pp, int error);
|
2003-06-04 18:17:52 +00:00
|
|
|
struct g_provider *g_provider_by_name(char const *arg);
|
2017-08-07 21:12:28 +00:00
|
|
|
void g_geom_add_alias(struct g_geom *gp, const char *alias);
|
2002-04-09 15:13:42 +00:00
|
|
|
int g_getattr__(const char *attr, struct g_consumer *cp, void *var, int len);
|
|
|
|
#define g_getattr(a, c, v) g_getattr__((a), (c), (v), sizeof *(v))
|
2009-02-01 01:50:09 +00:00
|
|
|
int g_handleattr(struct bio *bp, const char *attribute, const void *val,
|
|
|
|
int len);
|
2002-12-16 22:33:27 +00:00
|
|
|
int g_handleattr_int(struct bio *bp, const char *attribute, int val);
|
|
|
|
int g_handleattr_off_t(struct bio *bp, const char *attribute, off_t val);
|
Improve ZFS N-way mirror read performance by using load and locality
information.
The existing algorithm selects a preferred leaf vdev based on offset of the zio
request modulo the number of members in the mirror. It assumes the devices are
of equal performance and that spreading the requests randomly over both drives
will be sufficient to saturate them. In practice this results in the leaf vdevs
being under utilized.
The new algorithm takes into the following additional factors:
* Load of the vdevs (number outstanding I/O requests)
* The locality of last queued I/O vs the new I/O request.
Within the locality calculation additional knowledge about the underlying vdev
is considered such as; is the device backing the vdev a rotating media device.
This results in performance increases across the board as well as significant
increases for predominantly streaming loads and for configurations which don't
have evenly performing devices.
The following are results from a setup with 3 Way Mirror with 2 x HD's and
1 x SSD from a basic test running multiple parrallel dd's.
With pre-fetch disabled (vfs.zfs.prefetch_disable=1):
== Stripe Balanced (default) ==
Read 15360MB using bs: 1048576, readers: 3, took 161 seconds @ 95 MB/s
== Load Balanced (zfslinux) ==
Read 15360MB using bs: 1048576, readers: 3, took 297 seconds @ 51 MB/s
== Load Balanced (locality freebsd) ==
Read 15360MB using bs: 1048576, readers: 3, took 54 seconds @ 284 MB/s
With pre-fetch enabled (vfs.zfs.prefetch_disable=0):
== Stripe Balanced (default) ==
Read 15360MB using bs: 1048576, readers: 3, took 91 seconds @ 168 MB/s
== Load Balanced (zfslinux) ==
Read 15360MB using bs: 1048576, readers: 3, took 108 seconds @ 142 MB/s
== Load Balanced (locality freebsd) ==
Read 15360MB using bs: 1048576, readers: 3, took 48 seconds @ 320 MB/s
In addition to the performance changes the code was also restructured, with
the help of Justin Gibbs, to provide a more logical flow which also ensures
vdevs loads are only calculated from the set of valid candidates.
The following additional sysctls where added to allow the administrator
to tune the behaviour of the load algorithm:
* vfs.zfs.vdev.mirror.rotating_inc
* vfs.zfs.vdev.mirror.rotating_seek_inc
* vfs.zfs.vdev.mirror.rotating_seek_offset
* vfs.zfs.vdev.mirror.non_rotating_inc
* vfs.zfs.vdev.mirror.non_rotating_seek_inc
These changes where based on work started by the zfsonlinux developers:
https://github.com/zfsonlinux/zfs/pull/1487
Reviewed by: gibbs, mav, will
MFC after: 2 weeks
Sponsored by: Multiplay
2013-10-23 09:54:58 +00:00
|
|
|
int g_handleattr_uint16_t(struct bio *bp, const char *attribute, uint16_t val);
|
2009-02-01 01:50:09 +00:00
|
|
|
int g_handleattr_str(struct bio *bp, const char *attribute, const char *str);
|
2002-03-11 21:42:35 +00:00
|
|
|
struct g_consumer * g_new_consumer(struct g_geom *gp);
|
2012-11-20 12:32:18 +00:00
|
|
|
struct g_geom * g_new_geomf(struct g_class *mp, const char *fmt, ...)
|
|
|
|
__printflike(2, 3);
|
|
|
|
struct g_provider * g_new_providerf(struct g_geom *gp, const char *fmt, ...)
|
|
|
|
__printflike(2, 3);
|
2012-07-07 20:13:40 +00:00
|
|
|
void g_resize_provider(struct g_provider *pp, off_t size);
|
2008-03-23 01:23:35 +00:00
|
|
|
int g_retaste(struct g_class *mp);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_spoil(struct g_provider *pp, struct g_consumer *cp);
|
|
|
|
int g_std_access(struct g_provider *pp, int dr, int dw, int de);
|
|
|
|
void g_std_done(struct bio *bp);
|
|
|
|
void g_std_spoiled(struct g_consumer *cp);
|
2003-05-02 06:15:27 +00:00
|
|
|
void g_wither_geom(struct g_geom *gp, int error);
|
2004-10-29 09:19:03 +00:00
|
|
|
void g_wither_geom_close(struct g_geom *gp, int error);
|
2006-04-10 03:55:13 +00:00
|
|
|
void g_wither_provider(struct g_provider *pp, int error);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
2006-09-15 16:36:45 +00:00
|
|
|
#if defined(DIAGNOSTIC) || defined(DDB)
|
2004-03-10 08:49:08 +00:00
|
|
|
int g_valid_obj(void const *ptr);
|
2006-09-15 16:36:45 +00:00
|
|
|
#endif
|
|
|
|
#ifdef DIAGNOSTIC
|
2004-03-10 08:49:08 +00:00
|
|
|
#define G_VALID_CLASS(foo) \
|
|
|
|
KASSERT(g_valid_obj(foo) == 1, ("%p is not a g_class", foo))
|
|
|
|
#define G_VALID_GEOM(foo) \
|
|
|
|
KASSERT(g_valid_obj(foo) == 2, ("%p is not a g_geom", foo))
|
|
|
|
#define G_VALID_CONSUMER(foo) \
|
|
|
|
KASSERT(g_valid_obj(foo) == 3, ("%p is not a g_consumer", foo))
|
|
|
|
#define G_VALID_PROVIDER(foo) \
|
|
|
|
KASSERT(g_valid_obj(foo) == 4, ("%p is not a g_provider", foo))
|
|
|
|
#else
|
|
|
|
#define G_VALID_CLASS(foo) do { } while (0)
|
|
|
|
#define G_VALID_GEOM(foo) do { } while (0)
|
|
|
|
#define G_VALID_CONSUMER(foo) do { } while (0)
|
|
|
|
#define G_VALID_PROVIDER(foo) do { } while (0)
|
|
|
|
#endif
|
|
|
|
|
2003-05-31 18:13:07 +00:00
|
|
|
int g_modevent(module_t, int, void *);
|
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
/* geom_io.c */
|
|
|
|
struct bio * g_clone_bio(struct bio *);
|
2006-06-05 21:13:22 +00:00
|
|
|
struct bio * g_duplicate_bio(struct bio *);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_destroy_bio(struct bio *);
|
2002-09-30 08:54:46 +00:00
|
|
|
void g_io_deliver(struct bio *bp, int error);
|
2002-04-09 15:12:05 +00:00
|
|
|
int g_io_getattr(const char *attr, struct g_consumer *cp, int *len, void *ptr);
|
Add support for managing Shingled Magnetic Recording (SMR) drives.
This change includes support for SCSI SMR drives (which conform to the
Zoned Block Commands or ZBC spec) and ATA SMR drives (which conform to
the Zoned ATA Command Set or ZAC spec) behind SAS expanders.
This includes full management support through the GEOM BIO interface, and
through a new userland utility, zonectl(8), and through camcontrol(8).
This is now ready for filesystems to use to detect and manage zoned drives.
(There is no work in progress that I know of to use this for ZFS or UFS, if
anyone is interested, let me know and I may have some suggestions.)
Also, improve ATA command passthrough and dispatch support, both via ATA
and ATA passthrough over SCSI.
Also, add support to camcontrol(8) for the ATA Extended Power Conditions
feature set. You can now manage ATA device power states, and set various
idle time thresholds for a drive to enter lower power states.
Note that this change cannot be MFCed in full, because it depends on
changes to the struct bio API that break compatilibity. In order to
avoid breaking the stable API, only changes that don't touch or depend on
the struct bio changes can be merged. For example, the camcontrol(8)
changes don't depend on the new bio API, but zonectl(8) and the probe
changes to the da(4) and ada(4) drivers do depend on it.
Also note that the SMR changes have not yet been tested with an actual
SCSI ZBC device, or a SCSI to ATA translation layer (SAT) that supports
ZBC to ZAC translation. I have not yet gotten a suitable drive or SAT
layer, so any testing help would be appreciated. These changes have been
tested with Seagate Host Aware SATA drives attached to both SAS and SATA
controllers. Also, I do not have any SATA Host Managed devices, and I
suspect that it may take additional (hopefully minor) changes to support
them.
Thanks to Seagate for supplying the test hardware and answering questions.
sbin/camcontrol/Makefile:
Add epc.c and zone.c.
sbin/camcontrol/camcontrol.8:
Document the zone and epc subcommands.
sbin/camcontrol/camcontrol.c:
Add the zone and epc subcommands.
Add auxiliary register support to build_ata_cmd(). Make sure to
set the CAM_ATAIO_NEEDRESULT, CAM_ATAIO_DMA, and CAM_ATAIO_FPDMA
flags as appropriate for ATA commands.
Add a new get_ata_status() function to parse ATA result from SCSI
sense descriptors (for ATA passthrough over SCSI) and ATA I/O
requests.
sbin/camcontrol/camcontrol.h:
Update the build_ata_cmd() prototype
Add get_ata_status(), zone(), and epc().
sbin/camcontrol/epc.c:
Support for ATA Extended Power Conditions features. This includes
support for all features documented in the ACS-4 Revision 12
specification from t13.org (dated February 18, 2016).
The EPC feature set allows putting a drive into a power power mode
immediately, or setting timeouts so that the drive will
automatically enter progressively lower power states after various
idle times.
sbin/camcontrol/fwdownload.c:
Update the firmware download code for the new build_ata_cmd()
arguments.
sbin/camcontrol/zone.c:
Implement support for Shingled Magnetic Recording (SMR) drives
via SCSI Zoned Block Commands (ZBC) and ATA Zoned Device ATA
Command Set (ZAC).
These specs were developed in concert, and are functionally
identical. The primary differences are due to SCSI and ATA
differences. (SCSI is big endian, ATA is little endian, for
example.)
This includes support for all commands defined in the ZBC and
ZAC specs.
sys/cam/ata/ata_all.c:
Decode a number of additional ATA command names in ata_op_string().
Add a new CCB building function, ata_read_log().
Add ata_zac_mgmt_in() and ata_zac_mgmt_out() CCB building
functions. These support both DMA and NCQ encapsulation.
sys/cam/ata/ata_all.h:
Add prototypes for ata_read_log(), ata_zac_mgmt_out(), and
ata_zac_mgmt_in().
sys/cam/ata/ata_da.c:
Revamp the ada(4) driver to support zoned devices.
Add four new probe states to gather information needed for zone
support.
Add a new adasetflags() function to avoid duplication of large
blocks of flag setting between the async handler and register
functions.
Add new sysctl variables that describe zone support and paramters.
Add support for the new BIO_ZONE bio, and all of its subcommands:
DISK_ZONE_OPEN, DISK_ZONE_CLOSE, DISK_ZONE_FINISH, DISK_ZONE_RWP,
DISK_ZONE_REPORT_ZONES, and DISK_ZONE_GET_PARAMS.
sys/cam/scsi/scsi_all.c:
Add command descriptions for the ZBC IN/OUT commands.
Add descriptions for ZBC Host Managed devices.
Add a new function, scsi_ata_pass() to do ATA passthrough over
SCSI. This will eventually replace scsi_ata_pass_16() -- it
can create the 12, 16, and 32-byte variants of the ATA
PASS-THROUGH command, and supports setting all of the
registers defined as of SAT-4, Revision 5 (March 11, 2016).
Change scsi_ata_identify() to use scsi_ata_pass() instead of
scsi_ata_pass_16().
Add a new scsi_ata_read_log() function to facilitate reading
ATA logs via SCSI.
sys/cam/scsi/scsi_all.h:
Add the new ATA PASS-THROUGH(32) command CDB. Add extended and
variable CDB opcodes.
Add Zoned Block Device Characteristics VPD page.
Add ATA Return SCSI sense descriptor.
Add prototypes for scsi_ata_read_log() and scsi_ata_pass().
sys/cam/scsi/scsi_da.c:
Revamp the da(4) driver to support zoned devices.
Add five new probe states, four of which are needed for ATA
devices.
Add five new sysctl variables that describe zone support and
parameters.
The da(4) driver supports SCSI ZBC devices, as well as ATA ZAC
devices when they are attached via a SCSI to ATA Translation (SAT)
layer. Since ZBC -> ZAC translation is a new feature in the T10
SAT-4 spec, most SATA drives will be supported via ATA commands
sent via the SCSI ATA PASS-THROUGH command. The da(4) driver will
prefer the ZBC interface, if it is available, for performance
reasons, but will use the ATA PASS-THROUGH interface to the ZAC
command set if the SAT layer doesn't support translation yet.
As I mentioned above, ZBC command support is untested.
Add support for the new BIO_ZONE bio, and all of its subcommands:
DISK_ZONE_OPEN, DISK_ZONE_CLOSE, DISK_ZONE_FINISH, DISK_ZONE_RWP,
DISK_ZONE_REPORT_ZONES, and DISK_ZONE_GET_PARAMS.
Add scsi_zbc_in() and scsi_zbc_out() CCB building functions.
Add scsi_ata_zac_mgmt_out() and scsi_ata_zac_mgmt_in() CCB/CDB
building functions. Note that these have return values, unlike
almost all other CCB building functions in CAM. The reason is
that they can fail, depending upon the particular combination
of input parameters. The primary failure case is if the user
wants NCQ, but fails to specify additional CDB storage. NCQ
requires using the 32-byte version of the SCSI ATA PASS-THROUGH
command, and the current CAM CDB size is 16 bytes.
sys/cam/scsi/scsi_da.h:
Add ZBC IN and ZBC OUT CDBs and opcodes.
Add SCSI Report Zones data structures.
Add scsi_zbc_in(), scsi_zbc_out(), scsi_ata_zac_mgmt_out(), and
scsi_ata_zac_mgmt_in() prototypes.
sys/dev/ahci/ahci.c:
Fix SEND / RECEIVE FPDMA QUEUED in the ahci(4) driver.
ahci_setup_fis() previously set the top bits of the sector count
register in the FIS to 0 for FPDMA commands. This is okay for
read and write, because the PRIO field is in the only thing in
those bits, and we don't implement that further up the stack.
But, for SEND and RECEIVE FPDMA QUEUED, the subcommand is in that
byte, so it needs to be transmitted to the drive.
In ahci_setup_fis(), always set the the top 8 bits of the
sector count register. We need it in both the standard
and NCQ / FPDMA cases.
sys/geom/eli/g_eli.c:
Pass BIO_ZONE commands through the GELI class.
sys/geom/geom.h:
Add g_io_zonecmd() prototype.
sys/geom/geom_dev.c:
Add new DIOCZONECMD ioctl, which allows sending zone commands to
disks.
sys/geom/geom_disk.c:
Add support for BIO_ZONE commands.
sys/geom/geom_disk.h:
Add a new flag, DISKFLAG_CANZONE, that indicates that a given
GEOM disk client can handle BIO_ZONE commands.
sys/geom/geom_io.c:
Add a new function, g_io_zonecmd(), that handles execution of
BIO_ZONE commands.
Add permissions check for BIO_ZONE commands.
Add command decoding for BIO_ZONE commands.
sys/geom/geom_subr.c:
Add DDB command decoding for BIO_ZONE commands.
sys/kern/subr_devstat.c:
Record statistics for REPORT ZONES commands. Note that the
number of bytes transferred for REPORT ZONES won't quite match
what is received from the harware. This is because we're
necessarily counting bytes coming from the da(4) / ada(4) drivers,
which are using the disk_zone.h interface to communicate up
the stack. The structure sizes it uses are slightly different
than the SCSI and ATA structure sizes.
sys/sys/ata.h:
Add many bit and structure definitions for ZAC, NCQ, and EPC
command support.
sys/sys/bio.h:
Convert the bio_cmd field to a straight enumeration. This will
yield more space for additional commands in the future. After
change r297955 and other related changes, this is now possible.
Converting to an enumeration will also prevent use as a bitmask
in the future.
sys/sys/disk.h:
Define the DIOCZONECMD ioctl.
sys/sys/disk_zone.h:
Add a new API for managing zoned disks. This is very close to
the SCSI ZBC and ATA ZAC standards, but uses integers in native
byte order instead of big endian (SCSI) or little endian (ATA)
byte arrays.
This is intended to offer to the complete feature set of the ZBC
and ZAC disk management without requiring the application developer
to include SCSI or ATA headers. We also use one set of headers
for ioctl consumers and kernel bio-level consumers.
sys/sys/param.h:
Bump __FreeBSD_version for sys/bio.h command changes, and inclusion
of SMR support.
usr.sbin/Makefile:
Add the zonectl utility.
usr.sbin/diskinfo/diskinfo.c
Add disk zoning capability to the 'diskinfo -v' output.
usr.sbin/zonectl/Makefile:
Add zonectl makefile.
usr.sbin/zonectl/zonectl.8
zonectl(8) man page.
usr.sbin/zonectl/zonectl.c
The zonectl(8) utility. This allows managing SCSI or ATA zoned
disks via the disk_zone.h API. You can report zones, reset write
pointers, get parameters, etc.
Sponsored by: Spectra Logic
Differential Revision: https://reviews.freebsd.org/D6147
Reviewed by: wblock (documentation)
2016-05-19 14:08:36 +00:00
|
|
|
int g_io_zonecmd(struct disk_zone_args *zone_args, struct g_consumer *cp);
|
2006-10-31 21:11:21 +00:00
|
|
|
int g_io_flush(struct g_consumer *cp);
|
2009-06-11 09:55:26 +00:00
|
|
|
int g_register_classifier(struct g_classifier_hook *hook);
|
|
|
|
void g_unregister_classifier(struct g_classifier_hook *hook);
|
2002-03-11 21:42:35 +00:00
|
|
|
void g_io_request(struct bio *bp, struct g_consumer *cp);
|
|
|
|
struct bio *g_new_bio(void);
|
2004-08-27 14:43:11 +00:00
|
|
|
struct bio *g_alloc_bio(void);
|
2016-02-17 17:16:02 +00:00
|
|
|
void g_reset_bio(struct bio *);
|
2002-03-11 21:42:35 +00:00
|
|
|
void * g_read_data(struct g_consumer *cp, off_t offset, off_t length, int *error);
|
2002-09-30 08:50:47 +00:00
|
|
|
int g_write_data(struct g_consumer *cp, off_t offset, void *ptr, off_t length);
|
2007-05-05 16:35:22 +00:00
|
|
|
int g_delete_data(struct g_consumer *cp, off_t offset, off_t length);
|
2004-02-11 18:21:32 +00:00
|
|
|
void g_print_bio(struct bio *bp);
|
2018-01-26 00:58:32 +00:00
|
|
|
int g_use_g_read_data(void *, off_t, void **, int);
|
|
|
|
int g_use_g_write_data(void *, off_t, void *, int);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
|
|
|
/* geom_kern.c / geom_kernsim.c */
|
|
|
|
|
|
|
|
#ifdef _KERNEL
|
|
|
|
|
2006-07-12 15:44:00 +00:00
|
|
|
extern struct sx topology_lock;
|
|
|
|
|
2002-04-19 09:24:12 +00:00
|
|
|
struct g_kerneldump {
|
|
|
|
off_t offset;
|
|
|
|
off_t length;
|
2011-03-24 08:37:48 +00:00
|
|
|
struct dumperinfo di;
|
2002-04-19 09:24:12 +00:00
|
|
|
};
|
|
|
|
|
2002-03-11 21:42:35 +00:00
|
|
|
MALLOC_DECLARE(M_GEOM);
|
|
|
|
|
|
|
|
static __inline void *
|
|
|
|
g_malloc(int size, int flags)
|
|
|
|
{
|
|
|
|
void *p;
|
|
|
|
|
|
|
|
p = malloc(size, M_GEOM, flags);
|
|
|
|
return (p);
|
|
|
|
}
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
g_free(void *ptr)
|
|
|
|
{
|
2004-03-10 08:49:08 +00:00
|
|
|
|
|
|
|
#ifdef DIAGNOSTIC
|
2006-07-12 15:44:00 +00:00
|
|
|
if (sx_xlocked(&topology_lock)) {
|
|
|
|
KASSERT(g_valid_obj(ptr) == 0,
|
|
|
|
("g_free(%p) of live object, type %d", ptr,
|
|
|
|
g_valid_obj(ptr)));
|
|
|
|
}
|
2004-03-10 08:49:08 +00:00
|
|
|
#endif
|
2002-03-11 21:42:35 +00:00
|
|
|
free(ptr, M_GEOM);
|
|
|
|
}
|
|
|
|
|
2002-05-20 10:03:15 +00:00
|
|
|
#define g_topology_lock() \
|
|
|
|
do { \
|
|
|
|
sx_xlock(&topology_lock); \
|
|
|
|
} while (0)
|
|
|
|
|
2004-12-21 18:32:46 +00:00
|
|
|
#define g_topology_try_lock() sx_try_xlock(&topology_lock)
|
|
|
|
|
2002-05-20 10:03:15 +00:00
|
|
|
#define g_topology_unlock() \
|
|
|
|
do { \
|
|
|
|
sx_xunlock(&topology_lock); \
|
|
|
|
} while (0)
|
|
|
|
|
|
|
|
#define g_topology_assert() \
|
|
|
|
do { \
|
|
|
|
sx_assert(&topology_lock, SX_XLOCKED); \
|
|
|
|
} while (0)
|
2002-03-11 21:42:35 +00:00
|
|
|
|
2004-02-10 15:53:28 +00:00
|
|
|
#define g_topology_assert_not() \
|
|
|
|
do { \
|
|
|
|
sx_assert(&topology_lock, SX_UNLOCKED); \
|
|
|
|
} while (0)
|
|
|
|
|
2010-05-05 18:53:24 +00:00
|
|
|
#define g_topology_sleep(chan, timo) \
|
|
|
|
sx_sleep(chan, &topology_lock, 0, "gtopol", timo)
|
|
|
|
|
2003-05-31 18:13:07 +00:00
|
|
|
#define DECLARE_GEOM_CLASS(class, name) \
|
|
|
|
static moduledata_t name##_mod = { \
|
|
|
|
#name, g_modevent, &class \
|
|
|
|
}; \
|
|
|
|
DECLARE_MODULE(name, name##_mod, SI_SUB_DRIVERS, SI_ORDER_FIRST);
|
2002-03-11 21:42:35 +00:00
|
|
|
|
Merge GEOM direct dispatch changes from the projects/camlock branch.
When safety requirements are met, it allows to avoid passing I/O requests
to GEOM g_up/g_down thread, executing them directly in the caller context.
That allows to avoid CPU bottlenecks in g_up/g_down threads, plus avoid
several context switches per I/O.
The defined now safety requirements are:
- caller should not hold any locks and should be reenterable;
- callee should not depend on GEOM dual-threaded concurency semantics;
- on the way down, if request is unmapped while callee doesn't support it,
the context should be sleepable;
- kernel thread stack usage should be below 50%.
To keep compatibility with GEOM classes not meeting above requirements
new provider and consumer flags added:
- G_CF_DIRECT_SEND -- consumer code meets caller requirements (request);
- G_CF_DIRECT_RECEIVE -- consumer code meets callee requirements (done);
- G_PF_DIRECT_SEND -- provider code meets caller requirements (done);
- G_PF_DIRECT_RECEIVE -- provider code meets callee requirements (request).
Capable GEOM class can set them, allowing direct dispatch in cases where
it is safe. If any of requirements are not met, request is queued to
g_up or g_down thread same as before.
Such GEOM classes were reviewed and updated to support direct dispatch:
CONCAT, DEV, DISK, GATE, MD, MIRROR, MULTIPATH, NOP, PART, RAID, STRIPE,
VFS, ZERO, ZFS::VDEV, ZFS::ZVOL, all classes based on g_slice KPI (LABEL,
MAP, FLASHMAP, etc).
To declare direct completion capability disk(9) KPI got new flag equivalent
to G_PF_DIRECT_SEND -- DISKFLAG_DIRECT_COMPLETION. da(4) and ada(4) disk
drivers got it set now thanks to earlier CAM locking work.
This change more then twice increases peak block storage performance on
systems with manu CPUs, together with earlier CAM locking changes reaching
more then 1 million IOPS (512 byte raw reads from 16 SATA SSDs on 4 HBAs to
256 user-level threads).
Sponsored by: iXsystems, Inc.
MFC after: 2 months
2013-10-22 08:22:19 +00:00
|
|
|
int g_is_geom_thread(struct thread *td);
|
|
|
|
|
2002-04-23 11:48:45 +00:00
|
|
|
#endif /* _KERNEL */
|
2002-03-11 21:42:35 +00:00
|
|
|
|
2003-03-27 14:35:00 +00:00
|
|
|
/* geom_ctl.c */
|
2006-04-07 16:19:48 +00:00
|
|
|
int gctl_set_param(struct gctl_req *req, const char *param, void const *ptr, int len);
|
|
|
|
void gctl_set_param_err(struct gctl_req *req, const char *param, void const *ptr, int len);
|
2003-03-27 14:35:00 +00:00
|
|
|
void *gctl_get_param(struct gctl_req *req, const char *param, int *len);
|
2003-06-01 13:47:51 +00:00
|
|
|
char const *gctl_get_asciiparam(struct gctl_req *req, const char *param);
|
2003-04-23 07:50:01 +00:00
|
|
|
void *gctl_get_paraml(struct gctl_req *req, const char *param, int len);
|
2006-09-16 10:39:07 +00:00
|
|
|
int gctl_error(struct gctl_req *req, const char *fmt, ...) __printflike(2, 3);
|
2003-06-01 13:47:51 +00:00
|
|
|
struct g_class *gctl_get_class(struct gctl_req *req, char const *arg);
|
|
|
|
struct g_geom *gctl_get_geom(struct gctl_req *req, struct g_class *mpr, char const *arg);
|
|
|
|
struct g_provider *gctl_get_provider(struct gctl_req *req, char const *arg);
|
2003-03-27 14:35:00 +00:00
|
|
|
|
2002-04-22 19:54:17 +00:00
|
|
|
#endif /* _GEOM_GEOM_H_ */
|