130f4520cb
CTL is a disk and processor device emulation subsystem originally written for Copan Systems under Linux starting in 2003. It has been shipping in Copan (now SGI) products since 2005. It was ported to FreeBSD in 2008, and thanks to an agreement between SGI (who acquired Copan's assets in 2010) and Spectra Logic in 2010, CTL is available under a BSD-style license. The intent behind the agreement was that Spectra would work to get CTL into the FreeBSD tree. Some CTL features: - Disk and processor device emulation. - Tagged queueing - SCSI task attribute support (ordered, head of queue, simple tags) - SCSI implicit command ordering support. (e.g. if a read follows a mode select, the read will be blocked until the mode select completes.) - Full task management support (abort, LUN reset, target reset, etc.) - Support for multiple ports - Support for multiple simultaneous initiators - Support for multiple simultaneous backing stores - Persistent reservation support - Mode sense/select support - Error injection support - High Availability support (1) - All I/O handled in-kernel, no userland context switch overhead. (1) HA Support is just an API stub, and needs much more to be fully functional. ctl.c: The core of CTL. Command handlers and processing, character driver, and HA support are here. ctl.h: Basic function declarations and data structures. ctl_backend.c, ctl_backend.h: The basic CTL backend API. ctl_backend_block.c, ctl_backend_block.h: The block and file backend. This allows for using a disk or a file as the backing store for a LUN. Multiple threads are started to do I/O to the backing device, primarily because the VFS API requires that to get any concurrency. ctl_backend_ramdisk.c: A "fake" ramdisk backend. It only allocates a small amount of memory to act as a source and sink for reads and writes from an initiator. Therefore it cannot be used for any real data, but it can be used to test for throughput. It can also be used to test initiators' support for extremely large LUNs. ctl_cmd_table.c: This is a table with all 256 possible SCSI opcodes, and command handler functions defined for supported opcodes. ctl_debug.h: Debugging support. ctl_error.c, ctl_error.h: CTL-specific wrappers around the CAM sense building functions. ctl_frontend.c, ctl_frontend.h: These files define the basic CTL frontend port API. ctl_frontend_cam_sim.c: This is a CTL frontend port that is also a CAM SIM. This frontend allows for using CTL without any target-capable hardware. So any LUNs you create in CTL are visible in CAM via this port. ctl_frontend_internal.c, ctl_frontend_internal.h: This is a frontend port written for Copan to do some system-specific tasks that required sending commands into CTL from inside the kernel. This isn't entirely relevant to FreeBSD in general, but can perhaps be repurposed. ctl_ha.h: This is a stubbed-out High Availability API. Much more is needed for full HA support. See the comments in the header and the description of what is needed in the README.ctl.txt file for more details. ctl_io.h: This defines most of the core CTL I/O structures. union ctl_io is conceptually very similar to CAM's union ccb. ctl_ioctl.h: This defines all ioctls available through the CTL character device, and the data structures needed for those ioctls. ctl_mem_pool.c, ctl_mem_pool.h: Generic memory pool implementation used by the internal frontend. ctl_private.h: Private data structres (e.g. CTL softc) and function prototypes. This also includes the SCSI vendor and product names used by CTL. ctl_scsi_all.c, ctl_scsi_all.h: CTL wrappers around CAM sense printing functions. ctl_ser_table.c: Command serialization table. This defines what happens when one type of command is followed by another type of command. ctl_util.c, ctl_util.h: CTL utility functions, primarily designed to be used from userland. See ctladm for the primary consumer of these functions. These include CDB building functions. scsi_ctl.c: CAM target peripheral driver and CTL frontend port. This is the path into CTL for commands from target-capable hardware/SIMs. README.ctl.txt: CTL code features, roadmap, to-do list. usr.sbin/Makefile: Add ctladm. ctladm/Makefile, ctladm/ctladm.8, ctladm/ctladm.c, ctladm/ctladm.h, ctladm/util.c: ctladm(8) is the CTL management utility. It fills a role similar to camcontrol(8). It allow configuring LUNs, issuing commands, injecting errors and various other control functions. usr.bin/Makefile: Add ctlstat. ctlstat/Makefile ctlstat/ctlstat.8, ctlstat/ctlstat.c: ctlstat(8) fills a role similar to iostat(8). It reports I/O statistics for CTL. sys/conf/files: Add CTL files. sys/conf/NOTES: Add device ctl. sys/cam/scsi_all.h: To conform to more recent specs, the inquiry CDB length field is now 2 bytes long. Add several mode page definitions for CTL. sys/cam/scsi_all.c: Handle the new 2 byte inquiry length. sys/dev/ciss/ciss.c, sys/dev/ata/atapi-cam.c, sys/cam/scsi/scsi_targ_bh.c, scsi_target/scsi_cmds.c, mlxcontrol/interface.c: Update for 2 byte inquiry length field. scsi_da.h: Add versions of the format and rigid disk pages that are in a more reasonable format for CTL. amd64/conf/GENERIC, i386/conf/GENERIC, ia64/conf/GENERIC, sparc64/conf/GENERIC: Add device ctl. i386/conf/PAE: The CTL frontend SIM at least does not compile cleanly on PAE. Sponsored by: Copan Systems, SGI and Spectra Logic MFC after: 1 month
290 lines
7.9 KiB
C
290 lines
7.9 KiB
C
/*-
|
|
* Copyright (c) 1999 Michael Smith
|
|
* All rights reserved.
|
|
*
|
|
* Redistribution and use in source and binary forms, with or without
|
|
* modification, are permitted provided that the following conditions
|
|
* are met:
|
|
* 1. Redistributions of source code must retain the above copyright
|
|
* notice, this list of conditions and the following disclaimer.
|
|
* 2. Redistributions in binary form must reproduce the above copyright
|
|
* notice, this list of conditions and the following disclaimer in the
|
|
* documentation and/or other materials provided with the distribution.
|
|
*
|
|
* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
|
|
* ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
* ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
|
|
* FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
* DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
* OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
* LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
* OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
* SUCH DAMAGE.
|
|
*
|
|
* $FreeBSD$
|
|
*/
|
|
|
|
#include <fcntl.h>
|
|
#include <stdio.h>
|
|
#include <stdlib.h>
|
|
#include <unistd.h>
|
|
#include <string.h>
|
|
#include <cam/scsi/scsi_all.h>
|
|
|
|
#include <dev/mlx/mlxio.h>
|
|
#include <dev/mlx/mlxreg.h>
|
|
|
|
#include "mlxcontrol.h"
|
|
|
|
/********************************************************************************
|
|
* Iterate over all mlx devices, call (func) with each ones' path and (arg)
|
|
*/
|
|
void
|
|
mlx_foreach(void (*func)(int unit, void *arg), void *arg)
|
|
{
|
|
int i, fd;
|
|
|
|
/* limit total count for sanity */
|
|
for (i = 0; i < 64; i++) {
|
|
/* verify we can open it */
|
|
if ((fd = open(ctrlrpath(i), 0)) >= 0)
|
|
close(fd);
|
|
/* if we can, do */
|
|
if (fd >= 0) {
|
|
func(i, arg);
|
|
}
|
|
}
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Open the controller (unit) and give the fd to (func) along with (arg)
|
|
*/
|
|
void
|
|
mlx_perform(int unit, void (*func)(int fd, void *arg), void *arg)
|
|
{
|
|
int fd;
|
|
|
|
if ((fd = open(ctrlrpath(unit), 0)) >= 0) {
|
|
func(fd, arg);
|
|
close(fd);
|
|
}
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Iterate over all mlxd devices, call (func) with each ones' path and (arg)
|
|
*/
|
|
void
|
|
mlxd_foreach_ctrlr(int unit, void *arg)
|
|
{
|
|
struct mlxd_foreach_action *ma = (struct mlxd_foreach_action *)arg;
|
|
int i, fd, ctrlfd;
|
|
|
|
/* Get the device */
|
|
if ((ctrlfd = open(ctrlrpath(unit), 0)) < 0)
|
|
return;
|
|
|
|
for (i = -1; ;) {
|
|
/* Get the unit number of the next child device */
|
|
if (ioctl(ctrlfd, MLX_NEXT_CHILD, &i) < 0) {
|
|
close(ctrlfd);
|
|
return;
|
|
}
|
|
|
|
/* check that we can open this unit */
|
|
if ((fd = open(drivepath(i), 0)) >= 0)
|
|
close(fd);
|
|
/* if we can, do */
|
|
if (fd >= 0) {
|
|
ma->func(i, ma->arg);
|
|
}
|
|
}
|
|
}
|
|
|
|
void
|
|
mlxd_foreach(void (*func)(int unit, void *arg), void *arg)
|
|
{
|
|
struct mlxd_foreach_action ma;
|
|
|
|
ma.func = func;
|
|
ma.arg = arg;
|
|
mlx_foreach(mlxd_foreach_ctrlr, &ma);
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Find the controller that manages the drive (unit), return controller number
|
|
* and system drive number on that controller.
|
|
*/
|
|
static struct
|
|
{
|
|
int unit;
|
|
int ctrlr;
|
|
int sysdrive;
|
|
} mlxd_find_ctrlr_param;
|
|
|
|
static void
|
|
mlxd_find_ctrlr_search(int unit, void *arg)
|
|
{
|
|
int i, fd;
|
|
|
|
/* Get the device */
|
|
if ((fd = open(ctrlrpath(unit), 0)) >= 0) {
|
|
for (i = -1; ;) {
|
|
/* Get the unit number of the next child device */
|
|
if (ioctl(fd, MLX_NEXT_CHILD, &i) < 0)
|
|
break;
|
|
|
|
/* is this child the unit we want? */
|
|
if (i == mlxd_find_ctrlr_param.unit) {
|
|
mlxd_find_ctrlr_param.ctrlr = unit;
|
|
if (ioctl(fd, MLX_GET_SYSDRIVE, &i) == 0)
|
|
mlxd_find_ctrlr_param.sysdrive = i;
|
|
}
|
|
}
|
|
close(fd);
|
|
}
|
|
}
|
|
|
|
int
|
|
mlxd_find_ctrlr(int unit, int *ctrlr, int *sysdrive)
|
|
{
|
|
mlxd_find_ctrlr_param.unit = unit;
|
|
mlxd_find_ctrlr_param.ctrlr = -1;
|
|
mlxd_find_ctrlr_param.sysdrive = -1;
|
|
|
|
mlx_foreach(mlxd_find_ctrlr_search, NULL);
|
|
if ((mlxd_find_ctrlr_param.ctrlr != -1) && (mlxd_find_ctrlr_param.sysdrive != -1)) {
|
|
*ctrlr = mlxd_find_ctrlr_param.ctrlr;
|
|
*sysdrive = mlxd_find_ctrlr_param.sysdrive;
|
|
return(0);
|
|
}
|
|
return(1);
|
|
}
|
|
|
|
|
|
/********************************************************************************
|
|
* Send a command to the controller on (fd)
|
|
*/
|
|
|
|
void
|
|
mlx_command(int fd, void *arg)
|
|
{
|
|
struct mlx_usercommand *cmd = (struct mlx_usercommand *)arg;
|
|
int error;
|
|
|
|
error = ioctl(fd, MLX_COMMAND, cmd);
|
|
if (error != 0)
|
|
cmd->mu_error = error;
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Perform an ENQUIRY2 command and return information related to the controller
|
|
* (unit)
|
|
*/
|
|
int
|
|
mlx_enquiry(int unit, struct mlx_enquiry2 *enq)
|
|
{
|
|
struct mlx_usercommand cmd;
|
|
|
|
/* build the command */
|
|
cmd.mu_datasize = sizeof(*enq);
|
|
cmd.mu_buf = enq;
|
|
cmd.mu_bufptr = 8;
|
|
cmd.mu_command[0] = MLX_CMD_ENQUIRY2;
|
|
|
|
/* hand it off for processing */
|
|
mlx_perform(unit, mlx_command, (void *)&cmd);
|
|
|
|
return(cmd.mu_status != 0);
|
|
}
|
|
|
|
|
|
/********************************************************************************
|
|
* Perform a READ CONFIGURATION command and return information related to the controller
|
|
* (unit)
|
|
*/
|
|
int
|
|
mlx_read_configuration(int unit, struct mlx_core_cfg *cfg)
|
|
{
|
|
struct mlx_usercommand cmd;
|
|
|
|
/* build the command */
|
|
cmd.mu_datasize = sizeof(*cfg);
|
|
cmd.mu_buf = cfg;
|
|
cmd.mu_bufptr = 8;
|
|
cmd.mu_command[0] = MLX_CMD_READ_CONFIG;
|
|
|
|
/* hand it off for processing */
|
|
mlx_perform(unit, mlx_command, (void *)&cmd);
|
|
|
|
return(cmd.mu_status != 0);
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Perform a SCSI INQUIRY command and return pointers to the relevant data.
|
|
*/
|
|
int
|
|
mlx_scsi_inquiry(int unit, int channel, int target, char **vendor, char **device, char **revision)
|
|
{
|
|
struct mlx_usercommand cmd;
|
|
static struct {
|
|
struct mlx_dcdb dcdb;
|
|
union {
|
|
struct scsi_inquiry_data inq;
|
|
u_int8_t pad[SHORT_INQUIRY_LENGTH];
|
|
} d;
|
|
} __attribute__ ((packed)) dcdb_cmd;
|
|
struct scsi_inquiry *inq_cmd = (struct scsi_inquiry *)&dcdb_cmd.dcdb.dcdb_cdb[0];
|
|
|
|
/* build the command */
|
|
cmd.mu_datasize = sizeof(dcdb_cmd);
|
|
cmd.mu_buf = &dcdb_cmd;
|
|
cmd.mu_command[0] = MLX_CMD_DIRECT_CDB;
|
|
|
|
/* build the DCDB */
|
|
bzero(&dcdb_cmd, sizeof(dcdb_cmd));
|
|
dcdb_cmd.dcdb.dcdb_channel = channel;
|
|
dcdb_cmd.dcdb.dcdb_target = target;
|
|
dcdb_cmd.dcdb.dcdb_flags = MLX_DCDB_DATA_IN | MLX_DCDB_TIMEOUT_10S;
|
|
dcdb_cmd.dcdb.dcdb_datasize = SHORT_INQUIRY_LENGTH;
|
|
dcdb_cmd.dcdb.dcdb_cdb_length = 6;
|
|
dcdb_cmd.dcdb.dcdb_sense_length = SSD_FULL_SIZE;
|
|
|
|
/* build the cdb */
|
|
inq_cmd->opcode = INQUIRY;
|
|
scsi_ulto2b(SHORT_INQUIRY_LENGTH, inq_cmd->length);
|
|
|
|
/* hand it off for processing */
|
|
mlx_perform(unit, mlx_command, &cmd);
|
|
|
|
if (cmd.mu_status == 0) {
|
|
*vendor = &dcdb_cmd.d.inq.vendor[0];
|
|
*device = &dcdb_cmd.d.inq.product[0];
|
|
*revision = &dcdb_cmd.d.inq.revision[0];
|
|
}
|
|
return(cmd.mu_status);
|
|
}
|
|
|
|
/********************************************************************************
|
|
* Perform a GET DEVICE STATE command and return pointers to the relevant data.
|
|
*/
|
|
int
|
|
mlx_get_device_state(int unit, int channel, int target, struct mlx_phys_drv *drv)
|
|
{
|
|
struct mlx_usercommand cmd;
|
|
|
|
/* build the command */
|
|
cmd.mu_datasize = sizeof(*drv);
|
|
cmd.mu_buf = drv;
|
|
cmd.mu_bufptr = 8;
|
|
cmd.mu_command[0] = MLX_CMD_DEVICE_STATE;
|
|
cmd.mu_command[2] = channel;
|
|
cmd.mu_command[3] = target;
|
|
|
|
/* hand it off for processing */
|
|
mlx_perform(unit, mlx_command, (void *)&cmd);
|
|
|
|
return(cmd.mu_status != 0);
|
|
}
|