2010-09-10 15:03:56 +00:00
|
|
|
/*-
|
2017-11-27 14:52:40 +00:00
|
|
|
* SPDX-License-Identifier: BSD-2-Clause-FreeBSD
|
|
|
|
|
*
|
2010-09-10 15:03:56 +00:00
|
|
|
* Copyright (c) 2009 Yahoo! Inc.
|
2015-02-24 22:07:42 +00:00
|
|
|
* Copyright (c) 2011-2015 LSI Corp.
|
|
|
|
|
* Copyright (c) 2013-2015 Avago Technologies
|
2012-01-26 18:17:21 +00:00
|
|
|
* All rights reserved.
|
|
|
|
|
*
|
|
|
|
|
* Redistribution and use in source and binary forms, with or without
|
|
|
|
|
* modification, are permitted provided that the following conditions
|
|
|
|
|
* are met:
|
|
|
|
|
* 1. Redistributions of source code must retain the above copyright
|
|
|
|
|
* notice, this list of conditions and the following disclaimer.
|
|
|
|
|
* 2. Redistributions in binary form must reproduce the above copyright
|
|
|
|
|
* notice, this list of conditions and the following disclaimer in the
|
|
|
|
|
* documentation and/or other materials provided with the distribution.
|
|
|
|
|
*
|
|
|
|
|
* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
|
|
|
|
|
* ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
|
|
|
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
|
|
|
* ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
|
|
|
|
|
* FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
|
|
|
* DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
|
|
|
* OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
|
|
|
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
|
|
|
* LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
|
|
|
* OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
|
|
|
* SUCH DAMAGE.
|
|
|
|
|
*
|
2015-02-24 22:07:42 +00:00
|
|
|
* Avago Technologies (LSI) MPT-Fusion Host Adapter FreeBSD
|
2012-01-26 18:17:21 +00:00
|
|
|
*
|
2010-09-10 15:03:56 +00:00
|
|
|
* $FreeBSD$
|
|
|
|
|
*/
|
|
|
|
|
|
|
|
|
|
#ifndef _MPSVAR_H
|
|
|
|
|
#define _MPSVAR_H
|
|
|
|
|
|
2017-05-25 19:14:44 +00:00
|
|
|
#define MPS_DRIVER_VERSION "21.02.00.00-fbsd"
|
2012-01-26 18:17:21 +00:00
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_DB_MAX_WAIT 2500
|
|
|
|
|
|
2017-09-11 01:51:27 +00:00
|
|
|
#define MPS_REQ_FRAMES 2048
|
|
|
|
|
#define MPS_PRI_REQ_FRAMES 128
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_EVT_REPLY_FRAMES 32
|
|
|
|
|
#define MPS_REPLY_FRAMES MPS_REQ_FRAMES
|
2018-02-27 01:48:13 +00:00
|
|
|
#define MPS_CHAIN_FRAMES 16384
|
2016-07-12 19:34:10 +00:00
|
|
|
#define MPS_MAXIO_PAGES (-1)
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_SENSE_LEN SSD_FULL_SIZE
|
2017-09-11 01:51:27 +00:00
|
|
|
#define MPS_MSI_MAX 1
|
|
|
|
|
#define MPS_MSIX_MAX 16
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_SGE64_SIZE 12
|
|
|
|
|
#define MPS_SGE32_SIZE 8
|
|
|
|
|
#define MPS_SGC_SIZE 8
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
#define CAN_SLEEP 1
|
|
|
|
|
#define NO_SLEEP 0
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_PERIODIC_DELAY 1 /* 1 second heartbeat/watchdog check */
|
2015-02-24 22:07:42 +00:00
|
|
|
#define MPS_ATA_ID_TIMEOUT 5 /* 5 second timeout for SATA ID cmd */
|
2017-05-25 19:14:44 +00:00
|
|
|
#define MPS_MISSING_CHECK_DELAY 10 /* 10 seconds between missing check */
|
2010-09-10 15:03:56 +00:00
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
#define MPS_SCSI_RI_INVALID_FRAME (0x00000002)
|
|
|
|
|
|
2015-02-24 22:07:42 +00:00
|
|
|
#define DEFAULT_SPINUP_WAIT 3 /* seconds to wait for spinup */
|
|
|
|
|
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
#include <sys/endian.h>
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
/*
|
|
|
|
|
* host mapping related macro definitions
|
|
|
|
|
*/
|
|
|
|
|
#define MPS_MAPTABLE_BAD_IDX 0xFFFFFFFF
|
|
|
|
|
#define MPS_DPM_BAD_IDX 0xFFFF
|
|
|
|
|
#define MPS_ENCTABLE_BAD_IDX 0xFF
|
|
|
|
|
#define MPS_MAX_MISSING_COUNT 0x0F
|
|
|
|
|
#define MPS_DEV_RESERVED 0x20000000
|
|
|
|
|
#define MPS_MAP_IN_USE 0x10000000
|
|
|
|
|
#define MPS_MAP_BAD_ID 0xFFFFFFFF
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* WarpDrive controller
|
|
|
|
|
*/
|
|
|
|
|
#define MPS_CHIP_WD_DEVICE_ID 0x007E
|
|
|
|
|
#define MPS_WD_LSI_OEM 0x80
|
|
|
|
|
#define MPS_WD_HIDE_EXPOSE_MASK 0x03
|
|
|
|
|
#define MPS_WD_HIDE_ALWAYS 0x00
|
|
|
|
|
#define MPS_WD_EXPOSE_ALWAYS 0x01
|
|
|
|
|
#define MPS_WD_HIDE_IF_VOLUME 0x02
|
|
|
|
|
#define MPS_WD_RETRY 0x01
|
|
|
|
|
#define MPS_MAN_PAGE10_SIZE 0x5C /* Hardcode for now */
|
|
|
|
|
#define MPS_MAX_DISKS_IN_VOL 10
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* WarpDrive Event Logging
|
|
|
|
|
*/
|
|
|
|
|
#define MPI2_WD_LOG_ENTRY 0x8002
|
|
|
|
|
#define MPI2_WD_SSD_THROTTLING 0x0041
|
|
|
|
|
#define MPI2_WD_DRIVE_LIFE_WARN 0x0043
|
|
|
|
|
#define MPI2_WD_DRIVE_LIFE_DEAD 0x0044
|
|
|
|
|
#define MPI2_WD_RAIL_MON_FAIL 0x004D
|
|
|
|
|
|
|
|
|
|
typedef uint8_t u8;
|
|
|
|
|
typedef uint16_t u16;
|
|
|
|
|
typedef uint32_t u32;
|
|
|
|
|
typedef uint64_t u64;
|
|
|
|
|
|
|
|
|
|
/**
|
|
|
|
|
* struct dev_mapping_table - device mapping information
|
|
|
|
|
* @physical_id: SAS address for drives or WWID for RAID volumes
|
|
|
|
|
* @device_info: bitfield provides detailed info about the device
|
|
|
|
|
* @phy_bits: bitfields indicating controller phys
|
|
|
|
|
* @dpm_entry_num: index of this device in device persistent map table
|
|
|
|
|
* @dev_handle: device handle for the device pointed by this entry
|
|
|
|
|
* @id: target id
|
|
|
|
|
* @missing_count: number of times the device not detected by driver
|
|
|
|
|
* @hide_flag: Hide this physical disk/not (foreign configuration)
|
|
|
|
|
* @init_complete: Whether the start of the day checks completed or not
|
|
|
|
|
*/
|
|
|
|
|
struct dev_mapping_table {
|
|
|
|
|
u64 physical_id;
|
|
|
|
|
u32 device_info;
|
|
|
|
|
u32 phy_bits;
|
|
|
|
|
u16 dpm_entry_num;
|
|
|
|
|
u16 dev_handle;
|
2017-05-25 19:14:44 +00:00
|
|
|
u16 reserved1;
|
2012-01-26 18:17:21 +00:00
|
|
|
u16 id;
|
|
|
|
|
u8 missing_count;
|
|
|
|
|
u8 init_complete;
|
|
|
|
|
u8 TLR_bits;
|
|
|
|
|
u8 reserved2;
|
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
/**
|
|
|
|
|
* struct enc_mapping_table - mapping information about an enclosure
|
|
|
|
|
* @enclosure_id: Logical ID of this enclosure
|
|
|
|
|
* @start_index: index to the entry in dev_mapping_table
|
|
|
|
|
* @phy_bits: bitfields indicating controller phys
|
|
|
|
|
* @dpm_entry_num: index of this enclosure in device persistent map table
|
|
|
|
|
* @enc_handle: device handle for the enclosure pointed by this entry
|
|
|
|
|
* @num_slots: number of slots in the enclosure
|
|
|
|
|
* @start_slot: Starting slot id
|
|
|
|
|
* @missing_count: number of times the device not detected by driver
|
|
|
|
|
* @removal_flag: used to mark the device for removal
|
|
|
|
|
* @skip_search: used as a flag to include/exclude enclosure for search
|
|
|
|
|
* @init_complete: Whether the start of the day checks completed or not
|
|
|
|
|
*/
|
|
|
|
|
struct enc_mapping_table {
|
|
|
|
|
u64 enclosure_id;
|
|
|
|
|
u32 start_index;
|
|
|
|
|
u32 phy_bits;
|
|
|
|
|
u16 dpm_entry_num;
|
|
|
|
|
u16 enc_handle;
|
|
|
|
|
u16 num_slots;
|
|
|
|
|
u16 start_slot;
|
|
|
|
|
u8 missing_count;
|
|
|
|
|
u8 removal_flag;
|
|
|
|
|
u8 skip_search;
|
|
|
|
|
u8 init_complete;
|
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
/**
|
|
|
|
|
* struct map_removal_table - entries to be removed from mapping table
|
|
|
|
|
* @dpm_entry_num: index of this device in device persistent map table
|
|
|
|
|
* @dev_handle: device handle for the device pointed by this entry
|
|
|
|
|
*/
|
|
|
|
|
struct map_removal_table{
|
|
|
|
|
u16 dpm_entry_num;
|
|
|
|
|
u16 dev_handle;
|
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
typedef struct mps_fw_diagnostic_buffer {
|
|
|
|
|
size_t size;
|
|
|
|
|
uint8_t extended_type;
|
|
|
|
|
uint8_t buffer_type;
|
|
|
|
|
uint8_t force_release;
|
|
|
|
|
uint32_t product_specific[23];
|
|
|
|
|
uint8_t immediate;
|
|
|
|
|
uint8_t enabled;
|
|
|
|
|
uint8_t valid_data;
|
|
|
|
|
uint8_t owned_by_firmware;
|
|
|
|
|
uint32_t unique_id;
|
|
|
|
|
} mps_fw_diagnostic_buffer_t;
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_softc;
|
|
|
|
|
struct mps_command;
|
|
|
|
|
struct mpssas_softc;
|
2012-01-26 18:17:21 +00:00
|
|
|
union ccb;
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mpssas_target;
|
2012-01-26 18:17:21 +00:00
|
|
|
struct mps_column_map;
|
2010-09-10 15:03:56 +00:00
|
|
|
|
|
|
|
|
MALLOC_DECLARE(M_MPT2);
|
|
|
|
|
|
|
|
|
|
typedef void mps_evt_callback_t(struct mps_softc *, uintptr_t,
|
|
|
|
|
MPI2_EVENT_NOTIFICATION_REPLY *reply);
|
|
|
|
|
typedef void mps_command_callback_t(struct mps_softc *, struct mps_command *cm);
|
|
|
|
|
|
|
|
|
|
struct mps_chain {
|
|
|
|
|
TAILQ_ENTRY(mps_chain) chain_link;
|
|
|
|
|
MPI2_SGE_IO_UNION *chain;
|
|
|
|
|
uint32_t chain_busaddr;
|
|
|
|
|
};
|
|
|
|
|
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
/*
|
|
|
|
|
* This needs to be at least 2 to support SMP passthrough.
|
|
|
|
|
*/
|
2012-01-26 18:17:21 +00:00
|
|
|
#define MPS_IOVEC_COUNT 2
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_command {
|
|
|
|
|
TAILQ_ENTRY(mps_command) cm_link;
|
2012-01-26 18:17:21 +00:00
|
|
|
TAILQ_ENTRY(mps_command) cm_recovery;
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_softc *cm_sc;
|
2012-01-26 18:17:21 +00:00
|
|
|
union ccb *cm_ccb;
|
2010-09-10 15:03:56 +00:00
|
|
|
void *cm_data;
|
|
|
|
|
u_int cm_length;
|
2012-01-26 18:17:21 +00:00
|
|
|
u_int cm_out_len;
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
struct uio cm_uio;
|
|
|
|
|
struct iovec cm_iovec[MPS_IOVEC_COUNT];
|
|
|
|
|
u_int cm_max_segs;
|
2010-09-10 15:03:56 +00:00
|
|
|
u_int cm_sglsize;
|
|
|
|
|
MPI2_SGE_IO_UNION *cm_sge;
|
|
|
|
|
uint8_t *cm_req;
|
|
|
|
|
uint8_t *cm_reply;
|
|
|
|
|
uint32_t cm_reply_data;
|
|
|
|
|
mps_command_callback_t *cm_complete;
|
|
|
|
|
void *cm_complete_data;
|
|
|
|
|
struct mpssas_target *cm_targ;
|
|
|
|
|
MPI2_REQUEST_DESCRIPTOR_UNION cm_desc;
|
2012-01-26 18:17:21 +00:00
|
|
|
u_int cm_lun;
|
2010-09-10 15:03:56 +00:00
|
|
|
u_int cm_flags;
|
|
|
|
|
#define MPS_CM_FLAGS_POLLED (1 << 0)
|
|
|
|
|
#define MPS_CM_FLAGS_COMPLETE (1 << 1)
|
|
|
|
|
#define MPS_CM_FLAGS_SGE_SIMPLE (1 << 2)
|
|
|
|
|
#define MPS_CM_FLAGS_DATAOUT (1 << 3)
|
|
|
|
|
#define MPS_CM_FLAGS_DATAIN (1 << 4)
|
|
|
|
|
#define MPS_CM_FLAGS_WAKEUP (1 << 5)
|
2012-01-26 18:17:21 +00:00
|
|
|
#define MPS_CM_FLAGS_DD_IO (1 << 6)
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
#define MPS_CM_FLAGS_USE_UIO (1 << 7)
|
|
|
|
|
#define MPS_CM_FLAGS_SMP_PASS (1 << 8)
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
#define MPS_CM_FLAGS_CHAIN_FAILED (1 << 9)
|
|
|
|
|
#define MPS_CM_FLAGS_ERROR_MASK MPS_CM_FLAGS_CHAIN_FAILED
|
2013-02-12 16:57:20 +00:00
|
|
|
#define MPS_CM_FLAGS_USE_CCB (1 << 10)
|
2015-02-24 22:07:42 +00:00
|
|
|
#define MPS_CM_FLAGS_SATA_ID_TIMEOUT (1 << 11)
|
2010-09-10 15:03:56 +00:00
|
|
|
u_int cm_state;
|
|
|
|
|
#define MPS_CM_STATE_FREE 0
|
|
|
|
|
#define MPS_CM_STATE_BUSY 1
|
|
|
|
|
#define MPS_CM_STATE_TIMEDOUT 2
|
2018-02-18 16:41:34 +00:00
|
|
|
#define MPS_CM_STATE_INQUEUE 3
|
2010-09-10 15:03:56 +00:00
|
|
|
bus_dmamap_t cm_dmamap;
|
|
|
|
|
struct scsi_sense_data *cm_sense;
|
|
|
|
|
TAILQ_HEAD(, mps_chain) cm_chain_list;
|
|
|
|
|
uint32_t cm_req_busaddr;
|
|
|
|
|
uint32_t cm_sense_busaddr;
|
|
|
|
|
struct callout cm_callout;
|
2018-12-21 20:30:52 +00:00
|
|
|
mps_command_callback_t *cm_timeout_handler;
|
2010-09-10 15:03:56 +00:00
|
|
|
};
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
struct mps_column_map {
|
|
|
|
|
uint16_t dev_handle;
|
|
|
|
|
uint8_t phys_disk_num;
|
|
|
|
|
};
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_event_handle {
|
|
|
|
|
TAILQ_ENTRY(mps_event_handle) eh_list;
|
|
|
|
|
mps_evt_callback_t *callback;
|
|
|
|
|
void *data;
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
u32 mask[MPI2_EVENT_NOTIFY_EVENTMASK_WORDS];
|
2010-09-10 15:03:56 +00:00
|
|
|
};
|
|
|
|
|
|
Diagnostic buffer fixes for the mps(4) and mpr(4) drivers.
In mp{r,s}_diag_register(), which is used to register diagnostic
buffers with the mp{r,s}(4) firmware, we allocate DMAable memory.
There were several issues here:
o No checking of the bus_dmamap_load() return value. If the load
failed or got deferred, mp{r,s}_diag_register() continued on as if
nothing had happened. We now check the return value and bail
out if it fails.
o No waiting for a deferred load callback. bus_dmamap_load()
calls a supplied callback when the mapping is done. This is
generally done immediately, but it can be deferred.
mp{r,s}_diag_register() did not check to see whether the callback
was already done before proceeding on. We now sleep until the
callback is done if it is deferred.
o No call to bus_dmamap_sync(... BUS_DMASYNC_PREREAD) after the
memory is allocated and loaded. This is necessary on some
platforms to synchronize host memory that is going to be updated
by a device.
Both drivers would also panic if the firmware was reinitialized while
a diagnostic buffer operation was in progress. This fixes that problem
as well. (The driver will reinitialize the firmware in various
circumstances, but the problem I ran into was that the firmware would
generate an IOC Fault due to a PCIe error.)
mp{r,s}var.h:
Add a new structure, struct mpr_busdma_context, that is
used for deferred busdma load callbacks.
Add a prototype for mp{r,s}_memaddr_wait_cb().
mp{r,s}.c:
Add a new busdma callback function, mp{r,s}_memaddr_wait_cb().
This provides synchronization for callers that want to
wait on a deferred bus_dmamap_load() callback.
mp{r,s}_user.c:
In bus_dmamap_register(), add a call to bus_dmamap_sync()
with the BUS_DMASYNC_PREREAD flag set after an allocation
is loaded.
Also, check the return value of bus_dmamap_load(). If it
fails, bail out. If it is EINPROGRESS, wait for the
callback to happen. We use an interruptible sleep (msleep
with PCATCH) and let the callback clean things up if we get
interrupted.
In mpr_diag_read_buffer() and mps_diag_read_buffer(), call
bus_dmamap_sync(..., BUS_DMASYNC_POSTREAD) before copying
the data out to make sure the data is in stable storage.
In mp{r,s}_post_fw_diag_buffer() and
mp{r,s}_release_fw_diag_buffer(), check the reply to see
whether it is NULL. It can be NULL (and the command non-NULL)
if the controller gets reinitialized while we're waiting for
the command to complete but the driver structures aren't
reallocated. The driver structures generally won't be
reallocated unless there is a firmware upgrade that changes
one of the IOCFacts.
When freeing diagnostic buffers in mp{r,s}_diag_register()
and mp{r,s}_diag_unregister(), zero/NULL out the buffer after
freeing it. This will prevent a duplicate free in some
situations.
Sponsored by: Spectra Logic
Reviewed by: mav, scottl
MFC after: 1 week
Differential Revision: D13453
2018-02-06 15:58:22 +00:00
|
|
|
struct mps_busdma_context {
|
|
|
|
|
int completed;
|
|
|
|
|
int abandoned;
|
|
|
|
|
int error;
|
|
|
|
|
bus_addr_t *addr;
|
|
|
|
|
struct mps_softc *softc;
|
|
|
|
|
bus_dmamap_t buffer_dmamap;
|
|
|
|
|
bus_dma_tag_t buffer_dmat;
|
|
|
|
|
};
|
|
|
|
|
|
2017-09-09 18:03:40 +00:00
|
|
|
struct mps_queue {
|
|
|
|
|
struct mps_softc *sc;
|
|
|
|
|
int qnum;
|
|
|
|
|
MPI2_REPLY_DESCRIPTORS_UNION *post_queue;
|
|
|
|
|
int replypostindex;
|
|
|
|
|
#ifdef notyet
|
|
|
|
|
ck_ring_buffer_t *ringmem;
|
|
|
|
|
ck_ring_buffer_t *chainmem;
|
|
|
|
|
ck_ring_t req_ring;
|
|
|
|
|
ck_ring_t chain_ring;
|
|
|
|
|
#endif
|
|
|
|
|
bus_dma_tag_t buffer_dmat;
|
|
|
|
|
int io_cmds_highwater;
|
|
|
|
|
int chain_free_lowwater;
|
|
|
|
|
int chain_alloc_fail;
|
|
|
|
|
struct resource *irq;
|
|
|
|
|
void *intrhand;
|
|
|
|
|
int irq_rid;
|
|
|
|
|
};
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_softc {
|
|
|
|
|
device_t mps_dev;
|
|
|
|
|
struct cdev *mps_cdev;
|
|
|
|
|
u_int mps_flags;
|
|
|
|
|
#define MPS_FLAGS_INTX (1 << 0)
|
|
|
|
|
#define MPS_FLAGS_MSI (1 << 1)
|
|
|
|
|
#define MPS_FLAGS_BUSY (1 << 2)
|
|
|
|
|
#define MPS_FLAGS_SHUTDOWN (1 << 3)
|
2012-01-26 18:17:21 +00:00
|
|
|
#define MPS_FLAGS_DIAGRESET (1 << 4)
|
|
|
|
|
#define MPS_FLAGS_ATTACH_DONE (1 << 5)
|
|
|
|
|
#define MPS_FLAGS_WD_AVAILABLE (1 << 6)
|
2017-08-10 14:59:17 +00:00
|
|
|
#define MPS_FLAGS_REALLOCATED (1 << 7)
|
2010-09-10 15:03:56 +00:00
|
|
|
u_int mps_debug;
|
2017-07-30 06:53:58 +00:00
|
|
|
u_int msi_msgs;
|
2018-02-06 21:01:38 +00:00
|
|
|
u_int reqframesz;
|
|
|
|
|
u_int replyframesz;
|
Turn on serialization of task management commands going down to the
controller, but make it optional.
After a problem report from Andrew Boyer, it looks like the LSI
chip may have issues (the watchdog timer fired) if too many aborts
are sent down to the chip at the same time. We know that task
management commands are serialized, and although the manual doesn't
say it, it may be a good idea to just send one at a time.
But, since I'm not certain that this is necessary, add a tunable
and sysctl variable (hw.mps.%d.allow_multiple_tm_cmds) to control
the driver's behavior.
mps.c: Add support for the sysctl and tunable, and add a
comment about the possible return values to
mps_map_command().
mps_sas.c: Run all task management commands through two new
routines, mpssas_issue_tm_request() and
mpssas_complete_tm_request().
This allows us to optionally serialize task
management commands. Also, change things so that
the response to a task management command always
comes back through the callback. (Before it could
come via the callback or the return value.)
mpsvar.h: Add softc variables for the list of active task
management commands, the number of active commands,
and whether we should allow multiple active task
management commands. Add an active command flag.
mps.4: Describe the new sysctl/loader tunable variable.
Sponsored by: Spectra Logic Corporation
2010-10-07 21:56:10 +00:00
|
|
|
int tm_cmds_active;
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
int io_cmds_active;
|
|
|
|
|
int io_cmds_highwater;
|
|
|
|
|
int chain_free;
|
2012-01-26 18:17:21 +00:00
|
|
|
int max_chains;
|
2016-07-12 19:34:10 +00:00
|
|
|
int max_io_pages;
|
2018-02-10 00:55:46 +00:00
|
|
|
u_int maxio;
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
int chain_free_lowwater;
|
2015-02-24 22:07:42 +00:00
|
|
|
u_int enable_ssu;
|
|
|
|
|
int spinup_wait_time;
|
2016-11-02 15:13:25 +00:00
|
|
|
int use_phynum;
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
uint64_t chain_alloc_fail;
|
2010-09-10 15:03:56 +00:00
|
|
|
struct sysctl_ctx_list sysctl_ctx;
|
|
|
|
|
struct sysctl_oid *sysctl_tree;
|
2012-01-26 18:17:21 +00:00
|
|
|
char fw_version[16];
|
2010-09-10 15:03:56 +00:00
|
|
|
struct mps_command *commands;
|
|
|
|
|
struct mps_chain *chains;
|
|
|
|
|
struct callout periodic;
|
2017-05-25 19:14:44 +00:00
|
|
|
struct callout device_check_callout;
|
2017-09-09 18:03:40 +00:00
|
|
|
struct mps_queue *queues;
|
2010-09-10 15:03:56 +00:00
|
|
|
|
|
|
|
|
struct mpssas_softc *sassc;
|
|
|
|
|
TAILQ_HEAD(, mps_command) req_list;
|
2012-01-26 18:17:21 +00:00
|
|
|
TAILQ_HEAD(, mps_command) high_priority_req_list;
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_HEAD(, mps_chain) chain_list;
|
Turn on serialization of task management commands going down to the
controller, but make it optional.
After a problem report from Andrew Boyer, it looks like the LSI
chip may have issues (the watchdog timer fired) if too many aborts
are sent down to the chip at the same time. We know that task
management commands are serialized, and although the manual doesn't
say it, it may be a good idea to just send one at a time.
But, since I'm not certain that this is necessary, add a tunable
and sysctl variable (hw.mps.%d.allow_multiple_tm_cmds) to control
the driver's behavior.
mps.c: Add support for the sysctl and tunable, and add a
comment about the possible return values to
mps_map_command().
mps_sas.c: Run all task management commands through two new
routines, mpssas_issue_tm_request() and
mpssas_complete_tm_request().
This allows us to optionally serialize task
management commands. Also, change things so that
the response to a task management command always
comes back through the callback. (Before it could
come via the callback or the return value.)
mpsvar.h: Add softc variables for the list of active task
management commands, the number of active commands,
and whether we should allow multiple active task
management commands. Add an active command flag.
mps.4: Describe the new sysctl/loader tunable variable.
Sponsored by: Spectra Logic Corporation
2010-10-07 21:56:10 +00:00
|
|
|
TAILQ_HEAD(, mps_command) tm_list;
|
2010-09-10 15:03:56 +00:00
|
|
|
int replypostindex;
|
|
|
|
|
int replyfreeindex;
|
|
|
|
|
|
|
|
|
|
struct resource *mps_regs_resource;
|
|
|
|
|
bus_space_handle_t mps_bhandle;
|
|
|
|
|
bus_space_tag_t mps_btag;
|
|
|
|
|
int mps_regs_rid;
|
|
|
|
|
|
|
|
|
|
bus_dma_tag_t mps_parent_dmat;
|
|
|
|
|
bus_dma_tag_t buffer_dmat;
|
|
|
|
|
|
|
|
|
|
MPI2_IOC_FACTS_REPLY *facts;
|
|
|
|
|
int num_reqs;
|
2018-02-06 16:02:25 +00:00
|
|
|
int num_prireqs;
|
2010-09-10 15:03:56 +00:00
|
|
|
int num_replies;
|
2018-02-10 00:55:46 +00:00
|
|
|
int num_chains;
|
2010-09-10 15:03:56 +00:00
|
|
|
int fqdepth; /* Free queue */
|
|
|
|
|
int pqdepth; /* Post queue */
|
|
|
|
|
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
u32 event_mask[MPI2_EVENT_NOTIFY_EVENTMASK_WORDS];
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_HEAD(, mps_event_handle) event_list;
|
|
|
|
|
struct mps_event_handle *mps_log_eh;
|
|
|
|
|
|
|
|
|
|
struct mtx mps_mtx;
|
|
|
|
|
struct intr_config_hook mps_ich;
|
|
|
|
|
|
|
|
|
|
uint8_t *req_frames;
|
|
|
|
|
bus_addr_t req_busaddr;
|
|
|
|
|
bus_dma_tag_t req_dmat;
|
|
|
|
|
bus_dmamap_t req_map;
|
|
|
|
|
|
|
|
|
|
uint8_t *reply_frames;
|
|
|
|
|
bus_addr_t reply_busaddr;
|
|
|
|
|
bus_dma_tag_t reply_dmat;
|
|
|
|
|
bus_dmamap_t reply_map;
|
|
|
|
|
|
|
|
|
|
struct scsi_sense_data *sense_frames;
|
|
|
|
|
bus_addr_t sense_busaddr;
|
|
|
|
|
bus_dma_tag_t sense_dmat;
|
|
|
|
|
bus_dmamap_t sense_map;
|
|
|
|
|
|
|
|
|
|
uint8_t *chain_frames;
|
|
|
|
|
bus_dma_tag_t chain_dmat;
|
|
|
|
|
bus_dmamap_t chain_map;
|
|
|
|
|
|
|
|
|
|
MPI2_REPLY_DESCRIPTORS_UNION *post_queue;
|
|
|
|
|
bus_addr_t post_busaddr;
|
|
|
|
|
uint32_t *free_queue;
|
|
|
|
|
bus_addr_t free_busaddr;
|
|
|
|
|
bus_dma_tag_t queues_dmat;
|
|
|
|
|
bus_dmamap_t queues_map;
|
2012-01-26 18:17:21 +00:00
|
|
|
|
|
|
|
|
uint8_t *fw_diag_buffer;
|
|
|
|
|
bus_addr_t fw_diag_busaddr;
|
|
|
|
|
bus_dma_tag_t fw_diag_dmat;
|
|
|
|
|
bus_dmamap_t fw_diag_map;
|
|
|
|
|
|
|
|
|
|
uint8_t ir_firmware;
|
|
|
|
|
|
|
|
|
|
/* static config pages */
|
|
|
|
|
Mpi2IOCPage8_t ioc_pg8;
|
|
|
|
|
|
|
|
|
|
/* host mapping support */
|
|
|
|
|
struct dev_mapping_table *mapping_table;
|
|
|
|
|
struct enc_mapping_table *enclosure_table;
|
|
|
|
|
struct map_removal_table *removal_table;
|
|
|
|
|
uint8_t *dpm_entry_used;
|
|
|
|
|
uint8_t *dpm_flush_entry;
|
|
|
|
|
Mpi2DriverMappingPage0_t *dpm_pg0;
|
|
|
|
|
uint16_t max_devices;
|
|
|
|
|
uint16_t max_enclosures;
|
|
|
|
|
uint16_t max_expanders;
|
|
|
|
|
uint8_t max_volumes;
|
|
|
|
|
uint8_t num_enc_table_entries;
|
|
|
|
|
uint8_t num_rsvd_entries;
|
|
|
|
|
uint16_t max_dpm_entries;
|
|
|
|
|
uint8_t is_dpm_enable;
|
|
|
|
|
uint8_t track_mapping_events;
|
|
|
|
|
uint32_t pending_map_events;
|
|
|
|
|
|
|
|
|
|
/* FW diag Buffer List */
|
|
|
|
|
mps_fw_diagnostic_buffer_t
|
|
|
|
|
fw_diag_buffer_list[MPI2_DIAG_BUF_TYPE_COUNT];
|
|
|
|
|
|
|
|
|
|
/* Event Recording IOCTL support */
|
|
|
|
|
uint32_t events_to_record[4];
|
|
|
|
|
mps_event_entry_t recorded_events[MPS_EVENT_QUEUE_SIZE];
|
|
|
|
|
uint8_t event_index;
|
|
|
|
|
uint32_t event_number;
|
|
|
|
|
|
|
|
|
|
/* EEDP and TLR support */
|
|
|
|
|
uint8_t eedp_enabled;
|
|
|
|
|
uint8_t control_TLR;
|
|
|
|
|
|
|
|
|
|
/* Shutdown Event Handler */
|
|
|
|
|
eventhandler_tag shutdown_eh;
|
|
|
|
|
|
|
|
|
|
/* To track topo events during reset */
|
|
|
|
|
#define MPS_DIAG_RESET_TIMEOUT 300000
|
|
|
|
|
uint8_t wait_for_port_enable;
|
|
|
|
|
uint8_t port_enable_complete;
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
uint8_t msleep_fake_chan;
|
2012-01-26 18:17:21 +00:00
|
|
|
|
|
|
|
|
/* WD controller */
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
uint8_t WD_available;
|
2012-01-26 18:17:21 +00:00
|
|
|
uint8_t WD_valid_config;
|
|
|
|
|
uint8_t WD_hide_expose;
|
|
|
|
|
|
|
|
|
|
/* Direct Drive for WarpDrive */
|
|
|
|
|
uint8_t DD_num_phys_disks;
|
|
|
|
|
uint16_t DD_dev_handle;
|
|
|
|
|
uint32_t DD_stripe_size;
|
|
|
|
|
uint32_t DD_stripe_exponent;
|
|
|
|
|
uint32_t DD_block_size;
|
|
|
|
|
uint16_t DD_block_exponent;
|
|
|
|
|
uint64_t DD_max_lba;
|
|
|
|
|
struct mps_column_map DD_column_map[MPS_MAX_DISKS_IN_VOL];
|
2013-08-09 01:09:02 +00:00
|
|
|
|
2014-07-30 17:58:17 +00:00
|
|
|
/* StartStopUnit command handling at shutdown */
|
|
|
|
|
uint32_t SSU_refcount;
|
|
|
|
|
uint8_t SSU_started;
|
2017-09-11 01:51:27 +00:00
|
|
|
|
|
|
|
|
/* Configuration tunables */
|
|
|
|
|
u_int disable_msix;
|
|
|
|
|
u_int disable_msi;
|
|
|
|
|
u_int max_msix;
|
|
|
|
|
u_int max_reqframes;
|
|
|
|
|
u_int max_prireqframes;
|
|
|
|
|
u_int max_replyframes;
|
|
|
|
|
u_int max_evtframes;
|
|
|
|
|
char exclude_ids[80];
|
|
|
|
|
|
|
|
|
|
struct timeval lastfail;
|
2010-09-10 15:03:56 +00:00
|
|
|
};
|
|
|
|
|
|
|
|
|
|
struct mps_config_params {
|
|
|
|
|
MPI2_CONFIG_EXT_PAGE_HEADER_UNION hdr;
|
|
|
|
|
u_int action;
|
|
|
|
|
u_int page_address; /* Attributes, not a phys address */
|
|
|
|
|
u_int status;
|
|
|
|
|
void *buffer;
|
|
|
|
|
u_int length;
|
|
|
|
|
int timeout;
|
|
|
|
|
void (*callback)(struct mps_softc *, struct mps_config_params *);
|
|
|
|
|
void *cbdata;
|
|
|
|
|
};
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
struct scsi_read_capacity_eedp
|
|
|
|
|
{
|
|
|
|
|
uint8_t addr[8];
|
|
|
|
|
uint8_t length[4];
|
|
|
|
|
uint8_t protect;
|
|
|
|
|
};
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
static __inline uint32_t
|
|
|
|
|
mps_regread(struct mps_softc *sc, uint32_t offset)
|
|
|
|
|
{
|
|
|
|
|
return (bus_space_read_4(sc->mps_btag, sc->mps_bhandle, offset));
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_regwrite(struct mps_softc *sc, uint32_t offset, uint32_t val)
|
|
|
|
|
{
|
|
|
|
|
bus_space_write_4(sc->mps_btag, sc->mps_bhandle, offset, val);
|
|
|
|
|
}
|
|
|
|
|
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
/* free_queue must have Little Endian address
|
|
|
|
|
* TODO- cm_reply_data is unwanted. We can remove it.
|
|
|
|
|
* */
|
2010-09-10 15:03:56 +00:00
|
|
|
static __inline void
|
|
|
|
|
mps_free_reply(struct mps_softc *sc, uint32_t busaddr)
|
|
|
|
|
{
|
|
|
|
|
if (++sc->replyfreeindex >= sc->fqdepth)
|
|
|
|
|
sc->replyfreeindex = 0;
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
sc->free_queue[sc->replyfreeindex] = htole32(busaddr);
|
2010-09-10 15:03:56 +00:00
|
|
|
mps_regwrite(sc, MPI2_REPLY_FREE_HOST_INDEX_OFFSET, sc->replyfreeindex);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline struct mps_chain *
|
|
|
|
|
mps_alloc_chain(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
struct mps_chain *chain;
|
|
|
|
|
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
if ((chain = TAILQ_FIRST(&sc->chain_list)) != NULL) {
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_REMOVE(&sc->chain_list, chain, chain_link);
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
sc->chain_free--;
|
|
|
|
|
if (sc->chain_free < sc->chain_free_lowwater)
|
|
|
|
|
sc->chain_free_lowwater = sc->chain_free;
|
2015-10-16 17:56:43 +00:00
|
|
|
} else
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
sc->chain_alloc_fail++;
|
2010-09-10 15:03:56 +00:00
|
|
|
return (chain);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_free_chain(struct mps_softc *sc, struct mps_chain *chain)
|
|
|
|
|
{
|
Fix several issues with the mps(4) driver.
When the driver ran out of DMA chaining buffers, it kept the timeout for
the I/O, and I/O would stall.
The driver was not freezing the device queue on errors.
mps.c: Pull command completion logic into a separate
function, and call the callback/wakeup for commands
that are never sent due to lack of chain buffers.
Add a number of extra diagnostic sysctl variables.
Handle pre-hardware errors for configuration I/O.
This doesn't panic the system, but it will fail the
configuration I/O and there is no retry mechanism.
So the device probe will not succeed. This should
be a very uncommon situation, however.
mps_sas.c: Freeze the SIM queue when we run out of chain
buffers, and unfreeze it when more commands
complete.
Freeze the device queue when errors occur, so that
CAM can insure proper command ordering.
Report pre-hardware errors for task management
commands. In general, that shouldn't be possible
because task management commands don't have S/G
lists, and that is currently the only error path
before we get to the hardware.
Handle pre-hardware errors (like out of chain
elements) for SMP requests. That shouldn't happen
either, since we should have enough space for two
S/G elements in the standard request.
For commands that end with
MPI2_IOCSTATUS_SCSI_IOC_TERMINATED and
MPI2_IOCSTATUS_SCSI_EXT_TERMINATED, return them
with CAM_REQUEUE_REQ to retry them unconditionally.
These seem to be related to back end, transport
related problems that are hopefully transient. We
don't want to go through the retry count for
something that is not a permanent error.
Keep track of the number of outstanding I/Os.
mpsvar.h: Track the number of free chain elements.
Add variables for the number of outstanding I/Os,
and I/O high water mark.
Add variables to track the number of free chain
buffers and the chain low water mark, as well as
the number of chain allocation failures.
Add I/O state flags and an attach done flag.
MFC after: 3 days
2011-02-18 17:06:06 +00:00
|
|
|
sc->chain_free++;
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_INSERT_TAIL(&sc->chain_list, chain, chain_link);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_free_command(struct mps_softc *sc, struct mps_command *cm)
|
|
|
|
|
{
|
|
|
|
|
struct mps_chain *chain, *chain_temp;
|
|
|
|
|
|
2018-02-18 16:41:34 +00:00
|
|
|
KASSERT(cm->cm_state == MPS_CM_STATE_BUSY, ("state not busy\n"));
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
if (cm->cm_reply != NULL)
|
2010-09-10 15:03:56 +00:00
|
|
|
mps_free_reply(sc, cm->cm_reply_data);
|
2012-01-26 18:17:21 +00:00
|
|
|
cm->cm_reply = NULL;
|
2010-09-10 15:03:56 +00:00
|
|
|
cm->cm_flags = 0;
|
|
|
|
|
cm->cm_complete = NULL;
|
|
|
|
|
cm->cm_complete_data = NULL;
|
2012-01-26 18:17:21 +00:00
|
|
|
cm->cm_ccb = NULL;
|
|
|
|
|
cm->cm_targ = NULL;
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
cm->cm_max_segs = 0;
|
2012-01-26 18:17:21 +00:00
|
|
|
cm->cm_lun = 0;
|
2010-09-10 15:03:56 +00:00
|
|
|
cm->cm_state = MPS_CM_STATE_FREE;
|
2012-02-09 00:16:12 +00:00
|
|
|
cm->cm_data = NULL;
|
|
|
|
|
cm->cm_length = 0;
|
|
|
|
|
cm->cm_out_len = 0;
|
|
|
|
|
cm->cm_sglsize = 0;
|
|
|
|
|
cm->cm_sge = NULL;
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_FOREACH_SAFE(chain, &cm->cm_chain_list, chain_link, chain_temp) {
|
|
|
|
|
TAILQ_REMOVE(&cm->cm_chain_list, chain, chain_link);
|
|
|
|
|
mps_free_chain(sc, chain);
|
|
|
|
|
}
|
|
|
|
|
TAILQ_INSERT_TAIL(&sc->req_list, cm, cm_link);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline struct mps_command *
|
|
|
|
|
mps_alloc_command(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
struct mps_command *cm;
|
|
|
|
|
|
|
|
|
|
cm = TAILQ_FIRST(&sc->req_list);
|
|
|
|
|
if (cm == NULL)
|
|
|
|
|
return (NULL);
|
|
|
|
|
|
2018-02-18 16:41:34 +00:00
|
|
|
KASSERT(cm->cm_state == MPS_CM_STATE_FREE,
|
|
|
|
|
("mps: Allocating busy command\n"));
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
TAILQ_REMOVE(&sc->req_list, cm, cm_link);
|
|
|
|
|
cm->cm_state = MPS_CM_STATE_BUSY;
|
2018-12-21 20:30:52 +00:00
|
|
|
cm->cm_timeout_handler = NULL;
|
2010-09-10 15:03:56 +00:00
|
|
|
return (cm);
|
|
|
|
|
}
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
static __inline void
|
|
|
|
|
mps_free_high_priority_command(struct mps_softc *sc, struct mps_command *cm)
|
|
|
|
|
{
|
|
|
|
|
struct mps_chain *chain, *chain_temp;
|
|
|
|
|
|
2018-02-18 16:41:34 +00:00
|
|
|
KASSERT(cm->cm_state == MPS_CM_STATE_BUSY, ("state not busy\n"));
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
if (cm->cm_reply != NULL)
|
|
|
|
|
mps_free_reply(sc, cm->cm_reply_data);
|
|
|
|
|
cm->cm_reply = NULL;
|
|
|
|
|
cm->cm_flags = 0;
|
|
|
|
|
cm->cm_complete = NULL;
|
|
|
|
|
cm->cm_complete_data = NULL;
|
|
|
|
|
cm->cm_ccb = NULL;
|
|
|
|
|
cm->cm_targ = NULL;
|
|
|
|
|
cm->cm_lun = 0;
|
|
|
|
|
cm->cm_state = MPS_CM_STATE_FREE;
|
|
|
|
|
TAILQ_FOREACH_SAFE(chain, &cm->cm_chain_list, chain_link, chain_temp) {
|
|
|
|
|
TAILQ_REMOVE(&cm->cm_chain_list, chain, chain_link);
|
|
|
|
|
mps_free_chain(sc, chain);
|
|
|
|
|
}
|
|
|
|
|
TAILQ_INSERT_TAIL(&sc->high_priority_req_list, cm, cm_link);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline struct mps_command *
|
|
|
|
|
mps_alloc_high_priority_command(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
struct mps_command *cm;
|
|
|
|
|
|
|
|
|
|
cm = TAILQ_FIRST(&sc->high_priority_req_list);
|
|
|
|
|
if (cm == NULL)
|
|
|
|
|
return (NULL);
|
|
|
|
|
|
2018-02-18 16:41:34 +00:00
|
|
|
KASSERT(cm->cm_state == MPS_CM_STATE_FREE,
|
|
|
|
|
("mps: Allocating busy command\n"));
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
TAILQ_REMOVE(&sc->high_priority_req_list, cm, cm_link);
|
|
|
|
|
cm->cm_state = MPS_CM_STATE_BUSY;
|
2018-12-21 20:30:52 +00:00
|
|
|
cm->cm_timeout_handler = NULL;
|
2018-12-24 05:05:38 +00:00
|
|
|
cm->cm_desc.HighPriority.RequestFlags =
|
|
|
|
|
MPI2_REQ_DESCRIPT_FLAGS_HIGH_PRIORITY;
|
2012-01-26 18:17:21 +00:00
|
|
|
return (cm);
|
|
|
|
|
}
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
static __inline void
|
|
|
|
|
mps_lock(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
mtx_lock(&sc->mps_mtx);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_unlock(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
mtx_unlock(&sc->mps_mtx);
|
|
|
|
|
}
|
|
|
|
|
|
2013-07-19 00:12:41 +00:00
|
|
|
#define MPS_INFO (1 << 0) /* Basic info */
|
|
|
|
|
#define MPS_FAULT (1 << 1) /* Hardware faults */
|
|
|
|
|
#define MPS_EVENT (1 << 2) /* Event data from the controller */
|
|
|
|
|
#define MPS_LOG (1 << 3) /* Log data from the controller */
|
|
|
|
|
#define MPS_RECOVERY (1 << 4) /* Command error recovery tracing */
|
|
|
|
|
#define MPS_ERROR (1 << 5) /* Parameter errors, programming bugs */
|
|
|
|
|
#define MPS_INIT (1 << 6) /* Things related to system init */
|
|
|
|
|
#define MPS_XINFO (1 << 7) /* More detailed/noisy info */
|
|
|
|
|
#define MPS_USER (1 << 8) /* Trace user-generated commands */
|
|
|
|
|
#define MPS_MAPPING (1 << 9) /* Trace device mappings */
|
|
|
|
|
#define MPS_TRACE (1 << 10) /* Function-by-function trace */
|
2010-09-10 15:03:56 +00:00
|
|
|
|
2015-02-24 22:07:42 +00:00
|
|
|
#define MPS_SSU_DISABLE_SSD_DISABLE_HDD 0
|
|
|
|
|
#define MPS_SSU_ENABLE_SSD_DISABLE_HDD 1
|
|
|
|
|
#define MPS_SSU_DISABLE_SSD_ENABLE_HDD 2
|
|
|
|
|
#define MPS_SSU_ENABLE_SSD_ENABLE_HDD 3
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
#define mps_printf(sc, args...) \
|
|
|
|
|
device_printf((sc)->mps_dev, ##args)
|
|
|
|
|
|
2017-01-19 21:47:50 +00:00
|
|
|
#define mps_print_field(sc, msg, args...) \
|
|
|
|
|
printf("\t" msg, ##args)
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
#define mps_vprintf(sc, args...) \
|
|
|
|
|
do { \
|
|
|
|
|
if (bootverbose) \
|
|
|
|
|
mps_printf(sc, ##args); \
|
|
|
|
|
} while (0)
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
#define mps_dprint(sc, level, msg, args...) \
|
|
|
|
|
do { \
|
2013-07-19 00:12:41 +00:00
|
|
|
if ((sc)->mps_debug & (level)) \
|
|
|
|
|
device_printf((sc)->mps_dev, msg, ##args); \
|
2010-09-10 15:03:56 +00:00
|
|
|
} while (0)
|
|
|
|
|
|
|
|
|
|
#define MPS_PRINTFIELD_START(sc, tag...) \
|
2017-01-19 21:47:50 +00:00
|
|
|
mps_printf((sc), ##tag); \
|
|
|
|
|
mps_print_field((sc), ":\n")
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_PRINTFIELD_END(sc, tag) \
|
2017-01-19 21:47:50 +00:00
|
|
|
mps_printf((sc), tag "\n")
|
2010-09-10 15:03:56 +00:00
|
|
|
#define MPS_PRINTFIELD(sc, facts, attr, fmt) \
|
2017-01-19 21:47:50 +00:00
|
|
|
mps_print_field((sc), #attr ": " #fmt "\n", (facts)->attr)
|
2010-09-10 15:03:56 +00:00
|
|
|
|
2013-07-19 00:12:41 +00:00
|
|
|
#define MPS_FUNCTRACE(sc) \
|
|
|
|
|
mps_dprint((sc), MPS_TRACE, "%s\n", __func__)
|
|
|
|
|
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
#define CAN_SLEEP 1
|
|
|
|
|
#define NO_SLEEP 0
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
static __inline void
|
|
|
|
|
mps_from_u64(uint64_t data, U64 *mps)
|
|
|
|
|
{
|
2012-08-01 17:31:31 +00:00
|
|
|
(mps)->High = htole32((uint32_t)((data) >> 32));
|
|
|
|
|
(mps)->Low = htole32((uint32_t)((data) & 0xffffffff));
|
2010-09-10 15:03:56 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline uint64_t
|
|
|
|
|
mps_to_u64(U64 *data)
|
|
|
|
|
{
|
|
|
|
|
|
2012-08-01 17:31:31 +00:00
|
|
|
return (((uint64_t)le32toh(data->High) << 32) | le32toh(data->Low));
|
2010-09-10 15:03:56 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_mask_intr(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
uint32_t mask;
|
|
|
|
|
|
|
|
|
|
mask = mps_regread(sc, MPI2_HOST_INTERRUPT_MASK_OFFSET);
|
|
|
|
|
mask |= MPI2_HIM_REPLY_INT_MASK;
|
|
|
|
|
mps_regwrite(sc, MPI2_HOST_INTERRUPT_MASK_OFFSET, mask);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __inline void
|
|
|
|
|
mps_unmask_intr(struct mps_softc *sc)
|
|
|
|
|
{
|
|
|
|
|
uint32_t mask;
|
|
|
|
|
|
|
|
|
|
mask = mps_regread(sc, MPI2_HOST_INTERRUPT_MASK_OFFSET);
|
|
|
|
|
mask &= ~MPI2_HIM_REPLY_INT_MASK;
|
|
|
|
|
mps_regwrite(sc, MPI2_HOST_INTERRUPT_MASK_OFFSET, mask);
|
|
|
|
|
}
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
int mps_pci_setup_interrupts(struct mps_softc *sc);
|
2017-09-09 18:03:40 +00:00
|
|
|
void mps_pci_free_interrupts(struct mps_softc *sc);
|
2012-01-26 18:17:21 +00:00
|
|
|
int mps_pci_restore(struct mps_softc *sc);
|
|
|
|
|
|
2017-07-30 06:53:58 +00:00
|
|
|
void mps_get_tunables(struct mps_softc *sc);
|
2010-09-10 15:03:56 +00:00
|
|
|
int mps_attach(struct mps_softc *sc);
|
|
|
|
|
int mps_free(struct mps_softc *sc);
|
|
|
|
|
void mps_intr(void *);
|
|
|
|
|
void mps_intr_msi(void *);
|
|
|
|
|
void mps_intr_locked(void *);
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
int mps_register_events(struct mps_softc *, u32 *, mps_evt_callback_t *,
|
2010-09-10 15:03:56 +00:00
|
|
|
void *, struct mps_event_handle **);
|
2012-01-26 18:17:21 +00:00
|
|
|
int mps_restart(struct mps_softc *);
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
int mps_update_events(struct mps_softc *, struct mps_event_handle *, u32 *);
|
|
|
|
|
void mps_deregister_events(struct mps_softc *, struct mps_event_handle *);
|
2010-10-14 16:44:05 +00:00
|
|
|
int mps_push_sge(struct mps_command *, void *, size_t, int);
|
|
|
|
|
int mps_add_dmaseg(struct mps_command *, vm_paddr_t, size_t, u_int, int);
|
2010-09-10 15:03:56 +00:00
|
|
|
int mps_attach_sas(struct mps_softc *sc);
|
|
|
|
|
int mps_detach_sas(struct mps_softc *sc);
|
|
|
|
|
int mps_read_config_page(struct mps_softc *, struct mps_config_params *);
|
|
|
|
|
int mps_write_config_page(struct mps_softc *, struct mps_config_params *);
|
|
|
|
|
void mps_memaddr_cb(void *, bus_dma_segment_t *, int , int );
|
Diagnostic buffer fixes for the mps(4) and mpr(4) drivers.
In mp{r,s}_diag_register(), which is used to register diagnostic
buffers with the mp{r,s}(4) firmware, we allocate DMAable memory.
There were several issues here:
o No checking of the bus_dmamap_load() return value. If the load
failed or got deferred, mp{r,s}_diag_register() continued on as if
nothing had happened. We now check the return value and bail
out if it fails.
o No waiting for a deferred load callback. bus_dmamap_load()
calls a supplied callback when the mapping is done. This is
generally done immediately, but it can be deferred.
mp{r,s}_diag_register() did not check to see whether the callback
was already done before proceeding on. We now sleep until the
callback is done if it is deferred.
o No call to bus_dmamap_sync(... BUS_DMASYNC_PREREAD) after the
memory is allocated and loaded. This is necessary on some
platforms to synchronize host memory that is going to be updated
by a device.
Both drivers would also panic if the firmware was reinitialized while
a diagnostic buffer operation was in progress. This fixes that problem
as well. (The driver will reinitialize the firmware in various
circumstances, but the problem I ran into was that the firmware would
generate an IOC Fault due to a PCIe error.)
mp{r,s}var.h:
Add a new structure, struct mpr_busdma_context, that is
used for deferred busdma load callbacks.
Add a prototype for mp{r,s}_memaddr_wait_cb().
mp{r,s}.c:
Add a new busdma callback function, mp{r,s}_memaddr_wait_cb().
This provides synchronization for callers that want to
wait on a deferred bus_dmamap_load() callback.
mp{r,s}_user.c:
In bus_dmamap_register(), add a call to bus_dmamap_sync()
with the BUS_DMASYNC_PREREAD flag set after an allocation
is loaded.
Also, check the return value of bus_dmamap_load(). If it
fails, bail out. If it is EINPROGRESS, wait for the
callback to happen. We use an interruptible sleep (msleep
with PCATCH) and let the callback clean things up if we get
interrupted.
In mpr_diag_read_buffer() and mps_diag_read_buffer(), call
bus_dmamap_sync(..., BUS_DMASYNC_POSTREAD) before copying
the data out to make sure the data is in stable storage.
In mp{r,s}_post_fw_diag_buffer() and
mp{r,s}_release_fw_diag_buffer(), check the reply to see
whether it is NULL. It can be NULL (and the command non-NULL)
if the controller gets reinitialized while we're waiting for
the command to complete but the driver structures aren't
reallocated. The driver structures generally won't be
reallocated unless there is a firmware upgrade that changes
one of the IOCFacts.
When freeing diagnostic buffers in mp{r,s}_diag_register()
and mp{r,s}_diag_unregister(), zero/NULL out the buffer after
freeing it. This will prevent a duplicate free in some
situations.
Sponsored by: Spectra Logic
Reviewed by: mav, scottl
MFC after: 1 week
Differential Revision: D13453
2018-02-06 15:58:22 +00:00
|
|
|
void mps_memaddr_wait_cb(void *, bus_dma_segment_t *, int , int );
|
Add Serial Management Protocol (SMP) passthrough support to CAM.
This includes support in the kernel, camcontrol(8), libcam and the mps(4)
driver for SMP passthrough.
The CAM SCSI probe code has been modified to fetch Inquiry VPD page 0x00
to determine supported pages, and will now fetch page 0x83 in addition to
page 0x80 if supported.
Add two new CAM CCBs, XPT_SMP_IO, and XPT_GDEV_ADVINFO. The SMP CCB is
intended for SMP requests and responses. The ADVINFO is currently used to
fetch cached VPD page 0x83 data from the transport layer, but is intended
to be extensible to fetch other types of device-specific data.
SMP-only devices are not currently represented in the CAM topology, and so
the current semantics are that the SIM will route SMP CCBs to either the
addressed device, if it contains an SMP target, or its parent, if it
contains an SMP target. (This is noted in cam_ccb.h, since it will change
later once we have the ability to have SMP-only devices in CAM's topology.)
smp_all.c,
smp_all.h: New helper routines for SMP. This includes
SMP request building routines, response parsing
routines, error decoding routines, and structure
definitions for a number of SMP commands.
libcam/Makefile: Add smp_all.c to libcam, so that SMP functionality
is available to userland applications.
camcontrol.8,
camcontrol.c: Add smp passthrough support to camcontrol. Several
new subcommands are now available:
'smpcmd' functions much like 'cmd', except that it
allows the user to send generic SMP commands.
'smprg' sends the SMP report general command, and
displays the decoded output. It will automatically
fetch extended output if it is available.
'smppc' sends the SMP phy control command, with any
number of potential options. Among other things,
this allows the user to reset a phy on a SAS
expander, or disable a phy on an expander.
'smpmaninfo' sends the SMP report manufacturer
information and displays the decoded output.
'smpphylist' displays a list of phys on an
expander, and the CAM devices attached to those
phys, if any.
cam.h,
cam.c: Add a status value for SMP errors
(CAM_SMP_STATUS_ERROR).
Add a missing description for CAM_SCSI_IT_NEXUS_LOST.
Add support for SMP commands to cam_error_string().
cam_ccb.h: Rename the CAM_DIR_RESV flag to CAM_DIR_BOTH. SMP
commands are by nature bi-directional, and we may
need to support bi-directional SCSI commands later.
Add the XPT_SMP_IO CCB. Since SMP commands are
bi-directional, there are pointers for both the
request and response.
Add a fill routine for SMP CCBs.
Add the XPT_GDEV_ADVINFO CCB. This is currently
used to fetch cached page 0x83 data from the
transport later, but is extensible to fetch many
other types of data.
cam_periph.c: Add support in cam_periph_mapmem() for XPT_SMP_IO
and XPT_GDEV_ADVINFO CCBs.
cam_xpt.c: Add support for executing XPT_SMP_IO CCBs.
cam_xpt_internal.h: Add fields for VPD pages 0x00 and 0x83 in struct
cam_ed.
scsi_all.c: Add scsi_get_sas_addr(), a function that parses
VPD page 0x83 data and pulls out a SAS address.
scsi_all.h: Add VPD page 0x00 and 0x83 structures, and a
prototype for scsi_get_sas_addr().
scsi_pass.c: Add support for mapping buffers in XPT_SMP_IO and
XPT_GDEV_ADVINFO CCBs.
scsi_xpt.c: In the SCSI probe code, first ask the device for
VPD page 0x00. If any VPD pages are supported,
that page is required to be implemented. Based on
the response, we may probe for the serial number
(page 0x80) or device id (page 0x83).
Add support for the XPT_GDEV_ADVINFO CCB.
sys/conf/files: Add smp_all.c.
mps.c: Add support for passing in a uio in mps_map_command(),
so we can map a S/G list at once.
Add support for SMP passthrough commands in
mps_data_cb(). SMP is a special case, because the
first buffer in the S/G list is outbound and the
second buffer is inbound.
Add support for warning the user if the busdma code
comes back with more buffers than will work for the
command. This will, for example, help the user
determine why an SMP command failed if busdma comes
back with three buffers.
mps_pci.c: Add sys/uio.h.
mps_sas.c: Add the SAS address and the parent handle to the
list of fields we pull from device page 0 and cache
in struct mpssas_target. These are needed for SMP
passthrough.
Add support for the XPT_SMP_IO CCB. For now, this
CCB is routed to the addressed device if it supports
SMP, or to its parent if it does not and the parent
does. This is necessary because CAM does not
currently support SMP-only nodes in the topology.
Make SMP passthrough support conditional on
__FreeBSD_version >= 900026. This will make it
easier to MFC this change to the driver without
MFCing the CAM changes as well.
mps_user.c: Un-staticize mpi_init_sge() so we can use it for
the SMP passthrough code.
mpsvar.h: Add a uio and iovecs into struct mps_command for
SMP passthrough commands.
Add a cm_max_segs field to struct mps_command so
that we can warn the user if busdma comes back with
too many segments.
Clear the cm_reply when a command gets freed. If
it is not cleared, reply frames will eventually get
freed into the pool multiple times and corrupt the
pool. (This fix is from scottl.)
Add a prototype for mpi_init_sge().
sys/param.h: Bump __FreeBSD_version to 900026 for the for the
inclusion of the XPT_GDEV_ADVINFO and XPT_SMP_IO
CAM CCBs.
2010-11-30 22:39:46 +00:00
|
|
|
void mpi_init_sge(struct mps_command *cm, void *req, void *sge);
|
2010-09-10 15:03:56 +00:00
|
|
|
int mps_attach_user(struct mps_softc *);
|
|
|
|
|
void mps_detach_user(struct mps_softc *);
|
2012-01-26 18:17:21 +00:00
|
|
|
void mpssas_record_event(struct mps_softc *sc,
|
|
|
|
|
MPI2_EVENT_NOTIFICATION_REPLY *event_reply);
|
|
|
|
|
|
|
|
|
|
int mps_map_command(struct mps_softc *sc, struct mps_command *cm);
|
2017-08-10 14:59:17 +00:00
|
|
|
int mps_wait_command(struct mps_softc *sc, struct mps_command **cm, int timeout,
|
Merge in phase 14+ -> 16 mps driver fixes from LSI:
---------------------------------------------------------------
System panics during a Port reset with ouststanding I/O
---------------------------------------------------------------
It is possible to call mps_mapping_free_memory after this
memory is already freed, causing a panic. Removed this extra
call to mps_mappiing_free_memory and call mps_mapping_exit
in place of the mps_mapping_free_memory call so that any
outstanding mapping items can be flushed before memory is
freed.
---------------------------------------------------------------
Correct memory leak during a Port reset with ouststanding I/O
---------------------------------------------------------------
In mps_reinit function, the mapping memory was not being
freed before being re-allocated. Added line to call the
memory free function for mapping memory.
---------------------------------------------------------------
Use CAM_SIM_QUEUED flag in Driver IO path.
---------------------------------------------------------------
This flag informs the XPT that successful abort of a CCB
requires an abort ccb to be issued to the SIM. While
processing SCSI IO's, set the CAM_SIM_QUEUED flag in the
status for the IO. When the command completes, clear this
flag.
---------------------------------------------------------------
Check for CAM_REQ_INPROG in I/O path.
---------------------------------------------------------------
Added a check in mpssas_action_scsiio for the In Progress
status for the IO. If this flag is set, the IO has already
been aborted by the upper layer (before CAM_SIM_QUEUED was
set) and there is no need to send the IO. The request will
be completed without error.
---------------------------------------------------------------
Improve "doorbell handshake method" for mps_get_iocfacts
---------------------------------------------------------------
Removed call to get Port Facts since this information is
not used currently.
Added mps_iocfacts_allocate function to allocate memory
that is based on IOC Facts data. Added mps_iocfacts_free
function to free memory that is based on IOC Facts data.
Both of the functions are used when a Diag Reset is performed
or when the driver is attached/detached. This is needed in
case IOC Facts changes after a Diag Reset, which could
happen if FW is upgraded.
Moved call of mps_bases_static_config_pages from the attach
routine to after the IOC is ready to process accesses based
on the new memory allocations (instead of polling through
the Doorbell).
---------------------------------------------------------------
Set TimeStamp in INIT message in millisecond format Set the IOC
---------------------------------------------------------------
---------------------------------------------------------------
Prefer mps_wait_command to mps_request_polled
---------------------------------------------------------------
Instead of using mps_request_polled, call mps_wait_command
whenever possible. Change the mps_wait_command function to
check the current context and either use interrupt context
or poll if required by using the pause or DELAY function.
Added a check after waiting 50mSecs to see if the command
has timed out. This is only done if polliing, the msleep
command will automatically timeout if the command has taken
too long to complete.
---------------------------------------------------------------
Integrated RAID: Volume Activation Failed error message is
displayed though the volume has been activated.
---------------------------------------------------------------
Instead of failing an IOCTL request that does not have a
large enough buffer to hold the complete reply, copy as
much data from the reply as possible into the user's buffer
and log a message saying that the user's buffer was smaller
than the returned data.
---------------------------------------------------------------
mapping_add_new_device failure due to persistent table FULL
---------------------------------------------------------------
When a new device is added, if it is determined that the
device persistent table is being used and is full, instead
of displaying a message for this condition every time, only
log a message if the MPS_INFO bit is set in the debug_flags.
Submitted by: LSI
MFC after: 1 week
2013-07-22 18:41:53 +00:00
|
|
|
int sleep_flag);
|
2012-01-26 18:17:21 +00:00
|
|
|
|
|
|
|
|
int mps_config_get_bios_pg3(struct mps_softc *sc, Mpi2ConfigReply_t
|
|
|
|
|
*mpi_reply, Mpi2BiosPage3_t *config_page);
|
|
|
|
|
int mps_config_get_raid_volume_pg0(struct mps_softc *sc, Mpi2ConfigReply_t
|
|
|
|
|
*mpi_reply, Mpi2RaidVolPage0_t *config_page, u32 page_address);
|
|
|
|
|
int mps_config_get_ioc_pg8(struct mps_softc *sc, Mpi2ConfigReply_t *,
|
|
|
|
|
Mpi2IOCPage8_t *);
|
|
|
|
|
int mps_config_get_man_pg10(struct mps_softc *sc, Mpi2ConfigReply_t *mpi_reply);
|
|
|
|
|
int mps_config_get_sas_device_pg0(struct mps_softc *, Mpi2ConfigReply_t *,
|
|
|
|
|
Mpi2SasDevicePage0_t *, u32 , u16 );
|
|
|
|
|
int mps_config_get_dpm_pg0(struct mps_softc *, Mpi2ConfigReply_t *,
|
|
|
|
|
Mpi2DriverMappingPage0_t *, u16 );
|
|
|
|
|
int mps_config_get_raid_volume_pg1(struct mps_softc *sc,
|
|
|
|
|
Mpi2ConfigReply_t *mpi_reply, Mpi2RaidVolPage1_t *config_page, u32 form,
|
|
|
|
|
u16 handle);
|
|
|
|
|
int mps_config_get_volume_wwid(struct mps_softc *sc, u16 volume_handle,
|
|
|
|
|
u64 *wwid);
|
|
|
|
|
int mps_config_get_raid_pd_pg0(struct mps_softc *sc,
|
|
|
|
|
Mpi2ConfigReply_t *mpi_reply, Mpi2RaidPhysDiskPage0_t *config_page,
|
|
|
|
|
u32 page_address);
|
2018-03-14 21:32:23 +00:00
|
|
|
void mpssas_ir_shutdown(struct mps_softc *sc, int howto);
|
2012-01-26 18:17:21 +00:00
|
|
|
|
|
|
|
|
int mps_reinit(struct mps_softc *sc);
|
|
|
|
|
void mpssas_handle_reinit(struct mps_softc *sc);
|
|
|
|
|
|
|
|
|
|
void mps_base_static_config_pages(struct mps_softc *sc);
|
|
|
|
|
void mps_wd_config_pages(struct mps_softc *sc);
|
|
|
|
|
|
|
|
|
|
int mps_mapping_initialize(struct mps_softc *);
|
|
|
|
|
void mps_mapping_topology_change_event(struct mps_softc *,
|
|
|
|
|
Mpi2EventDataSasTopologyChangeList_t *);
|
|
|
|
|
void mps_mapping_free_memory(struct mps_softc *sc);
|
|
|
|
|
int mps_config_set_dpm_pg0(struct mps_softc *, Mpi2ConfigReply_t *,
|
|
|
|
|
Mpi2DriverMappingPage0_t *, u16 );
|
|
|
|
|
void mps_mapping_exit(struct mps_softc *);
|
2017-05-25 19:14:44 +00:00
|
|
|
void mps_mapping_check_devices(void *);
|
2012-01-26 18:17:21 +00:00
|
|
|
int mps_mapping_allocate_memory(struct mps_softc *sc);
|
2017-05-25 19:14:44 +00:00
|
|
|
unsigned int mps_mapping_get_tid(struct mps_softc *, uint64_t , u16);
|
|
|
|
|
unsigned int mps_mapping_get_tid_from_handle(struct mps_softc *sc,
|
2012-01-26 18:17:21 +00:00
|
|
|
u16 handle);
|
2017-05-25 19:14:44 +00:00
|
|
|
unsigned int mps_mapping_get_raid_tid(struct mps_softc *sc, u64 wwid,
|
|
|
|
|
u16 volHandle);
|
|
|
|
|
unsigned int mps_mapping_get_raid_tid_from_handle(struct mps_softc *sc,
|
2012-01-26 18:17:21 +00:00
|
|
|
u16 volHandle);
|
|
|
|
|
void mps_mapping_enclosure_dev_status_change_event(struct mps_softc *,
|
|
|
|
|
Mpi2EventDataSasEnclDevStatusChange_t *event_data);
|
|
|
|
|
void mps_mapping_ir_config_change_event(struct mps_softc *sc,
|
|
|
|
|
Mpi2EventDataIrConfigChangeList_t *event_data);
|
2016-02-04 23:38:55 +00:00
|
|
|
int mps_mapping_dump(SYSCTL_HANDLER_ARGS);
|
|
|
|
|
int mps_mapping_encl_dump(SYSCTL_HANDLER_ARGS);
|
2012-01-26 18:17:21 +00:00
|
|
|
|
|
|
|
|
void mpssas_evt_handler(struct mps_softc *sc, uintptr_t data,
|
|
|
|
|
MPI2_EVENT_NOTIFICATION_REPLY *event);
|
|
|
|
|
void mpssas_prepare_remove(struct mpssas_softc *sassc, uint16_t handle);
|
2012-02-09 00:16:12 +00:00
|
|
|
void mpssas_prepare_volume_remove(struct mpssas_softc *sassc, uint16_t handle);
|
2012-01-26 18:17:21 +00:00
|
|
|
int mpssas_startup(struct mps_softc *sc);
|
2012-02-09 00:16:12 +00:00
|
|
|
struct mpssas_target * mpssas_find_target_by_handle(struct mpssas_softc *, int, uint16_t);
|
2014-07-01 04:33:36 +00:00
|
|
|
void mpssas_realloc_targets(struct mps_softc *sc, int maxtargets);
|
|
|
|
|
struct mps_command * mpssas_alloc_tm(struct mps_softc *sc);
|
|
|
|
|
void mpssas_free_tm(struct mps_softc *sc, struct mps_command *tm);
|
2014-07-30 17:58:17 +00:00
|
|
|
void mpssas_release_simq_reinit(struct mpssas_softc *sassc);
|
2015-02-24 22:07:42 +00:00
|
|
|
int mpssas_send_reset(struct mps_softc *sc, struct mps_command *tm,
|
|
|
|
|
uint8_t type);
|
2010-09-10 15:03:56 +00:00
|
|
|
|
|
|
|
|
SYSCTL_DECL(_hw_mps);
|
|
|
|
|
|
2012-01-26 18:17:21 +00:00
|
|
|
/* Compatibility shims for different OS versions */
|
|
|
|
|
#if __FreeBSD_version >= 800001
|
|
|
|
|
#define mps_kproc_create(func, farg, proc_ptr, flags, stackpgs, fmtstr, arg) \
|
|
|
|
|
kproc_create(func, farg, proc_ptr, flags, stackpgs, fmtstr, arg)
|
|
|
|
|
#define mps_kproc_exit(arg) kproc_exit(arg)
|
|
|
|
|
#else
|
|
|
|
|
#define mps_kproc_create(func, farg, proc_ptr, flags, stackpgs, fmtstr, arg) \
|
|
|
|
|
kthread_create(func, farg, proc_ptr, flags, stackpgs, fmtstr, arg)
|
|
|
|
|
#define mps_kproc_exit(arg) kthread_exit(arg)
|
|
|
|
|
#endif
|
|
|
|
|
|
|
|
|
|
#if defined(CAM_PRIORITY_XPT)
|
|
|
|
|
#define MPS_PRIORITY_XPT CAM_PRIORITY_XPT
|
|
|
|
|
#else
|
|
|
|
|
#define MPS_PRIORITY_XPT 5
|
|
|
|
|
#endif
|
Bring in LSI's latest mps(4) 6Gb SAS and WarpDrive driver, version
14.00.00.01-fbsd.
Their description of the changes is as follows:
1. Copyright contents has been changed in all respective .c
and .h files
2. Support for WRITE12 and READ12 for direct-io (warpdrive only)
has been added.
3. Driver has added checks to see if Drive has READ_CAP_16
support before sending it down to the device.
If SPC3_SID_PROTECT flag is set in the inquiry data, the
device supports protection information, and must support
the 16 byte read capacity command, otherwise continue without
sending read cap 16. This will optimize driver performance,
since it will not send READ_CAP_16 to the drive which does
not have support of READ_CAP_16.
4. With new approach, "MPTIOCTL_RESET_ADAPTER" IOCTL will not
use DELAY() which is busy loop implementation.
It will use <msleep> (Better way to sleep without busy
loop). Also from the HBA reset code path and some other
places, DELAY() is replaced with msleep() or "pause()",
which is based on sleep/wakeup style calls. Driver use
msleep()/pause() instead of DELAY based on CAN_SLEEP/NO_SLEEP
flags to avoid busy loop which is not required all the
time.e.a
a. While driver is getting loaded, driver calls most of the
commands with NO_SLEEP.
b. When Driver is functional and it needs Reinit of HBA,
CAN_SLEEP flag is used.
5. <mpslsi> driver is not Endian safe. It will not work on Big
Endian machines like Sparc and PowerPC platforms because it
assumes it is running on a Little Endian machine.
Driver code is modified such way that it does not assume CPU
arch is Little Endian.
a. All places where Driver interacts from HBA to Host, it
converts Little Endian format to CPU format.
b. All places where Driver interacts from Host to HBA, it
converts CPU format to Little Endian.
6. Findout memory leaks in FreeBSD Driver and resolve those,
such as memory leak in targ's luns creation/deletion.
Also added additional checks to see memory allocation
success/fail.
7. Add loginfo prints as debug message, i.e. When FW sends any
loginfo, Driver should print those as debug message.
This will help for debugging purpose.
8. There is possibility to get config request timeout. Current
driver is able to detect config request timetout, but it does
not do anything on config_request timeout. Driver should
call mps_reinit() if any request_poll (which is called as
part of config_request) is time out.
9. cdb length check is required for 32 byte CDB. Add correct mpi
control value for 32 bit CDB as below while submitting SCSI IO
Request to controller.
mpi_control |= 4 << MPI2_SCSIIO_CONTROL_ADDCDBLEN_SHIFT;
10. Check the actual status of Message unit reset
(mps_message_unit_reset).Previously FreeBSD Driver just writes
MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET and never check the ack
(it just wait for 50 millisecond). So, Driver now check the
status of "MPI2_FUNCTION_IOC_MESSAGE_UNIT_RESET" after writing
it to the FW.
Now it also checking for whether doorbell ack uses msleep with
proper sleep flags, instead of <DELAY>.
11. Previously CAM does not detect Multi-Lun Devices. In order to
detect Multi-Lun Devices by CAM the driver needs following change
set:
a. There is "max_lun" field which Driver need to set based on
hw/fw support. Currently LSI released driver does not set
this field.
b. Default of "max_lun" should not be 0 in OS, but it is
currently set to 0 in CAM layer.
c. Export max_lun capacity to 255
12. Driver will not reset target info after port enable complete and
also do Device removal when Device remove from FW. The detail
description is as follows
a. When Driver receive WD PD add events, it will add all
information in driver local data structure.
b. Only for WD, we have below checks after port enable
completes, where driver clear off all information retrieved
at #1.
if ((sc->WD_available &&
(sc->WD_hide_expose == MPS_WD_HIDE_ALWAYS)) ||
(sc->WD_valid_config && (sc->WD_hide_expose ==
MPS_WD_HIDE_IF_VOLUME)) {
// clear off target data structure.
}
It is mainly not to attach PDs to OS.
FreeBSD does bus rescan as older Parallel scsi style. So Driver
needs to handle which Drive is visible to OS. That is a reason
we have to clear off targ information for PDs.
Again, above logic was implemented long time ago. Similar concept
we have for non-wd also. For that, LSI have introduced different
logic to hide PDs.
Eventually, because of above gap, when Phy goes offline, we
observe below failure. That is what Driver is not doing complete
removal of device with FW. (which was pointed by Scott)
Apr 5 02:39:24 Freebsd7 kernel: mpslsi0: mpssas_prepare_remove
Apr 5 02:39:24 Freebsd7 kernel: mpssas_prepare_remove 497 : invalid handle 0xe
Now Driver will not reset target info after port enable complete
and also will do Device removal when Device remove from FW.
13. Returning "CAM_SEL_TIMEOUT" instead of "CAM_TID_INVALID"
error code on request to the Target IDs that have no devices
conected at that moment. As if "CAM_TID_INVALID" error code
is returned to the CAM Layaer then it results in a huge chain
of errors in verbose kernel messages on boot and every
hot-plug event.
Submitted by: Sreekanth Reddy <Sreekanth.Reddy@lsi.com>
MFC after: 3 days
2012-06-28 03:48:54 +00:00
|
|
|
|
|
|
|
|
#if __FreeBSD_version < 800107
|
|
|
|
|
// Prior to FreeBSD-8.0 scp3_flags was not defined.
|
|
|
|
|
#define spc3_flags reserved
|
|
|
|
|
|
|
|
|
|
#define SPC3_SID_PROTECT 0x01
|
|
|
|
|
#define SPC3_SID_3PC 0x08
|
|
|
|
|
#define SPC3_SID_TPGS_MASK 0x30
|
|
|
|
|
#define SPC3_SID_TPGS_IMPLICIT 0x10
|
|
|
|
|
#define SPC3_SID_TPGS_EXPLICIT 0x20
|
|
|
|
|
#define SPC3_SID_ACC 0x40
|
|
|
|
|
#define SPC3_SID_SCCS 0x80
|
|
|
|
|
|
|
|
|
|
#define CAM_PRIORITY_NORMAL CAM_PRIORITY_NONE
|
|
|
|
|
#endif
|
|
|
|
|
|
2010-09-10 15:03:56 +00:00
|
|
|
#endif
|
|
|
|
|
|
