d/numam-spdk
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
2fefd9f53c
numam-spdk/CHANGELOG.md

1314 lines
57 KiB
Markdown
Raw Normal View History

changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
# Changelog
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
version: 19.04 pre Change-Id: I8a89febac0af1e2faa98f1e299ce03edef9f8e59 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442572 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2019-01-29 09:22:50 +00:00
## v19.04: (Upcoming Release)
nvme: add the asynchronous controllers probe/poll APIs User can create a probe context to probe and attach controllers asynchronously, the controllers will be added to the context list for the first step, then users can poll the context until the list becomes empty. Change-Id: I3a96e2d8a9724332ff15542f78f9553fdab505e2 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/c/442664 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 02:16:32 +00:00
### nvme
Added asynchronous probe support. New APIs spdk_nvme_probe_ctx_init(), spdk_nvme_probe_async()
and spdk_nvme_probe_poll_async() were added to enable this feature.
bdev/raid: Add strip_size_kb rpc param for create strip_size as an rpc param is now deprecated and can be removed in a future release. Either strip_size or strip_size_kb can be used but only one of them or the rpc will fail. Internally we maintain both fields because strip size always comes in as KB but we convert it to blocks so having both elements makes it clear for developers what they're looking at. JSON output includes both strip_size and strip_size_kb. Fixes #550 Change-Id: I5dc51e8af22eae3d56af8f8d37a564dbaae228fa Signed-off-by: paul luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/c/437873 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-19 18:04:18 +00:00
### raid
Added new strip_size_kb rpc param on create to replace the more ambiguous
strip_size. The strip_size rpc param is deprecated.
SPDK 19.01 Change-Id: I819755deb35b3deca836e3cb22882de7bfc8b6a0 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442571 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-01-29 09:20:39 +00:00
## v19.01:
version: 19.01 pre Change-Id: I00cf8919c25e67f9771327b1802b64f24ef2cb82 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431164 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-10-29 12:34:15 +00:00
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
### ocf bdev
New virtual bdev module based on [Open CAS Framework](https://open-cas.github.io/) has been added.
This module allows for the use of one bdev to act as a high performance cache in front of another bdev.
Please see [documentation](https://spdk.io/doc/bdev.html#bdev_config_cas) for more details.
Only write through mode is currently supported and this feature is considered experimental.
parse: add return value to app_parse callback Need to check user input and return status of parsing to prevent app or target from crashing. Input checking function will be added in the future. Change-Id: I8167ac13306ae4f81e2cacb80edd9dcf9382c374 Signed-off-by: Chunyang Hui <chunyang.hui@intel.com> Reviewed-on: https://review.gerrithub.io/c/439479 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: GangCao <gang.cao@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com>
2019-01-08 19:40:06 +00:00
### event framework
For `spdk_app_parse_args`, add return value to the callback which parses application
specific command line parameters to protect SPDK applications from crashing by invalid
values from user input.
CHANGELOG: all hugepages are now reserved dynamically Change-Id: I8d6c3b4c7b1ff1e82782db05d5c14cddc06d1a6a Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442726 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 10:18:50 +00:00
By default, all SPDK applications will now reserve all hugepages at runtime. The pre-reserved
memory size can be still set with `-s` or `--mem-size` option, although the default value
was reduced down to 0.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
A custom hugetlbfs directory can now be specified via spdk_app_opts.
This can be used to configure hugepages with different sizes, a different size limit,
or different access permissions than the system's default hugepage pool.
SPDK applications can specify a custom hugetlbfs mount with the `--huge-dir` option.
env: add spdk_env_dpdk_post_init Based on requirement of initializing SPDK env from a DPDK application, relative to spdk_env_init, add spdk_env_dpdk_post_init for calling after rte_env_init. More details, visit https://github.com/spdk/spdk/issues/529 Change-Id: I6fda1593e0296ef93b705e31cc76bcd0d248673a Signed-off-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/c/437225 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-13 15:54:01 +00:00
### environment
CHANGELOG: add env changes Change-Id: I3ea1719439a84b60e3a2a8c56a7f5fbebe6be861 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442629 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2019-01-29 20:45:10 +00:00
spdk_vtophys() has been refactored to accept length of the translated region as a new
parameter. The function will now update that parameter with the largest possible value
for which the memory is contiguous in the physical memory address space.
The following functions were removed:
- spdk_pci_nvme_device_attach()
- spdk_pci_nvme_enumerate()
- spdk_pci_ioat_device_attach()
- spdk_pci_ioat_enumerate()
- spdk_pci_virtio_device_attach()
- spdk_pci_virtio_enumerate()
They were replaced with generic spdk_pci_device_attach() and spdk_pci_enumerate() which
require a new spdk_pci_driver object to be provided. It can be one of the following:
- spdk_pci_nvme_get_driver()
- spdk_pci_ioat_get_driver()
- spdk_pci_virtio_get_driver()
spdk_pci_hook_device() and spdk_pci_unhook_device() were added. Those allow adding a virtual
spdk_pci_device into the SPDK PCI subsystem. A virtual device calls provided callbacks for
each BAR mapping request or PCI config access. It's attachable with spdk_pci_device_attach()
or spdk_pci_enumerate() like any other device.
A new spdk_pause() function was added to pause CPU execution for an implementation specific
amount of time. Quoting from DPDK function this is based on: "This call is intended for
tight loops which poll a shared resource or wait for an event. A short pause within the loop
may reduce the power consumption."
env: add spdk_env_dpdk_post_init Based on requirement of initializing SPDK env from a DPDK application, relative to spdk_env_init, add spdk_env_dpdk_post_init for calling after rte_env_init. More details, visit https://github.com/spdk/spdk/issues/529 Change-Id: I6fda1593e0296ef93b705e31cc76bcd0d248673a Signed-off-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/c/437225 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-13 15:54:01 +00:00
A new public header file env_dpdk.h has been introduced, and function spdk_env_dpdk_post_init
is added into it. If user is using DPDK, and already called rte_eal_init, then include
include/spdk/env_dpdk.h, and call spdk_env_dpdk_post_init() instead of spdk_env_init.
spdk: Add ISA-L support with related crc32 function In SPDK, we will build isa-l with no shared option and then integrate it into SPDK. And we do not need to install isal in the system libaries. Note: ocf build in autobuild.sh now needs to build include/spdk/config.h before building the ocf library, to ensure that header is available in a clean build environment. Change-Id: I3f0ce6932b386de17a77cf5bfdfd738b22417e2d Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Signed-off-by: paul luse <paul.e.luse@intel.com> Signed-off-by: Jim Harris <james.r.harris@intel.com> Reviewed-on: https://review.gerrithub.io/c/441279 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Chunyang Hui <chunyang.hui@intel.com>
2019-01-21 09:05:59 +00:00
ISA-L has been added as an SPDK submodule. ISA-L is enabled by default on x86 architecture
to accelerate algorithms such as CRC for iSCSI and NVMe-oF. Users may still disable ISA-L
by explicitly passing --without-isal to the configure script.
util/uuid: add a new uuid copy API. Change-Id: I03042c4a7030eaac406e3c3afe6fe2f69bd9db36 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/436301 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: Jim Harris <james.r.harris@intel.com>
2018-12-06 04:20:51 +00:00
### util
A new uuid API `spdk_uuid_copy` was added to make a copy of the source uuid.
util/crc16: Add init_crc parameter as seed value to spdk_crc16_t10dif Add init_crc parameter as seed value to spdk_crc16_t10dif API to generate a CRC value spanning multiple separate buffers. This will be necessary for upcoming DIF/DIX patches. Having init_crc parameter is general, and so change the existing API without adding seed version of the existing API. Change-Id: I0ac7919b18013967e41829dcedd3e4e73204d5d6 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/437204 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-12-13 23:05:23 +00:00
An new parameter `init_crc` representing the initial CRC value was added to
`spdk_crc16_t10dif`. The parameter can be used to calculate a CRC value spanning
multiple separate buffers.
CHANGELOG: DIF and DIX APIs were added to utilility Change-Id: Ia98c3a364ee28e43c69cf2c890bc7cac990dd3f5 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/c/440606 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: wuzhouhui <wuzhouhui@kingsoft.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com>
2019-01-16 02:28:14 +00:00
New DIF APIs were added to generate and verify DIF by byte granularity for both DIF and DIX
formats. Among them, DIF with copy APIs will be usable to emulate DIF operations such as DIF
insert and strip.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Added `spdk_strtol` and `spdk_strtoll` to provide additional error checking around `strtol`
and `strtoll`.
Added `spdk_sprintf_append_realloc` and `spdk_vsprintf_append_realloc` for appending a string
with automatic buffer re-allocation.
nvme: add timeout for Admin commands when initialization Currently there are no timeout mechanism for Admin commands when initialization, the NVMe driver may enter infinite loop. While here, add a new parameter to the controller initialization options, NVMe controller will report an error when timeout happens during initialization. Change-Id: Id0c6b6fa15abe5227b486bee95c8e02914b0d358 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/424622 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-15 06:20:35 +00:00
### nvme
nvme: add security receive and security send wrapper Change-Id: Id25040d62f89d4e8f2268bb3383c5665c0508f5a Signed-off-by: Chunyang Hui <chunyang.hui@intel.com> Reviewed-on: https://review.gerrithub.io/c/438776 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2019-01-02 20:20:21 +00:00
Wrapper functions spdk_nvme_ctrlr_security_send() and spdk_nvme_ctrlr_security_receive() are
introduced to support further security protocol development.
nvme: add timeout for Admin commands when initialization Currently there are no timeout mechanism for Admin commands when initialization, the NVMe driver may enter infinite loop. While here, add a new parameter to the controller initialization options, NVMe controller will report an error when timeout happens during initialization. Change-Id: Id0c6b6fa15abe5227b486bee95c8e02914b0d358 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/424622 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-15 06:20:35 +00:00
admin_timeout_ms was added to NVMe controller initialization options, users
can change the default value when probing a controller.
nvme_tcp: Make the header and data digest configurable. Change-Id: Ia65e235a85207c128ba274e1bab38d6c35344239 Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/435563 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-11-30 01:46:55 +00:00
Add two new fields "header_digest" and "data_digest" in struct spdk_nvme_ctrlr_opts,
it will be used to enable the digest support for the NVMe/TCP transport.
Add a new TCP/IP transport(located in lib/nvme/nvme_tcp.c) in nvme driver. With
this new transport, it can be used to connect the NVMe-oF target with the
same TCP/IP support.
nvme: Eliminate identify errors to Discovery ctrlr The nvme/identify cmd issued some cmds to a ctrlr irrespective of its type, and when the target was a Discovery ctrlr which only accepts a very limited cmd set, that would result in errors observable both on the initiator side (from nvme/identify) and in the output on the target (nvmf_tgt). Introduce new API, spdk_nvme_ctrlr_is_discovery(), and alter identify to make use of that in determining which commands to send to the target. Change-Id: I974a569843f1d2b9e1ece7bd3bf9ceee1bfae872 Signed-off-by: Lance Hartmann <lance.hartmann@oracle.com> Reviewed-on: https://review.gerrithub.io/436225 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-12-05 21:57:53 +00:00
Added API, spdk_nvme_ctrlr_is_discovery(), to indicate whether the ctrlr
arg refers to a Discovery Controller or not.
nvme_bdev: add parsing for hostaddr and hostsvcid This allows us to specify the host-side configuration for each controller to which we connect. Change-Id: Iac2aed3934d4a326f45546f2f541e374308e2589 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/436219 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-04 22:09:31 +00:00
Added an API function `spdk_nvme_host_id_parse` and corresponding object `spdk_nvme_host_id`
for parsing host address and host service ID arguments on a per connection basis.
nvme_rdma: Add source addr info to RPC Change-Id: Id6b5aee4b36d828a0f9e5ddc85293a15342d2aae Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/436220 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-04 23:30:11 +00:00
The RPC `construct_nvme_bdev` now allows a user to specify a source address and service id for the host to
use when connecting to the controller backing the NVMe bdev.
nvmf: remove tgt_opts from nvmf_tgt This option is deprecated. Also, rename the rpc and configuration options for setting the opts to reflect that they now only set the max number of subsystems Change-Id: Iaabcbf33dd0a0dc489d81233fda74e9e7f3e0d2e Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/430161 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-10-19 20:19:09 +00:00
### NVMe-oF Target
The `spdk_nvmf_tgt_opts` struct has been deprecated in favor of `spdk_nvmf_transport_opts`.
Users will no longer be able to specify target wide I/O parameters. `spdk_nvmf_tgt_listen`
will also no longer implicitly initialize a transport with the default target options (since
there are none). Instead, a user must manually instantiate the transport with `spdk_nvmf_transport_create`
prior to calling `spdk_nvmf_tgt_listen`.
Related to the previous change, the rpc `set_nvmf_target_options` has been renamed to
`set_nvmf_target_max_subsystems` to indicate that this is the only target option available for the user to edit.
nvme: Add the NVMe over fabrics TCP/IP transport support It is the first patch to follow the NVMe over fabrics spec and implmenent the NVMe/TCP transport. It can be divided into work in the host and target sides: Host side: Add the TCP/IP transport in nvme lib (lib/nvme). Target side: Add the TCP/IP transport in nvmf lib (lib/nvmf). Change-Id: Idc4f93750df676354f6c2ea8ecdb234e3638fd44 Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/425191 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-08-02 02:21:45 +00:00
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Added fields `num_shared_buffers` and `buf_cache_size` in struct spdk_nvmf_transport_opts,
and also updated the related rpc function nvmf_create_transport, to make this
nvmf: add the transport shared buffer num configuration option. Previously, we allocate the buffer size according to the MaxQueueDepth info, however this is not exactly a good way for customers to configure, we should provided a shared buffer number configuration for the transport. Change-Id: Ic6ff83076a65e77ec7376688ffb3737fd899057c Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/437450 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-14 14:29:48 +00:00
configurable parameter available to users. The `num_shared_buffers` is used to
configure the shared buffer numbers of the transport used by RDMA or TCP transport.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
`buf_cache_size` configures number of shared buffers to cache per poll group.
nvmf: add the transport shared buffer num configuration option. Previously, we allocate the buffer size according to the MaxQueueDepth info, however this is not exactly a good way for customers to configure, we should provided a shared buffer number configuration for the transport. Change-Id: Ic6ff83076a65e77ec7376688ffb3737fd899057c Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/437450 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-12-14 14:29:48 +00:00
nvme: Add the NVMe over fabrics TCP/IP transport support It is the first patch to follow the NVMe over fabrics spec and implmenent the NVMe/TCP transport. It can be divided into work in the host and target sides: Host side: Add the TCP/IP transport in nvme lib (lib/nvme). Target side: Add the TCP/IP transport in nvmf lib (lib/nvmf). Change-Id: Idc4f93750df676354f6c2ea8ecdb234e3638fd44 Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/425191 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-08-02 02:21:45 +00:00
### nvmf
Add a new TCP/IP transport (located in lib/nvmf/tcp.c). With this tranport,
the SPDK NVMe-oF target can have a new transport, and can serve the NVMe-oF
protocol via TCP/IP from the host.
nvmf: remove tgt_opts from nvmf_tgt This option is deprecated. Also, rename the rpc and configuration options for setting the opts to reflect that they now only set the max number of subsystems Change-Id: Iaabcbf33dd0a0dc489d81233fda74e9e7f3e0d2e Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/430161 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-10-19 20:19:09 +00:00
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Added optional mechanism to modify the RDMA transport's behavior when creating protection domains and registering memory.
By default, the RDMA transport will use the ibverbs library to create protection domains and register memory.
Using `spdk_nvme_rdma_init_hooks` will subvert that and use an existing registration.
bdev: unregister bdevs top-down during shutdown. There are some use cases such as multipath and RAID expansion where a vbdev could have been registered before one of its base bdevs. Currently we unregister bdevs at shutdown in reverse order of their registration. Continue to do that in general, but skip any bdev that is still claimed. Any bdevs skipped in this way will eventually be unregistered once any bdevs that have claimed it have completed unregistration. Change-Id: Iafde9558430bc5ce56e8608ef50bcb2b5fbfbf71 Signed-off-by: Andrey Kuzmin <akuzmin@jetstreamsoft.com> Reviewed-on: https://review.gerrithub.io/432136 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-11-06 12:02:41 +00:00
### bdev
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Added `enable_bdev_histogram` and `get_bdev_histogram` RPC commands to allow gathering latency data for specified bdev.
Please see [documentation](https://spdk.io/doc/bdev.html#rpc_bdev_histogram) for more details.
Added `required_alignment` field to `spdk_bdev`, that specifies an alignment requirement for data buffers associated with an spdk_bdev_io.
Bdev layer will automatically double buffer any spdk_bdev_io that violates this alignment, before the spdk_bdev_io is submitted to the bdev module.
bdev: unregister bdevs top-down during shutdown. There are some use cases such as multipath and RAID expansion where a vbdev could have been registered before one of its base bdevs. Currently we unregister bdevs at shutdown in reverse order of their registration. Continue to do that in general, but skip any bdev that is still claimed. Any bdevs skipped in this way will eventually be unregistered once any bdevs that have claimed it have completed unregistration. Change-Id: Iafde9558430bc5ce56e8608ef50bcb2b5fbfbf71 Signed-off-by: Andrey Kuzmin <akuzmin@jetstreamsoft.com> Reviewed-on: https://review.gerrithub.io/432136 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-11-06 12:02:41 +00:00
On shutdown, bdev unregister now proceeds in top-down fashion, with
claimed bdevs skipped (these will be unregistered later, when virtual
bdev built on top of the respective base bdev unclaims it). This
allows virtual bdevs to be shut down cleanly as opposed to the
previous behavior that didn't differentiate between hotremove and
planned shutdown.
CHANGELOG: add deprecation-related notices Change-Id: Ic5bc07145bc4c9723a41c2cc02d4f33d2efab42b Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442727 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 10:54:33 +00:00
The `delete_bdev` RPC is now deprecated. Users should instead use the specific deletion RPC
for the bdev type to be removed (i.e. delete_malloc_bdev).
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Added support for separate bandwidth rate limits for read and write to QoS in bdev layer.
Bdev I/O statistics now track unmap opertations.
lvol: exposed marking lvol bdev as read only Added set_read_only_lvol_bdev() RPC that marks lvol bdev as read only. This enables to create clones off of a base lvol, without having to create additional lvol bdev with snapshot. Change-Id: Ic20bbcd8fbebcef157acce44bfa1da035b0da459 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/440534 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-15 15:31:05 +00:00
### logical volumes
Logical volume bdev can now be marked as read only using `set_read_only_lvol_bdev` RPC.
This allows for basing clones on top of lvol_bdev without first creating a snapshot.
doc/lvol: add description for clear-method when creating lvol bdevs Change-Id: I93647d2633f88522e3c0826eb7a379b9cfa0126d Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442563 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 10:23:26 +00:00
Added option to change method for data erasure when deleting lvol or resizing down.
Default of unmapping clusters can now be changed to writing zeroes or no operation.
log: remove "trace" from log flag RPCs We will keep the RPCs for now but mark them deprecated. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I0407dcb392ea0c9e89c0f26cd5670aed2dbfadef Reviewed-on: https://review.gerrithub.io/435345 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-11-27 07:26:59 +00:00
### log
"trace flags" are now referred to as "log flags" in the SPDK log API. The
set_trace_flag, clear_trace_flag and get_trace_flags RPCs are now deprecated,
and set_log_flag, clear_log_flag and get_log_flags RPCs have been added.
lib/trace: add 3 RPC method for tpoint_group_mask Now trace facility can be enabled/disabled at runtime, besides app starting parameters Change-Id: I086564665ba4375b946a5339d5921d6584e9bfda Signed-off-by: Liu Xiaodong <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/435470 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-11-29 11:12:26 +00:00
### trace
CHANGELOG: add trace_record Change-Id: I805259dca4e5242307a43ce5a9a8bde79d8769ba Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442729 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2019-01-30 11:19:23 +00:00
New `trace_record` application was added. It can be used to poll spdk trace shm file and
append any new trace entries into another specified file. This can help retain those entries
that would otherwise be overwritten in the shm file. See
[Capturing sufficient trace events](https://spdk.io/doc/nvmf_tgt_tracepoints.html#capture_trace_events)
for more details.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
Number of trace entries in circular buffer per lcore can now be assigned by starting SPDK app
with argument "--num-trace-entries <NUM>" provided.
lib/trace: add 3 RPC method for tpoint_group_mask Now trace facility can be enabled/disabled at runtime, besides app starting parameters Change-Id: I086564665ba4375b946a5339d5921d6584e9bfda Signed-off-by: Liu Xiaodong <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/435470 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-11-29 11:12:26 +00:00
New `get_tpoint_group_mask` RPC was added to get current tpoint_group_mask, and
each tpoint group status.
New `enable_tpoint_group` and `disable_tpoint_group` RPC were added to enable or
disable a specific tpoint group.
ftl: usage documentation Added FTL module user guide including setting up QEMU for Open Channel drive emulation. Change-Id: Ic9b46552ba99a2180a9f72e8c08e876edcecd39d Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-on: https://review.gerrithub.io/c/441736 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Pawel Wodkowski <pawelx.wodkowski@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-23 15:52:08 +00:00
### ftl
EXPERIMENTAL: Added basic flash translation layer module allowing for using Open Channel SSDs as
block devices. The module is split into the library (located in lib/ftl) and bdev_ftl
(lib/bdev/ftl). See the [documentation](https://spdk.io/doc/ftl.html) for more details.
CHANGELOG: add multiple connections per vhost device Change-Id: I13065d0e12bf96f9192cf9e8aa896c7f6dd51e2a Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442630 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2019-01-29 20:50:18 +00:00
### vhost
CHANGELOG: add note on vhost vulnerability Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Id47256ecfc5d774e7d8054423cda32a90f0c4f76 Reviewed-on: https://review.gerrithub.io/c/442929 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2019-02-01 03:11:19 +00:00
A security vulnerability has been identified and fixed in the SPDK vhost target. A malicious
vhost client (i.e. virtual machine) could carefully construct a circular descriptor chain which
would result in a partial denial of service in the SPDK vhost target. These types of descriptor
chains are now properly detected by the vhost target. All SPDK vhost users serving untrusted
vhost clients are strongly recommended to upgrade. (Reported by Dima Stepanov and Evgeny
Yakovlev.)
CHANGELOG: add multiple connections per vhost device Change-Id: I13065d0e12bf96f9192cf9e8aa896c7f6dd51e2a Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442630 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2019-01-29 20:50:18 +00:00
Vhost SCSI and Vhost Block devices can now accept multiple connections on the same socket file.
Each connection (internally called a vhost session) will have access to the same storage, but
will use different virtqueues, different features and possibly different memory.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
### vhost scsi
SCSI target hotremove can now be performed even without the VIRTIO_SCSI_F_HOTPLUG feature negotiated.
Regardless of VIRTIO_SCSI_F_HOTPLUG support, the hotremoval will be still reported through SCSI sense codes.
CHANGELOG: drop DPDK 16.07 support Change-Id: I39910e37fc8a23ca57dcd393f2c3c21e89cb31b4 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442725 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 08:48:40 +00:00
### DPDK
CHANGELOG: add DPDK 18.11 Change-Id: I3f7b2025f6ddb11dac5e23cc9c2b4df5c4cea860 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442631 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2019-01-29 21:01:48 +00:00
DPDK submodule was updated to DPDK 18.11. Note that SPDK does not fully leverage the new
multi-process device hotplug yet and continues to work the same way it always did.
CHANGELOG: drop DPDK 16.07 support Change-Id: I39910e37fc8a23ca57dcd393f2c3c21e89cb31b4 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442725 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 08:48:40 +00:00
Dropped support for DPDK 16.07 and earlier, which SPDK won't even compile with right now.
CHANGELOG: add deprecation-related notices Change-Id: Ic5bc07145bc4c9723a41c2cc02d4f33d2efab42b Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442727 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 10:54:33 +00:00
### RPC
The following RPC commands deprecated in the previous release are now removed:
- construct_virtio_user_scsi_bdev
- construct_virtio_pci_scsi_bdev
- construct_virtio_user_blk_bdev
- construct_virtio_pci_blk_bdev
- remove_virtio_scsi_bdev
- construct_nvmf_subsystem
configure: remove deprecated RAID options Change-Id: Ibbb53fefad5fa117c9b630301fb50bc04c87c3ea Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/c/442728 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-01-30 10:55:19 +00:00
### Miscellaneous
The configure options `--with-raid` and `--without-raid` that were deprecated in the previous
release are now removed.
changelog: added missing items for 19.01 Change-Id: I1168ac5317ef1142f14e19156c4a8df0dbf9fb00 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/c/442570 Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-01-29 13:11:15 +00:00
### nbd
Starting nbd using `spdk_nbd_start` is now performed asynchronously.
### net framework
Net framework initialization and finish is now done asynchronously.
### rpc
Added `spdk_rpc_is_method_allowed` function for checking whether method is permitted in a given state.
Added `spdk_rpc_get_state` to check current state of RPC server.
RPC `wait_subsystem_init` has been added to allow clients to block untill all subsystems are initialized.
### json rpc
JSON RPC client is now running in non-blocking mode. Requests are sent and received during spdk_jsonrpc_client_poll.
JSON RPC server can now recieve a callback on connection termination or server shutdown using `spdk_jsonrpc_conn_add_close_cb`
and `spdk_jsonrpc_conn_del_close_cb`.
SPDK 18.10 Change-Id: Idf71750aac404884384ec749b3136d2f341f76e7 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431163 Reviewed-by: Seth Howell <seth.howell5141@gmail.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 12:31:37 +00:00
## v18.10:
version: 18.10 pre Change-Id: I2d86f5aa440d971e4852d8b175abca830f42867b Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/421165 Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-08-02 17:32:39 +00:00
nvme: add spdk_nvme_ns_get_extended_sector_size spdk_nvme_ns_get_sector_size returns the sector size of the data only. This new function adds in the metadata size, if any. While here, modify the bdev/nvme driver to use this function - this is needed for ongoing extended sector size work through the bdev layer. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ic8070a7f8d29b0b2ac2a2d65e0df5f4736488351 Reviewed-on: https://review.gerrithub.io/422445 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-08-15 16:56:25 +00:00
### nvme
NVMe: Add support for security send/receive command Change-Id: I61f6a8fac4938d6af3ac6c84bcf11f99036ed856 Signed-off-by: Chunyang Hui <chunyang.hui@intel.com> Reviewed-on: https://review.gerrithub.io/426657 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-09-25 20:07:32 +00:00
spdk_nvme_ctrlr_cmd_security_send() and spdk_nvme_ctrlr_cmd_security_receive()
were added to support sending or receiving security protocol data to or from
nvme controller.
nvme: add spdk_nvme_ns_get_extended_sector_size spdk_nvme_ns_get_sector_size returns the sector size of the data only. This new function adds in the metadata size, if any. While here, modify the bdev/nvme driver to use this function - this is needed for ongoing extended sector size work through the bdev layer. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ic8070a7f8d29b0b2ac2a2d65e0df5f4736488351 Reviewed-on: https://review.gerrithub.io/422445 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-08-15 16:56:25 +00:00
spdk_nvme_ns_get_extended_sector_size() was added. This function includes
the metadata size per sector (if any). spdk_nvme_ns_get_sector_size() still
returns only the data size per sector, not including metadata.
CHANGELOG: add info on send_nvme_cmd RPC Change-Id: Iad65dc8b3863601bb8b061a0f903d4ab39201180 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431162 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 14:23:24 +00:00
New `send_nvme_cmd` RPC was added to allow sending NVMe commands directly to NVMe controller.
See the [send_nvme_cmd](http://spdk.io/doc/jsonrpc.html#rpc_send_nvme_cmd) documentation
for more details.
build: Conditionally builds single and separate shared libs Adds option to configure script (default is disabled) to build SPDK shared libraries, and enhances build correspondingly to do so. This includes the single, combined shared library encompassing all of the SPDK static libs, as well as production of individual SPDK shared libraries corresponding to each of the static ones. Although the SPDK shared libs conform with shared lib naming conventions complete with version numbering suffixes, this does not confer any ABI compatibility claims whatsoever at this time. It's merely conformance with the naming conventions. Finally, there are no built-in dependencies between SPDK shared libs, thus requiring one to specify all needed SPDK shared libs to resolve all symbols in the final link of an executable wishing to use said SPDK shared libs. Change-Id: Ia375c0e3fb6d150d45a39e84e3b226fbaea48545 Signed-off-by: Lance Hartmann <lance.hartmann@oracle.com> Reviewed-on: https://review.gerrithub.io/422307 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-08-14 17:56:26 +00:00
### Build System
New `configure` options, `--with-shared` and `--without-shared`
[default], provide the capability to build, or not, SPDK shared libraries.
This includes the single SPDK shared lib encompassing all of the SPDK
static libs as well as individual SPDK shared libs corresponding to
each of the SPDK static ones. Although the production of the shared
libs conforms with conventional version naming practices, such naming
does not at this time confer any SPDK ABI compatibility claims.
bdev/lvol: using spdk_bdev_alias_del_all() to delete all alias on destroy So we don't need to allocate memory (maybe failed) just for free other memory. Change-Id: I2c83f6acc2aa6ed79455bff90f952a2e70b44d59 Signed-off-by: wuzhouhui <wuzhouhui@kingsoft.com> Reviewed-on: https://review.gerrithub.io/422203 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-08-14 08:39:27 +00:00
### bdev
spdk_bdev_alias_del_all() was added to delete all alias from block device.
bdev: Add crypto virtual bdev module Initial support for softare AESNI_MB DPDK driver only. Have tested (both aesni and QAT seprately and concurrrently) on underlying NVMe devices with bdevio and a bdevperf script that runs IOs from 512B to 128K each with Q depths from 1 to 512 in powers of 2 for 30 seconds each run. QAT can be included in the code (but not makefile) and marked as experimental until we are ready to test in CI. It works well on 2 systems but is a big PITA to get the hardware setup and configured for use with DPDK (IMHO). Change-Id: If518c3df8e74e00efa18afdf194824c5e69778fc Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/403107 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-03-07 23:44:06 +00:00
A new virtual bdev module has been added to perform at rest data encryption using the DPDK CryptoDev
Framework. The module initially uses a software AESNI CBC cipher with experimental support for the
Intel QAT hardware accelerator also currently implemented with support for CBC cipher. Future work
CHANGELOG: bdev crypto is not considered experimental for this release Change-Id: I9c01bfc05417f07b9265692a02b6aaba37c507f2 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431529 Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-10-31 14:50:11 +00:00
may include additional ciphers as well as consideration for authentication.
bdev: Add crypto virtual bdev module Initial support for softare AESNI_MB DPDK driver only. Have tested (both aesni and QAT seprately and concurrrently) on underlying NVMe devices with bdevio and a bdevperf script that runs IOs from 512B to 128K each with Q depths from 1 to 512 in powers of 2 for 30 seconds each run. QAT can be included in the code (but not makefile) and marked as experimental until we are ready to test in CI. It works well on 2 systems but is a big PITA to get the hardware setup and configured for use with DPDK (IMHO). Change-Id: If518c3df8e74e00efa18afdf194824c5e69778fc Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/403107 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-03-07 23:44:06 +00:00
raid: enable by default We kept this disabled by default originally because it lacked multiple iov support needed for vhost and nvmf in-capsule data. Now that support has been added, there is no reason to not enable it automatically - it has no extra package dependencies, so requiring users to specify --with-raid to configure is just an extra unneeded step. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ia9796370e12a6f93993e70083de36114a37851bd Reviewed-on: https://review.gerrithub.io/426003 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-09-18 22:55:06 +00:00
The RAID virtual bdev module is now always enabled by default. The configure --with-raid and
--without-raid options are now ignored and deprecated and will be removed in the next release.
QoS/Bdev: add the RPC support for the bandwidth rate limit This patch added the support of RPC method to enable, adjust, disable the bandwidth rate limit on the bdev. And it can work together with the existing IOPS rate limit. The RPC method has been consolidated to support both IOPS and bandwidth rate limits as below: usage: rpc.py set_bdev_qos_limit [-h] [--rw_ios_per_sec RW_IOS_PER_SEC] [--rw_mbytes_per_sec RW_MBYTES_PER_SEC] name positional arguments: name Blockdev name to set QoS. Example: Malloc0 optional arguments: -h, --help show this help message and exit --rw_ios_per_sec RW_IOS_PER_SEC R/W IOs per second limit (>=10000, example: 20000). 0 means unlimited. --rw_mbytes_per_sec RW_MBYTES_PER_SEC R/W megabytes per second limit (>=10, example: 100). 0 means unlimited. Change-Id: I9c03cd635280add01801a81c6a6c02f0cf85bee1 Signed-off-by: GangCao <gang.cao@intel.com> Reviewed-on: https://review.gerrithub.io/416511 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-06-22 02:15:02 +00:00
Enforcement of bandwidth limits for quality of service (QoS) has been added to the bdev layer.
See the new [set_bdev_qos_limit](http://www.spdk.io/doc/jsonrpc.html#rpc_set_bdev_qos_limit)
documentation for more details. The previous set_bdev_qos_limit_iops RPC method introduced at
18.04 release has been deprecated. The new set_bdev_qos_limit RPC method can support both
bandwidth and IOPS limits.
CHANGELOG: info on get_bdevs_config removal Change-Id: Iab4b2e0a3f5d646f0bde228ef966950a8a450017 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431199 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 16:11:11 +00:00
spdk_bdev_config_json() and corresponding `get_bdevs_config` RPC was removed.
env_dpdk: change behavior of spdk_mem_map_translate The function now takes a pointer as it's last argument, and copies the size of the memory region for which the translation is validinto that pointer. For now, that will always be 2MB. However that behavior can change in the future. This series of changes is aimed at enabling spdk_mem_map_translate to report back to the user the length of the valid mem_map up to the function that requested the translation. This will be useful when retrieving memory regions associated with I/O buffers in NVMe-oF. For large I/O it will be possible that the buffer is split over multiple MRs and the I/O will have to be split into multiple SGLs. Change-Id: I8686c166ec956507f5ae55cf602341281482cb89 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/424888 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-09-06 20:07:42 +00:00
### Environment Abstraction Layer and Event Framework
The size parameter of spdk_mem_map_translate is now a pointer. This allows the
function to report back the actual size of the translation relative to the original
request made by the user.
env: pass an spdk_mem_map_ops structure to mem_map_alloc This series of changes is aimed at enabling spdk_mem_map_translate to report back to the user the length of the valid mem_map up to the function that requested the translation. This will be useful when retrieving memory regions associated with I/O buffers in NVMe-oF. For large I/O it will be possible that the buffer is split over multiple MRs and the I/O will have to be split into multiple SGLs. Change-Id: I90da6d4d31c669a3bf046f7721923dd743c5ef21 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/425328 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-09-11 22:03:31 +00:00
A new structure spdk_mem_map_ops has been introduced to hold memory map related
callbacks. This structure is now passed as the second argument of spdk_mem_map_alloc
in lieu of the notify callback.
doc: describe dynamic memory management Change-Id: I0ffa5a8ea0ffb46113c6a000546a445784ce7b2f Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/431094 Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 07:02:30 +00:00
### DPDK 18.08
The DPDK submodule has been updated to the DPDK 18.08 release. SPDK will now automatically
utilize DPDK's dynamic memory management with DPDK versions >= 18.05.1.
Hugepages can be still reserved with `[-s|--mem-size <size>]` option at application startup,
but once we use them all up, instead of failing user allocations with -ENOMEM, we'll try
to dynamically reserve even more. This allows starting SPDK with `--mem-size 0` and using
only as many hugepages as it is really needed.
Due to this change, the memory buffers returned by `spdk_*malloc()` are no longer guaranteed
to be physically contiguous.
CHANGELOG: mention I/OAT improved error handling Change-Id: I62ba6697599c99791104e9fb46a5b275a47174ea Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/431270 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-10-30 10:38:39 +00:00
### I/OAT
I/OAT driver can now reinitialize I/OAT channels after encountering DMA errors.
doc/bdev: document iSCSI bdev module Most to-do items in lib/bdev/iscsi/README have been done a long time ago, leaving this file greatly outdated. It is removed now and the iSCSI bdev description is added to doc/bdev.md. Since most of the to-do items have been done, this patch also adds a CHANGELOG entry announcing that iSCSI bdev is no longer in experimental state. Change-Id: I186c9e1489547152655e1e036b27ab6bc17fcf11 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429896 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-10-18 11:29:31 +00:00
### iscsi target
rpc/iscsi: Use chap to parameter names for CHAP in discovery session Current parameter names of `set_iscsi_options` and `get_iscsi_global_params` RPC method for CHAP in discovery session may not be clear and long compared with CHAP in login to target nodes. This patch changes parameter names of `set_iscsi_options` and `get_iscsi_global_params` RPC method for CHAP in discovery session from no_discovery_auth, req_discovery_auth, req_discovery_auth_mutual, and discovery_auth_group to disable_chap, require_chap, mutual_chap, and chap_group, respectively. Old parameters are still usable because decoder of them are not removed. Change-Id: If3102f1233d57ee3cadfb733a6fc1fca14a0e972 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/423050 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-08-22 02:30:57 +00:00
Parameter names of `set_iscsi_options` and `get_iscsi_global_params` RPC
method for CHAP authentication in discovery sessions have been changed to
align with `construct_target_node` RPC method. Old names are still usable
but will be removed in future release.
iscsi: Add set_iscsi_target_node_auth RPC to configure CHAP dynamically An new RPC set_iscsi_target_node_auth enables users to configure CHAP authentication for the target node dynamically. New setting is used for new iSCSI sessions. For existing iSCSI sessions, new setting is not used until user logout and login again. Try to use descriptive message in the RPC when error occurs. Change-Id: I0bd40d92262d708c1f7de0effb208078bdf8cc41 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/420974 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-08-20 00:12:59 +00:00
`set_iscsi_discovery_auth` and `set_iscsi_target_node_auth` RPC methods have
been added to set CHAP authentication for discovery sessions and existing
target nodes, respectively.
iscsi: Add set_iscsi_discovery_auth RPC to configure CHAP dynamically An new RPC set_iscsi_discovery_auth enables users to configure CHAP authentication for discovery sessions dynamically. Try to use descriptive message in the RPC when error occurs. Change-Id: I8883d5e054539cf6db091a5b79d0479e62119811 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/420976 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-08-22 04:43:18 +00:00
iscsi&scrpts/rpc: Require to specify CHAP secret file explicitly to load it Previous patches enabled users to configure CHAP secrets dynamically by RPCs. Subsequent patches will enable users to load CHAP secrets from JSON config file. Loading CHAP secret file is done by default and this will conflict to JSON config file. Hence the path to CHAP secret file is required to specify in the config file or JSON RPC set_iscsi_options explicitly after this patch. Users who have used CHAP secret file are expected to specify it explicitly and this will be no harm for them. Besides, CHAP secret file is not oly for discovery sessions but also for login to iSCSI targets. However there were wrong description to make user misunderstand. Hence remove these wrong description in this patch too. Change-Id: Ic4093cabc0c14b87e26baef4bba6b0d292e40c06 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/421467 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-08-27 23:37:35 +00:00
The SPDK iSCSI target supports an AuthFile which can be used to load CHAP
shared secrets when the iSCSI target starts. SPDK previously provided a
default location for this file (`/usr/local/etc/spdk/auth.conf`) if none was
specified. This default has been removed. Users must now explicitly specify
the location of this file to load CHAP shared secrets from a file, or use
the related iSCSI RPC methods to add them at runtime.
CHANGELOG: Load CHAP secrets from file once only at boot and then configure them by RPCs This feature change is done by a few patches and it is difficult to do CHANGELOG in a patch of them. Hence use this dedicated patch. Change-Id: I4b3957640828f8c4652a2cc0db84c37fc2a04063 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/423051 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-08-22 06:09:05 +00:00
doc/bdev: document iSCSI bdev module Most to-do items in lib/bdev/iscsi/README have been done a long time ago, leaving this file greatly outdated. It is removed now and the iSCSI bdev description is added to doc/bdev.md. Since most of the to-do items have been done, this patch also adds a CHANGELOG entry announcing that iSCSI bdev is no longer in experimental state. Change-Id: I186c9e1489547152655e1e036b27ab6bc17fcf11 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429896 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-10-18 11:29:31 +00:00
### iscsi initiator
doc: adjust CHANGELOG entry for iSCSI initiator Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Iddf357ad9a2a5d078591312ee545264d5775756b Reviewed-on: https://review.gerrithub.io/429974 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: GangCao <gang.cao@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 22:07:38 +00:00
The SPDK iSCSI initiator is no longer considered experimental and becomes
doc/bdev: document iSCSI bdev module Most to-do items in lib/bdev/iscsi/README have been done a long time ago, leaving this file greatly outdated. It is removed now and the iSCSI bdev description is added to doc/bdev.md. Since most of the to-do items have been done, this patch also adds a CHANGELOG entry announcing that iSCSI bdev is no longer in experimental state. Change-Id: I186c9e1489547152655e1e036b27ab6bc17fcf11 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429896 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-10-18 11:29:31 +00:00
a first-class citizen among bdev modules. The basic usage has been briefly
described in the bdev user guide: [iSCSI bdev](https://spdk.io/doc/bdev.html#bdev_config_iscsi)
app: deprecate ReactorMask from ini config file This is not used anywhere, and is not something we can set over RPC. So make this a command-line only option (as it should be). Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I2df862cdce2f17992d2324312d5c0e98b38a8acd Reviewed-on: https://review.gerrithub.io/423930 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-08-28 23:36:46 +00:00
### Miscellaneous
CHANGELOG: mention long name cmdline parameters Change-Id: Iaf4323190c5f4e0e19fb1311d35bc2347a5b70da Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/431269 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-10-30 10:30:52 +00:00
The SPDK application framework can now parse long name command line parameters.
Most single-character parameters have a long name equivalent now. See the
[Command Line Parameters](https://spdk.io/doc/app_overview.html) documentation
for details or use the `--help` command line parameter to list all available
params.
bdevperf `-s` param (io size) was renamed to `-o` as `-s` had been already
used by existing apps for memory size.
bdevio can now accept all SPDK command line parameters. The config now has to
be provided with `-c` or `--config` param.
The following ioat/perf and nvme/perf parameters were renamed as well:
`-s` (io size) to `-o`
`-d` (mem size) to `-s`
app: deprecate ReactorMask from ini config file This is not used anywhere, and is not something we can set over RPC. So make this a command-line only option (as it should be). Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I2df862cdce2f17992d2324312d5c0e98b38a8acd Reviewed-on: https://review.gerrithub.io/423930 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-08-28 23:36:46 +00:00
The ReactorMask config file parameter has been deprecated. Users should
use the -m or --cpumask command line option to specify the CPU core mask
for the application.
iscsi, nvmf, vhost: remove default config file pathnames Config file pathnames have been possible on the command line for a very long time, and all of the SPDK testing infrastructure uses it. The default pathnames were added a very long time ago, and now can cause weird issues like conflicting with --wait-for-rpc when an INI config file is not passed on the command line but is pulled in by the default pathname instead. So remove the default pathnames. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ia914ff1c9321235f79f8cc9a054ed7f099340151 Reviewed-on: https://review.gerrithub.io/424606 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-09-04 20:58:35 +00:00
Default config file pathnames have been removed from iscsi_tgt, nvmf_tgt
and vhost. Config file pathnames may now only be specified using the
-c command line option.
build: remove DPDK_DIR This is an artifact from before SPDK had a configure script or a DPDK submodule. Make configure the only supported way for specifying the location of the DPDK installation to use with SPDK. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I5c197c46220928bb18b97c8807755967d76ea42c Reviewed-on: https://review.gerrithub.io/424893 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-09-06 21:09:14 +00:00
Users may no longer set DPDK_DIR in their environment to specify the
location of the DPDK installation used to build SPDK. Using DPDK_DIR
has not been the documented nor recommended way to specify the DPDK
location for several releases, but removing it ensures no unexpected
surprises for users who may have DPDK_DIR defined for other reasons.
Users should just use the "configure" script to specify the DPDK
location before building SPDK.
scripts: use python3 in all scripts This it to prepare for RPM package. Also lower number of dependencies needed by SPDK tools. Update changelog to deprecate Python 2 and explicit interpeter invoking in scripts. Change-Id: I2497cca721cbcbadc1c99c675f8b8b7f682d5efa Signed-off-by: Pawel Wodkowski <pawelx.wodkowski@intel.com> Reviewed-on: https://review.gerrithub.io/425233 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Karol Latecki <karol.latecki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-09-11 13:26:14 +00:00
Although we know that many developers still use Python 2 we are officially
switching to Python3 with requirement that all new code must be valid also
for Python 2 up to the EOL which is year 2020.
Invoking interpreter explicitly is forbidden for executable scripts. There
is no need to use syntax like "python ./scripts/rpc.py". All executable
scripts must contain proper shebang pointing to the right interpreter.
Scripts without shebang musn't be executable.
scripts: add config converter Add a new script to enable converting old INI config files to the new JSON-RPC config file format. This prepares for deprecating the INI config file file format in the future. Change-Id: I0f2bfa9a585ce3537772b662d8e4028ab08a554d Signed-off-by: Pawel Kaminski <pawelx.kaminski@intel.com> Reviewed-on: https://review.gerrithub.io/420457 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Karol Latecki <karol.latecki@intel.com>
2018-07-26 01:32:05 +00:00
A Python script has been added to enable conversion of old INI config file
to new JSON-RPC config file format. This script can be found at
scripts/config_converter.py. Example how this script can be used:
~~~{.sh}
cat old_format.ini | scripts/config_converter.py > new_json_format.json
~~~
sock: Update the spdk_sock_getaddr function. Purpose: We need to get the port info in other applications (e.g., NVMe-oF TCP/IP transport) Change-Id: I3a4636e764e44425436bb064cb0062c6f3e44035 Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/428313 Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Tomasz Kulasek <tomaszx.kulasek@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-10-08 01:51:03 +00:00
### Sock
Two additional parameters were added to spdk_sock_get_addr() for the server
port and client port. These parameters are named "sport" and "cport"
respectively.
bdev/virtio: deprecate old bdev construct RPCs The 4 different RPC commands to create Virtio bdevs have been unified to a single, yet another RPC command in hopes the previous ones will be eventually removed. That happened in 18.07 and now in order to remove the old ones we mark them deprecated. The unified RPC command was introduced in 18.07 and has already replaced the old, separate RPCs in our test scripts some time ago. This patch also removes the old RPCs from doc/bdev.md and while here, rephrases the Virtio section a bit to make it more readable after some alphabetization changes from the past. jsonrpc.md already described the old RPCs as about to be deprecated, so there are no changes required in there. Change-Id: I77ebf2dde56b1f4a6e4090ed76de16a97310c1c5 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429908 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 12:25:17 +00:00
### Virtio
The following RPC commands have been deprecated:
- construct_virtio_user_scsi_bdev
- construct_virtio_pci_scsi_bdev
- construct_virtio_user_blk_bdev
- construct_virtio_pci_blk_bdev
bdev/virtio: deprecate remove_virtio_scsi_bdev RPC `remove_virtio_bdev` RPC can be used instead. It deletes both Virtio Block and SCSI devices. Change-Id: I3504f8d27eb13bb7522c05041c21042153a4fa18 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429909 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 13:12:03 +00:00
- remove_virtio_scsi_bdev
bdev/virtio: deprecate old bdev construct RPCs The 4 different RPC commands to create Virtio bdevs have been unified to a single, yet another RPC command in hopes the previous ones will be eventually removed. That happened in 18.07 and now in order to remove the old ones we mark them deprecated. The unified RPC command was introduced in 18.07 and has already replaced the old, separate RPCs in our test scripts some time ago. This patch also removes the old RPCs from doc/bdev.md and while here, rephrases the Virtio section a bit to make it more readable after some alphabetization changes from the past. jsonrpc.md already described the old RPCs as about to be deprecated, so there are no changes required in there. Change-Id: I77ebf2dde56b1f4a6e4090ed76de16a97310c1c5 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429908 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 12:25:17 +00:00
bdev/virtio: deprecate remove_virtio_scsi_bdev RPC `remove_virtio_bdev` RPC can be used instead. It deletes both Virtio Block and SCSI devices. Change-Id: I3504f8d27eb13bb7522c05041c21042153a4fa18 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429909 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 13:12:03 +00:00
The `construct_virtio_*` ones were replaced with a single `construct_virtio_dev`
command that can create any type of Virtio bdev(s). `remove_virtio_scsi_bdev`
was replaced with `remove_virtio_bdev` that can delete both Virtio Block and SCSI
devices.
bdev/virtio: deprecate old bdev construct RPCs The 4 different RPC commands to create Virtio bdevs have been unified to a single, yet another RPC command in hopes the previous ones will be eventually removed. That happened in 18.07 and now in order to remove the old ones we mark them deprecated. The unified RPC command was introduced in 18.07 and has already replaced the old, separate RPCs in our test scripts some time ago. This patch also removes the old RPCs from doc/bdev.md and while here, rephrases the Virtio section a bit to make it more readable after some alphabetization changes from the past. jsonrpc.md already described the old RPCs as about to be deprecated, so there are no changes required in there. Change-Id: I77ebf2dde56b1f4a6e4090ed76de16a97310c1c5 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/429908 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-18 12:25:17 +00:00
CHANGELOG: add info on spdk_file_get_id() Change-Id: Ic5e4c5560481f93db349696373d295737e1bf2dc Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431200 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 14:53:45 +00:00
### Blobfs
spdk_file_get_id() returning unique ID for the file was added.
CHANGELOG: added info on new API for iteration over JSON object Change-Id: Ia82a6a5315e430e22cd0cec471ff45a5f5458eec Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431201 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 16:20:48 +00:00
### JSON
CHANGELOG: add info on new jsonrpc-client library Change-Id: Ieb699a3d59711cb0ab6b8683decdcea290a6fb80 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431203 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 16:54:24 +00:00
Added jsonrpc-client C library intended for issuing RPC commands from applications.
CHANGELOG: added info on new API for iteration over JSON object Change-Id: Ia82a6a5315e430e22cd0cec471ff45a5f5458eec Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431201 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 16:20:48 +00:00
Added API enabling iteration over JSON object:
- spdk_json_find()
- spdk_json_find_string()
- spdk_json_find_array()
- spdk_json_object_first()
- spdk_json_array_first()
- spdk_json_next()
CHANGELOG: add info on blobstore io_units Change-Id: Ief376d26ec33507e458693487b892e00bab1682e Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431159 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-10-29 12:46:23 +00:00
### Blobstore
Blobstore I/O operations are now based on io_units, instead of blobstore page size.
The io_unit size is now the same as the underlying block device's block size.
Logical volumes built on a block device with 512B block size can now be used as boot devices
in QEMU.
CHANGELOG: iSCSI and NVMe-oF support for SPDKCLI Change-Id: I622cb78656d2da6b9c410c3acd862d4870289ee0 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-on: https://review.gerrithub.io/431160 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-10-29 12:38:16 +00:00
### SPDKCLI
The SPDKCLI interactive command tool for managing SPDK is no longer considered experimental.
Support for the iSCSI and NVMe-oF targets has been added.
SPDK 18.07 Change-Id: I9b9c8f0c213dcdd4d233171daf41e96033324af6 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/421164 Reviewed-by: Jim Harris <james.r.harris@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2018-08-02 17:29:48 +00:00
## v18.07:
version: SPDK 18.07-pre Change-Id: I712fb4fce02821bc7ae483d06aa905f54b4998aa Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409361 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-27 23:16:47 +00:00
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
### bdev
A new public header file bdev_module.h has been introduced to facilitate the
development of new bdev modules. This header includes an interface for the
spdk_bdev_part and spdk_bdev_part_base objects to enable the creation of
multiple virtual bdevs on top of a single base bdev and should act as the
primary API for module authors.
spdk_bdev_get_opts() and spdk_bdev_set_opts() were added to set bdev-wide
options.
A mechanism for handling out of memory condition errors (ENOMEM) returned from
I/O submission requests at the bdev layer has been added. See
spdk_bdev_queue_io_wait().
The spdk_bdev_get_io_stat() function now returns cumulative totals instead of
resetting on each call. This allows multiple callers to query I/O statistics
without conflicting with each other. Existing users will need to adjust their
code to record the previous I/O statistics to calculate the delta between calls.
I/O queue depth tracking and samples options have been added. See
spdk_bdev_get_qd(), spdk_bdev_get_qd_sampling_period(), and
spdk_bdev_set_qd_sampling_period().
bdev: add raid bdev module Raid module: ============ - SPDK raid bdev module is a new bdev module which is responsible for striping various NVMe devices and expose the raid bdev to bdev layer which would enhance the performance and capacity. - It can support theoretically 256 base devices (currently it is being tested max upto 8 base devices) - Multiple strip sizes like 32KB, 64KB, 128KB, 256KB, 512KB etc is supported. Most of the current testing is focused on 64KB strip size. - New RPC commands like "create raid bdev", "destroy raid bdev" and "get raid bdevs" are introduced to configure raid bdev dynamically in a running SPDK system. - Currently raid bdev configuration parameters are persisted in the current SPDK configuration file for across reboot support. DDF will be introduced later. High level testing done: ======================= - Raid bdev is created with 8 base NVMe devices via configuration file and is exposed to initiator via existing methods. Initiator is able to see a single NVMe namespace with capacity equal to sum of the minimum capacities of 8 devices. Initiator was able to run raw read/write workload, file system workload etc (tested with XFS file system workload). - Multiple raid bdevs are also created and exposed to initiator and tested with file system and other workloads for read/write IO. - LVS / LVOL are created over raid bdev and exposed to initiator. Testing was done for raw read/write workloads and XFS file system workloads. - RPC testing is done where on the running SPDK system raid bdevs are created out of NVMe base devices. These raid bdevs (and LVOLs over raid bdevs) are then exposed to initiator and IO workload was tested for raw read/write and XFS file system workload. - RPC testing is done for delete raid bdevs where all raid bdevs are deleted in running SPDK system. - RPC testing is done for get raid bdevs where existing list of raid bdev names is printed (it can be all raid bdevs or only online or only configuring or only offline). - RPC testing is done where raid bdevs and underlying NVMe devices relationship was returned in JSON RPC commands Change-Id: I10ae1266f8f2cca3c106e4df8c1c0993ddf435d8 Signed-off-by: Kunal Sablok <kunal.sablok@intel.com> Reviewed-on: https://review.gerrithub.io/410484 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-05-08 11:30:29 +00:00
### RAID module
A new bdev module called "raid" has been added as experimental module which
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
aggregates underlying NVMe bdevs and exposes a single raid bdev. Please note
that vhost will not work with this module because it does not yet have support
for multi-element io vectors.
bdev: add raid bdev module Raid module: ============ - SPDK raid bdev module is a new bdev module which is responsible for striping various NVMe devices and expose the raid bdev to bdev layer which would enhance the performance and capacity. - It can support theoretically 256 base devices (currently it is being tested max upto 8 base devices) - Multiple strip sizes like 32KB, 64KB, 128KB, 256KB, 512KB etc is supported. Most of the current testing is focused on 64KB strip size. - New RPC commands like "create raid bdev", "destroy raid bdev" and "get raid bdevs" are introduced to configure raid bdev dynamically in a running SPDK system. - Currently raid bdev configuration parameters are persisted in the current SPDK configuration file for across reboot support. DDF will be introduced later. High level testing done: ======================= - Raid bdev is created with 8 base NVMe devices via configuration file and is exposed to initiator via existing methods. Initiator is able to see a single NVMe namespace with capacity equal to sum of the minimum capacities of 8 devices. Initiator was able to run raw read/write workload, file system workload etc (tested with XFS file system workload). - Multiple raid bdevs are also created and exposed to initiator and tested with file system and other workloads for read/write IO. - LVS / LVOL are created over raid bdev and exposed to initiator. Testing was done for raw read/write workloads and XFS file system workloads. - RPC testing is done where on the running SPDK system raid bdevs are created out of NVMe base devices. These raid bdevs (and LVOLs over raid bdevs) are then exposed to initiator and IO workload was tested for raw read/write and XFS file system workload. - RPC testing is done for delete raid bdevs where all raid bdevs are deleted in running SPDK system. - RPC testing is done for get raid bdevs where existing list of raid bdev names is printed (it can be all raid bdevs or only online or only configuring or only offline). - RPC testing is done where raid bdevs and underlying NVMe devices relationship was returned in JSON RPC commands Change-Id: I10ae1266f8f2cca3c106e4df8c1c0993ddf435d8 Signed-off-by: Kunal Sablok <kunal.sablok@intel.com> Reviewed-on: https://review.gerrithub.io/410484 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com>
2018-05-08 11:30:29 +00:00
changelog: add note about -t to -L option rename This was changed in commit 8f26b74e020a ("examples: make debug flag option consistent"). Change-Id: Id47eff11321063b684fdd4e9d2187e459065e98e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/416890 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-06-26 21:54:37 +00:00
### Log
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
The debug log component flag available on several SPDK applications has been
renamed from `-t` to `-L` to prevent confusion with tracepoints and to allow the
option to be added to tools that already use `-t` to mean something else.
### Blobstore
A new function, spdk_bs_dump(), has been added that dumps all of the contents of
a blobstore to a file pointer. This includes the metadata and is very useful for
debugging.
Two new operations have been added for thin-provisioned blobs.
spdk_bs_inflate_blob() will allocate clusters for all thinly provisioned regions
of the blob and populate them with the correct data by reading from the backing
blob(s). spdk_bs_blob_decouple_parent() works similarly, but will only allocate
clusters that correspond to data in the blob's immediate parent. Clusters
allocated to grandparents or that aren't allocated at all will remain
thin-provisioned.
### BlobFS
Changed the return type of spdk_file_truncate() from void to int to allow the
propagation of `ENOMEM` errors.
changelog: add note about -t to -L option rename This was changed in commit 8f26b74e020a ("examples: make debug flag option consistent"). Change-Id: Id47eff11321063b684fdd4e9d2187e459065e98e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/416890 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-06-26 21:54:37 +00:00
nvme: add nvme error injection support Users can set specified Admin commands or IO commands with error status, when submitting new commands which are already set with error status, the commands will return to the caller with specified error code. So that users can emulate some error status for their error condition code path. Change-Id: I4b93c7e4f2b15a659da73b39e26bfa162eb5214e Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/410870 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-05-17 17:32:42 +00:00
### NVMe Driver
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
The new API functions spdk_nvme_qpair_add_cmd_error_injection() and
spdk_nvme_qpair_remove_cmd_error_injection() have been added for NVMe error
emulation. Users can set a specified command to fail with a particular error
status.
Changed the name `timeout_sec` parameter to `timeout_us` in
spdk_nvme_ctrlr_register_timeout_callback(), and also changed the type from
uint32_t to uint64_t. This will give users more fine-grained control over the
timeout period.
nvme: add nvme error injection support Users can set specified Admin commands or IO commands with error status, when submitting new commands which are already set with error status, the commands will return to the caller with specified error code. So that users can emulate some error status for their error condition code path. Change-Id: I4b93c7e4f2b15a659da73b39e26bfa162eb5214e Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/410870 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-05-17 17:32:42 +00:00
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
Basic support for Open Channel SSDs was added. See nvme_ocssd.h
### NVMe Over Fabrics
The spdk_nvmf_tgt_destroy() function is now asynchronous and takes a callback
as a parameter.
spdk_nvmf_qpair_disconnect() was added to allow the user to disconnect qpairs.
spdk_nvmf_subsystem_get_max_namespaces() was added to query the maximum allowed
number of namespaces for a given subsystem.
nvme: change the type of paramter for timeout_callback set Change the type of nvme_timeout parameter in spdk_nvme_ctrlr_register_timeout_callback from uin32_t to uint64_t. Reason: This will make the timeout trigger test more flexible and will not affect the original meanings. Also for the configuration file, still maintain the compatability support Change-Id: I94c90f67b2e9c57220ab82ecea11a1590d62aed4 Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Reviewed-on: https://review.gerrithub.io/419326 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-07-16 01:58:45 +00:00
build: add combined shared library (libspdk.so) Change-Id: If48df087c145a3fd278c0ae04558d8352b01cc1a Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/414687 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-06-11 19:40:29 +00:00
### Build System
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
The build system now generates a combined shared library (libspdk.so) that may
be used in place of the individual static libraries (libspdk_*.a). The combined
library includes all components of SPDK and is intended to make linking against
SPDK easier. The static libraries are also still provided for users that prefer
to link only the minimal set of components required.
### git pre-commit and pre-push hooks
build: add combined shared library (libspdk.so) Change-Id: If48df087c145a3fd278c0ae04558d8352b01cc1a Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/414687 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-06-11 19:40:29 +00:00
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
The pre-commit hook will run `scripts/check_format.sh` and verify there are no
formating errors before allowing `git commit` to run. The pre-push hook runs
`make CONFIG_WERROR=y` with and without `CONFIG_DEBUG=y` using both the gcc and
clang compiler before allowing `git push` to run. Following each DEBUG build
`test/unit/unittest.sh` is run and verified. Results are recorded in the
`make.log` file.
To enable type: 'git config core.hooksPath .githooks'. To override after
configuration use the `git --no-verify` flag.
build: add intel-ipsec-mb submodule This is a dependency of the DPDK crypto framework. The submodule is currently set to our SPDK fork of the ipsec library which is based off of the library v0.48 tag, as required by DPDK plus one minor Makefile change on the 'spdk' branch of the fork. Also added is a configure option '--with-crypto' and the associated conditionals for building DPDK with or without the library dependency. The crypto vbdev patch will use this same configure option to determine DPDK opts as well as whether the crypto vbdev should be built or not. Change-Id: Ib1cfd15b63b29acf3c2f7345d0d7edfd94716620 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Signed-off-by: paul luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/404983 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-03-22 23:24:14 +00:00
nbd: return path to /dev/nbd* in start_nbd_disk This will allow us to make the start_nbd_disk method choose an available /dev/nbd* node automatically in an upcoming commit. Change-Id: I3c6eb67e7e0c513212eba17139fd0cc96bf9b6dd Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/413847 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-06-05 19:31:50 +00:00
### RPC
The `start_nbd_disk` RPC method now returns the path to the kernel NBD device node
rather than always returning `true`.
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
### DPDK 18.05
bdev: stop zeroing data in spdk_bdev_get_io_stat() This will allow multiple independent callers to request I/O statistics without stepping on each other (previously the stats would be reset on each request, which only works with a single caller). This also means that we can now allow requesting stats while the VTune integration is enabled. Change-Id: Ia9d4d6fd37fa66b3671cd33b3183c90524f955bd Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/412257 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-05-23 18:30:01 +00:00
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
The DPDK submodule has been rebased on the DPDK 18.05 release. DPDK 18.05 supports
dynamic memory allocation, but due to some issues found after the DPDK 18.05 release,
that support is not enabled for SPDK 18.07. Therefore, SPDK 18.07 will continue to use
the legacy memory allocation model. The plan is to enable dynamic memory allocation
after the DPDK 18.08 release which should fix these issues.
bdev.c: encapsulate members of spdk_bdev_part. Change-Id: Ia3d04905d319c075a12726ca85c3aa1d3135db44 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/417176 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-06-28 17:37:00 +00:00
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
### Environment Abstraction Layer and Event Framework
env: add size parameter to spdk_mem_map_translate Change-Id: I808101edaf4d75613baf19a950915f1d8e75b1af Signed-off-by: zkhatami88 <z.khatami88@gmail.com> Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/413154 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Zahra Khatami <zahra.k.khatami@oracle.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-05-31 21:44:49 +00:00
The spdk_mem_map_translate() function now takes a size parameter to indicate the size of
the memory region. This can be used by environment implementations to validate the
requested translation.
thread: Rename io_channel.h to thread.h Leave io_channel.h in the repository and make it simply include thread.h for backward compatibility. Change-Id: I5320fb8e9e5bc6e39ee9ce44cd79570194a8b841 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/414699 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Madhu Pai <mpai@netapp.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-06-11 18:49:43 +00:00
The I/O Channel implementation has been moved to its own library - lib/thread. The
public API that was previously in spdk/io_channel.h is now in spdk/thread.h The
file spdk/io_channel.h remains and includes spdk/thread.h.
Reorganize 18.07 Changelog entries. Fill in some missing things based on the diff Change-Id: I5dadd6ac31dac7e9cf483c514080f88b1429a405 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/420922 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Seth Howell <seth.howell5141@gmail.com>
2018-07-31 16:57:23 +00:00
spdk_reactor_get_tsc_stats was added to return interesting statistics for each
reactor.
git: add .githooks to repository - Add git pre-commit and pre-push hooks - To enable type 'git config core.hooksPath .githooks' - For for additional example hooks see the .git/hooks directory Change-Id: I92155f4083c8547759bfbbfe4df64923548fa4d5 Signed-off-by: Ed Rodriguez <ed.rodriguez@netapp.com> Signed-off-by: John Meneghini <johnm@netapp.com> Reviewed-on: https://review.gerrithub.io/409577 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-02-05 18:15:54 +00:00
copy/ioat: Change the default of IOAT from Enabled to Disabled This patch changes the default setting of IOAT copy engine from Enabled to Disabled. Accordingly this patch changes the config file specification for IOAT copy engine from "Disable Yes/No" to "Enable No/Yes". Subsequent patches will add a new JSON RPC to configure IOAT copy engine dynamically. Change-Id: I754990cbb6ecc096953dd2fb9d34366b91111bf8 Signed-off-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-on: https://review.gerrithub.io/410757 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-06-05 23:33:20 +00:00
### IOAT
IOAT for copy engine is disabled by default. It can be enabled by specifying the Enable
option with "Yes" in `[Ioat]` section of the configuration file. The Disable option is
now deprecated and will be removed in a future release.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
## v18.04: Logical Volume Snapshot/Clone, iSCSI Initiator, Bdev QoS, VPP Userspace TCP/IP
rpc: remove [Rpc] configuration file section This section was deprecated in the previous release, and its removal was planned for v18.04. Users may configure the RPC listen address via the command-line '-r' parameter. Change-Id: Ic714417b87d422492b8742852c16983eb61793c2 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/398239 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-02-02 17:39:35 +00:00
CHANGELOG.md: document DPDK CVE-2018-1059 fixes Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I748be6adeb83cfa99f4359db68acdec7ea5ab523 Reviewed-on: https://review.gerrithub.io/408736 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-04-23 17:34:45 +00:00
### vhost
The SPDK vhost-scsi, vhost-blk and vhost-nvme applications have fixes to address the
DPDK rte_vhost vulnerability [CVE-2018-1059](http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2018-1059).
Please see this [security advisory](https://access.redhat.com/security/cve/cve-2018-1059)
for additional information on the DPDK vulnerability.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
Workarounds have been added to ensure vhost compatibility with QEMU 2.12.
EXPERIMENTAL: Support for vhost-nvme has been added to the SPDK vhost target. See the
[vhost documentation](http://www.spdk.io/doc/vhost.html) for more details.
### Unified Target Application
A new unified SPDK target application, `spdk_tgt`, has been added. This application combines the
functionality of several existing SPDK applications, including the iSCSI target, NVMe-oF target,
and vhost target. The new application can be managed through the existing configuration file and
[JSON-RPC](http://www.spdk.io/doc/jsonrpc.html) methods.
CHANGELOG.md: document DPDK CVE-2018-1059 fixes Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I748be6adeb83cfa99f4359db68acdec7ea5ab523 Reviewed-on: https://review.gerrithub.io/408736 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-04-23 17:34:45 +00:00
### Env
env: Add SPDK wrapper for rte_mempool_get_bulk() Needed for crypto vbdev work. Change-Id: Ib18ce3aaecf2388cf2cdc4dea110db514c8c1f1b Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/408256 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-04-18 23:25:05 +00:00
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
spdk_mempool_get_bulk() has been added to wrap DPDK rte_mempool_get_bulk().
env: Add SPDK wrapper for rte_mempool_get_bulk() Needed for crypto vbdev work. Change-Id: Ib18ce3aaecf2388cf2cdc4dea110db514c8c1f1b Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/408256 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-04-18 23:25:05 +00:00
env: add malloc variants with DMA/shareable flags This will allow environment abstraction layers to provide different types of memory depending on whether it needs to be DMA-able and/or shared across multi-process boundaries. For the DPDK environment, the flags can be ignored, since rte_malloc() supports both DMA-able and shared memory. Change-Id: I5ee894337dd9d6e24418848c0a35f131184383c8 Signed-off-by: zkhatami88 <z.khatami88@gmail.com> Reviewed-on: https://review.gerrithub.io/402334 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Tested-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-02-23 06:43:28 +00:00
New memory management functions spdk_malloc(), spdk_zmalloc(), and spdk_free() have been added.
These new functions have a `flags` parameter that allows the user to specify whether the allocated
memory needs to be suitable for DMA and whether it should be shared across processes with the same
shm_id. The new functions are intended to replace spdk_dma_malloc() and related functions, which will
eventually be deprecated and removed.
bdev: add new optional bdev i/f entry point Add new optional bdev module interface function, init_complete, to notify bdev modules when the bdev subsystem initialization is complete. Useful for virtual bdevs that require notification that the set of initialization examine() calls is complete. Change-Id: I0997fb5749d430f2fd3a40172ec8a1d5caa96964 Signed-off-by: paul luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/407222 Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-04-10 21:53:20 +00:00
### Bdev
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
A new optional bdev module interface function, `init_complete`, has been added to notify bdev modules
when the bdev subsystem initialization is complete. This may be useful for virtual bdevs that require
bdev: add new optional bdev i/f entry point Add new optional bdev module interface function, init_complete, to notify bdev modules when the bdev subsystem initialization is complete. Useful for virtual bdevs that require notification that the set of initialization examine() calls is complete. Change-Id: I0997fb5749d430f2fd3a40172ec8a1d5caa96964 Signed-off-by: paul luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/407222 Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-04-10 21:53:20 +00:00
notification that the set of initialization examine() calls is complete.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
The bdev layer now allows modules to provide an optional per-bdev UUID, which can be retrieved with
the spdk_bdev_get_uuid() function.
Enforcement of IOPS limits for quality of service (QoS) has been added to the bdev layer. See the
[set_bdev_qos_limit_iops](http://www.spdk.io/doc/jsonrpc.html#rpc_set_bdev_qos_limit_iops) documentation
for more details.
rpc: remove [Rpc] configuration file section This section was deprecated in the previous release, and its removal was planned for v18.04. Users may configure the RPC listen address via the command-line '-r' parameter. Change-Id: Ic714417b87d422492b8742852c16983eb61793c2 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/398239 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-02-02 17:39:35 +00:00
### RPC
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
The `[Rpc]` configuration file section, which was deprecated in v18.01, has been removed.
rpc: remove [Rpc] configuration file section This section was deprecated in the previous release, and its removal was planned for v18.04. Users may configure the RPC listen address via the command-line '-r' parameter. Change-Id: Ic714417b87d422492b8742852c16983eb61793c2 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/398239 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-02-02 17:39:35 +00:00
Users should switch to the `-r` command-line parameter instead.
jsonrpc: allow send_buf to grow as needed Reallocate the send buffer if more data is written by the RPC handler than currently fits in the buffer. Change-Id: I590dd173b843aba48c768adfafaf87e4b47bcc19 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/399925 Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-02-14 17:12:50 +00:00
The JSON-RPC server implementation now allows up to 32 megabyte responses, growing as
needed; previously, the response was limited to 32 kilobytes.
doc: changelog update Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Change-Id: Ia2d0c596725c5df239f0e01ac9f10e5b65b02764 Reviewed-on: https://review.gerrithub.io/408825 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Karol Latecki <karol.latecki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 11:11:04 +00:00
### SPDKCLI
EXPERIMENTAL: New SPDKCLI interactive command tool for managing SPDK is available.
See the [SPDKCLI](http://www.spdk.io/doc/spdkcli.html) documentation for more details.
nvme: add API to allocate CMB I/O buffers Change-Id: I2a3c7a272dc08be5a5ecb4339622816482c4cbb0 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Signed-off-by: Stephen Bates <sbates@raithlin.com> Reviewed-on: https://review.gerrithub.io/397036 Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-04-21 23:35:11 +00:00
### NVMe Driver
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
EXPERIMENTAL: Support for WDS and RDS capable CMBs in NVMe controllers has been added. This support is
nvme: add API to allocate CMB I/O buffers Change-Id: I2a3c7a272dc08be5a5ecb4339622816482c4cbb0 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Signed-off-by: Stephen Bates <sbates@raithlin.com> Reviewed-on: https://review.gerrithub.io/397036 Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-04-21 23:35:11 +00:00
experimental pending a functional allocator to free and reallocate CMB buffers.
rpc: remove [Rpc] configuration file section This section was deprecated in the previous release, and its removal was planned for v18.04. Users may configure the RPC listen address via the command-line '-r' parameter. Change-Id: Ic714417b87d422492b8742852c16983eb61793c2 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/398239 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2018-02-02 17:39:35 +00:00
nvme: add spdk_nvme_ns_get_uuid() function This function retrieves the UUID from a namespace, if available. Change-Id: I98c55375948b92eaf429b41fb36dfea4e2b780a2 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/404734 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-03-22 00:36:06 +00:00
spdk_nvme_ns_get_uuid() has been added to allow retrieval of per-namespace UUIDs when available.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
New API functions spdk_nvme_ctrlr_get_first_active_ns() and spdk_nvme_ctrlr_get_next_active_ns()
have been added to iterate active namespaces, as well as spdk_nvme_ctrlr_is_active_ns() to check if
a namespace ID is active.
nvme: Use active namespace list for enumerating namespaces - Add support for multi page CNS 0x2 - Use CNS value 0x02 (SPDK_NVME_IDENTIFY_ACTIVE_NS_LIST) to query active namespaces - Add an API to iterate the active list Change-Id: Iea524881fa6e3610a7d85ab02a2005a92fd633df Signed-off-by: John Meneghini <johnm@netapp.com> Reviewed-on: https://review.gerrithub.io/401957 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-02-23 14:38:24 +00:00
nvmf: allow configuration of ns NGUID and EUI64 Add optional parameters to namespace creation to let the user pick the namespace globally unique identifier and EUI-64. Change-Id: Ia3eebaf22f8a64733a00a83f90cafb4977c2d07a Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/399531 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-02-13 00:03:01 +00:00
### NVMe-oF Target
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
Namespaces may now be assigned unique identifiers via new optional `eui64` and `nguid` parameters
to the `nvmf_subsystem_add_ns` RPC method. Additionally, the NVMe-oF target automatically exposes
the backing bdev's UUID as the namespace UUID when available.
nvmf: allow configuration of ns NGUID and EUI64 Add optional parameters to namespace creation to let the user pick the namespace globally unique identifier and EUI-64. Change-Id: Ia3eebaf22f8a64733a00a83f90cafb4977c2d07a Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/399531 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-02-13 00:03:01 +00:00
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
spdk_nvmf_subsystem_remove_ns() is now asynchronous and requires a callback to indicate completion.
nvmf: make spdk_nvmf_subsystem_remove_ns asynchronous Update the thread-local caches with new namespace data during each call to spdk_nvmf_subsystem_remove_ns to handle the case where the user requested to remove a namespace and then immediately add a different one at the same namespace id. This makes the call asynchronous. Change-Id: I8fd1968f7da78966386de18506b98d403b82d80e Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/408220 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2018-04-18 16:31:40 +00:00
blob: change spdk_bs_io_xxx_blob functions to spdk_blob_io_xxx These new names are much more clear and are aligned with other functions such as spdk_blob_close. Keep the old names around for now but deprecate them. We will remove them in next release. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Idc60fd0b19fa2a8b0247a1f5835774d342e721f9 Reviewed-on: https://review.gerrithub.io/400884 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-02-21 21:37:37 +00:00
### Blobstore
A number of functions have been renamed:
- spdk_bs_io_write_blob() => spdk_blob_io_write()
- spdk_bs_io_read_blob() => spdk_blob_io_read()
- spdk_bs_io_writev_blob() => spdk_blob_io_writev()
- spdk_bs_io_readv_blob() => spdk_blob_io_readv()
- spdk_bs_io_unmap_blob() => spdk_blob_io_unmap()
- spdk_bs_io_write_zeroes_blob() => spdk_blob_io_write_zeroes()
The old names still exist but are deprecated. They will be removed in the v18.07 release.
blob: make spdk_blob_resize an async operation To support resize operations during I/O, we will need to send messages to each thread to quiesce I/O while the resize operation is in progress to guard against the cluster map memory changing while another thread is accessing the cluster map. Therefore, spdk_blob_resize needs to be asynchronous. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ida037334739b4b80a1dbc76e8f1c70bca8b73582 Reviewed-on: https://review.gerrithub.io/404616 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-03-19 21:05:44 +00:00
spdk_blob_resize() is now an asynchronous operation to enable resizing a blob while I/O
are in progress to that blob on other threads. An explicit spdk_blob_sync_md() is still
required to sync the updated metadata to disk.
lvol: add destroy_lvol_bdev RPC method This is the first step toward fixing the behavior of the lvol bdev module so that it handles spdk_bdev_unregister() correctly. Currently, when an lvol bdev is unregistered, this causes the associated lvol to be deleted; this isn't the desired behavior, since spdk_bdev_unregister() is just meant to drop the currently-exposed bdev, as in a hot-unplug event, not destroy the backing storage. The current implementation of the new destroy_lvol_bdev method still calls into the exsting (broken) spdk_bdev_unregister() path, but this at least lets us fix the existing delete_bdev RPC callers that really intended to destroy the lvol. The next step is to make vbdev_lvol_destroy() call spdk_lvol_destroy() instead of unregistering the bdev, which will require cleanup in the generic lvol layer to remove the close_only flag. Change-Id: Ic4cb51305d31f6d7366a82ba7bf7b19ebbcd3e9c Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/408084 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-11 22:12:13 +00:00
### Logical Volumes
A new `destroy_lvol_bdev` RPC method to delete logical volumes has been added.
doc: changelog update Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Change-Id: Ia2d0c596725c5df239f0e01ac9f10e5b65b02764 Reviewed-on: https://review.gerrithub.io/408825 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Karol Latecki <karol.latecki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 11:11:04 +00:00
Lvols now have their own UUIDs which replace previous LvolStoreUUID_BlobID combination.
doc: fix typos in the doc directory Change-Id: Ifff553ed70ce5aa8e7bdf6d8a8e9e9afb73e8a64 Signed-off-by: Chen Wang <chenx.wang@intel.com> Reviewed-on: https://review.gerrithub.io/423497 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-08-27 08:42:35 +00:00
New Snapshot and Clone functionalities have been added. User may create Snapshots of existing Lvols
doc: changelog update Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Change-Id: Ia2d0c596725c5df239f0e01ac9f10e5b65b02764 Reviewed-on: https://review.gerrithub.io/408825 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Karol Latecki <karol.latecki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 11:11:04 +00:00
and Clones of existing Snapshots.
See the [lvol snapshots](http://www.spdk.io/doc/logical_volumes.html#lvol_snapshots) documentation
for more details.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
Resizing logical volumes is now supported via the `resize_lvol_bdev` RPC method.
lib: Return instead of exit in event Modifies behavior of spdk_app_start() and spdk_app_parse_args() such that they return on failure instead of terminating with exit(). Change-Id: I82566417f04e1ae2e3ca60a00c72e664db26c9e4 Signed-off-by: Lance Hartmann <lance.hartmann@oracle.com> Reviewed-on: https://review.gerrithub.io/401243 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-02-22 23:50:51 +00:00
### Lib
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
A set of changes were made in the SPDK's lib code altering
lib: Return instead of exit in event Modifies behavior of spdk_app_start() and spdk_app_parse_args() such that they return on failure instead of terminating with exit(). Change-Id: I82566417f04e1ae2e3ca60a00c72e664db26c9e4 Signed-off-by: Lance Hartmann <lance.hartmann@oracle.com> Reviewed-on: https://review.gerrithub.io/401243 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-02-22 23:50:51 +00:00
instances of calls to `exit()` and `abort()` to return a failure instead
wherever reasonably possible.
spdk_app_start() no longer exit()'s on an internal failure, but
instead returns a non-zero error status.
spdk_app_parse_args() no longer exit()'s on help, '-h', or an invalid
option, but instead returns SPDK_APP_PARSE_ARGS_HELP and
SPDK_APP_PARSE_ARGS_FAIL, respectively, and SPDK_APP_PARSE_ARGS_SUCCESS
on success.
env: deprecate spdk_pci_get_device() This isn't possible to implement using the current public API of DPDK, and all of the in-tree users have been removed. Replace the implementation with a stub that always returns NULL and mark it deprecated so that any users have a release to update their code. Change-Id: I4bc71f0a9fd518923484e862333b0c5e86883980 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/405710 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-03-28 22:50:52 +00:00
spdk_pci_get_device() has been deprecated and will be removed in SPDK v18.07.
io_channel: add return value to pollers This will be used to track time used in pollers - each poller can now indicate if it found any work to do or not. For cases where it was obvious and the infrastructure was already in place, existing pollers have been modified to return 0 or a positive value to indicate whether work was done. Other pollers have been modified to return -1 by default, indicating that the poller isn't indicating anything about whether work was performed. This will allow us to find un-annotated pollers easily in the future and fix them incrementally. Change-Id: Ifebfa56604a38434fac5c76ba7263267574ff199 Signed-off-by: Roman Sudarikov <roman.sudarikov@intel.com> Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/391042 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2018-03-13 00:16:47 +00:00
### I/O Channels
The prototype for spdk_poller_fn() has been modified; it now returns a value indicating
whether or not the poller did any work. Existing pollers will need to be updated to
return a value.
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
### iSCSI Target
The SPDK iSCSI target now supports the fd.io Vector Packet Processing (VPP) framework userspace
TCP/IP stack. See the [iSCSI VPP documentation](http://www.spdk.io/doc/iscsi.html#vpp) for more
details.
bdev: add iSCSI initiator bdev module This uses libiscsi to implement an iSCSI initiator bdev module for SPDK. Still a lots of work to do on this - posting it in case anyone is interested in working on this further. A number of todo items are listed in a README in the lib/bdev/iscsi directory. Signed-off-by: Jim Harris <james.r.harris@intel.com> Signed-off-by: Ziye Yang <optimistyzy@gmail.com> Change-Id: I060e33de0cd6796246789bf0e1bb4f2df59d8f71 Reviewed-on: https://review.gerrithub.io/390313 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-12-04 17:07:04 +00:00
### iSCSI initiator
An iSCSI initiator bdev module has been added to SPDK. This module should be considered
experimental pending additional features and tests. More details can be found in
lib/bdev/iscsi/README.
bdev/pmem: change all NVML strings to PMDK NVML (Non Volatile Memory Library) changed its name to PMDK (Persistent Memory Development Kit), so make the necessary changes to the SPDK repository. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Id07a87eafb4e9a3099603030c58c0e927bafa608 Reviewed-on: https://review.gerrithub.io/406256 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-03 23:07:39 +00:00
### PMDK
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
The persistent memory (PMDK) bdev module is now enabled using `--with-pmdk` instead of
`--with-nvml`. This reflects the renaming of the persistent memory library from NVML to
bdev/pmem: change all NVML strings to PMDK NVML (Non Volatile Memory Library) changed its name to PMDK (Persistent Memory Development Kit), so make the necessary changes to the SPDK repository. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Id07a87eafb4e9a3099603030c58c0e927bafa608 Reviewed-on: https://review.gerrithub.io/406256 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-03 23:07:39 +00:00
PMDK.
doc/virtio: add Virtio Block doc I decided to use 'Virtio Block' as the title. Virtio spec uses the same name alongside SCSI. ``` 5 Device Types [...] 5.2 Block Device 5.6 SCSI Host Device ``` Also added a CHANGELOG note. Change-Id: Ie2eabd053213da776c78a8d938a621b42e6d5558 Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/408829 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Pawel Wodkowski <pawelx.wodkowski@intel.com> Reviewed-by: Maciej Szwed <maciej.szwed@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 10:17:56 +00:00
### Virtio Block driver
A userspace driver for Virtio Block devices has been added. It was built on top of the
[Virtio](http://www.spdk.io/doc/virtio.html) library and can be managed similarly to
the Virtio SCSI driver. See the
[Virtio Block](http://www.spdk.io/doc/bdev.html#bdev_config_virtio_blk) reference for
more information.
doc/virtio: mention 2MB hugepage support Also updated the CHANGELOG. Change-Id: I9040505f689aab51fc26ab47d5a10438e35f9fc4 Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/408830 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 11:49:13 +00:00
### Virtio with 2MB hugepages
changelog: add bdev QoS and iSCSI VPP support Also tweak some wording and add other minor feature additions. Change-Id: I37f4c97c260e55c62b112b72fb47a316772da3f7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/409223 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-04-26 19:46:22 +00:00
The previous 1GB hugepage limitation has now been lifted. A new `-g` command-line option
doc/virtio: mention 2MB hugepage support Also updated the CHANGELOG. Change-Id: I9040505f689aab51fc26ab47d5a10438e35f9fc4 Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/408830 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-04-24 11:49:13 +00:00
enables SPDK Virtio to work with 2MB hugepages.
See [2MB hugepages](http://www.spdk.io/doc/virtio.html#virtio_2mb) for details.
changelog: add thin provisioning and live migration Change-Id: I939a6f492f4a97994052479b515b63075ff38e0b Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/397272 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-01-30 21:22:20 +00:00
## v18.01: Blobstore Thin Provisioning
build: add 'make install' rule For now, this only installs libraries and headers; we will need to consider which binaries should be installed and what they should be named before we add them to the install rule. Change-Id: I78dc8631f793d0df88cd884b0ac66406df9e4427 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/387637 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-11-15 17:36:36 +00:00
### Build System
The build system now includes a `make install` rule, including support for the common
`DESTDIR` and `prefix` variables as used in other build systems. Additionally, the prefix
may be set via the configure `--prefix` option. Example: `make install prefix=/usr`.
rpc: add default UNIX domain socket listen address RPC is a default feature required for almost all usages, so enable RPC by default, but with a UNIX domain socket for security reasons. -r can now be used from the command line to specify an alternative RPC listen address from the default /var/tmp/spdk.sock. Remove the Enable parameter from the Rpc config section but still allow specifying an alternative listen address using the Listen parameter as an alternative to the command line option. This keeps backward compatibility for this release for anyone using the configuration file still. Remove the Rpc sections from all configuration files that were using them, except for those that specified alternate TCP ports for multi-process test cases. We can fix these later to use an alternate UNIX domain socket and to use the command line instead. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ife0d03fcab638c67b659f1eb85348ddc2b55c4c4 Reviewed-on: https://review.gerrithub.io/386561 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-11-09 23:33:29 +00:00
### RPC
A JSON RPC listener is now enabled by default using a UNIX domain socket at /var/run/spdk.sock.
A -r option command line option has been added to enable an alternative UNIX domain socket location,
or a TCP port in the format ip_addr:tcp_port (i.e. 127.0.0.1:5260). The Rpc configuration file
section is now deprecated and will be removed in the v18.04 release.
event: Move spdk_poller_register to io_channel Make this generic and not directly dependent on the event framework. That way our libraries can register pollers without adding a dependency. Change-Id: I7ad7a7ddc131596ca1791a7b0f43dabfda050f5f Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/387690 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-11-14 20:42:17 +00:00
### I/O Channels
spdk_poller_register() and spdk_poller_unregister() were moved from the event
framework (include/spdk/event.h) to the I/O channel library
(include/spdk/io_channel.h). This allows code that doesn't depend on the event
framework to request registration and unregistration of pollers.
channel: Make spdk_for_each_channel support async operations While iterating, allow the user to perform asynchronous operations. To continue iteration, the user is expected to call spdk_for_each_channel_continue. Change-Id: Ifd7d03d5fbf17cf13843704274b036d49ca0484a Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/391309 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com>
2017-12-11 22:14:19 +00:00
spdk_for_each_channel() now allows asynchronous operations during iteration.
Instead of immediately continuing the interation upon returning from the iteration
callback, the user must call spdk_for_each_channel_continue() to resume iteration.
bdev: Remove poller abstraction Use the new one from io_channel.h. Change-Id: I7bf6729caf6eeebcb58450a36119601957ad5da4 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/388290 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-11-17 21:49:36 +00:00
### Block Device Abstraction Layer (bdev)
The poller abstraction was removed from the bdev layer. There is now a general purpose
abstraction for pollers available in include/spdk/io_channel.h
lib: Return instead of exit/abort in env_dpdk Modifies spdk_env_init() and spdk_mem_map_init() such that they return on failure instead of terminating with exit() or abort(). Change-Id: I054c1d9b2e46516ff53d845328ab9547f54bdbc4 Signed-off-by: Lance Hartmann <lance.hartmann@oracle.com> Reviewed-on: https://review.gerrithub.io/393987 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com>
2017-12-18 19:57:01 +00:00
### Lib
A set of changes were made in the SPDK's lib code altering,
instances of calls to `exit()` and `abort()` to return a failure instead
wherever reasonably possible. This has resulted in return type changes of
the API for:
- spdk_env_init() from type `void` to `int`.
- spdk_mem_map_init() from type `void` to `int`.
Applications making use of these APIs should be modified to check for
a non-zero return value instead of relying on them to fail without return.
Changelog: Add section about hotplug of vfio-attached device. Change-Id: I0a6cd8a1ac4648b06ad057912cafcf97a54bb377 Signed-off-by: Cunyin Chang <cunyin.chang@intel.com> Reviewed-on: https://review.gerrithub.io/390700 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-12-07 00:59:17 +00:00
### NVMe Driver
changelog: modify the log about hotplug of vfio-attached devices. Change-Id: I2f78a42c2a54273b4c117cab0794901df60b0874 Signed-off-by: Cunyin Chang <cunyin.chang@intel.com> Reviewed-on: https://review.gerrithub.io/391341 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-12-12 06:25:32 +00:00
SPDK now supports hotplug for vfio-attached devices. But there is one thing keep in mind:
Only physical removal events are supported; removing devices via the sysfs `remove` file will not work.
Changelog: Add section about hotplug of vfio-attached device. Change-Id: I0a6cd8a1ac4648b06ad057912cafcf97a54bb377 Signed-off-by: Cunyin Chang <cunyin.chang@intel.com> Reviewed-on: https://review.gerrithub.io/390700 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-12-07 00:59:17 +00:00
nvmf: No longer tie subsystems to CPU cores The "Core" parameter in the configuration file has been removed. New connections are handed out to available cores using round-robin. Change-Id: I24527fa22a0b2738ebbf5fb030e3bb373ead5da2 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/388295 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-11-20 18:36:36 +00:00
### NVMe-oF Target
Subsystems are no longer tied explicitly to CPU cores. Instead, connections are handed out to the available
cores round-robin. The "Core" option in the configuration file has been removed.
blob: rename spdk blob metadata functions spdk_bs_md_resize_blob => spdk_blob_resize spdk_bs_md_sync_blob => spdk_blob_sync_md spdk_bs_md_get_xattr_value => spdk_blob_get_xattr_value spdK_bs_md_get_xattr_names => spdk_blob_get_xattr_names spdk_blob_md_set_xattr => spdk_blob_set_xattr spdk_blob_md_remove_xattr => spdk_blob_remove_xattr spdk_bs_md_close_blob => spdk_blob_close Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I99b593c03bc61354ba6aa5a446b0fc82df1e9ce2 Reviewed-on: https://review.gerrithub.io/391006 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-12-08 16:38:33 +00:00
### Blobstore
A number of functions have been renamed:
changelog: make blobstore API changes a list Also add parentheses to function names so they will get auto-linked (once these functions have Doxygen comments). Change-Id: Iba19bd60dc5ea9d2120234e185a7ca3e6604e177 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/393818 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-01-05 18:24:03 +00:00
- spdk_bs_md_resize_blob() => spdk_blob_resize()
- spdk_bs_md_sync_blob() => spdk_blob_sync_md()
- spdk_bs_md_close_blob() => spdk_blob_close()
- spdk_bs_md_get_xattr_names() => spdk_blob_get_xattr_names()
- spdk_bs_md_get_xattr_value() => spdk_blob_get_xattr_value()
- spdk_blob_md_set_xattr() => spdk_blob_set_xattr()
- spdk_blob_md_remove_xattr() => spdk_blob_remove_xattr()
- spdk_bs_md_create_blob() => spdk_bs_create_blob()
- spdk_bs_md_open_blob() => spdk_bs_open_blob()
- spdk_bs_md_delete_blob() => spdk_bs_delete_blob()
- spdk_bs_md_iter_first() => spdk_bs_iter_first()
- spdk_bs_md_iter_next() => spdk_bs_iter_next()
The function signature of spdk_blob_close() has changed. It now takes a struct spdk_blob * argument
blob: change spdk_blob_close parameter to spdk_blob * Using the ** paradigm is a bit problematic for asynchronous routines that could fail. Currently we were inconsistent in that some error paths would zero the pointer while others did not. So make this just a plain pointer, which simplifies the API and its implementation. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I67147931c6e8350896a4505022a6a314655de3d3 Reviewed-on: https://review.gerrithub.io/391482 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-12-12 20:42:56 +00:00
rather than struct spdk_blob **.
changelog: make blobstore API changes a list Also add parentheses to function names so they will get auto-linked (once these functions have Doxygen comments). Change-Id: Iba19bd60dc5ea9d2120234e185a7ca3e6604e177 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/393818 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-01-05 18:24:03 +00:00
The function signature of spdk_bs_iter_next() has changed. It now takes a struct spdk_blob * argument
blob: change spdk_bs_iter_next parameter to spdk_blob * Similar to previous change, the ** paradigm is a bit problematic for asynchronous routines that could fail. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ife7748280482356c4c51a796817b71cd7bc7e479 Reviewed-on: https://review.gerrithub.io/391483 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-12-12 20:53:10 +00:00
rather than struct spdk_blob **.
changelog: add thin provisioning and live migration Change-Id: I939a6f492f4a97994052479b515b63075ff38e0b Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/397272 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-01-30 21:22:20 +00:00
Thin provisioning support has been added to the blobstore. It can be enabled by setting the
`thin_provision` flag in struct spdk_blob_opts when calling spdk_bs_create_blob_ext().
nbd: remove nbd test app nbd functionality now can be gotten by nbd rpc. Change-Id: I85ebcb44d9ed263bcee19162dc060f3b268dddcd Signed-off-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/391371 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-12-12 09:53:18 +00:00
### NBD device
The NBD application (test/lib/bdev/nbd) has been removed; Same functionality can now be
achieved by using the test/app/bdev_svc application and start_nbd_disk RPC method.
See the [GPT](http://www.spdk.io/doc/bdev.html#bdev_config_gpt) documentation for more details.
CHANGELOG: add fio 3.3 support Change-Id: I650d5cdb6237d1e74edbaa5d80a6c9eaeaa65a7f Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/394382 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-01-11 13:35:35 +00:00
### FIO plugin
doc: fix typos in the doc directory Change-Id: Ifff553ed70ce5aa8e7bdf6d8a8e9e9afb73e8a64 Signed-off-by: Chen Wang <chenx.wang@intel.com> Reviewed-on: https://review.gerrithub.io/423497 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Chandler-Test-Pool: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-08-27 08:42:35 +00:00
SPDK `fio_plugin` now supports FIO 3.3. The support for previous FIO 2.21 has been dropped,
CHANGELOG: add fio 3.3 support Change-Id: I650d5cdb6237d1e74edbaa5d80a6c9eaeaa65a7f Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/394382 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2018-01-11 13:35:35 +00:00
although it still remains to work for now. The new FIO contains huge amount of bugfixes and
it's recommended to do an update.
CHANGELOG: added Virtio library Change-Id: Ifed877fdbcbac855c41f94d13f1cf57f637d97ee Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/394518 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2018-01-12 14:21:48 +00:00
### Virtio library
Previously a part of the bdev_virtio module, now a separate library. Virtio is now available
via `spdk_internal/virtio.h` file. This is an internal interface to be used when implementing
new Virtio backends, namely Virtio-BLK.
iscsi: remove idle connection handling Some upcoming changes will effectively render this moot anyways by adding an epoll/kqueue descriptor to poll on in all cases (not just connections that have been idle for 5ms). The epoll/kqueue code was just ifdef'd out instead of removed - some of this code will be useful and reusable with minimal changes in the upcoming patches. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I0c354390537e6369cb3c32e78a59c300dec6d098 Reviewed-on: https://review.gerrithub.io/395553 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: <shuhei.matsumoto.xt@hitachi.com>
2018-01-19 18:15:38 +00:00
### iSCSI
The MinConnectionIdleInterval parameter has been removed, and connections are no longer migrated
to an epoll/kqueue descriptor on the master core when idle.
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
## v17.10: Logical Volumes
bdev: Add an example fio plugin Change-Id: I5e0ebb8d452a41ad848b319af9bb978546807d5e Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/366495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-06-06 17:24:07 +00:00
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
### New dependencies
lvol: Logical volume implementation Change-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Reviewed-on: https://review.gerrithub.io/375392 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-14 14:53:36 +00:00
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
libuuid was added as new dependency for logical volumes.
libnuma is now required unconditionally now that the DPDK submodule has been updated to DPDK 17.08.
lvol: Logical volume implementation Change-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Reviewed-on: https://review.gerrithub.io/375392 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-14 14:53:36 +00:00
Fix up merge conflicts in the CHANGELOG There were a number of unflagged merge conflicts in the CHANGELOG that resulted in duplicated sections and notes being out of place. Clean them up. Change-Id: I88a590fad9d8812554665102e764bdaeccaea827 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/374714 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-08-17 18:45:43 +00:00
### Block Device Abstraction Layer (bdev)
bdev_nvme: disable hotplug feature by default When users don't enable hotplug option in their configuration section, SPDK will enable it by default. DPDK will print probing messages continuously for NVMe devices which don't belong to SPDK. Change-Id: I8c43335a282ecba206b4b5305bd881d2bd07836e Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.gerrithub.io/374486 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: GangCao <gang.cao@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-17 14:18:52 +00:00
bdev: Add an example fio plugin Change-Id: I5e0ebb8d452a41ad848b319af9bb978546807d5e Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/366495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-06-06 17:24:07 +00:00
An [fio](http://github.com/axboe/fio) plugin was added that can route
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
I/O to the bdev layer. See the [plugin documentation](https://github.com/spdk/spdk/tree/master/examples/bdev/fio_plugin/)
bdev: Add an example fio plugin Change-Id: I5e0ebb8d452a41ad848b319af9bb978546807d5e Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/366495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-06-06 17:24:07 +00:00
for more information.
bdev: Change unmap to use offset/len instead of descriptors This is far simpler, although it does limit the bdev layer to unmapped just one range per command. In practice, all of our code reports limits of just one range per command anyway. Change-Id: I99247ab349fe85b9925769e965833b06708d0d70 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/370382 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-07-19 21:32:04 +00:00
spdk_bdev_unmap() was modified to take an offset and a length in bytes as
arguments instead of requiring the user to provide an array of SCSI
unmap descriptors. This limits unmaps to a single contiguous range.
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
spdk_bdev_write_zeroes() was introduced. It ensures that all specified blocks will be zeroed out.
If a block device doesn't natively support a write zeroes command, the bdev layer emulates it using
write commands.
bdev: add write_zeroes function Add functionality to the bdev layer to handle the nvme write_zeroes function. Change-Id: I0dadad273b28c16db5a2275f7d8d57e98253a8d3 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/372171 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-08-01 18:28:29 +00:00
bdev: introduce APIs with block units Add new versions of all of the I/O calls that take parameters in blocks instead of bytes. These are intended to replace the old APIs, but we'll keep them for now to preserve compatibility. Change-Id: I85ab665c653e8c697016c628837d49aa0c3bfcd0 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/376255 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com>
2017-08-28 21:55:35 +00:00
New API functions that accept I/O parameters in units of blocks instead of bytes
have been added:
- spdk_bdev_read_blocks(), spdk_bdev_readv_blocks()
- spdk_bdev_write_blocks(), spdk_bdev_writev_blocks()
- spdk_bdev_write_zeroes_blocks()
- spdk_bdev_unmap_blocks()
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
The bdev layer now handles temporary out-of-memory I/O failures internally by queueing the I/O to be
retried later.
bdev/aio: allow user to override block size Add a file-backed AIO bdev to test it out. Change-Id: Ifdf206bbdf6cae9379fdc02c80755e96a7198bce Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/373673 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-10 00:28:32 +00:00
### Linux AIO bdev
The AIO bdev now allows the user to override the auto-detected block size.
nvme: add support for NS Optimal IO Boundary An optional field was added in NVMe 1.3 to indicate the optimal I/O boundary that should not be crossed for best performance. This is equivalent to the existing Intel-specific stripe size quirk. Add support for the new NOIOB field and move the current quirk-based code so it is updated in nvme_ns_identify_update(). Change-Id: Ifc4974f51dcd59e7f24565d8d5159b036458c6e5 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/373132 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-07 17:17:29 +00:00
### NVMe driver
The NVMe driver now recognizes the NVMe 1.3 Namespace Optimal I/O Boundary field.
NVMe 1.3 devices may report an optimal I/O boundary, which the driver will take
into account when splitting I/O requests.
Fix up merge conflicts in the CHANGELOG There were a number of unflagged merge conflicts in the CHANGELOG that resulted in duplicated sections and notes being out of place. Clean them up. Change-Id: I88a590fad9d8812554665102e764bdaeccaea827 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/374714 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-08-17 18:45:43 +00:00
The HotplugEnable option in `[Nvme]` sections of the configuration file is now
"No" by default. It was previously "Yes".
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
The NVMe library now includes a spdk_nvme_ns_get_ctrlr() function which returns the
lib/nvme: Add spdk_nvme_ns_get_ctrlr to the public api This can be used in callbacks when a user has a namespace but needs to call controller specific functions such as alloc_io_qpair. Change-Id: I00c931e2846e42f540c17f3254fe97a45e9bd079 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/375022 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-21 17:32:22 +00:00
NVMe Controller associated with a given namespace.
nvme: add controller option to specify host ID A random host ID is generated per SPDK application startup if the user doesn't specify a host ID during controller startup. This also changes the default host NQN for NVMe-oF connections to a random UUID NQN based on the host ID. Change-Id: Ib0f70dd63e53087716842b412a1f134a9991d4da Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/380528 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2017-09-27 17:52:47 +00:00
The NVMe library now allows the user to specify a host identifier when attaching
to a controller. The host identifier is used as part of the Reservations feature,
as well as in the NVMe-oF Connect command. The default host ID is also now a
randomly-generated UUID, and the default host NQN uses the host ID to generate
a UUID-based NQN.
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
spdk_nvme_connect() was added to allow the user to connect directly to a single
NVMe or NVMe-oF controller.
nvmf: add AllowAnyHost option to subsystems The previous behavior with an empty host NQN whitelist was to allow any host to connect. Change-Id: I5401e52d96642cf20afe0d50c692613e67262edf Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/376432 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-30 20:21:12 +00:00
### NVMe-oF Target (nvmf_tgt)
nvmf: No longer use in capsule data buffers for CONNECT Previously, the shared buffer pools were allocated on the nvmf controllers. When a new connection was established, the CONNECT command needs a 4k buffer, but we didn't know which nvmf controller it belonged to until after the CONNECT command completed. So there was a special case for CONNECT that used in capsule data buffers instead. Now, the buffer pool is global and always available. We can just use that always, with no more special cases. This has the additional nice side effect of allowing users to run the target with no in capsule data buffers allocated at all. Change-Id: I974289f646947651c58d65cf898571d80e9dee9b Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/374360 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-08-15 21:55:41 +00:00
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
The NVMe-oF target no longer requires any in-capsule data buffers to run, and
the feature is now entirely optional. Previously, at least 4 KiB in-capsule
nvmf: No longer use in capsule data buffers for CONNECT Previously, the shared buffer pools were allocated on the nvmf controllers. When a new connection was established, the CONNECT command needs a 4k buffer, but we didn't know which nvmf controller it belonged to until after the CONNECT command completed. So there was a special case for CONNECT that used in capsule data buffers instead. Now, the buffer pool is global and always available. We can just use that always, with no more special cases. This has the additional nice side effect of allowing users to run the target with no in capsule data buffers allocated at all. Change-Id: I974289f646947651c58d65cf898571d80e9dee9b Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/374360 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-08-15 21:55:41 +00:00
data buffers were required.
nvmf: add AllowAnyHost option to subsystems The previous behavior with an empty host NQN whitelist was to allow any host to connect. Change-Id: I5401e52d96642cf20afe0d50c692613e67262edf Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/376432 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-30 20:21:12 +00:00
NVMe-oF subsytems have a new configuration option, AllowAnyHost, to control
whether the host NQN whitelist is enforced when accepting new connections.
If no Host options have been specified and AllowAnyHost is disabled, the
connection will be denied; this is a behavior change from previous releases,
which allowed any host NQN to connect if the Host list was empty.
AllowAnyHost is disabled by default.
nvmf: allow user to specify NSID via conf and RPC The nvmf library now supports the ability to assign arbitrary NSIDs, rather than automatically assigning the next one in line. Expose this functionality to the user via the configuration file and RPC interfaces. Change-Id: Ia85a9a6dfe31a2cd0605c7a6c098eec0c1b7de68 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/376463 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-30 23:55:48 +00:00
NVMe-oF namespaces may now be assigned arbitrary namespace IDs, and the number
of namespaces per subsystem is no longer limited.
nvmf: add Write Zeroes support Change-Id: I743f5e4d1c24ad5ef9f1fef4c2678e347b179a9f Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/377260 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-06 00:26:14 +00:00
The NVMe-oF target now supports the Write Zeroes command.
env: Add a default value for mempool cache size This is just a convenience and replaces the common practice of passing -1. Change-Id: Id96734307ebf52ef0ee7dba0e7ac89602b2b5b1a Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.gerrithub.io/374520 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-16 17:05:24 +00:00
### Environment Abstraction Layer
A new default value, SPDK_MEMPOOL_DEFAULT_CACHE_SIZE, was added to provide
additional clarity when constructing spdk_mempools. Previously, -1 could be
passed and the library would choose a reasonable default, but this new value
makes it explicit that the default is being used.
blob: add readv/writev support Most of the work here revolves around having to split an I/O that spans a cluster boundary. In this case we need to allocate a separate iov array, and then issue each sub-I/O serially, copying the relevant subset of the original iov array. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I0d46b3f832245900d109ee6c78cc6d49cf96428b Reviewed-on: https://review.gerrithub.io/374880 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-18 16:41:26 +00:00
### Blobstore
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
The blobstore super block now contains a bstype field to identify the type of the blobstore.
Existing code should be updated to fill out bstype when calling spdk_bs_init() and spdk_bs_load().
blobstore: New API call to destroy blobstore [1/3] Currently exposed API allows to load/unload and to initialize blobstore on a device. A spdk_bs_destroy() call is added in order to reach functional parity with spdk_bs_init(). It was not possible to remove blobstore from device from within SPDK previously. spdk_bs_destroy() takes blobstore pointer as argument (instead of bs_dev), because blobstore has to be already loaded to destroy it. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I2c493a4407868fcf08fd1766a19fc8463f634ef5 Reviewed-on: https://review.gerrithub.io/382019 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-10-20 12:52:19 +00:00
spdk_bs_destroy() was added to allow destroying blobstore on device
with an initialized blobstore.
blob: add readv/writev support Most of the work here revolves around having to split an I/O that spans a cluster boundary. In this case we need to allocate a separate iov array, and then issue each sub-I/O serially, copying the relevant subset of the original iov array. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I0d46b3f832245900d109ee6c78cc6d49cf96428b Reviewed-on: https://review.gerrithub.io/374880 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-18 16:41:26 +00:00
spdk_bs_io_readv_blob() and spdk_bs_io_writev_blob() were added to enable
scattered payloads.
lib/nvme: Add spdk_nvme_ns_get_ctrlr to the public api This can be used in callbacks when a user has a namespace but needs to call controller specific functions such as alloc_io_qpair. Change-Id: I00c931e2846e42f540c17f3254fe97a45e9bd079 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/375022 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-21 17:32:22 +00:00
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
A CLI tool for blobstore has been added, allowing basic operations through either command
line or shell interface. See the [blobcli](https://github.com/spdk/spdk/tree/master/examples/blob/cli)
documentation for more details.
blobcli: add interactive shell mode All of the same commands and options are available but by starting with the -S option the user enters an interactive shell mode to interact with blobstore significantly improving response time by only having to init DPDK and NVMe subsystems one time. Change-Id: Ib927ba0848166dba1090484cecbbcf011122b714 Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/380833 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-09-29 20:11:15 +00:00
io_channel: allow user to provide a thread name This moves the thread name setting code into the generic SPDK thread setup code, so now all spdk_threads can be named, not just ones created by the event framework. Change-Id: I6c824cf4bcf12fe64a8e2fc7cdc2d6c949021e40 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/375220 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-22 20:06:57 +00:00
### Event Framework
The ability to set a thread name, previously only used by the reactor code, is
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
now part of the spdk_thread_allocate() API. Users may specify a thread name
io_channel: allow user to provide a thread name This moves the thread name setting code into the generic SPDK thread setup code, so now all spdk_threads can be named, not just ones created by the event framework. Change-Id: I6c824cf4bcf12fe64a8e2fc7cdc2d6c949021e40 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/375220 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-22 20:06:57 +00:00
which will show up in tools like `gdb`.
log: add new parm to spdk_trace_dump() Allows called to specify something other than stderr such as stdout. Existing callers updated to use stderr. Change-Id: I48a703e1474a45952878121a83c19fef1c43d630 Signed-off-by: Paul Luse <paul.e.luse@intel.com> Reviewed-on: https://review.gerrithub.io/377420 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-06 20:17:54 +00:00
### Log
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
The spdk_trace_dump() function now takes a new parameter to allow the caller to
specify an output file handle (stdout or stderr, for example).
io_channel: allow user to provide a thread name This moves the thread name setting code into the generic SPDK thread setup code, so now all spdk_threads can be named, not just ones created by the event framework. Change-Id: I6c824cf4bcf12fe64a8e2fc7cdc2d6c949021e40 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/375220 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-08-22 20:06:57 +00:00
lvol: Logical volume implementation Change-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Reviewed-on: https://review.gerrithub.io/375392 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-14 14:53:36 +00:00
### Logical Volumes
Logical volumes library built on top of SPDK blobstore has been added.
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
It is possible to create logical volumes on top of other devices using RPC.
lvol: Logical volume implementation Change-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Reviewed-on: https://review.gerrithub.io/375392 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-14 14:53:36 +00:00
lvol: updated documentation. Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Change-Id: I566a4d277ac1595fa7b4d630df52301a9abeec49 Reviewed-on: https://review.gerrithub.io/381629 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-10-06 07:27:23 +00:00
See the [logical volumes](http://www.spdk.io/doc/logical_volumes.html) documentation for more information.
lvol: Logical volume implementation Change-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430 Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Signed-off-by: Maciej Szwed <maciej.szwed@intel.com> Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Reviewed-on: https://review.gerrithub.io/375392 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-14 14:53:36 +00:00
bdev_pmem: documentation This patch adds documentation adn test plan for PMEM functional tests Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Change-Id: Ia2e8bcb9901ab216c3e45d2db6d06a3a02fdd308 Reviewed-on: https://review.gerrithub.io/378618 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-26 13:21:38 +00:00
### Persistent Memory
changelog: clean up and fill out v17.10 details Change-Id: Iafe021f5d7e38bfea8cefd297439e33efe8a1e4e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/383495 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 18:07:48 +00:00
A new persistent memory bdev type has been added.
The persistent memory block device is built on top of [libpmemblk](http://pmem.io/nvml/libpmemblk/).
It is possible to create pmem devices on top of pmem pool files using RPC.
See the [Pmem Block Device](http://www.spdk.io/doc/bdev.html#bdev_config_pmem) documentation for more information.
bdev_pmem: documentation This patch adds documentation adn test plan for PMEM functional tests Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Change-Id: Ia2e8bcb9901ab216c3e45d2db6d06a3a02fdd308 Reviewed-on: https://review.gerrithub.io/378618 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-26 13:21:38 +00:00
changelog: add virtio-initiator Change-Id: I7fb7adb2d7ffdd4e99544a9b96c4342dde9b840e Signed-off-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-on: https://review.gerrithub.io/383502 Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2017-10-23 20:01:04 +00:00
### Virtio SCSI driver
A userspace driver for Virtio SCSI devices has been added.
The driver is capable of creating block devices on top of LUNs exposed by another SPDK vhost-scsi application.
See the [Virtio SCSI](http://www.spdk.io/doc/virtio.html) documentation and [Getting Started](http://www.spdk.io/doc/bdev.html#bdev_config_virtio_scsi) guide for more information.
changelog: add thin provisioning and live migration Change-Id: I939a6f492f4a97994052479b515b63075ff38e0b Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/397272 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Dariusz Stojaczyk <dariuszx.stojaczyk@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK Automated Test System <sys_sgsw@intel.com>
2018-01-30 21:22:20 +00:00
### Vhost target
The vhost target application now supports live migration between QEMU instances.
bdev_pmem: documentation This patch adds documentation adn test plan for PMEM functional tests Signed-off-by: Piotr Pelplinski <piotr.pelplinski@intel.com> Change-Id: Ia2e8bcb9901ab216c3e45d2db6d06a3a02fdd308 Reviewed-on: https://review.gerrithub.io/378618 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2017-09-26 13:21:38 +00:00
changelog: fill out release summary line Change-Id: Id038a1ba5c050ac4aa3fe5b621fe2f5968bd74c5 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/369912 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-07-17 23:46:33 +00:00
## v17.07: Build system improvements, userspace vhost-blk target, and GPT bdev
changelog: begin filling out v17.07 section Change-Id: I83813557d33e34be13dab543ab513127b568bf80 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/362044 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-05-17 23:28:02 +00:00
### Build System
A `configure` script has been added to simplify the build configuration process.
The existing CONFIG file and `make CONFIG_...` options are also still supported.
Run `./configure --help` for information about available configuration options.
A DPDK submodule has been added to make building SPDK easier. If no `--with-dpdk`
option is specified to configure, the SPDK build system will automatically build a
known-good configuration of DPDK with the minimal options enabled. See the Building
section of README.md for more information.
A [Vagrant](https://www.vagrantup.com/) setup has been added to make it easier to
develop and use SPDK on systems without suitable NVMe hardware. See the Vagrant
section of README.md for more information.
changelog: add vhost-blk, GPT Change-Id: Iedae857cba4d69278013c31395515062bfa2f829 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/367741 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-06-30 21:26:37 +00:00
### Userspace vhost-blk target
The vhost library and example app have been updated to support the vhost-blk
protocol in addition to the existing vhost-scsi protocol.
See the [vhost documentation](http://www.spdk.io/doc/vhost.html) for more details.
### Block device abstraction layer (bdev)
A GPT virtual block device has been added, which automatically exposes GPT partitions
with a special SPDK-specific partition type as bdevs.
See the [GPT bdev documentation](http://www.spdk.io/doc/bdev.md#bdev_config_gpt) for
more information.
changelog: begin filling out v17.07 section Change-Id: I83813557d33e34be13dab543ab513127b568bf80 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/362044 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-05-17 23:28:02 +00:00
### NVMe driver
The NVMe driver has been updated to support recent Intel SSDs, including the Intel®
Optane™ SSD DC P4800X series.
A workaround has been added for devices that failed to recognize register writes
during controller reset.
The NVMe driver now allocates request tracking objects on a per-queue basis. The
number of requests allowed on an I/O queue may be set during `spdk_nvme_probe()` by
modifying `io_queue_requests` in the opts structure.
The SPDK NVMe `fio_plugin` has been updated to support multiple threads (`numjobs`).
nvme: add I/O qpair creation options Add a new struct spdk_nvme_io_qpair_opts to allow the user to override controller options on a per-I/O qpair basis. Existing callers with qprio == 0 can be updated to: ... = spdk_nvme_ctrlr_alloc_io_qpair(ctrlr, NULL, 0); Callers that need to specify a non-default qprio should be updated to: struct spdk_nvme_io_qpair_opts opts; spdk_nvme_ctrlr_get_default_io_qpair_opts(ctrlr, &opts, sizeof(opts)); opts.qprio = SPDK_NVME_QPRIO_...; ... = spdk_nvme_ctrlr_alloc_io_qpair(ctrlr, &opts, sizeof(opts)); Change-Id: I8ac3ea369535cfde759abbe75e1d974b6450a800 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/369676 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-07-14 23:08:05 +00:00
spdk_nvme_ctrlr_alloc_io_qpair() has been modified to allow the user to override
controller-level options for each individual I/O queue pair.
Existing callers with qprio == 0 can be updated to:
~~~
... = spdk_nvme_ctrlr_alloc_io_qpair(ctrlr, NULL, 0);
~~~
Callers that need to specify a non-default qprio should be updated to:
~~~
struct spdk_nvme_io_qpair_opts opts;
spdk_nvme_ctrlr_get_default_io_qpair_opts(ctrlr, &opts, sizeof(opts));
opts.qprio = SPDK_NVME_QPRIO_...;
... = spdk_nvme_ctrlr_alloc_io_qpair(ctrlr, &opts, sizeof(opts));
~~~
changelog: begin filling out v17.07 section Change-Id: I83813557d33e34be13dab543ab513127b568bf80 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/362044 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-05-17 23:28:02 +00:00
### Environment Abstraction Layer
The environment abstraction layer has been updated to include several new functions
in order to wrap additional DPDK functionality. See `include/spdk/env.h` for the
current set of functions.
changelog: add a note about VTune integration This was added in SPDK v17.07, but the changelog wasn't updated. Change-Id: I897d8c578c1506bbd022b6cde00736f854da6d6f Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com> Reviewed-on: https://review.gerrithub.io/373633 Tested-by: SPDK Automated Test System <sys_sgsw@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2017-08-09 16:46:14 +00:00
### SPDK Performance Analysis with Intel® VTune™ Amplifier
Support for SPDK performance analysis has been added to Intel® VTune™ Amplifier 2018.
This analysis provides:
- I/O performance monitoring (calculating standard I/O metrics like IOPS, throughput, etc.)
- Tuning insights on the interplay of I/O and compute devices by estimating how many cores
would be reasonable to provide for SPDK to keep up with a current storage workload.
See the VTune Amplifier documentation for more information.
changelog: add blobstore and vhost Change-Id: Ie07c165e6a3d6c231e3703d25303e67a1ba7fb5e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-03-28 18:31:03 +00:00
## v17.03: Blobstore and userspace vhost-scsi target
### Blobstore and BlobFS
The blobstore is a persistent, power-fail safe block allocator designed to be
used as the local storage system backing a higher-level storage service.
See the [blobstore documentation](http://www.spdk.io/doc/blob.html) for more details.
BlobFS adds basic filesystem functionality like filenames on top of the blobstore.
This release also includes a RocksDB Env implementation using BlobFS in place of the
kernel filesystem.
See the [BlobFS documentation](http://www.spdk.io/doc/blobfs.html) for more details.
### Userspace vhost-scsi target
A userspace implementation of the QEMU vhost-scsi protocol has been added.
The vhost target is capable of exporting SPDK bdevs to QEMU-based VMs as virtio devices.
doc: link to vhost docs from readme and changelog Change-Id: Ia12de190c5b6c42d1a52dafc5fbab9de93913037 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-03-29 23:01:32 +00:00
See the [vhost documentation](http://www.spdk.io/doc/vhost.html) for more details.
changelog: begin filling out the next release Change-Id: Ie8478974fe8cc8acb7b5823a4c75fe68aef7e882 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-16 00:14:02 +00:00
### Event framework
The overhead of the main reactor event loop was reduced by optimizing the number of
calls to spdk_get_ticks() per iteration.
### NVMe library
The NVMe library will now automatically split readv/writev requests with scatter-gather
lists that do not map to valid PRP lists when the NVMe controller does not natively
support SGLs.
The `identify` and `perf` NVMe examples were modified to add a consistent format for
specifying remote NVMe over Fabrics devices via the `-r` option.
This is implemented using the new `spdk_nvme_transport_id_parse()` function.
conf: No longer allow wildcard claiming of NVMe devices All devices must be specified by BDF. Add support for scripts to use lspci to grab the available NVMe device BDFs for the current machine. Change-Id: I4a53b335e3d516629f050ae1b2ab7aff8dd7f568 Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2017-01-25 23:36:40 +00:00
### iSCSI Target
The [Nvme] section of the configuration file was modified to remove the `BDF` directive
and replace it with a `TransportID` directive. Both local (PCIe) and remote (NVMe-oF)
devices can now be specified as the backing block device. A script to generate an
entire [Nvme] section based on the local NVMe devices attached was added at
`scripts/gen_nvme.sh`.
### NVMe-oF Target
The [Nvme] section of the configuration file was modified to remove the `BDF` directive
and replace it with a `TransportID` directive. Both local (PCIe) and remote (NVMe-oF)
devices can now be specified as the backing block device. A script to generate an
entire [Nvme] section based on the local NVMe devices attached was added at
`scripts/gen_nvme.sh`.
changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
## v16.12: NVMe over Fabrics host, hotplug, and multi-process
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
### NVMe library
changelog: document nvme request_mempool change Change-Id: I397a5a7871545e5e401bce0926c3f3a4365aab05 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-10-04 17:23:07 +00:00
The NVMe library has been changed to create its own request memory pool rather than
requiring the user to initialize the global `request_mempool` variable. Apps can be
updated by simply removing the initialization of `request_mempool`. Since the NVMe
library user no longer needs to know the size of the internal NVMe request
structure to create the pool, the `spdk_nvme_request_size()` function was also removed.
changelog: deallocate to dataset management change Change-Id: I2417a23e0ce71476035779022a51fbcca3dff838 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-10-04 23:01:34 +00:00
The `spdk_nvme_ns_cmd_deallocate()` function was renamed and extended to become
`spdk_nvme_ns_cmd_dataset_management()`, which allows access to all of the NVMe
Dataset Management command's parameters. Existing callers can be updated to use
`spdk_nvme_ns_cmd_dataset_management()` with `SPDK_NVME_DSM_ATTR_DEALLOCATE` as the
`type` parameter.
nvme: return virtual address in SGL callback Instead of the next_sge callback returning the physical address directly, make it return the virtual address and convert to physical address inside the NVMe library. This is necessary for NVMe over Fabrics host support, since the RDMA userspace API requires virtual addresses rather than physical addresses. It is also more consistent with the normal non-SGL NVMe functions that already take virtual addresses. Change-Id: I79a7af64ead987535f6bf3057b2b22aef3171c5b Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-11-03 17:12:16 +00:00
The NVMe library SGL callback prototype has been changed to return virtual addresses
rather than physical addresses. Callers of `spdk_nvme_ns_cmd_readv()` and
`spdk_nvme_ns_cmd_writev()` must update their `next_sge_fn` callbacks to match.
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
The NVMe library now supports NVMe over Fabrics devices in addition to the existing
support for local PCIe-attached NVMe devices. For an example of how to enable
NVMe over Fabrics support in an application, see `examples/nvme/identify` and
`examples/nvme/perf`.
Hot insert/remove support for NVMe devices has been added. To enable NVMe hotplug
support, an application should call the `spdk_nvme_probe()` function on a regular
basis to probe for new devices (reported via the existing `probe_cb` callback) and
removed devices (reported via a new `remove_cb` callback). Hotplug is currently
only supported on Linux with the `uio_pci_generic` driver, and newly-added NVMe
devices must be bound to `uio_pci_generic` by an external script or tool.
changelog: add bdev changes and NVMe multi-process Change-Id: Ib68feab08123d6b631a506cd9024c39eb36c5832 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-13 00:26:58 +00:00
Multiple processes may now coordinate and use a single NVMe device simultaneously
using [DPDK Multi-process Support](http://dpdk.org/doc/guides/prog_guide/multi_proc_support.html).
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
### NVMe over Fabrics target (`nvmf_tgt`)
The `nvmf_tgt` configuration file format has been updated significantly to enable
new features. See the example configuration file `etc/spdk/nvmf.conf.in` for
more details on the new and changed options.
The NVMe over Fabrics target now supports virtual mode subsystems, which allow the
user to export devices from the SPDK block device abstraction layer as NVMe over
Fabrics subsystems. Direct mode (raw NVMe device access) is also still supported,
and a single `nvmf_tgt` may export both types of subsystems simultaneously.
changelog: add bdev changes and NVMe multi-process Change-Id: Ib68feab08123d6b631a506cd9024c39eb36c5832 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-13 00:26:58 +00:00
### Block device abstraction layer (bdev)
The bdev layer now supports scatter/gather read and write I/O APIs, and the NVMe
blockdev driver has been updated to support scatter/gather. Apps can use the
new scatter/gather support via the `spdk_bdev_readv()` and `spdk_bdev_writev()`
functions.
The bdev status returned from each I/O has been extended to pass through NVMe
or SCSI status codes directly in cases where the underlying device can provide
a more specific status code.
A Ceph RBD (RADOS Block Device) blockdev driver has been added. This allows the
`iscsi_tgt` and `nvmf_tgt` apps to export Ceph RBD volumes as iSCSI LUNs or
NVMe namespaces.
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
### General changes
`libpciaccess` has been removed as a dependency and DPDK PCI enumeration is
Drop libpciaccess and switch to DPDK PCI This patch also drops support for automatically unbinding devices from the kernel - run scripts/setup.sh first. Our generic pci interface is now hidden behind include/spdk/pci.h and implemented in lib/util/pci.c. We no longer wrap the calls in nvme_impl.h or ioat_impl.h. The implementation now only uses DPDK and the libpciaccess dependency has been removed. If using a version of DPDK earlier than 16.07, enumerating devices by class code isn't available and only Intel SSDs will be discovered. DPDK 16.07 adds enumeration by class code and all NVMe devices will be correctly discovered. Change-Id: I0e8bac36b5ca57df604a2b310c47342c67dc9f3c Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-08 22:57:49 +00:00
used instead. Prior to DPDK 16.07 enumeration by class code was not supported,
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
so for earlier DPDK versions, only Intel SSD DC P3x00 devices will be discovered
by the NVMe library.
The `env` environment abstraction library has been introduced, and a default
DPDK-based implementation is provided as part of SPDK. The goal of the `env`
layer is to enable use of alternate user-mode memory allocation and PCI access
doc: move porting guide into doc/ and add to index This moves all the documentation under the doc/ tree for consistency. Replace the link to include/spdk/env.h to raw text - the Doxygen Markdown parser will automatically turn it into a link since it is a Doxygen input file. Change-Id: If6bde1cfc965cada2c741acd5505026545ad4cf7 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-01-17 23:23:28 +00:00
libraries. See `doc/porting.md` for more details.
Drop libpciaccess and switch to DPDK PCI This patch also drops support for automatically unbinding devices from the kernel - run scripts/setup.sh first. Our generic pci interface is now hidden behind include/spdk/pci.h and implemented in lib/util/pci.c. We no longer wrap the calls in nvme_impl.h or ioat_impl.h. The implementation now only uses DPDK and the libpciaccess dependency has been removed. If using a version of DPDK earlier than 16.07, enumerating devices by class code isn't available and only Intel SSDs will be discovered. DPDK 16.07 adds enumeration by class code and all NVMe devices will be correctly discovered. Change-Id: I0e8bac36b5ca57df604a2b310c47342c67dc9f3c Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-08 22:57:49 +00:00
changelog: add note about build/lib move Change-Id: I75c2359e0ca87d33931ea89e4bd623f07209233b Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-11-17 20:47:43 +00:00
The build process has been modified to produce all of the library files in the
`build/lib` directory. This is intended to simplify the use of SPDK from external
projects, which can now link to SPDK libraries by adding the `build/lib` directory
to the library path via `-L` and linking the SPDK libraries by name (for example,
`-lspdk_nvme -lspdk_log -lspdk_util`).
changelog: fill out major 16.12 features Change-Id: I09f3505049970645aca33191c80d893a68828a76 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-12-07 22:47:01 +00:00
`nvmf_tgt` and `iscsi_tgt` now have a JSON-RPC interface, which allows the user
to query and modify the configuration at runtime. The RPC service is disabled by
default, since it currently does not provide any authentication or security
mechanisms; it should only be enabled on systems with controlled user access
behind a firewall. An example RPC client implemented in Python is provided in
`scripts/rpc.py`.
changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
## v16.08: iSCSI target, NVMe over Fabrics maturity
Replace "NVMf" with "NVMe over Fabrics" in docs Use the final official spec name rather than a non-standard abbreviation. Change-Id: I4d797294be35b2fbf7b39570ea3246eb71c8d8ce Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-08-08 23:35:11 +00:00
Update the changelog to prepare for the next release. Change-Id: I0aab56c075c7d1956781380b45b36f068b0776c3 Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-04 20:28:25 +00:00
This release adds a userspace iSCSI target. The iSCSI target is capable of exporting
NVMe devices over a network using the iSCSI protocol. The application is located
in app/iscsi_tgt and a documented configuration file can be found at etc/spdk/spdk.conf.in.
changelog: updates since 16.06 Change-Id: Ide070c4a2a69b98603aefbbe75ecef2d7d7f3f73 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-06-28 22:27:50 +00:00
Update the changelog to prepare for the next release. Change-Id: I0aab56c075c7d1956781380b45b36f068b0776c3 Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-04 20:28:25 +00:00
This release also significantly improves the existing NVMe over Fabrics target.
changelog: updates since 16.06 Change-Id: Ide070c4a2a69b98603aefbbe75ecef2d7d7f3f73 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-06-28 22:27:50 +00:00
- The configuration file format was changed, which will require updates to
any existing nvmf.conf files (see `etc/spdk/nvmf.conf.in`):
- `SubsystemGroup` was renamed to `Subsystem`.
- `AuthFile` was removed (it was unimplemented).
- `nvmf_tgt` was updated to correctly recognize NQN (NVMe Qualified Names)
when naming subsystems. The default node name was changed to reflect this;
it is now "nqn.2016-06.io.spdk".
Update the changelog to prepare for the next release. Change-Id: I0aab56c075c7d1956781380b45b36f068b0776c3 Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-04 20:28:25 +00:00
- `Port` and `Host` sections were merged into the `Subsystem` section
- Global options to control max queue depth, number of queues, max I/O
size, and max in-capsule data size were added.
- The Nvme section was removed. Now a list of devices is specified by
bus/device/function directly in the Subsystem section.
- Subsystems now have a Mode, which can be Direct or Virtual. This is an attempt
to future-proof the interface, so the only mode supported by this release
is "Direct".
changelog: updates since 16.06 Change-Id: Ide070c4a2a69b98603aefbbe75ecef2d7d7f3f73 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-06-28 22:27:50 +00:00
- Many bug fixes and cleanups were applied to the `nvmf_tgt` app and library.
Update the changelog to prepare for the next release. Change-Id: I0aab56c075c7d1956781380b45b36f068b0776c3 Signed-off-by: Ben Walker <benjamin.walker@intel.com>
2016-08-04 20:28:25 +00:00
- The target now supports discovery.
This release also adds one new feature and provides some better examples and tools
for the NVMe driver.
- The Weighted Round Robin arbitration method is now supported. This allows
the user to specify different priorities on a per-I/O-queue basis. To
enable WRR, set the `arb_mechanism` field during `spdk_nvme_probe()`.
- A simplified "Hello World" example was added to show the proper way to use
the NVMe library API; see `examples/nvme/hello_world/hello_world.c`.
- A test for measuring software overhead was added. See `test/lib/nvme/overhead`.
changelog: updates since 16.06 Change-Id: Ide070c4a2a69b98603aefbbe75ecef2d7d7f3f73 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-06-28 22:27:50 +00:00
changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
## v16.06: NVMf userspace target
changelog: update to 16.06 and add NVMf Change-Id: Iebc8bba692530977d837fb6f3781fdb52a7e1945 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-06-06 23:40:34 +00:00
This release adds a userspace NVMf (NVMe over Fabrics) target, conforming to the
newly-released NVMf 1.0/NVMe 1.2.1 specification. The NVMf target exports NVMe
devices from a host machine over the network via RDMA. Currently, the target is
limited to directly exporting physical NVMe devices, and the discovery subsystem
is not supported.
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
This release includes a general API cleanup, including renaming all declarations
in public headers to include a `spdk` prefix to prevent namespace clashes with
user code.
- NVMe
- The `nvme_attach()` API was reworked into a new probe/attach model, which
moves device detection into the NVMe library. The new API also allows
parallel initialization of NVMe controllers, providing a major reduction in
startup time when using multiple controllers.
nvme: make I/O queue allocation explicit The previous method for registering I/O queues did not allow the user to specify queue priority for weighted round robin arbitration, and it limited the application to one queue per controller per thread. Change the API to require explicit allocation of each queue for each controller using the new function spdk_nvme_ctrlr_alloc_io_qpair(). Each function that submits a command on an I/O queue now takes an explicit qpair parameter rather than implicitly using the thread-local queue. This also allows the application to allocate different numbers of threads per controller; previously, the number of queues was capped at the smallest value supported by any attached controller. Weighted round robin arbitration is not supported yet; additional changes to the controller startup process are required to enable alternate arbitration methods. Change-Id: Ia33be1050a6953bc5a3cca9284aefcd95b01116e Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-02-29 21:19:02 +00:00
- I/O queue allocation was changed to be explicit in the API. Each function
that generates I/O requests now takes a queue pair (`spdk_nvme_qpair *`)
argument, and I/O queues may be allocated using
`spdk_nvme_ctrlr_alloc_io_qpair()`. This allows more flexible assignment of
queue pairs than the previous model, which only allowed a single queue
per thread and limited the total number of I/O queues to the lowest number
supported on any attached controller.
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
- Added support for the Write Zeroes command.
- `examples/nvme/perf` can now report I/O command latency from the
the controller's viewpoint using the Intel vendor-specific read/write latency
log page.
- Added namespace reservation command support, which can be used to coordinate
sharing of a namespace between multiple hosts.
- Added hardware SGL support, which enables use of scattered buffers that
don't conform to the PRP list alignment and length requirements on supported
NVMe controllers.
CHANGELOG: add NVMe E2E and VFIO PCI support Change-Id: Icc6073bc3ef46dfa3704d410e65f0a1ea248d6bc Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-04-28 22:59:17 +00:00
- Added end-to-end data protection support, including the ability to write and
read metadata in extended LBA (metadata appended to each block of data in the
buffer) and separate metadata buffer modes.
See `spdk_nvme_ns_cmd_write_with_md()` and `spdk_nvme_ns_cmd_read_with_md()`
for details.
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
- IOAT
- The DMA block fill feature is now exposed via the `ioat_submit_fill()`
function. This is functionally similar to `memset()`, except the memory is
filled with an 8-byte repeating pattern instead of a single byte like memset.
- PCI
- Added support for using DPDK for PCI device mapping in addition to the
CHANGELOG: add NVMe E2E and VFIO PCI support Change-Id: Icc6073bc3ef46dfa3704d410e65f0a1ea248d6bc Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-04-28 22:59:17 +00:00
existing libpciaccess option. Using the DPDK PCI support also allows use of
the Linux VFIO driver model, which means that SPDK userspace drivers will work
with the IOMMU enabled. Additionally, SPDK applications may be run as an
unprivileged user with access restricted to a specific set of PCIe devices.
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
- The PCI library API was made more generic to abstract away differences
between the underlying PCI access implementations.
changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
## v1.2.0: IOAT user-space driver
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
This release adds a user-space driver with support for the Intel I/O Acceleration Technology (I/OAT, also known as "Crystal Beach") DMA offload engine.
- IOAT
- New user-space driver supporting DMA memory copy offload
- Example programs `ioat/perf` and `ioat/verify`
- Kernel-mode DMA engine test driver `kperf` for performance comparison
- NVMe
- Per-I/O flags for Force Unit Access (FUA) and Limited Retry
- Public API for retrieving log pages
- Reservation register/acquire/release/report command support
- Scattered payload support - an alternate API to provide I/O buffers via a sequence of callbacks
- Declarations and `nvme/identify` support for Intel SSD DC P3700 series vendor-specific log pages and features
- Updated to support DPDK 2.2.0
changelog: use #/##/### headers consistently Change-Id: Ie85c86a72999cdaa2e7058a3918be06347ea7734 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2017-02-15 23:45:58 +00:00
## v1.0.0: NVMe user-space driver
Add a changelog Import the release notes from previous releases and fill out the major features for the next release. Change-Id: I5050d6cc83a92fac4f1dbed5f7ef039cca208765 Signed-off-by: Daniel Verkamp <daniel.verkamp@intel.com>
2016-03-08 20:34:24 +00:00
This is the initial open source release of the Storage Performance Development Kit (SPDK).
Features:
- NVMe user-space driver
- NVMe example programs
- `examples/nvme/perf` tests performance (IOPS) using the NVMe user-space driver
- `examples/nvme/identify` displays NVMe controller information in a human-readable format
- Linux and FreeBSD support
Reference in New Issue Copy Permalink