2015-09-21 18:31:01 +00:00
|
|
|
Storage Performance Development Kit
|
|
|
|
===================================
|
|
|
|
|
2015-11-04 21:18:02 +00:00
|
|
|
[![Build Status](https://travis-ci.org/spdk/spdk.svg?branch=master)](https://travis-ci.org/spdk/spdk)
|
|
|
|
|
2016-02-26 22:50:59 +00:00
|
|
|
[SPDK Mailing List](https://lists.01.org/mailman/listinfo/spdk)
|
|
|
|
|
2015-09-21 21:11:31 +00:00
|
|
|
[SPDK on 01.org](https://01.org/spdk)
|
2015-09-21 18:31:01 +00:00
|
|
|
|
|
|
|
The Storage Performance Development Kit (SPDK) provides a set of tools
|
|
|
|
and libraries for writing high performance, scalable, user-mode storage
|
2016-03-02 17:03:57 +00:00
|
|
|
applications. It achieves high performance by moving all of the necessary
|
|
|
|
drivers into userspace and operating in a polled mode instead of relying on
|
|
|
|
interrupts, which avoids kernel context switches and eliminates interrupt
|
|
|
|
handling overhead.
|
|
|
|
|
|
|
|
The development kit currently includes:
|
|
|
|
* NVMe driver
|
|
|
|
* I/OAT (DMA engine) driver
|
2016-06-08 23:18:56 +00:00
|
|
|
* NVMf target
|
2015-09-21 18:31:01 +00:00
|
|
|
|
2015-11-04 21:59:37 +00:00
|
|
|
Documentation
|
|
|
|
=============
|
|
|
|
|
2016-05-05 23:20:41 +00:00
|
|
|
[Doxygen API documentation](http://spdk.io/spdk/doc/) is available, as
|
2016-03-02 17:03:57 +00:00
|
|
|
well as a [Porting Guide](PORTING.md) for porting SPDK to different frameworks
|
|
|
|
and operating systems.
|
2015-11-04 21:59:37 +00:00
|
|
|
|
2016-03-02 17:03:57 +00:00
|
|
|
Many examples are available in the `examples` directory.
|
2015-09-25 21:31:26 +00:00
|
|
|
|
2016-03-08 20:34:24 +00:00
|
|
|
[Changelog](CHANGELOG.md)
|
|
|
|
|
2015-09-21 18:31:01 +00:00
|
|
|
Prerequisites
|
|
|
|
=============
|
|
|
|
|
|
|
|
To build SPDK, some dependencies must be installed.
|
|
|
|
|
|
|
|
Fedora/CentOS:
|
|
|
|
|
2016-03-02 17:03:57 +00:00
|
|
|
sudo dnf install -y gcc libpciaccess-devel CUnit-devel libaio-devel
|
2016-06-06 23:53:43 +00:00
|
|
|
# Additional dependencies for NVMf:
|
|
|
|
sudo dnf install -y libibverbs-devel librdmacm-devel
|
2015-09-21 18:31:01 +00:00
|
|
|
|
|
|
|
Ubuntu/Debian:
|
|
|
|
|
2016-03-02 17:03:57 +00:00
|
|
|
sudo apt-get install -y gcc libpciaccess-dev make libcunit1-dev libaio-dev
|
2016-06-06 23:53:43 +00:00
|
|
|
# Additional dependencies for NVMf:
|
|
|
|
sudo apt-get install -y libibverbs-dev librdmacm-dev
|
2015-09-21 18:31:01 +00:00
|
|
|
|
2015-09-25 16:13:05 +00:00
|
|
|
FreeBSD:
|
|
|
|
|
|
|
|
- gcc
|
|
|
|
- libpciaccess
|
|
|
|
- gmake
|
|
|
|
- cunit
|
|
|
|
|
2015-09-24 16:59:56 +00:00
|
|
|
Additionally, [DPDK](http://dpdk.org/doc/quick-start) is required.
|
|
|
|
|
|
|
|
1) cd /path/to/spdk
|
2016-04-12 16:36:43 +00:00
|
|
|
2) wget http://dpdk.org/browse/dpdk/snapshot/dpdk-16.04.tar.gz
|
|
|
|
3) tar xfz dpdk-16.04.tar.gz
|
2015-09-25 16:13:05 +00:00
|
|
|
|
|
|
|
Linux:
|
|
|
|
|
2016-04-12 16:36:43 +00:00
|
|
|
4) (cd dpdk-16.04 && make install T=x86_64-native-linuxapp-gcc DESTDIR=.)
|
2015-09-21 18:31:01 +00:00
|
|
|
|
2015-09-25 16:13:05 +00:00
|
|
|
FreeBSD:
|
|
|
|
|
2016-04-12 16:36:43 +00:00
|
|
|
4) (cd dpdk-16.04 && gmake install T=x86_64-native-bsdapp-clang DESTDIR=.)
|
2015-09-25 16:13:05 +00:00
|
|
|
|
2015-09-21 18:31:01 +00:00
|
|
|
Building
|
|
|
|
========
|
|
|
|
|
|
|
|
Once the prerequisites are installed, run 'make' within the SPDK directory
|
|
|
|
to build the SPDK libraries and examples.
|
|
|
|
|
|
|
|
make DPDK_DIR=/path/to/dpdk
|
2015-09-24 16:59:56 +00:00
|
|
|
|
|
|
|
If you followed the instructions above for building DPDK:
|
|
|
|
|
2015-09-25 16:13:05 +00:00
|
|
|
Linux:
|
|
|
|
|
2016-04-12 16:36:43 +00:00
|
|
|
make DPDK_DIR=./dpdk-16.04/x86_64-native-linuxapp-gcc
|
2015-09-25 16:13:05 +00:00
|
|
|
|
|
|
|
FreeBSD:
|
|
|
|
|
2016-04-12 16:36:43 +00:00
|
|
|
gmake DPDK_DIR=./dpdk-16.04/x86_64-native-bsdapp-clang
|
2015-09-25 16:13:05 +00:00
|
|
|
|
|
|
|
Hugepages and Device Binding
|
|
|
|
============================
|
|
|
|
|
|
|
|
Before running an SPDK application, some hugepages must be allocated and
|
2015-12-03 21:30:38 +00:00
|
|
|
any NVMe and I/OAT devices must be unbound from the native kernel drivers.
|
2016-04-14 20:22:11 +00:00
|
|
|
SPDK includes a script to automate this process on both Linux and FreeBSD.
|
|
|
|
This script should be run as root.
|
2015-09-25 16:13:05 +00:00
|
|
|
|
2016-04-14 20:22:11 +00:00
|
|
|
sudo scripts/setup.sh
|
2016-03-08 21:26:03 +00:00
|
|
|
|
|
|
|
Examples
|
|
|
|
========
|
|
|
|
|
|
|
|
Example code is located in the examples directory. The examples are compiled
|
|
|
|
automatically as part of the build process. Simply call any of the examples
|
|
|
|
with no arguments to see the help output. You'll likely need to run the examples
|
|
|
|
as a privileged user (root) unless you've done additional configuration
|
|
|
|
to grant your user permission to allocate huge pages and map devices through
|
|
|
|
vfio.
|