numam-spdk/doc/idxd.md
paul luse fc250841ca idxd: add batch capability to accel framework and IDXD back-end
This patch only includes the basic framework for batching and the
ability to batch one type of command, copy. Follow-on patches will
add the ability to batch other commands and include an example of
how to do so via the accel perf tool.  SW engine support for batching
will also come in a future patch. Documentation will also be coming.

Batching allows the application to submit a list of independent
descriptors to DSA with one single "batch" descriptor. This is beneficial
when the application is in a position to have several operations ready
at once; batching saves the overhead of submitting each one separately.

The way batching works in SPDK is as follows:

1) The app gets a handle to a new batch with spdk_accel_batch_create()
2) The app uses that handle to prepare a command to be included in the
batch. For copy the command is spdk_accel_batch_prep_copy(). The
app many continue to prep commands for the batch up to the max via
calling spdk_accel_batch_get_max()
3) The app then submits the batch with spdk_accel_batch_submit()
4) The callback provided for each command in the batch will be called as
they complete, the callback provided to the batch submit itself will be
called then the entire batch is done.

Signed-off-by: paul luse <paul.e.luse@intel.com>
Change-Id: I4102e9291fe59a245cedde6888f42a923b6dbafd
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2248
Community-CI: Mellanox Build Bot
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Ben Walker <benjamin.walker@intel.com>
Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-07-10 07:31:09 +00:00

1.3 KiB

IDXD Driver

Public Interface

  • spdk/idxd.h

Key Functions

Function Description
spdk_idxd_probe() @copybrief spdk_idxd_probe()
spdk_idxd_batch_get_max() @copybrief spdk_idxd_batch_get_max()
spdk_idxd_batch_create() @copybrief spdk_idxd_batch_create()
spdk_idxd_batch_prep_copy() @copybrief spdk_idxd_batch_prep_copy()
spdk_idxd_batch_submit() @copybrief spdk_idxd_batch_submit()
spdk_idxd_submit_copy() @copybrief spdk_idxd_submit_copy()
spdk_idxd_submit_compare() @copybrief spdk_idxd_submit_compare()
spdk_idxd_submit_crc32c() @copybrief spdk_idxd_submit_crc32c()
spdk_idxd_submit_dualcast @copybrief spdk_idxd_submit_dualcast()
spdk_idxd_submit_fill() @copybrief spdk_idxd_submit_fill()

Pre-defined configurations

The RPC idxd_scan_accel_engine is used to both enable IDXD and set it's configuration to one of two pre-defined configs:

Config #0: 4 groups, 1 work queue per group, 1 engine per group. Config #1: 2 groups, 2 work queues per group, 2 engines per group.