LIBSDP - A User Level Socket Switch for Seemless Migration to SDP
-----------------------------------------------------------------
OVERVIEW:
---------
libsdp is a LD_PRELOAD-able library that can be used to migrate existing
applications use InfiniBand Sockets Direct Protocol (SDP) instead of
TCP sockets, transparently and without recompilations. To setup libsdp
please follow the instructions below.
SETUP:
------
libsdp.so isn't setup automatically. it can be used in one of 2 ways:
1) LD_PRELOAD environment variable. Setting this to the name of the
library you want to use will cause it to be preloaded.
2) Adding the name of the library into /etc/ld.so.preload. This will
cause the library to be preloaded for every executable that is linked
with libc.
The library should be installed in a directory in which the dynamic loader
searches for shared libraries (as specified by LD_LIBRARY_PATH,
/etc/ld.so.conf, etc). Alternatively, you can specify the full path to the
library that you want to use in LD_PRELOAD or /etc/ld.so.preload as described
above.
The last option cant be used if you have multiple library versions
(e.g. 64/32 bit) and want the linker to select between them automatically.
The best way to handle such case is to use LD_LIBRARY_PATH to point to both the
lib (the 32 bit version) and lib64 directories and LD_RELOAD the libsdp.so.
This way the correct 32/64bit libsdp.so will be selected.
For example running ssh over SDP with OFED distribution from bash this can be written:
LD_LIBRARY_PATH=/usr/local/ofed/lib64:/usr/local/ofed/lib LD_PRELOAD=libsdp.so ssh
CONFIGURATION:
--------------
libsdp supports two modes of configuration:
* simple operation where it converts all calls to socket(2) with a family
of AF_INET(6) and a type of SOCK_STREAM into family of AF_INET_SDP.
* selective mode where it uses a configuration file to select which sockets
will be using SDP and which will not.
For real world applications where communication with X, authentication,
DNS and other servers connected through TCP is required the selective mode
is required.
Simple mode will be selected in one of the following conditions:
* the environment variable SIMPLE_LIBSDP to a non-empty value
* no configuration file is defined or is un-readble
* the configuration file does not include any address family rule
For information on how to configure libsdp, see libsdp.conf, which is installed
in $(sysconfdir) (usually /usr/local/etc or /etc). The user can further control
the file to be used for configuration by setting the environment variable:
LIBSDP_CONFIG_FILE
LIMITATIONS:
------------
1. Applications statically linked with libc will not allow dynamic pre-loading
to port these applications to use SDP one needs to replace specific socket
calls (within the application) with AF_INET_SDP and recompile.
2. If for some reason the dynamic linker fail to pre-load libc before the
libsdp.so is initialized or it does not support RTDL_NEXT, libsdp will
fail to find the libc socket API. To overcome this situation a simple
implementation of hijacking "socket" call is provided in libsdp_sys.
This partial implementation does not support any configuration and is
limited to i386 architecture.
3. Non-blocking connect in "both" mode defaults to SDP. Specific rules might be
needed for applications to operate properly.
