Introduction
============
libmlx4 is a userspace driver for Mellanox ConnectX InfiniBand HCAs.
It is a plug-in module for libibverbs that allows programs to use
Mellanox hardware directly from userspace. See the libibverbs package
for more information.
Using libmlx4
==============
libmlx4 will be loaded and used automatically by programs linked with
libibverbs. The mlx4_ib kernel module must be loaded for HCA devices
to be detected and used.
Supported Hardware
==================
libmlx4 currently supports HCAs based on the following Mellanox chip:
MT25408 ConnectX (PCI Express)
These HCAs use the mlx4_ib kernel driver. Support for other Mellanox
HCAs, which use the ib_mthca kernel driver, is provided by the
libmthca userspace driver.
Valgrind Support
================
When running applications that use libibverbs under the Valgrind
memory-checking debugger, Valgrind will falsely report "read from
uninitialized" for memory that was initialized by the kernel drivers
or HCA hardware. Specifically, Valgrind cannot see when kernel
drivers or HCA hardware write to userspace memory, so when the process
reads from that memory, Valgrind incorrectly assumes that the memory
contents are uninitialized, and therefore raises a warning.
libmlx4 can be built with specific support for the Valgrind
memory-checking debugger by specifying the --with-valgrind command
line argument to configure. This flag enables code in libibverbs to
tell Valgrind "this memory may look uninitialized, but it's really
OK," which therefore suppresses the incorrect "read from
uninitialized" warnings. This code adds trivial overhead to the
critical performance path, so it is disabled by default. The intent
is that production users can use a "normal" build of libmlx4 and
developers can use the "valgrind debug" build by simply switching
their OPENIB_DRIVER_PATH environment variables.
Libmlx4 needs some header files from Valgrind in order to compile this
support; it is important to use the header files from the same version
of Valgrind that will be used at run time. You may need to specify
the directory where Valgrind's header files are installed as an
argument to --with-valgrind. For example
./configure --with-valgrind=/opt/valgrind
will make the libmlx4 build look for valgrind headers in
/opt/valgrind/include