freebsd-nq/module/lua
Brian Behlendorf 93ce2b4ca5 Update build system and packaging
Minimal changes required to integrate the SPL sources in to the
ZFS repository build infrastructure and packaging.

Build system and packaging:
  * Renamed SPL_* autoconf m4 macros to ZFS_*.
  * Removed redundant SPL_* autoconf m4 macros.
  * Updated the RPM spec files to remove SPL package dependency.
  * The zfs package obsoletes the spl package, and the zfs-kmod
    package obsoletes the spl-kmod package.
  * The zfs-kmod-devel* packages were updated to add compatibility
    symlinks under /usr/src/spl-x.y.z until all dependent packages
    can be updated.  They will be removed in a future release.
  * Updated copy-builtin script for in-kernel builds.
  * Updated DKMS package to include the spl.ko.
  * Updated stale AUTHORS file to include all contributors.
  * Updated stale COPYRIGHT and included the SPL as an exception.
  * Renamed README.markdown to README.md
  * Renamed OPENSOLARIS.LICENSE to LICENSE.
  * Renamed DISCLAIMER to NOTICE.

Required code changes:
  * Removed redundant HAVE_SPL macro.
  * Removed _BOOT from nvpairs since it doesn't apply for Linux.
  * Initial header cleanup (removal of empty headers, refactoring).
  * Remove SPL repository clone/build from zimport.sh.
  * Use of DEFINE_RATELIMIT_STATE and DEFINE_SPINLOCK removed due
    to build issues when forcing C99 compilation.
  * Replaced legacy ACCESS_ONCE with READ_ONCE.
  * Include needed headers for `current` and `EXPORT_SYMBOL`.

Reviewed-by: Tony Hutter <hutter2@llnl.gov>
Reviewed-by: Olaf Faaland <faaland1@llnl.gov>
Reviewed-by: Matthew Ahrens <mahrens@delphix.com>
Reviewed-by: Pavel Zakharov <pavel.zakharov@delphix.com>
Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov>
TEST_ZIMPORT_SKIP="yes"
Closes #7556
2018-05-29 16:00:33 -07:00
..
setjmp OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lapi.c Update build system and packaging 2018-05-29 16:00:33 -07:00
lapi.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lauxlib.c Update build system and packaging 2018-05-29 16:00:33 -07:00
lbaselib.c Update build system and packaging 2018-05-29 16:00:33 -07:00
lcode.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lcode.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lcompat.c Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
lcorolib.c Update build system and packaging 2018-05-29 16:00:33 -07:00
lctype.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lctype.h Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
ldebug.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
ldebug.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
ldo.c Increase code coverage for Lua libraries 2018-02-08 15:29:38 -08:00
ldo.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lfunc.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lfunc.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lgc.c OpenZFS 9035 - zfs: this statement may fall through 2018-02-21 14:55:34 -08:00
lgc.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
llex.c OpenZFS 9035 - zfs: this statement may fall through 2018-02-21 14:55:34 -08:00
llex.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
llimits.h Address objtool check failures in lua module 2018-02-15 09:53:04 -08:00
lmem.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lmem.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lobject.c Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
lobject.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lopcodes.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lopcodes.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lparser.c Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
lparser.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lstate.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lstate.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lstring.c Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
lstring.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lstrlib.c Update build system and packaging 2018-05-29 16:00:33 -07:00
ltable.c OpenZFS 9035 - zfs: this statement may fall through 2018-02-21 14:55:34 -08:00
ltable.h Fix coverity defects: zfs channel programs 2018-02-20 11:19:42 -08:00
ltablib.c Update build system and packaging 2018-05-29 16:00:33 -07:00
ltm.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
ltm.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lvm.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lvm.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lzio.c OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
lzio.h OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00
Makefile.in Increase code coverage for Lua libraries 2018-02-08 15:29:38 -08:00
README.zfs OpenZFS 7431 - ZFS Channel Programs 2018-02-08 15:28:18 -08:00

#
# CDDL HEADER START
#
# This file and its contents are supplied under the terms of the
# Common Development and Distribution License ("CDDL"), version 1.0.
# You may only use this file in accordance with the terms of version
# 1.0 of the CDDL.
#
# A full copy of the text of the CDDL should have accompanied this
# source.  A copy of the CDDL is also available via the Internet at
# http://www.illumos.org/license/CDDL.
#
# CDDL HEADER END
#

#
# Copyright (c) 2017 by Delphix. All rights reserved.
#

Introduction
------------

This README describes the Lua interpreter source code that lives in the ZFS
source tree to enable execution of ZFS channel programs, including its
maintenance policy, the modifications that have been made to it, and how it
should (and should not) be used.

For a description of the Lua language and features exposed by ZFS channel
programs, please refer to the zfs-program(1m) man page instead.


Maintenance policy
------------------

The Lua runtime is considered stable software. Channel programs don't need much
complicated logic, so updates to the Lua runtime from upstream are viewed as
nice-to-have, but not required for channel programs to be well-supported. As
such, the Lua runtime in ZFS should be updated on an as-needed basis for
security vulnerabilities, but not much else.


Modifications to Lua
--------------------

The version of the Lua runtime we're using in ZFS has been modified in a variety
of ways to make it more useful for the specific purpose of running channel
programs. These changes include:

1. "Normal" Lua uses floating point for all numbers it stores, but those aren't
   useful inside ZFS / the kernel. We have changed the runtime to use int64_t
   throughout for all numbers.
2. Some of the Lua standard libraries do file I/O or spawn processes, but
   neither of these make sense from inside channel programs. We have removed
   those libraries rather than reimplementing them using kernel APIs.
3. The "normal" Lua runtime handles errors by failing fatally, but since this
   version of Lua runs inside the kernel we must handle these failures and
   return meaningful error codes to userland. We have customized the Lua
   failure paths so that they aren't fatal.
4. Running poorly-vetted code inside the kernel is always a risk; even if the
   ability to do so is restricted to the root user, it's still possible to write
   an incorrect program that results in an infinite loop or massive memory use.
   We've added new protections into the Lua interpreter to limit the runtime
   (measured in number of Lua instructions run) and memory overhead of running
   a channel program.
5. The Lua bytecode is not designed to be secure / safe, so it would be easy to
   pass invalid bytecode which can panic the kernel. By comparison, the parser
   is hardened and fails gracefully on invalid input. Therefore, we only accept
   Lua source code at the ioctl level and then interpret it inside the kernel.

Each of these modifications have been tested in the zfs-test suite. If / when
new modifications are made, new tests should be added to the suite located in
zfs-tests/tests/functional/channel_program/lua_core.


How to use this Lua interpreter
-------------------------------

From the above, it should be clear that this is not a general-purpose Lua
interpreter. Additional work would be required to extricate this custom version
of Lua from ZFS and make it usable by other areas of the kernel.