e4a3297a04
Adopt and extend the OpenZFS ZTS results analysis script for use with ZFS on Linux. This allows for automatic analysis of tests which may be skipped for a variety or reasons or which are not entirely reliable. In addition to the list of 'known' failures, which have been updated for ZFS on Linux, there in a new 'maybe' section. This mapping include tests which might be correctly skipped depending on the test environment. This may be because of a missing dependency or lack of required kernel support. This list also includes tests which normally pass but might on occasion fail for a harmless reason. The script was also extended include a reason for why a given test might be skipped or may fail. The reason will be included after the test in the "results other than PASS that are expected" section. For failures it is preferable to set the reason to the GitHub issue number and for skipped tests several generic reasons are available. You may also specify a custom reason if needed. All tests were added back in to the linux.run file even if they are expected to failed. There is value in running tests which may not pass, the expected results for these tests has been encoded in the new analysis script. All tests which were disabled because they ran more slowly on a 32-bit system have been re-enabled. Developers working on 32-bit systems should assess what it reasonable for their environment. The unnecessary dependency on physical block devices was removed for the checksum, grow_pool, and grow_replicas test groups so they are no longer skipped. Updated the filetest_001_pos test case to run properly now that it is enabled and moved the grow tests in to a single directory. Reviewed-by: Prakash Surya <prakash.surya@delphix.com> Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov> Closes #7638
22 lines
617 B
Bash
22 lines
617 B
Bash
#!/bin/sh
|
|
|
|
# Directories
|
|
export BIN_DIR=
|
|
export SBIN_DIR=
|
|
export ZTS_DIR=
|
|
export SCRIPT_DIR=
|
|
|
|
# General commands
|
|
export ZDB=${ZDB:-$SBIN_DIR/zdb}
|
|
export ZFS=${ZFS:-$SBIN_DIR/zfs}
|
|
export ZPOOL=${ZPOOL:-$SBIN_DIR/zpool}
|
|
export ZTEST=${ZTEST:-$SBIN_DIR/ztest}
|
|
export ZFS_SH=${ZFS_SH:-$SCRIPT_DIR/zfs.sh}
|
|
|
|
# Test Suite
|
|
export RUNFILE_DIR=${RUNFILE_DIR:-$ZTS_DIR/runfiles}
|
|
export TEST_RUNNER=${TEST_RUNNER:-$ZTS_DIR/test-runner/bin/test-runner.py}
|
|
export ZTS_REPORT=${ZTS_REPORT:-$ZTS_DIR/test-runner/bin/zts-report.py}
|
|
export STF_TOOLS=${STF_TOOLS:-$ZTS_DIR/test-runner}
|
|
export STF_SUITE=${STF_SUITE:-$ZTS_DIR/zfs-tests}
|