freebsd-dev/tools/regression
David Xu 323d80a0a7 Don't forget to use fourth argument if O_CREAT is set in argument oflag.
The fourth specifies initial value for the semaphore.
2010-01-07 04:15:49 +00:00
..
acct Also cleanup after the test run. 2010-01-04 09:57:00 +00:00
acltools Make tests for ACL preservation by mv(1) and cp(1) more complete 2009-12-27 13:05:56 +00:00
aio Add the ability to do all read, all write, or random read/write. 2008-05-15 16:10:55 +00:00
atm Update README to reflect removal of netatm/harp test parts some time ago. 2008-08-31 11:41:31 +00:00
audit/audit_pipe_ioctl Merge Perforce change 93572 from TrustedBSD audit3 branch: 2006-03-19 15:47:53 +00:00
bin sh: Send the "not found" message for builtin <cmd> to redirected fd 2. 2010-01-03 15:01:38 +00:00
bpf Make this test case little bit more interesting. 2009-11-23 22:28:15 +00:00
ccd/layout
doat Simple testing program for *at family of syscalls. 2008-05-18 08:34:04 +00:00
environ Do not gratuitously fail *env(3) operations due to corrupt ('='-less) 2009-12-01 05:04:31 +00:00
ethernet/ethermulti Add a regression test for ethernet link-layer multicast memberships. 2007-02-25 01:58:02 +00:00
execve o Grammar. 2006-10-09 06:47:08 +00:00
fifo The devices that supported EVFILT_NETDEV kqueue filters were removed in 2009-12-31 20:29:58 +00:00
file Add a new 'void closefrom(int lowfd)' system call. When called, it closes 2009-06-15 20:38:55 +00:00
fstest Fix a case where rename actually succeeds, which is also expected behaviour 2009-10-20 21:08:32 +00:00
fsx getopt(3) returns -1, not EOF. 2008-02-19 07:09:19 +00:00
gaithrstress
geom (S)LIST_HEAD_INITIALIZER takes a (S)LIST_HEAD as an argument. 2009-12-28 22:56:30 +00:00
geom_concat Finish conversion of gconcat(8) regression tests to the new framework. 2005-12-07 01:24:25 +00:00
geom_eli By default backup geli metadata to a file. It is quite critical 512 bytes, 2008-08-29 18:10:18 +00:00
geom_gate
geom_gpt MFp4: 2006-04-10 04:13:44 +00:00
geom_mirror - Make use of geom_subr.sh to improve regression tests. 2005-12-07 01:27:23 +00:00
geom_nop - Make use of geom_subr.sh to improve regression tests. 2005-12-07 01:27:23 +00:00
geom_raid3 Convert graid3(8) regression tests to the new framework. 2005-12-07 01:28:59 +00:00
geom_shsec Convert gshsec(8) regression tests to the new framework. 2005-12-07 01:29:50 +00:00
geom_stripe Convert gstripe(8) regression tests to the new framework. 2005-12-07 01:30:44 +00:00
geom_uzip Use mkuzip(8) instead of create_compressed_fs. 2005-09-29 22:41:20 +00:00
ia64 Add regression tests of the emulation of the long branch conditional form. 2006-07-17 00:27:12 +00:00
include/tgmath Switch over to gnu99 compilation on default for userland. 2009-03-14 17:55:16 +00:00
ipsec Adding tests for Camellia which will be added to the tree soon. 2007-03-26 07:40:51 +00:00
kgssapi Implement support for RPCSEC_GSS authentication to both the NFS client 2008-11-03 10:38:00 +00:00
kqueue Merge libkqueue test suite through r119 2009-12-15 10:43:20 +00:00
lib Add test-pidfile.c and increase warning level. 2009-11-12 01:37:25 +00:00
mac Oops. Correct comment in the LICENSE file. 2009-03-14 21:59:12 +00:00
mlock Style: NO_MAN doesn't need any value. 2006-03-15 10:46:38 +00:00
mmap Replace the name of the sysctl to security.bsd.map_at_zero and to be 2009-10-02 17:53:48 +00:00
mqueue Fix compiling. 2007-01-06 11:32:15 +00:00
msdosfs Adding another multi-byte characters related regression test for recent 2006-01-01 01:28:31 +00:00
net80211 Catching up with the latest crypto API changes in net80211. 2005-05-05 13:16:30 +00:00
netatalk/simple_send Change s_net to s_node when printing the destination address. 2006-03-17 20:14:25 +00:00
netinet Update udpzerobyte to understand that passing 0 as a length to recv(2) 2008-10-07 21:01:23 +00:00
netinet6 Remove extra comment that snuck in in last commit. 2008-07-29 18:38:37 +00:00
netipx Up the scale of the SPX loopback check a bit: use much larger data sizes 2009-06-20 18:13:20 +00:00
nfsmmap
p1003_1b
pipe
poll Add some tests for poll(2)/shutdown(2) interaction. 2009-08-25 20:33:37 +00:00
posixsem Rework the lifetime management of the kernel implementation of POSIX 2008-06-27 05:39:04 +00:00
posixsem2 Don't forget to use fourth argument if O_CREAT is set in argument oflag. 2010-01-07 04:15:49 +00:00
posixshm Fix compile on 64-bit platforms. 2008-06-26 21:26:34 +00:00
priv Start respecting WITHOUT_INET6. 2009-08-13 09:11:47 +00:00
pthread mutex_islocked_np -> mutex_isowned_np 2008-02-06 19:41:05 +00:00
redzone9 Add simple tests which verify that redzone(9) works properly. 2006-01-31 11:20:13 +00:00
rpcsec_gss Implement support for RPCSEC_GSS authentication to both the NFS client 2008-11-03 10:38:00 +00:00
security Add open_to_operation, a security regression test that opens files with 2008-02-14 20:57:38 +00:00
sigqueue Tweaks for sigqueue tests: 2009-10-11 17:04:13 +00:00
sockets A few regression tests for SOCK_SEQPACKET UNIX domain sockets. 2009-10-05 15:27:01 +00:00
sysvmsg Fix message size tests for msgsnd(3) and msgrcv(3). msgsz is the length of 2006-11-16 19:51:10 +00:00
sysvsem
sysvshm
tls NO_MAN is not needed here. 2006-03-16 15:18:17 +00:00
tmpfs Fix build on amd64. 2009-10-07 23:01:31 +00:00
ufs/uprintf o style.Makefile(5): WARNS= -> WARNS?=. 2006-07-09 11:51:14 +00:00
usr.bin Add ability to search up the directory hierarchy for the system directory. 2010-01-04 18:57:22 +00:00
usr.sbin It is expected these are chmod +x. 2010-01-04 09:50:30 +00:00
vfs Increment the counter outside the subshell. 2009-05-27 15:15:58 +00:00
zfs Update ZFS from version 6 to 13 and bring some FreeBSD-specific changes. 2008-11-17 20:49:29 +00:00
geom_subr.sh Add file with helper functions for geom tools regression tests. 2005-12-07 01:20:18 +00:00
README Add the regression test for bin/date. 2009-05-27 12:31:55 +00:00
TODO

$FreeBSD$

This directory is for regression test programs.

A regression test program is one that will exercise a particular bit of the
system to check that we have not reintroduced an old bug.

Tests should be implemented in files with a .t extension.  Each .t file
can contain more than one test, and can be implemented in any scripting
language -- /bin/sh, Perl...

The test protocol is quite simple.  At its most basic, each .t file should, 
when run, print a line in this format:

   1..m

where m is the number of tests that will be run.

Each test should produce a single line of output.  This line should start
with one of

   ok n
   not ok n

to indicate whether or not the test succeeded.  'n' is the test's number.
Anything after this on the line (up to the first '#' if present) is 
considered to be the name of the test.  Naming tests is optional, but 
encouraged.

A test may be written which is conditional, and may need to be skipped.
For example, the netatalk tests require 'options NETATALK' in the kernel.
A test may be skipped by printing '# skip Reason for skipping' after the
test name.  For example,

    ok 1 - netatalk # skip 'options NETATALK' not compiled in

A test may be flagged as 'todo'.  This indicates that you expect the test
to fail (perhaps because the necessary functionality hasn't been written
yet).  'todo' tests are expected to fail, so when they start working the
test framework can alert you to this happy occurence.  Flag these tests 
with a '# TODO' comment after the test name

    not ok 1 - infiniteloop # TODO write test for an infinite loop

This is modelled on the protocol followed by the Test::Harness Perl
module (and therefore much of the automated testing carried out by the 
Perl community).  More documentation can be found at:

    http://search.cpan.org/~petdance/Test-Harness-2.42/lib/Test/Harness.pm

To run the tests and parse their output install the devel/p5-Test-Harness
port.  This includes the prove(1) command which is used to run the tests
and collate the output.

    prove geom_concat		# run all the tests in geom_concat
    prove -r lib		# run all tests in lib/, and subdirectories
    prove -r -v lib		# as above, with verbose output
    prove -r			# run *all* the tests

Tests that are for parts of the base system should go into a directory here
which is the same as their path relative to src/, for example the uuencode(1)
utility resides in src/usr.bin/uuencode so its regression test resides in
src/tools/regression/usr.bin/uuencode.

To avoid the pre-commit check program complaining about the lack of
CVS keywords in test data files, use a .in suffix for input files and
a .out suffix for output files.

To execute individual regression tests for binaries that you are
developing, add their directory in the path before running the tests.
Example:
cd /usr/src/tools/regression/usr.bin
(PATH=/home/user/src/experimental/jot:$PATH ; make SUBDIR=jot)

Please make a subdir per other regression test, and add a brief description to
this file.

acct		Exercise the integer to float conversion used in acct(5)
geom		Some tests and an out-of-kernel simulator for the GEOM code
ia64		ia64 specific regression tests
nfsmmap		Some tests to exercise some tricky cases in NFS and mmap
p1003_1b	Exercise 1003.1B scheduler
pipe		Pipe code regression test
fsx		General filesystem exerciser
sysvmsg 	SysV IPC Message Queue Regression Utility
sysvsem 	SysV IPC Semaphore Regression Utility
sysvshm 	SysV IPC Shared Memory Regression Utility
gaithrstress	General threaded getaddrinfo(3) exerciser
date		Date(1) + format string regression test