freebsd-dev/usr.bin
Maxim Sobolev 4fc55e3e46 Improve performance in a few key areas:
o Split the compression across several worker threads. By default, "several"
   matches number of CPUs, capped at 24 for sanity when running on a very big
   hardwares. Provide option to set that number manually;

 o Fix bug inherited from the mkulzma (R.I.P) which degraded already slow LZMA
   compression even further by calling function to release compression state
   after processing each block.

   It is neither documented as required nor actually required by the LZMA
   library. This caused spree of system calls to release memory and then map
   it again for every block. LZMA compression is more than 2x faster after this
   change alone;

 o Record time it takes to do compression and report throughput achieved.

 o Add simple first-level 256 entry hash table for de-dup code, so it's not
   becoming a bottleneck at big files.
2016-04-23 07:23:43 +00:00
..
addr2line elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
alias
apply MFH 2016-03-10 21:16:01 +00:00
ar DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
asa
at Fix typo: actually test the return of strchr(3) 2016-04-20 20:54:47 +00:00
atm
awk META_MODE: Don't rebuild build-tools targets during normal build. 2016-04-14 21:06:10 +00:00
banner
basename MFH 2016-03-10 21:16:01 +00:00
bc DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
biff
bluetooth Update dependencies after r291406 added libelf to libkvm. 2015-12-01 05:18:48 +00:00
bmake MFH 2016-04-04 23:55:32 +00:00
brandelf Use standard 'THE AUTHOR' license text 2015-07-31 16:45:42 +00:00
bsdiff Cleanup unnecessary semicolons from utilities we all love. 2016-04-15 22:31:22 +00:00
bzip2
bzip2recover
c89
c99 Don't claim c99 is a wrapper around gcc; it's a wrapper around the system cc. 2015-07-13 14:13:15 +00:00
caesar Fix LDADD/DPADD that should be LIBADD. 2015-12-04 03:17:47 +00:00
calendar MFH 2016-04-16 02:32:12 +00:00
cap_mkdb Remove O_SYNC from the options passed to dbmopen(). 2016-02-19 08:42:13 +00:00
catman
chat
checknr
chkey
chpass Restore the 'beforeinstall' for chpass(1), so files with the 2016-01-28 02:56:30 +00:00
cksum
clang MFH 2016-03-10 21:16:01 +00:00
cmp MFH 2016-03-10 21:16:01 +00:00
col MFH 2016-03-10 21:16:01 +00:00
colcrt
colldef Note that mklocale(1) and colldef(1) are no longer used 2016-04-17 23:02:49 +00:00
colrm
column Fix type mismatches for malloc(3) and Co. 2015-12-29 11:24:41 +00:00
comm MFH 2016-03-10 21:16:01 +00:00
compile_et DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
compress
cpio MFH 2016-03-10 21:16:01 +00:00
cpuset
csplit
ctags
ctlstat Bunch of improvements to ctlstat. 2015-09-21 09:37:49 +00:00
cut MFH 2016-03-10 21:16:01 +00:00
cxxfilt elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
dc
dirname MFH 2016-03-10 21:16:01 +00:00
dpv Bump copyright 2016-01-27 00:03:43 +00:00
drill META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
dtc Improvements to BSD-licensed DTC. 2015-12-29 16:29:42 +00:00
du
ee Create ee(1) package. 2016-02-02 21:04:33 +00:00
elf2aout
elfcopy elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
elfdump elfdump: handle STT_SPARC_REGISTER 2016-01-25 04:22:01 +00:00
enigma
env
expand
factor Fix LDADD/DPADD that should be LIBADD. 2015-12-04 03:17:47 +00:00
false
fetch Add phttpget(8) .Xr to fetch(1). 2016-03-29 11:56:00 +00:00
file
file2c MFH 2016-03-10 21:16:01 +00:00
find Use NULL instead of 0 for pointers. 2016-04-18 07:05:18 +00:00
finger Use NULL instead of 0 for pointers. 2016-04-18 14:44:01 +00:00
fmt fmt(1): for pointers use NULL instead of 0 2016-04-13 01:57:06 +00:00
fold
fortune Use print as a function for Python 3 [PEP 3105] 2015-11-19 00:01:52 +00:00
from
fstat
fsync
ftp
gcore
gencat
getconf DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
getent
getopt use : instead of true... 2015-08-01 17:27:47 +00:00
gprof
grdc Fix LDADD/DPADD that should be LIBADD. 2015-12-04 03:17:47 +00:00
grep MFH 2016-03-14 18:54:29 +00:00
gzip MFH 2016-03-10 21:16:01 +00:00
head
hesinfo
hexdump Fix a bug that caused nothing to be skipped when skipping exactly the 2016-02-14 14:23:56 +00:00
host
iconv META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
id
ident MFH 2016-03-10 21:16:01 +00:00
indent Fix a ton of speelling errors 2015-10-21 05:37:09 +00:00
ipcrm Update dependencies after r291406 added libelf to libkvm. 2015-12-01 05:18:48 +00:00
ipcs Update dependencies after r291406 added libelf to libkvm. 2015-12-01 05:18:48 +00:00
iscsictl MFH 2016-03-02 16:14:46 +00:00
join MFH 2016-03-10 21:16:01 +00:00
jot MFH 2016-03-10 21:16:01 +00:00
kdump Fix reporting of the CloudABI ABI in kdump. 2016-03-09 18:38:30 +00:00
keylogin
keylogout
killall
ktrace Add a cross reference to ktrace(2). 2016-03-31 23:57:03 +00:00
ktrdump Update dependencies after r291406 added libelf to libkvm. 2015-12-01 05:18:48 +00:00
lam
last Unbreak "last reboot". 2015-07-21 10:52:05 +00:00
lastcomm MFH 2016-03-10 21:16:01 +00:00
ldd We don't support a.out executables on RISC-V. 2016-01-24 15:15:57 +00:00
leave
less - Add support for zip to lesspipe.sh 2016-01-15 23:13:01 +00:00
lessecho
lesskey
lex Use NULL instead of 0 for pointers. 2016-04-19 02:05:32 +00:00
limits MFH 2016-03-14 18:54:29 +00:00
locale Use the nitems() macro 2016-04-17 22:42:48 +00:00
localedef Plug memory leaks 2016-04-20 21:23:42 +00:00
locate Fix type mismatches for malloc(3) and Co. 2015-12-29 11:24:41 +00:00
lock
lockf
logger
login Use NULL instead of 0. 2016-04-18 05:26:32 +00:00
logins
logname
look Fix a ton of speelling errors 2015-10-21 05:37:09 +00:00
lorder Introduce a new make variable: NMFLAGS. 2015-08-14 22:54:52 +00:00
lsvfs
lzmainfo
m4 Use NULL instead of 0 for pointers. 2016-04-18 07:09:34 +00:00
mail mail: Don't truncate mtime of mailbox to microseconds. 2016-04-17 20:00:24 +00:00
makewhatis Fix installation of makewhatis.local(1) since r283777. 2016-02-18 00:26:21 +00:00
man Restore man -t for manpages rendered by mandoc 2015-09-19 16:00:50 +00:00
mandoc Update mandoc to 20160116 2016-01-15 23:28:12 +00:00
mesg
minigzip
ministat Compute the median of the data set as the midpoint between the two middle 2015-11-24 02:30:59 +00:00
mkcsmapper DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
mkcsmapper_static META_MODE: Don't rebuild build-tools targets during normal build. 2016-04-14 21:06:10 +00:00
mkdep Replace gcc reference with 'cc' and document the default ${CC}. 2015-10-24 05:16:30 +00:00
mkesdb DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
mkesdb_static META_MODE: Don't rebuild build-tools targets during normal build. 2016-04-14 21:06:10 +00:00
mkfifo
mkimg MFH 2016-03-10 21:16:01 +00:00
mklocale Note that mklocale(1) and colldef(1) are no longer used 2016-04-17 23:02:49 +00:00
mkstr
mktemp
mkuzip Improve performance in a few key areas: 2016-04-23 07:23:43 +00:00
morse Final step of eliminating the "games" distribution: Merge src/games 2015-10-02 10:08:11 +00:00
msgs
mt Fix a ton of speelling errors 2015-10-21 05:37:09 +00:00
nc
ncal MFH 2016-03-10 21:16:01 +00:00
netstat Use macro MAX() from sys/param.h. 2016-04-22 03:37:27 +00:00
newgrp
newkey
nfsstat DIRDEPS_BUILD: Update dependencies. 2016-01-07 19:58:23 +00:00
nice
nl
nm elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
nohup
numactl numactl: fix CPU affinity when modifying an existing process or thread 2016-01-14 01:34:41 +00:00
number Final step of eliminating the "games" distribution: Merge src/games 2015-10-02 10:08:11 +00:00
opieinfo
opiekey
opiepasswd
pagesize
pamtest META_MODE: Remove DEP_MACHINE from Makefile.depend files. 2015-09-25 19:44:01 +00:00
passwd Restore the 'beforeinstall' for chpass(1), so files with the 2016-01-28 02:56:30 +00:00
paste
patch META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
pathchk
perror
pom Fix LDADD/DPADD that should be LIBADD. 2015-12-04 03:17:47 +00:00
pr Fix a ton of speelling errors 2015-10-21 05:37:09 +00:00
primes Fix LDADD/DPADD that should be LIBADD. 2015-12-04 03:17:47 +00:00
printenv
printf MFH 2016-03-10 21:16:01 +00:00
procstat Implement process-shared locks support for libthr.so.3, without 2016-02-28 17:52:33 +00:00
protect META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
quota - Add IPv6 support in quota(1). While rpc.rquotad has supported PF_INET6 2015-07-07 20:15:09 +00:00
random Final step of eliminating the "games" distribution: Merge src/games 2015-10-02 10:08:11 +00:00
rctl Add four new RCTL resources - readbps, readiops, writebps and writeiops, 2016-04-07 04:23:25 +00:00
readelf elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
renice
resizewin Fix a mandoc -Tlint warning 2016-04-16 12:49:26 +00:00
rev
revoke
rlogin Create a rcmds package. 2016-01-21 17:33:31 +00:00
rpcgen Use NULL for pointers. 2016-04-18 06:02:26 +00:00
rpcinfo
rs
rsh Create a rcmds package. 2016-01-21 17:33:31 +00:00
rup
ruptime Create a rcmds package. 2016-01-21 17:33:31 +00:00
rusers
rwall
rwho Create a rcmds package. 2016-01-21 17:33:31 +00:00
script Directly set the O_CLOEXEC flags via the open(2) attributes 2016-04-16 12:47:23 +00:00
sed kernel: use our nitems() macro when it is available through param.h. 2016-04-21 21:30:51 +00:00
send-pr META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
seq
setchannel META_MODE: Remove DEP_MACHINE from Makefile.depend files. 2015-09-25 19:44:01 +00:00
shar
showmount Cleanup unnecessary semicolons from utilities we all love. 2016-04-15 22:31:22 +00:00
size elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
smbutil META MODE: Update dependencies with 'the-lot' and add missing directories. 2015-12-01 05:23:19 +00:00
sockstat Fix a ton of speelling errors 2015-10-21 05:37:09 +00:00
soelim MFH 2016-03-10 21:16:01 +00:00
sort Cleanup unnecessary semicolons from utilities we all love. 2016-04-15 22:31:22 +00:00
split
ssh-copy-id
stat Use macro MAX() from sys/param.h. 2016-04-22 03:43:06 +00:00
stdbuf
strings elftoolchain: Use ${SRCTOP} for the top of the FreeBSD tree 2016-04-21 12:58:29 +00:00
su
svn MFH r289384-r293170 2016-01-04 19:19:48 +00:00
systat Use NULL instead of 0 for pointers. 2016-04-20 01:26:03 +00:00
tabs
tail
talk User NULL instead of 0 for pointers. 2016-04-18 07:14:01 +00:00
tar MFH 2016-03-10 21:16:01 +00:00
tcopy
tee
telnet
tests MFH 2016-03-10 21:16:01 +00:00
tftp Partially revert the change on r298325 where there is an 2016-04-20 01:38:54 +00:00
time
timeout MFH 2016-03-10 21:16:01 +00:00
tip Don't hide build commands. 2015-09-18 21:01:52 +00:00
top DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
touch
tput
tr MFH 2016-03-10 21:16:01 +00:00
true
truncate MFH 2016-03-10 21:16:01 +00:00
truss Cleanup unnecessary semicolons from utilities we all love. 2016-04-15 22:31:22 +00:00
tset
tsort
tty
ul
uname
unexpand
unifdef Avoid -Wmissing-initializer 2015-12-03 14:32:54 +00:00
uniq
units Bring a little more compability with GNU units 2.12 2016-04-21 05:24:47 +00:00
unvis
unzip - Match directory extraction message with Infozip [1] 2016-01-15 23:04:36 +00:00
usbhidaction Store PID after becoming a daemon() and not before to ensure the 2015-09-28 07:23:05 +00:00
usbhidctl
users
uudecode MFH 2016-03-10 21:16:01 +00:00
uuencode MFH 2016-04-11 15:24:59 +00:00
vacation DIRDEPS_BUILD: Regenerate without local dependencies. 2016-02-24 17:20:11 +00:00
vgrind Remove disconnected directory RETEST. 2015-12-04 05:00:51 +00:00
vi MFH 2016-04-16 02:32:12 +00:00
vis
vmstat Use MIN() macro from sys/param.h. 2016-04-22 03:46:57 +00:00
vtfontcvt vtfontcvt: support .hex fonts with characters beyond the Unicode BMP 2016-03-15 21:32:46 +00:00
w Add more text to explain --libxo flag. 2015-12-01 19:18:53 +00:00
wall Revert r286144 leaving the original fix to the buffer overflow. 2015-08-04 02:56:31 +00:00
wc Add more text to explain --libxo flag. 2015-12-01 19:18:53 +00:00
what
whereis Fix bad checking of the return of realloc(3) 2016-04-20 20:56:06 +00:00
which
who
whois Handle whois referrals between RIRs 2016-04-08 11:43:22 +00:00
write
xargs MFH 2016-03-10 21:16:01 +00:00
xinstall META MODE: Remove unneeded libmd.host dependency for xinstall.host. 2015-11-25 19:44:55 +00:00
xlint Use roundup2() macro from sys/param.h. 2016-04-22 06:23:23 +00:00
xo MFH 2016-04-04 23:55:32 +00:00
xstr Cleanup unnecessary semicolons from utilities we all love. 2016-04-15 22:31:22 +00:00
xz
xzdec
yacc MFH 2016-03-10 21:16:01 +00:00
yes
ypcat Rename YP to NIS in the manpages. 2015-09-03 07:18:52 +00:00
ypmatch Rename YP to NIS in the manpages. 2015-09-03 07:18:52 +00:00
ypwhich Rename YP to NIS in the manpages. 2015-09-03 07:18:52 +00:00
Makefile Add a small tool, resizewin(1), to query terminal for window size 2016-04-13 00:30:42 +00:00
Makefile.amd64
Makefile.arm
Makefile.i386
Makefile.inc
Makefile.powerpc
Makefile.sparc64