cf1eeb33be
This speeds up buildworld by 16% on my system and buildkernel by 35%.
Rather than calling mkdep(1), which is just a wrapper around 'cc -E',
use the modern -MD -MT -MF flags to gather and generate dependencies during
compilation. This flag was introduced in GCC "a long time ago", in GCC 3.0,
and is also supported by Clang. (It appears that ICC also supports this but I
do not have access to test it). This avoids running the preprocessor *twice*
for every build, in both 'make depend' and 'make all'. This is especially
noticeable when using ccache since it does not cache preprocessor results from
mkdep(1) / 'cc -E', but still speeds up compilation with the -MD flags.
For 'make depend' a tree-walk is still done to ensure that all DPSRCS
are generated when expected, and that beforedepend/afterdepend and
_EXTRADEPEND are all still respected. In time this may change but for now
I've been conservative. The time for a tree-walk with -j combined with
SUBDIR_PARALLEL is not significant. For example, it takes about 9 seconds
with -j15 to walk all of src/ for 'make depend' now on my system.
A .depend file is still generated with the various rules that apply to
the final target, or custom rules. Otherwise there are now
per-built-object-file .depend files, such as .depend.filename.o. These
are included directly by make rather than populating .depend with a loop
and .depend lines, which only added overhead to the now almost-NOP 'make
depend' phase.
Before this I experimented with having mkdep(1) called in parallel per-file.
While this improved the kernel and lib/libc 'make depend' phase, it resulted
in slower build times overall.
The -M flags are removed from CFLAGS when linking since they have no effect.
Enabling this by default, for src or out-of-src, can be done once more testing
has been done, such as a ports exp-run, and with more compilers.
The system I used for testing was:
WITNESS
Build options: -j20 WITH_LLDB=yes WITH_DEBUG_FILES=yes WITH_FAST_DEPEND=yes
DISK: ZFS 3-way mirror with very slow disks using SSD l2arc/log.
The arc was fully populated with src tree files.
RAM: 76GiB
CPU: Intel(R) Xeon(R) CPU L5520 @2.27GHz
2 package(s) x 4 core(s) x 2 SMT threads = hw.ncpu=16
buildworld:
x buildworld-before
+ buildworld-fastdep
+-------------------------------------------------------------------------------+
|+ |
|+ |
|+ xx x|
| |_MA___||
|A |
+-------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 3 3744.13 3794.31 3752.25 3763.5633 26.935139
+ 3 3153.34 3155.16 3154.2 3154.2333 0.91045776
Difference at 95.0% confidence
-609.33 +/- 43.1943
-16.1902% +/- 1.1477%
(Student's t, pooled s = 19.0569)
buildkernel:
x buildkernel-before
+ buildkernel-fastdep
+-------------------------------------------------------------------------------+
|+ x |
|++ xx|
| A||
|A| |
+-------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 3 571.57 573.94 571.79 572.43333 1.3094401
+ 3 369.12 370.57 369.3 369.66333 0.79033748
Difference at 95.0% confidence
-202.77 +/- 2.45131
-35.4225% +/- 0.428227%
(Student's t, pooled s = 1.0815)
Sponsored by: EMC / Isilon Storage Division
MFC after: 3 weeks
Relnotes: yes
249 lines
6.0 KiB
Makefile
249 lines
6.0 KiB
Makefile
# $FreeBSD$
|
|
#
|
|
# The include file <bsd.dep.mk> handles Makefile dependencies.
|
|
#
|
|
#
|
|
# +++ variables +++
|
|
#
|
|
# CTAGS A tags file generation program [gtags]
|
|
#
|
|
# CTAGSFLAGS Options for ctags(1) [not set]
|
|
#
|
|
# DEPENDFILE dependencies file [.depend]
|
|
#
|
|
# GTAGSFLAGS Options for gtags(1) [-o]
|
|
#
|
|
# HTAGSFLAGS Options for htags(1) [not set]
|
|
#
|
|
# MKDEP Options for ${MKDEPCMD} [not set]
|
|
#
|
|
# MKDEPCMD Makefile dependency list program [mkdep]
|
|
#
|
|
# SRCS List of source files (c, c++, assembler)
|
|
#
|
|
# DPSRCS List of source files which are needed for generating
|
|
# dependencies, ${SRCS} are always part of it.
|
|
#
|
|
# +++ targets +++
|
|
#
|
|
# cleandepend:
|
|
# Remove depend and tags file
|
|
#
|
|
# depend:
|
|
# Make the dependencies for the source files, and store
|
|
# them in the file ${DEPENDFILE}.
|
|
#
|
|
# tags:
|
|
# In "ctags" mode, create a tags file for the source files.
|
|
# In "gtags" mode, create a (GLOBAL) gtags file for the
|
|
# source files. If HTML is defined, htags(1) is also run
|
|
# after gtags(1).
|
|
|
|
.if !target(__<bsd.init.mk>__)
|
|
.error bsd.dep.mk cannot be included directly.
|
|
.endif
|
|
|
|
CTAGS?= gtags
|
|
CTAGSFLAGS?=
|
|
GTAGSFLAGS?= -o
|
|
HTAGSFLAGS?=
|
|
|
|
.if ${CC} != "cc"
|
|
MKDEPCMD?= CC='${CC} ${DEPFLAGS}' mkdep
|
|
.else
|
|
MKDEPCMD?= mkdep
|
|
.endif
|
|
DEPENDFILE?= .depend
|
|
DEPENDFILES= ${DEPENDFILE}
|
|
.if ${MK_FAST_DEPEND} == "yes"
|
|
DEPENDFILES+= ${DEPENDFILE}.*
|
|
DEPEND_CFLAGS+= -MD -MP -MF${DEPENDFILE}.${.TARGET}
|
|
DEPEND_CFLAGS+= -MT${.TARGET}
|
|
CFLAGS+= ${DEPEND_CFLAGS}
|
|
DEPENDOBJS+= ${OBJS} ${POBJS} ${SOBJS}
|
|
.for __obj in ${DEPENDOBJS:O:u}
|
|
.sinclude "${DEPENDFILE}.${__obj}"
|
|
DEPENDFILES_OBJS+= ${DEPENDFILE}.${__obj}
|
|
.endfor
|
|
.endif # ${MK_FAST_DEPEND} == "yes"
|
|
|
|
# Keep `tags' here, before SRCS are mangled below for `depend'.
|
|
.if !target(tags) && defined(SRCS) && !defined(NO_TAGS)
|
|
tags: ${SRCS}
|
|
.if ${CTAGS:T} == "gtags"
|
|
@cd ${.CURDIR} && ${CTAGS} ${GTAGSFLAGS} ${.OBJDIR}
|
|
.if defined(HTML)
|
|
@cd ${.CURDIR} && htags ${HTAGSFLAGS} -d ${.OBJDIR} ${.OBJDIR}
|
|
.endif
|
|
.else
|
|
@${CTAGS} ${CTAGSFLAGS} -f /dev/stdout \
|
|
${.ALLSRC:N*.h} | sed "s;${.CURDIR}/;;" > ${.TARGET}
|
|
.endif
|
|
.endif
|
|
|
|
.if defined(SRCS)
|
|
CLEANFILES?=
|
|
|
|
.if !exists(${.OBJDIR}/${DEPENDFILE})
|
|
.for _S in ${SRCS:N*.[dhly]}
|
|
${_S:R}.o: ${_S}
|
|
.endfor
|
|
.endif
|
|
|
|
# Lexical analyzers
|
|
.for _LSRC in ${SRCS:M*.l:N*/*}
|
|
.for _LC in ${_LSRC:R}.c
|
|
${_LC}: ${_LSRC}
|
|
${LEX} ${LFLAGS} -o${.TARGET} ${.ALLSRC}
|
|
.if !exists(${.OBJDIR}/${DEPENDFILE})
|
|
${_LC:R}.o: ${_LC}
|
|
.endif
|
|
SRCS:= ${SRCS:S/${_LSRC}/${_LC}/}
|
|
CLEANFILES+= ${_LC}
|
|
.endfor
|
|
.endfor
|
|
|
|
# Yacc grammars
|
|
.for _YSRC in ${SRCS:M*.y:N*/*}
|
|
.for _YC in ${_YSRC:R}.c
|
|
SRCS:= ${SRCS:S/${_YSRC}/${_YC}/}
|
|
CLEANFILES+= ${_YC}
|
|
.if !empty(YFLAGS:M-d) && !empty(SRCS:My.tab.h)
|
|
.ORDER: ${_YC} y.tab.h
|
|
${_YC} y.tab.h: ${_YSRC}
|
|
${YACC} ${YFLAGS} ${.ALLSRC}
|
|
cp y.tab.c ${_YC}
|
|
CLEANFILES+= y.tab.c y.tab.h
|
|
.elif !empty(YFLAGS:M-d)
|
|
.for _YH in ${_YC:R}.h
|
|
${_YH}: ${_YC}
|
|
${_YC}: ${_YSRC}
|
|
${YACC} ${YFLAGS} -o ${_YC} ${.ALLSRC}
|
|
SRCS+= ${_YH}
|
|
CLEANFILES+= ${_YH}
|
|
.endfor
|
|
.else
|
|
${_YC}: ${_YSRC}
|
|
${YACC} ${YFLAGS} -o ${_YC} ${.ALLSRC}
|
|
.endif
|
|
.if !exists(${.OBJDIR}/${DEPENDFILE})
|
|
${_YC:R}.o: ${_YC}
|
|
.endif
|
|
.endfor
|
|
.endfor
|
|
|
|
# DTrace probe definitions
|
|
.if ${SRCS:M*.d}
|
|
CFLAGS+= -I${.OBJDIR}
|
|
.endif
|
|
.for _DSRC in ${SRCS:M*.d:N*/*}
|
|
.for _D in ${_DSRC:R}
|
|
DHDRS+= ${_D}.h
|
|
${_D}.h: ${_DSRC}
|
|
${DTRACE} ${DTRACEFLAGS} -h -s ${.ALLSRC}
|
|
SRCS:= ${SRCS:S/^${_DSRC}$//}
|
|
OBJS+= ${_D}.o
|
|
CLEANFILES+= ${_D}.h ${_D}.o
|
|
${_D}.o: ${_DSRC} ${OBJS:S/^${_D}.o$//}
|
|
${DTRACE} ${DTRACEFLAGS} -G -o ${.TARGET} -s ${.ALLSRC}
|
|
.if defined(LIB)
|
|
CLEANFILES+= ${_D}.So ${_D}.po
|
|
${_D}.So: ${_DSRC} ${SOBJS:S/^${_D}.So$//}
|
|
${DTRACE} ${DTRACEFLAGS} -G -o ${.TARGET} -s ${.ALLSRC}
|
|
${_D}.po: ${_DSRC} ${POBJS:S/^${_D}.po$//}
|
|
${DTRACE} ${DTRACEFLAGS} -G -o ${.TARGET} -s ${.ALLSRC}
|
|
.endif
|
|
.endfor
|
|
.endfor
|
|
beforedepend: ${DHDRS}
|
|
beforebuild: ${DHDRS}
|
|
.endif
|
|
|
|
.if ${MK_META_MODE} == "yes"
|
|
.include <meta.autodep.mk>
|
|
# this depend: bypasses that below
|
|
# the dependency helps when bootstrapping
|
|
depend: beforedepend ${DPSRCS} ${SRCS} afterdepend
|
|
beforedepend:
|
|
afterdepend: beforedepend
|
|
.endif
|
|
|
|
.if !target(depend)
|
|
.if defined(SRCS)
|
|
depend: beforedepend ${DEPENDFILE} afterdepend
|
|
|
|
# Tell bmake not to look for generated files via .PATH
|
|
.NOPATH: ${DEPENDFILE} ${DEPENDFILES_OBJS}
|
|
|
|
# Different types of sources are compiled with slightly different flags.
|
|
# Split up the sources, and filter out headers and non-applicable flags.
|
|
MKDEP_CFLAGS= ${CFLAGS:M-nostdinc*} ${CFLAGS:M-[BIDU]*} ${CFLAGS:M-std=*} \
|
|
${CFLAGS:M-ansi}
|
|
MKDEP_CXXFLAGS= ${CXXFLAGS:M-nostdinc*} ${CXXFLAGS:M-[BIDU]*} \
|
|
${CXXFLAGS:M-std=*} ${CXXFLAGS:M-ansi} ${CXXFLAGS:M-stdlib=*}
|
|
|
|
DPSRCS+= ${SRCS}
|
|
${DEPENDFILE}: ${DPSRCS}
|
|
.if ${MK_FAST_DEPEND} == "no"
|
|
rm -f ${DEPENDFILE}
|
|
.if !empty(DPSRCS:M*.[cS])
|
|
${MKDEPCMD} -f ${DEPENDFILE} -a ${MKDEP} \
|
|
${MKDEP_CFLAGS} ${.ALLSRC:M*.[cS]}
|
|
.endif
|
|
.if !empty(DPSRCS:M*.cc) || !empty(DPSRCS:M*.C) || !empty(DPSRCS:M*.cpp) || \
|
|
!empty(DPSRCS:M*.cxx)
|
|
${MKDEPCMD} -f ${DEPENDFILE} -a ${MKDEP} \
|
|
${MKDEP_CXXFLAGS} \
|
|
${.ALLSRC:M*.cc} ${.ALLSRC:M*.C} ${.ALLSRC:M*.cpp} ${.ALLSRC:M*.cxx}
|
|
.else
|
|
.endif
|
|
.else
|
|
: > ${.TARGET}
|
|
.endif # ${MK_FAST_DEPEND} == "no"
|
|
.if target(_EXTRADEPEND)
|
|
_EXTRADEPEND: .USE
|
|
${DEPENDFILE}: _EXTRADEPEND
|
|
.endif
|
|
|
|
.ORDER: ${DEPENDFILE} afterdepend
|
|
.else
|
|
depend: beforedepend afterdepend
|
|
.endif
|
|
.if !target(beforedepend)
|
|
beforedepend:
|
|
.else
|
|
.ORDER: beforedepend ${DEPENDFILE}
|
|
.ORDER: beforedepend afterdepend
|
|
.endif
|
|
.if !target(afterdepend)
|
|
afterdepend:
|
|
.endif
|
|
.endif
|
|
|
|
.if !target(cleandepend)
|
|
cleandepend:
|
|
.if defined(SRCS)
|
|
.if ${CTAGS:T} == "gtags"
|
|
rm -f ${DEPENDFILES} GPATH GRTAGS GSYMS GTAGS
|
|
.if defined(HTML)
|
|
rm -rf HTML
|
|
.endif
|
|
.else
|
|
rm -f ${DEPENDFILES} tags
|
|
.endif
|
|
.endif
|
|
.endif
|
|
|
|
.if !target(checkdpadd) && (defined(DPADD) || defined(LDADD))
|
|
_LDADD_FROM_DPADD= ${DPADD:R:T:C;^lib(.*)$;-l\1;g}
|
|
# Ignore -Wl,--start-group/-Wl,--end-group as it might be required in the
|
|
# LDADD list due to unresolved symbols
|
|
_LDADD_CANONICALIZED= ${LDADD:N:R:T:C;^lib(.*)$;-l\1;g:N-Wl,--[es]*-group}
|
|
checkdpadd:
|
|
.if ${_LDADD_FROM_DPADD} != ${_LDADD_CANONICALIZED}
|
|
@echo ${.CURDIR}
|
|
@echo "DPADD -> ${_LDADD_FROM_DPADD}"
|
|
@echo "LDADD -> ${_LDADD_CANONICALIZED}"
|
|
.endif
|
|
.endif
|