freebsd-dev/sys/arm/at91
Matt Macy d7c5a620e2 ifnet: Replace if_addr_lock rwlock with epoch + mutex
Run on LLNW canaries and tested by pho@

gallatin:
Using a 14-core, 28-HTT single socket E5-2697 v3 with a 40GbE MLX5
based ConnectX 4-LX NIC, I see an almost 12% improvement in received
packet rate, and a larger improvement in bytes delivered all the way
to userspace.

When the host receiving 64 streams of netperf -H $DUT -t UDP_STREAM -- -m 1,
I see, using nstat -I mce0 1 before the patch:

InMpps OMpps  InGbs  OGbs err TCP Est %CPU syscalls csw     irq GBfree
4.98   0.00   4.42   0.00 4235592     33   83.80 4720653 2149771   1235 247.32
4.73   0.00   4.20   0.00 4025260     33   82.99 4724900 2139833   1204 247.32
4.72   0.00   4.20   0.00 4035252     33   82.14 4719162 2132023   1264 247.32
4.71   0.00   4.21   0.00 4073206     33   83.68 4744973 2123317   1347 247.32
4.72   0.00   4.21   0.00 4061118     33   80.82 4713615 2188091   1490 247.32
4.72   0.00   4.21   0.00 4051675     33   85.29 4727399 2109011   1205 247.32
4.73   0.00   4.21   0.00 4039056     33   84.65 4724735 2102603   1053 247.32

After the patch

InMpps OMpps  InGbs  OGbs err TCP Est %CPU syscalls csw     irq GBfree
5.43   0.00   4.20   0.00 3313143     33   84.96 5434214 1900162   2656 245.51
5.43   0.00   4.20   0.00 3308527     33   85.24 5439695 1809382   2521 245.51
5.42   0.00   4.19   0.00 3316778     33   87.54 5416028 1805835   2256 245.51
5.42   0.00   4.19   0.00 3317673     33   90.44 5426044 1763056   2332 245.51
5.42   0.00   4.19   0.00 3314839     33   88.11 5435732 1792218   2499 245.52
5.44   0.00   4.19   0.00 3293228     33   91.84 5426301 1668597   2121 245.52

Similarly, netperf reports 230Mb/s before the patch, and 270Mb/s after the patch

Reviewed by:	gallatin
Sponsored by:	Limelight Networks
Differential Revision:	https://reviews.freebsd.org/D15366
2018-05-18 20:13:34 +00:00
..
at91_aic.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_aicreg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_cfata.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_common.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_gpio.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_machdep.c Use the TSLOG framework to record entry/exit timestamps for DELAY and 2017-12-31 09:24:41 +00:00
at91_mci.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_mcireg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_ohci_fdt.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_ohci.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pdcreg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pinctrl.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pio_sam9g20.h
at91_pio_sam9g45.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_pio.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pioreg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_piovar.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pit.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_pitreg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_pmc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pmcreg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_pmcvar.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_reset.S sys/arm: Minor spelling fixes. 2016-05-04 15:48:59 +00:00
at91_rst.c This is MPSAFE on this platform, so don't take Giant out while running 2018-03-21 14:47:08 +00:00
at91_rstreg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_rtc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_rtcreg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_sdramc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_shdwc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_smc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_smc.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_spi.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_spireg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_ssc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_sscreg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_st.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_streg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_tcb.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_twi.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_twiio.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_twireg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91_usartreg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_wdt.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91_wdtreg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91board.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91rm92reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91rm9200_devices.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91rm9200.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91rm9200var.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91sam9g20.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9g20reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9g45.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9g45reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9x5.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91sam9x5reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9260.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91sam9260reg.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
at91soc.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91soc.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
at91var.h sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_bwct.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
board_eb9200.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
board_ethernut5.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_hl200.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
board_hl201.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
board_kb920x.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
board_qila9g20.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_sam9g20ek.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_sam9x25ek.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_sam9260ek.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_sn9g45.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
board_tsc4370.c Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
files.at91 We don't need at91_bs_tag. arm_base_bs_tag works now that we have 2016-01-16 05:47:34 +00:00
if_ate.c ifnet: Replace if_addr_lock rwlock with epoch + mutex 2018-05-18 20:13:34 +00:00
if_atereg.h Remove 'All Rights Reserved.' from all of my Copyrights in sys/arm and 2018-05-01 16:21:01 +00:00
if_macb.c ifnet: Replace if_addr_lock rwlock with epoch + mutex 2018-05-18 20:13:34 +00:00
if_macbreg.h
if_macbvar.h
std.at91
std.at91sam9
std.at91sam9g45
std.atmel
std.bwct Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.eb9200 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.ethernut5 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.hl200 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.hl201 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.kb920x Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.qila9g20 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.sam9g20ek Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.sam9x25ek Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.sam9260ek Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.sn9g45 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
std.tsc4370 Remove the arm KERNPHYSADDR option as it is no longer used. The make 2015-12-22 09:08:21 +00:00
uart_bus_at91usart.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
uart_cpu_at91usart.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00
uart_dev_at91usart.c sys/arm: further adoption of SPDX licensing ID tags. 2017-11-27 15:04:10 +00:00