Alexander Motin e16b3fcc61 Illumos 5008 - lock contention (rrw_exit) while running a read only load ...

5008 lock contention (rrw_exit) while running a read only load
Reviewed by: Matthew Ahrens <matthew.ahrens@delphix.com>
Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Alex Reece <alex.reece@delphix.com>
Reviewed by: Christopher Siden <christopher.siden@delphix.com>
Reviewed by: Richard Yao <ryao@gentoo.org>
Reviewed by: Saso Kiselkov <skiselkov.ml@gmail.com>
Approved by: Garrett D'Amore <garrett@damore.org>

Porting notes:

This patch ported perfectly cleanly to ZoL.  During testing 100% cached
small-block reads, extreme contention was noticed on rrl->rr_lock from
rrw_exit() due to the frequent entering and leaving ZPL.  Illumos picked
up this patch from FreeBSD and it also helps under Linux.

On a 1-minute 4K cached read test with 10 fio processes pinned to a single
socket on a 4-socket (10 thread per socket) NUMA system, contentions on
rrl->rr_lock were reduced from 508799 to 43085.

Ported-by: Tim Chase <tim@chase2k.com>
Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov>
Closes #3555

2015-07-06 09:34:13 -07:00

..

arc.c

Illumos 6033 - arc_adjust() should search MFU lists

2015-07-01 11:09:15 -07:00

blkptr.c

Illumos 4757, 4913

2014-08-01 14:28:05 -07:00

bplist.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

bpobj.c

Illumos 5810 - zdb should print details of bpobj

2015-05-11 15:10:24 -07:00

bptree.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

dbuf_stats.c

Illumos 5497 - lock contention on arcs_mtx

2015-06-11 10:27:25 -07:00

dbuf.c

Illumos 5911 - ZFS "hangs" while deleting file

2015-07-06 09:31:42 -07:00

ddt_zap.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

ddt.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

dmu_diff.c

Illumos 5369 - arc flags should be an enum

2015-06-11 10:27:25 -07:00

dmu_object.c

Illumos 3693 - restore_object uses at least two transactions to restore an object

2014-10-21 15:26:50 -07:00

dmu_objset.c

Illumos 5981 - Deadlock in dmu_objset_find_dp

2015-07-06 09:31:35 -07:00

dmu_send.c

Illumos 5946, 5945

2015-07-06 09:31:30 -07:00

dmu_traverse.c

Wait interruptibly in prefetch thread

2015-06-16 16:18:11 -07:00

dmu_tx.c

Illumos 5911 - ZFS "hangs" while deleting file

2015-07-06 09:31:42 -07:00

dmu_zfetch.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

dmu.c

Illumos 5175 - implement dmu_read_uio_dbuf() to improve cached read performance

2015-06-29 14:33:23 -07:00

dnode_sync.c

Illumos 5911 - ZFS "hangs" while deleting file

2015-07-06 09:31:42 -07:00

dnode.c

Illumos 5911 - ZFS "hangs" while deleting file

2015-07-06 09:31:42 -07:00

dsl_bookmark.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_dataset.c

Illumos 5909 - ensure that shared snap names don't become too long after promotion

2015-07-06 09:21:30 -07:00

dsl_deadlist.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

dsl_deleg.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_destroy.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

dsl_dir.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_pool.c

Illumos 5981 - Deadlock in dmu_objset_find_dp

2015-07-06 09:31:35 -07:00

dsl_prop.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_scan.c

Illumos 5369 - arc flags should be an enum

2015-06-11 10:27:25 -07:00

dsl_synctask.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_userhold.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

fm.c

zfsdev_getminor() should check for invalid file handles

2015-06-22 17:02:13 -07:00

gzip.c

cstyle: Resolve C style issues

2013-12-18 16:46:35 -08:00

lz4.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

lzjb.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

Makefile.in

Illumos 5497 - lock contention on arcs_mtx

2015-06-11 10:27:25 -07:00

metaslab.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00

multilist.c

Illumos 5497 - lock contention on arcs_mtx

2015-06-11 10:27:25 -07:00

range_tree.c

Illumos 5163 - arc should reap range_seg_cache

2015-06-25 08:58:16 -07:00

refcount.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

rrwlock.c

Illumos 5008 - lock contention (rrw_exit) while running a read only load

2015-07-06 09:34:13 -07:00

sa.c

Illumos 5562 - ZFS sa_handle's violate kmem invariants, debug kernels panic on boot

2015-05-11 15:10:57 -07:00

sha256.c

Add linux sha2 support

2010-08-31 13:41:59 -07:00

spa_boot.c

Add linux kernel module support

2010-08-31 13:41:58 -07:00

spa_config.c

Use vmem_alloc() in spa_config_write()

2015-04-07 15:10:19 -07:00

spa_errlog.c

Illumos 4914 - zfs on-disk bookmark structure should be named *_phys_t

2014-08-06 14:48:41 -07:00

spa_history.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

spa_misc.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00

spa_stats.c

Illumos 5369 - arc flags should be an enum

2015-06-11 10:27:25 -07:00

spa.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00

space_map.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

space_reftree.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

trace.c

Illumos 5497 - lock contention on arcs_mtx

2015-06-11 10:27:25 -07:00

txg.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00

uberblock.c

Illumos #3598

2013-10-31 14:58:04 -07:00

unique.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

vdev_cache.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

vdev_disk.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

vdev_file.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00

vdev_label.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

vdev_mirror.c

Illumos #5244 - zio pipeline callers should explicitly invoke next stage

2015-04-30 15:07:47 -07:00

vdev_missing.c

Illumos #5244 - zio pipeline callers should explicitly invoke next stage

2015-04-30 15:07:47 -07:00

vdev_queue.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

vdev_raidz.c

Illumos #5244 - zio pipeline callers should explicitly invoke next stage

2015-04-30 15:07:47 -07:00

vdev_root.c

Illumos #3598

2013-10-31 14:58:04 -07:00

vdev.c

Remove unused variable in vdev_add_child()

2015-06-11 10:22:38 -07:00

zap_leaf.c

Illumos 5314 - Remove "dbuf phys" db->db_data pointer aliases in ZFS

2015-04-28 16:25:20 -07:00

zap_micro.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

zap.c

Illumos 3654,3656

2015-05-04 09:41:09 -07:00

zfeature_common.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

zfeature.c

Use cached feature info in spa_add_feature_stats()

2015-03-05 14:11:10 -08:00

zfs_acl.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

zfs_byteswap.c

Add linux kernel module support

2010-08-31 13:41:58 -07:00

zfs_ctldir.c

Illumos 4368, 4369.

2014-07-29 10:55:29 -07:00

zfs_debug.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

zfs_dir.c

Revert "Revert "Revert "Fix unlink/xattr deadlock"""

2014-08-11 16:12:36 -07:00

zfs_fm.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

zfs_fuid.c

Illumos #3522

2013-10-30 14:51:27 -07:00

zfs_ioctl.c

Illumos 5008 - lock contention (rrw_exit) while running a read only load

2015-07-06 09:34:13 -07:00

zfs_log.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

zfs_onexit.c

zfsdev_getminor() should check for invalid file handles

2015-06-22 17:02:13 -07:00

zfs_replay.c

Linux AIO Support

2014-09-05 15:11:43 -07:00

zfs_rlock.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

zfs_sa.c

Illumos 5056 - ZFS deadlock on db_mtx and dn_holds

2015-04-28 16:25:34 -07:00

zfs_vfsops.c

Illumos 5008 - lock contention (rrw_exit) while running a read only load

2015-07-06 09:34:13 -07:00

zfs_vnops.c

Illumos 5175 - implement dmu_read_uio_dbuf() to improve cached read performance

2015-06-29 14:33:23 -07:00

zfs_znode.c

Illumos 5027 - zfs large block support

2015-05-11 12:23:16 -07:00

zil.c

Illumos 5369 - arc flags should be an enum

2015-06-11 10:27:25 -07:00

zio_checksum.c

Illumos 4757, 4913

2014-08-01 14:28:05 -07:00

zio_compress.c

Illumos 4757, 4913

2014-08-01 14:28:05 -07:00

zio_inject.c

Illumos 5497 - lock contention on arcs_mtx

2015-06-11 10:27:25 -07:00

zio.c

Illumos 5369 - arc flags should be an enum

2015-06-11 10:27:25 -07:00

zle.c

Update core ZFS code from build 121 to build 141.

2010-05-28 13:45:14 -07:00

zpl_ctldir.c

Mark additional functions as PF_FSTRANS

2015-04-17 09:35:24 -07:00

zpl_export.c

Return -ESTALE to force lookup for missing NFS file handles

2015-05-14 11:16:52 -07:00

zpl_file.c

Linux 4.1 compat: use read_iter() / write_iter()

2015-06-18 12:06:59 -07:00

zpl_inode.c

Safely handle security / ACL failures

2015-05-11 14:35:14 -07:00

zpl_super.c

Extend PF_FSTRANS critical regions

2015-04-24 09:54:22 -07:00

zpl_xattr.c

Mark additional functions as PF_FSTRANS

2015-04-17 09:35:24 -07:00

zrlock.c

Illumos 5812 - assertion failed in zrl_tryenter(): zr_owner==NULL

2015-04-30 14:43:40 -07:00

zvol.c

Update all default taskq settings

2015-06-25 08:58:16 -07:00