29 Commits

Author SHA1 Message Date
Andriy Gapon
6778adc153 7147 ztest: ztest_ddt_repair fails with ztest_pattern_match assertion
illumos/illumos-gate@aab8072633
aab8072633

https://www.illumos.org/issues/7147
  Here's the dbuf we're currently reading:
       966f200::dbuf
  addr object lvl blkid holds os
  966f200 4 0 0 1 ztest/ds_3
       966f200::print dmu_buf_t db_data
  db_data = 0x9ae0400
       0x9ae0400/10J
  0x9ae0400: c1c7ced932020d c1c7ced932020d c1c7ced932020d c1c7ced932020d
  c1c7ced932020d c1c7ced932020d c1c7ced932020d c1c7ced932020d
  c1c7ced932020d c1c7ced932020d
  The pattern we're expecting is actually this: a34ae10b5f2db2. If we attempt to
  read the block on disk we find that it has matches what ztest_ddt_repair()
  would have written:
       ~c1c7ced932020d=J
  ff3e383126cdfdf2
       966f200::print dmu_buf_impl_t db_blkptr | ::blkptr
  DVA0=<0:71d3c00:800>
  [L0 UINT64_OTHER] SHA256 OFF LE contiguous dedup single
  size=400L/400P birth=55L/55P fill=1
  cksum=18486450d3ce8c6d:75a72f4bbf117b0f:2d3a226314eb5650:2eb0fd68648b1af0
     1. zdb -U /rpool/tmp/zpool.cache -R ztest 0:71d3c00:800 | head
        Found vdev type: mirror
  0:71d3c00:800
  0 1 2 3 4 5 6 7 8 9 a b c d e f 0123456789abcdef
  000000: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.
  000010: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.
  000020: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.
  000030: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.
  000040: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.
  000050: ff3e383126cdfdf2 ff3e383126cdfdf2 ...&18>....&18>.

Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Reviewed by: Prakash Surya <prakash.surya@delphix.com>
Approved by: Robert Mustacchi <rm@joyent.com>
Author: George Wilson <george.wilson@delphix.com>
2016-07-20 09:51:33 +00:00
Andriy Gapon
fcc8f0a6e5 6950 ARC should cache compressed data
illumos/illumos-gate@dcbf3bd6a1
dcbf3bd6a1

https://www.illumos.org/issues/6950
  When reading compressed data from disk, the ARC should keep the compressed
  block cached and only decompress it when consumers access the block. The
  uncompressed data should be short-lived allowing the ARC to cache a much larger
  amount of data. The DMU would also maintain a smaller cache of uncompressed
  blocks to minimize the impact of decompressing frequently accessed blocks.

Reviewed by: Prakash Surya <prakash.surya@delphix.com>
Reviewed by: Dan Kimmel <dan.kimmel@delphix.com>
Reviewed by: Matt Ahrens <mahrens@delphix.com>
Reviewed by: Paul Dagnelie <pcd@delphix.com>
Reviewed by: Don Brady <don.brady@intel.com>
Reviewed by: Richard Elling <Richard.Elling@RichardElling.com>
Approved by: Richard Lowe <richlowe@richlowe.net>
Author: George Wilson <george.wilson@delphix.com>
2016-07-18 06:57:24 +00:00
Andriy Gapon
f728d00c4d 6314 buffer overflow in dsl_dataset_name
illumos/illumos-gate@9adfa60d48
9adfa60d48

https://www.illumos.org/issues/6314
  Callers of dsl_dataset_name pass a buffer of size ZFS_MAXNAMELEN, but
  dsl_dataset_name copies the datasets' name PLUS the snapshot name to it,
  resulting in a max of 2 * ZFS_MAXNAMELEN + '@'.

Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Prakash Surya <prakash.surya@delphix.com>
Reviewed by: Igor Kozhukhov <ikozhukhov@gmail.com>
Approved by: Dan McDonald <danmcd@omniti.com>
Author: Matthew Ahrens <mahrens@delphix.com>
2016-07-12 12:01:54 +00:00
Alexander Motin
a51bfc6a1e 5027 zfs large block support (add copyright)
Author: Matthew Ahrens <matt@mahrens.org>

illumos/illumos-gate@c3d26abc9e
2016-03-08 17:48:26 +00:00
Alexander Motin
fa4d80aacb 5960 zfs recv should prefetch indirect blocks
5925 zfs receive -o origin=

Reviewed by: Prakash Surya <prakash.surya@delphix.com>
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Author: Paul Dagnelie <pcd@delphix.com>

While running 'zfs recv' we noticed that every 128th 8K block required a
read. We were seeing that restore_write() was calling dmu_tx_hold_write()
and the indirect block was not cached. We should prefetch upcoming indirect
blocks to avoid having to go to disk and blocking the restore_write().
2015-08-12 22:36:02 +00:00
Andriy Gapon
cd7e9ce6ff 5818 zfs {ref}compressratio is incorrect with 4k sector size
Author: Matthew Ahrens <mahrens@delphix.com>
Reviewed by: George Wilson <george@delphix.com>
Reviewed by: Richard Elling <richard.elling@richardelling.com>
Reviewed by: Steven Hartland <killing@multiplay.co.uk>
Reviewed by: Don Brady <dev.fs.zfs@gmail.com>
Approved by: Albert Lee <trisk@omniti.com>

illumos/illumos-gate@81cd5c555f
2015-06-05 16:49:21 +00:00
Xin LI
f8d150572c 5408 managing ZFS cache devices requires lots of RAM
Reviewed by: Christopher Siden <christopher.siden@delphix.com>
Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Reviewed by: Don Brady <dev.fs.zfs@gmail.com>
Reviewed by: Josef 'Jeff' Sipek <josef.sipek@nexenta.com>
Approved by: Garrett D'Amore <garrett@damore.org>
Author: Chris Williamson <Chris.Williamson@delphix.com>

illumos/illumos-gate@89c86e3229
2015-01-20 20:08:50 +00:00
Xin LI
0945ce02d2 5027 zfs large block support
Reviewed by: Alek Pinchuk <pinchuk.alek@gmail.com>
Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Josef 'Jeff' Sipek <josef.sipek@nexenta.com>
Reviewed by: Richard Elling <richard.elling@richardelling.com>
Reviewed by: Saso Kiselkov <skiselkov.ml@gmail.com>
Reviewed by: Brian Behlendorf <behlendorf1@llnl.gov>
Approved by: Dan McDonald <danmcd@omniti.com>
Author: Matthew Ahrens <matt@mahrens.org>

illumos/illumos-gate@b515258426
2014-11-08 06:43:33 +00:00
Xin LI
f0315c58e9 Author: Matthew Ahrens <mahrens@delphix.com>
Date:   Fri Aug 1 11:09:46 2014 -0800

    5039 ztest should default to larger device sizes
    Reviewed by: George Wilson <george.wilson@delphix.com>
    Reviewed by: Max Grossman <max.grossman@delphix.com>
    Reviewed by: Christopher Siden <christopher.siden@delphix.com>
    Reviewed by: Saso Kiselkov <skiselkov.ml@gmail.com>
    Approved by: Richard Lowe <richlowe@richlowe.net>

illumos/illumos-gate@539eed8a40
2014-08-02 06:33:58 +00:00
Xin LI
df9458d254 4958 zdb trips assert on pools with ashift >= 0xe
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Reviewed by: Max Grossman <max.grossman@delphix.com>
Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Christopher Siden <christopher.siden@delphix.com>
Approved by: Garrett D'Amore <garrett@damore.org>

illumos/illumos-gate@2a104a5236
2014-07-18 17:55:12 +00:00
Xin LI
7c5f50e13f 4756 metaslab_group_preload() could deadlock
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Reviewed by: Christopher Siden <christopher.siden@delphix.com>
Reviewed by: Dan McDonald <danmcd@omniti.com>
Reviewed by: Saso Kiselkov <saso.kiselkov@nexenta.com>
Approved by: Garrett D'Amore <garrett@damore.org>

illumos/illumos-gate@30beaff42d
2014-06-17 08:02:50 +00:00
Xin LI
ee3ed92a53 4757 ZFS embedded-data block pointers ("zero block compression")
4913 zfs release should not be subject to space checks

Reviewed by: Adam Leventhal <ahl@delphix.com>
Reviewed by: Max Grossman <max.grossman@delphix.com>
Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Christopher Siden <christopher.siden@delphix.com>
Reviewed by: Dan McDonald <danmcd@omniti.com>
Approved by: Dan McDonald <danmcd@omniti.com>

illumos/illumos-dist@5d7b4d438c
2014-06-17 07:35:54 +00:00
Andriy Gapon
16f9dc06c8 4101 metaslab_debug should allow for fine-grained control
4102 space_maps should store more information about themselves
4103 space map object blocksize should be increased
4104 ::spa_space no longer works
4105 removing a mirrored log device results in a leaked object
4106 asynchronously load metaslab

Revision illumos/illumos-gate@0713e232b7
2013-11-20 10:41:10 +00:00
Xin LI
119a3b6b54 Update vendor/illumos/dist and vendor-sys/illumos/dist
to 14164:dceb17481b99:

Illumos ZFS issues:
  4045 zfs write throttle & i/o scheduler performance work
2013-09-05 17:52:54 +00:00
Xin LI
67f70bc889 Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 14122:1e57939bc87d:

Illumos ZFS issues:
  3956 ::vdev -r should work with pipelines
  3957 ztest should update the cachefile before killing itself
  3958 multiple scans can lead to partial resilvering
  3959 ddt entries are not always resilvered
  3960 dsl_scan can skip over dedup-ed blocks if
       physical birth != logical birth
  3961 freed gang blocks are not resilvered and can cause pool to suspend
  3962 ztest should print out zfs debug buffer before exiting
2013-08-08 00:06:25 +00:00
Xin LI
8b475cc7e4 Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 14121:6f5ac5d649af:

Illumos ZFS issues:
  3955 ztest failure: assertion refcount_count(&tx->tx_space_written) + delta <= tx->tx_space_towrite
2013-08-07 19:53:41 +00:00
Xin LI
28f378a105 Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 14120:e9e346400fef:

Illumos ZFS issues:
  3949 ztest fault injection should avoid resilvering devices
  3950 ztest: deadman fires when we're doing a scan
  3951 ztest hang when running dedup test
  3952 ztest: ztest_reguid test and ztest_fault_inject don't place nice together
2013-08-07 19:51:54 +00:00
Xin LI
03ce21f2d0 Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 14052:1a272fe1337b

Illumos ZFS issues:
  3740 Poor ZFS send / receive performance due to snapshot
       hold / release processing
2013-06-12 06:56:15 +00:00
Xin LI
08bfc9b7b6 Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 14050:0c8d9998d589

Illumos ZFS issues:
  3747 txg commit callbacks don't work
2013-06-11 18:43:25 +00:00
Martin Matuska
577227be9d Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 13973:4972ab336f54

Illumos ZFS issues:
  3464 zfs synctask code needs restructuring
2013-03-01 21:01:45 +00:00
Martin Matuska
00a61d1e73 Update vendor/illumos/dist and vendor/illumos-sys/dist
to illumos-gate 13887:196932ec9e6a
(illumos zfs issue #3236)
2012-11-14 00:43:27 +00:00
Martin Matuska
663883a40e Update vendor/illumos/dist and vendor/illumos-sys/dist
to illumos-gate 13886:e3261d03efbf
(illumos zfs issue #3349)
2012-11-14 00:40:40 +00:00
Martin Matuska
73aeb3d88b Update vendor/illumos/dist and vendor-sys/illumos/dist
to illumos-gate 13849:3468a95b27cd
(illumos ZFS issues #3145, #3212, #3258)
2012-11-08 01:24:06 +00:00
Martin Matuska
e73ba0ab20 Update vendor/illumos/dist and vendor/illumos-sys/dist
to illumos-gate 13805:e3a9ae14a119
(zfs changes, illumos issues #1884, #3006)
2012-09-09 07:52:13 +00:00
Martin Matuska
1034179220 Update vendor/illumos/dist and vendor/illumos-gate/dist
to illumos-gate revision 13794:7c5e0e746b2c

Obtained from:	ssh://anonhg@hg.illumos.org/illumos-gate
2012-09-04 21:58:22 +00:00
Martin Matuska
b15aa3a4ae Update vendor/illumos and vendor-sys/illumos to revision 13777:b1e53580146d
Obtained from:	ssh://anonhg@hg.illumos.org/illumos-gate
2012-08-23 09:18:52 +00:00
Martin Matuska
5b5bfb7422 Update vendor-sys/illumos/dist to illumos-gate 13752:9f5f6c52ba19
(zfs part)

Obtained from:	ssh://anonhg@hg.illumos.org/illumos-gate
2012-07-18 10:58:07 +00:00
Martin Matuska
51ab6c0afd Update vendor/illumos/dist to pre libzfs_core state (zfs part)
illumos-gate revision 13742:b6bbdd77139c

Obtained from:	ssh://anonhg@hg.illumos.org/illumos-gate
2012-07-18 10:19:51 +00:00
Martin Matuska
93a00b0821 Update vendor/opensolaris to last OpenSolaris state (13149:b23a4dab3d50)
Add ZFS bits to vendor/opensolaris

Obtained from:	https://hg.openindiana.org/upstream/oracle/onnv-gate
2012-07-18 07:48:04 +00:00