powerpc_nvram: Fix a bug in the adler32 checksum.

The Adler32 digest consists of two 16-bit words whose values are
calculated modulo 65521 (largest prime < 2^16).  To avoid two division
instructions per byte, this version copies an optimization found in
zlib which defers the modulus until close to the point that the
intermediate sums can overflow 2^32.  (zlib uses NMAX == 5552 for
this, this version uses 5000)

The bug is that in the deferred modulus case, the modulus was
only applied to the high word (and twice at that) but not to
the low word.  The fix is to apply it to both words.

Reviewed by:	jhibbits
Reported by:	Miod Vallat <miod@openbsd.org>
Differential Revision:	https://reviews.freebsd.org/D36798
This commit is contained in:
John Baldwin 2022-10-03 16:10:41 -07:00
parent a9fca3b987
commit e0df0dce71

View File

@ -360,7 +360,7 @@ adler_checksum(uint8_t *data, int len)
high = 0;
for (i = 0; i < len; i++) {
if ((i % 5000) == 0) {
high %= 65521UL;
low %= 65521UL;
high %= 65521UL;
}
low += data[i];