pfg 9fe5eca952 MFC r265095, r265167; ...

citrus: Avoid invalid code points.

The UTF-8 decoder should not accept byte sequences which decode to
unicode code positions U+D800 to U+DFFF (UTF-16 surrogates).[1]

Contrary to the original OpenBSD patch, we do pass U+FFFE and U+FFFF,
both values are valid "non-characters" [2] and must be mapped through
UTFs.

[1] http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
[2] http://www.unicode.org/faq/private_use.html

Reported by:	Stefan Sperling [1]
Thanks to:	jilles [2]
Obtained from:	OpenBSD

2014-05-05 14:50:53 +00:00

..

ascii.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

big5.5

…

big5.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

btowc.3

btowc(3), isblank(3): Correct prototypes for _l variants.

2013-03-27 21:31:40 +00:00

btowc.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

c16rtomb_iconv.c

Add libiconv based versions of *c16*() and *c32*().

2013-06-03 17:17:56 +00:00

c16rtomb.c

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

c32rtomb_iconv.c

Add libiconv based versions of *c16*() and *c32*().

2013-06-03 17:17:56 +00:00

c32rtomb.c

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

collate.c

libc: Make various internal file descriptors close-on-exec.

2012-12-11 22:52:56 +00:00

collate.h

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

collcmp.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

ctype_l.3

ctype_l(3): Note that not all these functions are specified by POSIX.1-2008.

2012-07-01 22:18:20 +00:00

ctype.3

Remove trailing whitespace per mdoc lint warning

2012-03-29 05:02:12 +00:00

ctype.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

cXXrtomb_iconv.h

Replace the #define for "iconv" so it is for the function name instead of

2013-07-03 07:03:19 +00:00

DESIGN.xlocale

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

digittoint.3

Remove trailing whitespace per mdoc lint warning

2012-03-29 05:02:12 +00:00

duplocale.3

mdoc: missing comma in .Dd macro.

2013-05-04 17:06:47 +00:00

euc.5

…

euc.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

fix_grouping.c

…

freelocale.3

Document that the return type is different from 1003.1-2008.

2013-05-04 17:21:44 +00:00

gb2312.5

…

gb2312.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

gb18030.5

…

gb18030.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

gbk.5

…

gbk.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

isalnum.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

isalpha.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

isascii.3

…

isblank.3

btowc(3), isblank(3): Correct prototypes for _l variants.

2013-03-27 21:31:40 +00:00

iscntrl.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

isctype.c

…

isdigit.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

isgraph.3

Add more locale-specific functions to the relevant man pages and Makefile:

2012-07-30 20:56:19 +00:00

isideogram.3

…

islower.3

Remove trailing whitespace.

2012-07-30 21:02:44 +00:00

isphonogram.3

…

isprint.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

ispunct.3

Add more locale-specific functions to the relevant man pages and Makefile:

2012-07-30 20:56:19 +00:00

isrune.3

…

isspace.3

Add more locale-specific functions to the relevant man pages and Makefile:

2012-07-30 20:56:19 +00:00

isspecial.3

…

isupper.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

iswalnum_l.3

Start manpage with Dd macro and also remove a trailing whitespace

2012-07-26 14:46:19 +00:00

iswalnum.3

…

iswctype.c

…

isxdigit.3

mdoc: fix column names, indentation, column separation within each row, and

2012-04-07 09:05:30 +00:00

ldpart.c

libc: Use O_CLOEXEC for various internal file descriptors.

2012-09-29 11:54:34 +00:00

ldpart.h

…

lmessages.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

lmessages.h

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

lmonetary.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

lmonetary.h

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

lnumeric.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

lnumeric.h

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

localeconv.3

Split sentences at period boundaries.

2011-12-02 11:55:09 +00:00

localeconv.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

Makefile.inc

Add libiconv based versions of *c16*() and *c32*().

2013-06-03 17:17:56 +00:00

mblen.3

…

mblen.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mblocal.h

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbrlen.3

…

mbrlen.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbrtoc16_iconv.c

Add libiconv based versions of *c16*() and *c32*().

2013-06-03 17:17:56 +00:00

mbrtoc16.c

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

mbrtoc32_iconv.c

Add libiconv based versions of *c16*() and *c32*().

2013-06-03 17:17:56 +00:00

mbrtoc32.c

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

mbrtocXX_iconv.h

Replace the #define for "iconv" so it is for the function name instead of

2013-07-03 07:03:19 +00:00

mbrtowc.3

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

mbrtowc.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbsinit.3

…

mbsinit.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbsnrtowcs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbsrtowcs.3

…

mbsrtowcs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbstowcs.3

…

mbstowcs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mbtowc.3

…

mbtowc.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

mskanji.5

…

mskanji.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

multibyte.3

…

newlocale.3

mdoc: missing comma in .Dd macro.

2013-05-04 17:06:47 +00:00

nextwctype.3

…

nextwctype.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

nl_langinfo.3

Add more locale-specific functions to the relevant man pages and Makefile:

2012-07-30 20:56:19 +00:00

nl_langinfo.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

nomacros.c

Fix build of libc.so after r232620. This caused a duplicate definition

2012-03-06 21:56:30 +00:00

none.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

querylocale.3

Remove the STANDARDS section.

2013-05-03 12:42:43 +00:00

rpmatch.3

…

rpmatch.c

…

rune.c

…

runefile.h

…

runetype.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

setlocale.3

mdoc: drop redundant .Pp and .LP calls

2010-10-08 12:40:16 +00:00

setlocale.c

libc: Eliminate some relative relocations in setlocale().

2011-12-27 23:28:01 +00:00

setlocale.h

…

setrunelocale.c

libc: Make various internal file descriptors close-on-exec.

2012-12-11 22:52:56 +00:00

Symbol.map

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

table.c

Reapply 227753 (xlocale cleanup), plus some fixes so that it passes build

2012-03-04 15:31:13 +00:00

toascii.3

…

tolower.3

Apply a small grammar fix to {toupper,tolower}(3).

2010-07-25 13:32:19 +00:00

tolower.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

toupper.3

Apply a small grammar fix to {toupper,tolower}(3).

2010-07-25 13:32:19 +00:00

toupper.c

Fix copy/paste error in lib/libc/locale/toupper.c.

2012-05-10 20:03:34 +00:00

towlower.3

…

towupper.3

…

uselocale.3

mdoc: missing comma in .Dd macro.

2013-05-04 17:06:47 +00:00

utf8.5

…

utf8.c

MFC r265095, r265167;

2014-05-05 14:50:53 +00:00

wcrtomb.3

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

wcrtomb.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcsftime.3

…

wcsftime.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcsnrtombs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcsrtombs.3

…

wcsrtombs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstod.3

…

wcstod.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstof.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstoimax.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstol.3

…

wcstol.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstold.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstoll.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstombs.3

…

wcstombs.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstoul.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstoull.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wcstoumax.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wctob.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wctomb.3

…

wctomb.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wctrans.3

…

wctrans.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

wctype.3

…

wctype.c

libc: Eliminate 13 relative relocations in wctype().

2011-12-05 00:00:47 +00:00

wcwidth.3

…

wcwidth.c

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a

2011-11-20 14:45:42 +00:00

xlocale_private.h

Add <uchar.h>.

2013-05-21 19:59:37 +00:00

xlocale.3

mdoc: missing comma in .Dd macro.

2013-05-04 17:06:47 +00:00

xlocale.c

Reapply 227753 (xlocale cleanup), plus some fixes so that it passes build

2012-03-04 15:31:13 +00:00