Commit Graph

128 Commits

Author SHA1 Message Date
Thomas Munro
cc7edd258c Add collation version support to querylocale(3).
Provide a way to ask for an opaque version string for a locale_t, so
that potential changes in sort order can be detected.  Similar to
ICU's ucol_getVersion() and Windows' GetNLSVersionEx(), this API is
intended to allow databases to detect when text order-based indexes
might need to be rebuilt.

The CLDR version is extracted from CLDR source data by the Makefile
under tools/tools/locale, written into the machine-generated Makefile
under shared/colldef, passed to localedef -V, and then written into
LC_COLLATE file headers.  The initial version is 34.0.
tools/tools/locale was recently updated to pull down 35.0, but the
output hasn't been committed under share/colldef yet, so that will
provide the first observable change when it happens.  Other versioning
schemes are possible in future, because the format is unspecified.

Reviewed by:	bapt, 0mp, kib, yuripv (albeit a long time ago)
Differential Revision:	https://reviews.freebsd.org/D17166
2020-11-08 02:50:34 +00:00
Yuri Pankov
ea22b5bd75 Add ga_IE.UTF-8 locale.
PR:		228587
Submitted by:	Micil <micheal.maclochlainn@oegaillimh.ie> (LC_TIME)
Reviewed by:	bapt
Approved by:	kib (mentor, implicit)
MFC after:	3 days
Differential revision:	https://reviews.freebsd.org/D17997
2018-11-26 19:39:49 +00:00
Yuri Pankov
1ade1c4113 Update to CLDR 34 and UNICODE 11.
Discussed with:	bapt
Approved by:	kib (mentor)
MFC after:	1 month
2018-11-03 22:02:10 +00:00
Yuri Pankov
4644f9bef6 Add -b/-l options to localedef(1) to specify output endianness and use
it appropriately when building share/ctypedef and share/colldef.

This makes the resulting locale data in EL->EB (amd64->powerpc64) cross
build and in the native EB build match.  Revert the changes done to libc
in r308170 as they are no longer needed.

PR:		231965
Reviewed by:	bapt, emaste, sbruno, 0mp
Approved by:	kib (mentor)
Differential Revision:	https://reviews.freebsd.org/D17603
2018-10-20 20:51:05 +00:00
Baptiste Daroussin
fe90c6bf15 Update to CLDR 32 and Unicode 10
MFC after:	2 weeks
Relnotes:	yes
2017-11-03 13:52:34 +00:00
Baptiste Daroussin
50502545ce Readd Big5: some large databases setup are still requiring it.
Reported by:	"張君天(Chun-Tien Chang)" <tcs@kitty.2y.idv.tw>
2017-04-20 18:21:50 +00:00
Baptiste Daroussin
ababdab0ce Remove zh_TW.Big5 locale
After discussion with many Taiwanese, in IT or not. Big5 is not used anymore.
It is not able to represent lots of the characters used in the language.
2017-03-19 17:52:46 +00:00
Enji Cooper
e44885ac01 share: normalize paths using SRCTOP-relative paths or :H when possible
This simplifies make logic/output

MFC after:	1 month
Sponsored by:	Dell EMC Isilon
2017-03-04 11:26:40 +00:00
Baptiste Daroussin
28fded59b4 Update locales cldr to v30.0.3 and unicode to 9.0.0
MFC after:	1 month
Relnotes:	yes
2016-12-18 04:17:13 +00:00
Baptiste Daroussin
3c2db7e010 Add the forgotten "svn mv" from r302329
Reported by:	Ivan Klymenko <fidaj@ukr.net>
Approved by:	re (implicit)
2016-07-03 19:31:21 +00:00
Baptiste Daroussin
3cf6509d70 Posixify the locales name for variants
For all locales with variants:
- if no ambiguity on the locale (only one variant) just use the regular name
- if ambiguity, pick one as default and append @<variant> to the others
  respecting POSIX

As a result:
- All the 3 components locales added recently are renamed to the usual 2
  components version for all but sr_RS.UTF-8
- Set sr_RS.UTF-8 to the cyrillic variant
- Add sr_RS.UTF-8@latin
- Remove the symlinks aliases they were created to represent the 2 components
  version as aliasas and are now useless
- Update the OptionalObsoleteFiles.inc and ObsoleteFiles.inc to reflect those
  changes

Discussed with:	ache@
Approved by:	re@ (gjb)
2016-07-03 18:21:11 +00:00
Baptiste Daroussin
d8fd68b648 Regenerate the Makefile so that actually the new generated collation are
properly installed
2016-04-16 19:39:51 +00:00
Baptiste Daroussin
110cf8a6f1 Regenerates locales Makefiles and locales 2016-04-16 17:55:11 +00:00
Baptiste Daroussin
f8fd13a099 Simplify the locale generated Makefiles by using bmake multi variables for loops 2015-12-18 21:34:28 +00:00
Bryan Drewery
393608176b META MODE: Fix 'make the-lot' with recent locale changes
Sponsored by:	EMC / Isilon Storage Division
2015-11-25 19:13:28 +00:00
Baptiste Daroussin
1d211085ac Bring back a couple of ISO8859-15 locales:
- af_ZA.ISO8859-15
- en_AU.ISO8859-15
- en_CA.ISO8859-15
- en_NZ.ISO8859-15
- en_US.ISO8859-15
- fr_CA.ISO8859-15
2015-11-16 12:58:47 +00:00
Baptiste Daroussin
c1c9ab6707 Regenerate locales after readding ISO8859-1 for locales that have ISO8859-15
Requested by:	arche
2015-11-15 14:51:10 +00:00
Bryan Drewery
d4ea5890a8 Use explicit filename when creating locale symlinks to avoid creating a
directory symlink when the target directory does not exist.  This will
cause an error instead of a broken setup.

Sponsored by:	EMC / Isilon Storage Division
2015-11-11 18:45:48 +00:00
Baptiste Daroussin
3c3feed41a Merge from head 2015-11-01 21:17:38 +00:00
Bryan Drewery
7d8f797b72 Use more appropriate ${SHAREDIR} rather than /usr/share.
MFC after:	2 weeks
Sponsored by:	EMC / Isilon Storage Division
2015-10-27 23:35:02 +00:00
Baptiste Daroussin
7cefd8ca2a Regenerate locales 2015-10-13 20:24:57 +00:00
Baptiste Daroussin
1a41e1f147 Add newly generated locales from CLDR 27.0.1
only skip timedef until I figure out how to workaround svn painful mime-type handling
2015-08-08 01:45:53 +00:00
Simon J. Gerraty
ccfb965433 Add META_MODE support.
Off by default, build behaves normally.
WITH_META_MODE we get auto objdir creation, the ability to
start build from anywhere in the tree.

Still need to add real targets under targets/ to build packages.

Differential Revision:       D2796
Reviewed by: brooks imp
2015-06-13 19:20:56 +00:00
Simon J. Gerraty
d083cb1104 Ensure SYMLINKS fully specified
Differential Revision:       D2748
Reviewed by: brooks
2015-06-11 21:09:03 +00:00
Simon J. Gerraty
44d314f704 dirdeps.mk now sets DEP_RELDIR 2015-06-08 23:35:17 +00:00
Simon J. Gerraty
f5f7c05209 Updated dependencies 2013-02-16 01:23:54 +00:00
Simon J. Gerraty
63478911d0 Include the target filename in SYMLINKS to avoid any confusion about
what is dirname and filename.
2013-01-23 00:49:05 +00:00
Marcel Moolenaar
7750ad47a9 Sync FreeBSD's bmake branch with Juniper's internal bmake branch.
Requested by: Simon Gerraty <sjg@juniper.net>
2012-08-22 19:25:57 +00:00
Andrey A. Chernov
b431ceaa94 Add lv_LV, move lt_LT to common part 2009-09-03 16:53:11 +00:00
Edwin Groothuis
84dc44d825 Croatian locale support for hr_HR.ISO8859-2
Without this patch /usr/share/locale/hr_HR.ISO8859-2/LC_COLLATE
	is a link to the ../la_LN.ISO8859-2/LC_COLLATE. It means
	that there is no support for Croatian locale.

PR:		conf/120113
Submitted by:	Simun Mikecin <numisemis@yahoo.com>
MFC after:	1 week
2009-06-10 21:55:38 +00:00
Edwin Groothuis
f8d7304fea add ca_AD, ca_FR and ca_IT locales
Catalan language is not only spoken in Spain (ca_ES), but also
    in Andorra, France and Italy. In Andorra it is the official
    language.

    (see http://en.wikipedia.org/wiki/Catalan_language#Geographic_distribution)

Add a bunch of symlinks to between ca_ES and ca_AD, ca_FR and ca_IT.

PR:		conf/92541
Submitted by:	<rmh@io.debian.net>
MFC after:	1 week
2009-06-10 12:20:11 +00:00
Dag-Erling Smørgrav
5373c6c718 According to a proposed Norwegian standard for alphabetization of which
I've obtained a draft, <u:> is indeed equivalent to u (to my surprise),
and <th> sorts immediately after z.

The correct ordering is algorithmic (based on the EOR) and can not be
accurately represented as a table.
2008-07-30 15:37:13 +00:00
Dag-Erling Smørgrav
d3fbed0e09 Add collation sequence for no_NO. The same sequence applies to nb_NO
and nn_NO, which are symlinked to no_NO.

The patch in the PR contained a number of errors apparently based on
(sometimes incorrect) pronunciation; for instance, v and w are
distinct letters and should be collated in that order, even if they
are pronounced the same, while <u:> should be collated with u, even
though it is often mispronounced as y.  For lack of a solid reference,
I have taken sv_SE and simply changed the last three letters of the
alphabet.

PR:		conf/51920
MFC after:	2 weeks
2008-07-28 21:33:34 +00:00
Diomidis Spinellis
499f0f956d Fix collation order for accented characters.
MFC after:	2 weeks
2008-02-04 10:25:28 +00:00
Andrey A. Chernov
aadebb995b Add reference to mnemonic char names 2007-12-25 21:21:26 +00:00
Andrey A. Chernov
280c5853dd Add Turkish collate
PR:             118976
Submitted by:   Ismail YENIGUL <ismail.yenigul@endersys.com.tr>
2007-12-24 10:30:09 +00:00
Andrey A. Chernov
f2bd4453a8 Since SAOL 13:th edition "v" and "w" are officially separated (in 2006) 2007-11-19 12:39:02 +00:00
Dag-Erling Smørgrav
a05bf06920 Add locales for nb_NO and nn_NO.
Reviewed by:	philip
2006-11-09 18:10:34 +00:00
Andrey A. Chernov
8a7dcaf4f9 Add mn_MN.UTF-8 2006-10-02 00:23:14 +00:00
Ruslan Ermilov
08f8440ba4 New Ukrainian locale: uk_UA.CP1251.
Submitted by:	Alexander Peresunko
2005-03-04 14:24:30 +00:00
Ruslan Ermilov
495eba5429 Utilize FILES and SYMLINKS, other simplifications. 2004-10-16 19:51:34 +00:00
Tim J. Robbins
1bbc832cce Add Basque (Spain) locales: eu_ES.ISO8859-1, eu_ES.ISO8859-15, eu_ES.UTF-8.
(This differs somewhat from the version originally submitted - any mistakes
are my own.)

PR:		68524
Submitted by:	J. Vicente Carrasco -Bixen-
2004-08-28 12:52:31 +00:00
Tim J. Robbins
ab670aebec Add an Israel Hebrew locale: he_IL.UTF-8.
PR:		65826
Submitted by:	Hye-Shik Chang
2004-04-21 15:28:23 +00:00
Tim J. Robbins
e75dc792b7 Add data for missing categories to zh_HK.Big5HKSCS locale. 2004-04-04 12:24:05 +00:00
Tim J. Robbins
839b21a6f4 Add UTF-8 versions of all the currently supported system locales. Most of
the hard work was done by Hye-Shik Chang in the misc/utf8locale port; I made
a few minor adjustments and merged the makefiles.

PR:	44307
2004-03-27 08:14:15 +00:00
Andrey A. Chernov
7d864d560c Add kk_KZ.PT154
Submitted by:   Birsh T <tim@zhezu.kz>
2004-01-29 16:28:22 +00:00
Andrey A. Chernov
df84d9a06c Add map for CP1131
Submitted by:   Yury Tarasievich <grog@grsu.by>
2003-12-20 11:20:05 +00:00
Andrey A. Chernov
24b5e6f18b Add be_BY.*
Submitted by:   Yury Tarasievich <grog@grsu.by>
2003-12-20 11:18:43 +00:00
David Xu
e461ba58ab Enable GB2312 locale. 2003-11-05 23:39:03 +00:00
Andrey A. Chernov
c7b5578215 Fix sl_SI.ISO8859-2
PR:             50160
Submitted by:   Simon 'Zekar <simon@entered.net>
2003-10-09 00:55:33 +00:00