Commit Graph

128 Commits

Author SHA1 Message Date
tmunro
b454726096 Add collation version support to querylocale(3).
Provide a way to ask for an opaque version string for a locale_t, so
that potential changes in sort order can be detected.  Similar to
ICU's ucol_getVersion() and Windows' GetNLSVersionEx(), this API is
intended to allow databases to detect when text order-based indexes
might need to be rebuilt.

The CLDR version is extracted from CLDR source data by the Makefile
under tools/tools/locale, written into the machine-generated Makefile
under shared/colldef, passed to localedef -V, and then written into
LC_COLLATE file headers.  The initial version is 34.0.
tools/tools/locale was recently updated to pull down 35.0, but the
output hasn't been committed under share/colldef yet, so that will
provide the first observable change when it happens.  Other versioning
schemes are possible in future, because the format is unspecified.

Reviewed by:	bapt, 0mp, kib, yuripv (albeit a long time ago)
Differential Revision:	https://reviews.freebsd.org/D17166
2020-11-08 02:50:34 +00:00
yuripv
8e370b212f Add ga_IE.UTF-8 locale.
PR:		228587
Submitted by:	Micil <micheal.maclochlainn@oegaillimh.ie> (LC_TIME)
Reviewed by:	bapt
Approved by:	kib (mentor, implicit)
MFC after:	3 days
Differential revision:	https://reviews.freebsd.org/D17997
2018-11-26 19:39:49 +00:00
yuripv
85d52a2654 Update to CLDR 34 and UNICODE 11.
Discussed with:	bapt
Approved by:	kib (mentor)
MFC after:	1 month
2018-11-03 22:02:10 +00:00
yuripv
d641b0caff Add -b/-l options to localedef(1) to specify output endianness and use
it appropriately when building share/ctypedef and share/colldef.

This makes the resulting locale data in EL->EB (amd64->powerpc64) cross
build and in the native EB build match.  Revert the changes done to libc
in r308170 as they are no longer needed.

PR:		231965
Reviewed by:	bapt, emaste, sbruno, 0mp
Approved by:	kib (mentor)
Differential Revision:	https://reviews.freebsd.org/D17603
2018-10-20 20:51:05 +00:00
bapt
fa6a6b77d9 Update to CLDR 32 and Unicode 10
MFC after:	2 weeks
Relnotes:	yes
2017-11-03 13:52:34 +00:00
bapt
3287651efa Readd Big5: some large databases setup are still requiring it.
Reported by:	"張君天(Chun-Tien Chang)" <tcs@kitty.2y.idv.tw>
2017-04-20 18:21:50 +00:00
bapt
f18b447322 Remove zh_TW.Big5 locale
After discussion with many Taiwanese, in IT or not. Big5 is not used anymore.
It is not able to represent lots of the characters used in the language.
2017-03-19 17:52:46 +00:00
ngie
f3b9b77d64 share: normalize paths using SRCTOP-relative paths or :H when possible
This simplifies make logic/output

MFC after:	1 month
Sponsored by:	Dell EMC Isilon
2017-03-04 11:26:40 +00:00
bapt
411ea23c1c Update locales cldr to v30.0.3 and unicode to 9.0.0
MFC after:	1 month
Relnotes:	yes
2016-12-18 04:17:13 +00:00
bapt
929f609fc0 Add the forgotten "svn mv" from r302329
Reported by:	Ivan Klymenko <fidaj@ukr.net>
Approved by:	re (implicit)
2016-07-03 19:31:21 +00:00
bapt
9889527f5a Posixify the locales name for variants
For all locales with variants:
- if no ambiguity on the locale (only one variant) just use the regular name
- if ambiguity, pick one as default and append @<variant> to the others
  respecting POSIX

As a result:
- All the 3 components locales added recently are renamed to the usual 2
  components version for all but sr_RS.UTF-8
- Set sr_RS.UTF-8 to the cyrillic variant
- Add sr_RS.UTF-8@latin
- Remove the symlinks aliases they were created to represent the 2 components
  version as aliasas and are now useless
- Update the OptionalObsoleteFiles.inc and ObsoleteFiles.inc to reflect those
  changes

Discussed with:	ache@
Approved by:	re@ (gjb)
2016-07-03 18:21:11 +00:00
bapt
13f217e478 Regenerate the Makefile so that actually the new generated collation are
properly installed
2016-04-16 19:39:51 +00:00
bapt
2d1226d5e3 Regenerates locales Makefiles and locales 2016-04-16 17:55:11 +00:00
bapt
429291909c Simplify the locale generated Makefiles by using bmake multi variables for loops 2015-12-18 21:34:28 +00:00
bdrewery
a23213fe40 META MODE: Fix 'make the-lot' with recent locale changes
Sponsored by:	EMC / Isilon Storage Division
2015-11-25 19:13:28 +00:00
bapt
3f00265ee4 Bring back a couple of ISO8859-15 locales:
- af_ZA.ISO8859-15
- en_AU.ISO8859-15
- en_CA.ISO8859-15
- en_NZ.ISO8859-15
- en_US.ISO8859-15
- fr_CA.ISO8859-15
2015-11-16 12:58:47 +00:00
bapt
ded369f5b9 Regenerate locales after readding ISO8859-1 for locales that have ISO8859-15
Requested by:	arche
2015-11-15 14:51:10 +00:00
bdrewery
bf614d3ddb Use explicit filename when creating locale symlinks to avoid creating a
directory symlink when the target directory does not exist.  This will
cause an error instead of a broken setup.

Sponsored by:	EMC / Isilon Storage Division
2015-11-11 18:45:48 +00:00
bapt
1477bec6db Merge from head 2015-11-01 21:17:38 +00:00
bdrewery
b5aa209983 Use more appropriate ${SHAREDIR} rather than /usr/share.
MFC after:	2 weeks
Sponsored by:	EMC / Isilon Storage Division
2015-10-27 23:35:02 +00:00
bapt
9e21b4c174 Regenerate locales 2015-10-13 20:24:57 +00:00
bapt
671598262f Add newly generated locales from CLDR 27.0.1
only skip timedef until I figure out how to workaround svn painful mime-type handling
2015-08-08 01:45:53 +00:00
sjg
008d7c831f Add META_MODE support.
Off by default, build behaves normally.
WITH_META_MODE we get auto objdir creation, the ability to
start build from anywhere in the tree.

Still need to add real targets under targets/ to build packages.

Differential Revision:       D2796
Reviewed by: brooks imp
2015-06-13 19:20:56 +00:00
sjg
af658cbca3 Ensure SYMLINKS fully specified
Differential Revision:       D2748
Reviewed by: brooks
2015-06-11 21:09:03 +00:00
sjg
75a137820d dirdeps.mk now sets DEP_RELDIR 2015-06-08 23:35:17 +00:00
sjg
0ee5295509 Updated dependencies 2013-02-16 01:23:54 +00:00
sjg
ce5707f03f Include the target filename in SYMLINKS to avoid any confusion about
what is dirname and filename.
2013-01-23 00:49:05 +00:00
marcel
9dd41e3647 Sync FreeBSD's bmake branch with Juniper's internal bmake branch.
Requested by: Simon Gerraty <sjg@juniper.net>
2012-08-22 19:25:57 +00:00
ache
5476e08be1 Add lv_LV, move lt_LT to common part 2009-09-03 16:53:11 +00:00
edwin
ce615f7cba Croatian locale support for hr_HR.ISO8859-2
Without this patch /usr/share/locale/hr_HR.ISO8859-2/LC_COLLATE
	is a link to the ../la_LN.ISO8859-2/LC_COLLATE. It means
	that there is no support for Croatian locale.

PR:		conf/120113
Submitted by:	Simun Mikecin <numisemis@yahoo.com>
MFC after:	1 week
2009-06-10 21:55:38 +00:00
edwin
f4fc80f170 add ca_AD, ca_FR and ca_IT locales
Catalan language is not only spoken in Spain (ca_ES), but also
    in Andorra, France and Italy. In Andorra it is the official
    language.

    (see http://en.wikipedia.org/wiki/Catalan_language#Geographic_distribution)

Add a bunch of symlinks to between ca_ES and ca_AD, ca_FR and ca_IT.

PR:		conf/92541
Submitted by:	<rmh@io.debian.net>
MFC after:	1 week
2009-06-10 12:20:11 +00:00
des
7999530a8d According to a proposed Norwegian standard for alphabetization of which
I've obtained a draft, <u:> is indeed equivalent to u (to my surprise),
and <th> sorts immediately after z.

The correct ordering is algorithmic (based on the EOR) and can not be
accurately represented as a table.
2008-07-30 15:37:13 +00:00
des
975daa69ac Add collation sequence for no_NO. The same sequence applies to nb_NO
and nn_NO, which are symlinked to no_NO.

The patch in the PR contained a number of errors apparently based on
(sometimes incorrect) pronunciation; for instance, v and w are
distinct letters and should be collated in that order, even if they
are pronounced the same, while <u:> should be collated with u, even
though it is often mispronounced as y.  For lack of a solid reference,
I have taken sv_SE and simply changed the last three letters of the
alphabet.

PR:		conf/51920
MFC after:	2 weeks
2008-07-28 21:33:34 +00:00
dds
b3d2d57ef4 Fix collation order for accented characters.
MFC after:	2 weeks
2008-02-04 10:25:28 +00:00
ache
9f96cc18b3 Add reference to mnemonic char names 2007-12-25 21:21:26 +00:00
ache
0239a1cc16 Add Turkish collate
PR:             118976
Submitted by:   Ismail YENIGUL <ismail.yenigul@endersys.com.tr>
2007-12-24 10:30:09 +00:00
ache
764e9c0b52 Since SAOL 13:th edition "v" and "w" are officially separated (in 2006) 2007-11-19 12:39:02 +00:00
des
a9a2f810d6 Add locales for nb_NO and nn_NO.
Reviewed by:	philip
2006-11-09 18:10:34 +00:00
ache
38c8b0a34c Add mn_MN.UTF-8 2006-10-02 00:23:14 +00:00
ru
47f2612399 New Ukrainian locale: uk_UA.CP1251.
Submitted by:	Alexander Peresunko
2005-03-04 14:24:30 +00:00
ru
4cf42888c9 Utilize FILES and SYMLINKS, other simplifications. 2004-10-16 19:51:34 +00:00
tjr
73afa7d781 Add Basque (Spain) locales: eu_ES.ISO8859-1, eu_ES.ISO8859-15, eu_ES.UTF-8.
(This differs somewhat from the version originally submitted - any mistakes
are my own.)

PR:		68524
Submitted by:	J. Vicente Carrasco -Bixen-
2004-08-28 12:52:31 +00:00
tjr
1511636f6c Add an Israel Hebrew locale: he_IL.UTF-8.
PR:		65826
Submitted by:	Hye-Shik Chang
2004-04-21 15:28:23 +00:00
tjr
76dcd1b254 Add data for missing categories to zh_HK.Big5HKSCS locale. 2004-04-04 12:24:05 +00:00
tjr
642f4c91af Add UTF-8 versions of all the currently supported system locales. Most of
the hard work was done by Hye-Shik Chang in the misc/utf8locale port; I made
a few minor adjustments and merged the makefiles.

PR:	44307
2004-03-27 08:14:15 +00:00
ache
93aa5eecf9 Add kk_KZ.PT154
Submitted by:   Birsh T <tim@zhezu.kz>
2004-01-29 16:28:22 +00:00
ache
aa555760c1 Add map for CP1131
Submitted by:   Yury Tarasievich <grog@grsu.by>
2003-12-20 11:20:05 +00:00
ache
ac5798858c Add be_BY.*
Submitted by:   Yury Tarasievich <grog@grsu.by>
2003-12-20 11:18:43 +00:00
davidxu
09e99681c0 Enable GB2312 locale. 2003-11-05 23:39:03 +00:00
ache
1f369a8e72 Fix sl_SI.ISO8859-2
PR:             50160
Submitted by:   Simon 'Zekar <simon@entered.net>
2003-10-09 00:55:33 +00:00