Commit Graph

126 Commits

Author SHA1 Message Date
Henri Sivonen
2dbc784d5a Bug 1814862 - Build ICU with UCONFIG_NO_BREAK_ITERATION r=anba
Differential Revision: https://phabricator.services.mozilla.com/D168970
2023-07-07 07:16:30 +00:00
André Bargull
6b464f9394 Bug 1838173: Allow to set the Gregorian change date for ISO-8601 calendars. r=platform-i18n-reviewers,dminor
Add a patch to work around <https://unicode-org.atlassian.net/jira/software/c/projects/ICU/issues/ICU-22412>.

Differential Revision: https://phabricator.services.mozilla.com/D180796
2023-06-14 05:38:46 +00:00
André Bargull
9f5d869662 Bug 1824744 - Part 2: Update in-tree ICU to 73. r=platform-i18n-reviewers,gregtatum
Depends on D176263

Differential Revision: https://phabricator.services.mozilla.com/D176264
2023-05-25 20:40:43 +00:00
André Bargull
32434f8e6b Bug 1818103: Revert date format for en-CA. r=platform-i18n-reviewers,jfkthame
Revert the date format for en-CA per <https://github.com/unicode-org/cldr/pull/2759>.

The actual patch is based on <https://github.com/unicode-org/icu/pull/2368>.

Differential Revision: https://phabricator.services.mozilla.com/D173406
2023-03-23 09:26:42 +00:00
André Bargull
450cd2c190 Bug 1792775 - Part 2: Update in-tree ICU to 72. r=platform-i18n-reviewers,dminor
Update to ICU 72 by running `./update-icu.sh https://github.com/unicode-org/icu.git maint/maint-72`.

Differential Revision: https://phabricator.services.mozilla.com/D160180
2022-11-23 17:56:04 +00:00
André Bargull
c527db03ac Bug 1792775 - Part 1.1: Remove unused "personNames" table from ICU data file. r=platform-i18n-reviewers,gregtatum
We don't use the "personNames" data, so let's filter it out to reduce the ICU data file size.

Depends on D160179

Differential Revision: https://phabricator.services.mozilla.com/D162706
2022-11-23 17:56:04 +00:00
Noemi Erli
57fbfda9e8 Backed out 16 changesets (bug 1792775) for causing build bustage in TestDateIntervalFormat.cpp CLOSED TREE
Backed out changeset 240681aef215 (bug 1792775)
Backed out changeset e15aea6bb46b (bug 1792775)
Backed out changeset ee9cd4c8d5cd (bug 1792775)
Backed out changeset 0be61a39756f (bug 1792775)
Backed out changeset 7db4fb376f48 (bug 1792775)
Backed out changeset 7009b35a05a0 (bug 1792775)
Backed out changeset 5abc2704004e (bug 1792775)
Backed out changeset 6d76fe50cf35 (bug 1792775)
Backed out changeset d6300cbbf628 (bug 1792775)
Backed out changeset 8f5e0e60d195 (bug 1792775)
Backed out changeset 0b9cf0354dc0 (bug 1792775)
Backed out changeset 7136c85641b7 (bug 1792775)
Backed out changeset 486778427d64 (bug 1792775)
Backed out changeset 7acee89c2699 (bug 1792775)
Backed out changeset 654c5f659fed (bug 1792775)
Backed out changeset a60b1bc33f91 (bug 1792775)
2022-11-23 17:18:45 +02:00
André Bargull
902df0f4d2 Bug 1792775 - Part 2: Update in-tree ICU to 72. r=platform-i18n-reviewers,dminor
Update to ICU 72 by running `./update-icu.sh https://github.com/unicode-org/icu.git maint/maint-72`.

Differential Revision: https://phabricator.services.mozilla.com/D160180
2022-11-23 10:42:32 +00:00
André Bargull
644f1b673d Bug 1792775 - Part 1.1: Remove unused "personNames" table from ICU data file. r=platform-i18n-reviewers,gregtatum
We don't use the "personNames" data, so let's filter it out to reduce the ICU data file size.

Depends on D160179

Differential Revision: https://phabricator.services.mozilla.com/D162706
2022-11-23 10:42:31 +00:00
Noemi Erli
001626e217 Backed out 3 changesets (bug 1792775) for causing build bustages in dateTimeField.js CLOSED TREE
Backed out changeset afc4c848f6cd (bug 1792775)
Backed out changeset 3ad9903f28d8 (bug 1792775)
Backed out changeset 838947448110 (bug 1792775)
2022-11-23 11:19:20 +02:00
André Bargull
409ed6f810 Bug 1792775 - Part 2: Update in-tree ICU to 72. r=platform-i18n-reviewers,dminor
Update to ICU 72 by running `./update-icu.sh https://github.com/unicode-org/icu.git maint/maint-72`.

Differential Revision: https://phabricator.services.mozilla.com/D160180
2022-11-23 08:38:46 +00:00
André Bargull
aa4f2ac584 Bug 1792775 - Part 1.1: Remove unused "personNames" table from ICU data file. r=platform-i18n-reviewers,gregtatum
We don't use the "personNames" data, so let's filter it out to reduce the ICU data file size.

Depends on D160179

Differential Revision: https://phabricator.services.mozilla.com/D162706
2022-11-23 08:38:45 +00:00
André Bargull
7d0125b8c7 Bug 1799859: Add support for "microsecond" and "nanosecond" units. r=dminor
Steps performed:
- Add "microsecond" and "nanosecond" to "intl/icu/data_filter.json".
- Run "icu_sources_data.py" to update the ICU data file.
- Run "update-tzdata.sh" to reapply the tzdata 2022f changes.
- Add "microsecond" and "nanosecond" to "SanctionedSimpleUnitIdentifiers.yaml".
- Run "make_intl_data.py units" to regenerate additional SpiderMonkey files.

Spec PR: https://github.com/tc39/ecma402/pull/708

Differential Revision: https://phabricator.services.mozilla.com/D161676
2022-11-09 16:45:43 +00:00
Henri Sivonen
1737aa6569 Bug 1630920 - Remove the gb2312han and big5han collations. r=anba
Makes the ICU data 191 KB smaller.

Differential Revision: https://phabricator.services.mozilla.com/D160337
2022-10-28 08:44:04 +00:00
Henri Sivonen
0b6dc7aed6 Bug 1793749 - Build ICU with the implicithan collation root. r=anba
Makes ICU data 353 KB smaller.

Differential Revision: https://phabricator.services.mozilla.com/D160345
2022-10-28 08:43:58 +00:00
Sean Burke
be3eb81a13 Bug 1790071 - work around ICU-22132. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D157023
2022-10-06 18:50:51 +00:00
André Bargull
ee902f8f06 Bug 1766220: Backport ICU-21994 to fix a potential heap buffer overflow. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D144542
2022-04-25 16:34:42 +00:00
André Bargull
d9409e29f8 Bug 1763783 - Part 2: Update in-tree ICU to release 71.1. r=platform-i18n-reviewers,jfkthame
Depends on D143273

Differential Revision: https://phabricator.services.mozilla.com/D143275
2022-04-10 09:17:54 +00:00
André Bargull
2e3c881a95 Bug 1738422 - Part 9: Add a separate UNumberFormatFields constant for the approximately sign. r=platform-i18n-reviewers,dminor
Our previous heuristic no longer works, so we now have to patch ICU directly to
support detecting the approximately sign.

Depends on D129930

Differential Revision: https://phabricator.services.mozilla.com/D129931
2021-11-16 17:02:57 +00:00
André Bargull
d814742408 Bug 1738422 - Part 2: Update in-tree ICU to release 70.1. r=platform-i18n-reviewers,dminor
Update to ICU 70.1 by running "update-icu.sh" with "maint/maint-70" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D129924
2021-11-16 17:02:38 +00:00
André Bargull
cbc4b735a9 Bug 1648137 - Part 16: Allow to format non-decimal number strings. r=platform-i18n-reviewers,dminor
Remove this Java compatibility restriction to be able to format ranges starting
resp. ending at infinity.

Differential Revision: https://phabricator.services.mozilla.com/D119756
2021-08-24 09:34:51 +00:00
André Bargull
adf02e643c Bug 1648137 - Part 4: Fully clear the decimal quantity before assigning a new value. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D119744
2021-08-24 09:34:47 +00:00
André Bargull
b0a94f02a6 Bug 1685075 - Part 2: Remove "en-US-posix" locale from ICU data file. r=zbraniecki
The filter file doesn't support exclusion lists for the "locales" filter type
(<https://github.com/unicode-org/icu/blob/main/docs/userguide/icu_data/buildtool.md#filtering-by-locale>),
therefore we have to manually exclude "en-US-posix" from the relevant resource
types: "en-US-posix" data is only present for collation, locales, and break
iteration. Break iteration is already completely stripped from the data file,
so we don't need to change anything on that front.

The string must be "en_US_POSIX" to match the resource file name, also see
<https://unicode-org.atlassian.net/browse/ICU-21400>.

Depends on D117975

Differential Revision: https://phabricator.services.mozilla.com/D117976
2021-06-18 09:22:06 +00:00
André Bargull
8b1839ebe0 Bug 1685075 - Part 1: Replace black/white-list in ICU data filter file. r=zbraniecki
Replace "whitelist" and "blacklist" with "includelist" resp. "excludelist", because
the latter is now the preferred name in ICU and the ICU docs/examples are all using
the new names.

Differential Revision: https://phabricator.services.mozilla.com/D117975
2021-06-18 09:22:06 +00:00
André Bargull
3fe14705b6 Bug 1697729: Re-add alias and parent links in ICU filters. r=tcampbell
The `-/*` filter also removes the alias (`%%ALIAS`) and parent locale (`%%Parent`)
links, so we have to manually add them back when we're using `-/*`.

The ICU docs warn about this issue, but unfortunately that warning wasn't
present when we originally created our filter file, so this bug went unnoticed
for a long time.

Differential Revision: https://phabricator.services.mozilla.com/D116981
2021-06-16 06:49:45 +00:00
André Bargull
e3d2b6377c Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-15 07:53:58 +00:00
Noemi Erli
ce2801c88f Backed out 8 changesets (bug 1714933) for causing build bustages in 1659595.js CLOSED TREE
Backed out changeset 2f72875b300f (bug 1714933)
Backed out changeset a42831b46643 (bug 1714933)
Backed out changeset c7ccabae5816 (bug 1714933)
Backed out changeset a4f4e4026174 (bug 1714933)
Backed out changeset fca960ad267b (bug 1714933)
Backed out changeset 62bdba475376 (bug 1714933)
Backed out changeset f168a2d1d391 (bug 1714933)
Backed out changeset 85af7c63b9c5 (bug 1714933)
2021-06-14 23:47:43 +03:00
André Bargull
0b804a59a3 Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-14 19:46:50 +00:00
Butkovits Atila
c9d6eddfc2 Backed out 7 changesets (bug 1714933) for causing failures on test_ManifestProcessor_lang.html
Backed out changeset 2b4a65b9c1ac (bug 1714933)
Backed out changeset 40c329123b7c (bug 1714933)
Backed out changeset 692101de3873 (bug 1714933)
Backed out changeset 695f3bd8e875 (bug 1714933)
Backed out changeset 30e9aacecf56 (bug 1714933)
Backed out changeset e9f2a0d262c2 (bug 1714933)
Backed out changeset 3de963fab6d6 (bug 1714933)
2021-06-14 19:46:45 +03:00
André Bargull
d165d44525 Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-14 13:12:59 +00:00
André Bargull
50a541b708 Bug 1686052 - Part 3: Update in-tree ICU to release 68.2. r=jwalden
Update to ICU 68.2 by running "update-icu.sh" with "maint/maint-68" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D101389
2021-06-04 17:42:10 +00:00
André Bargull
3d58656e00 Bug 1693575 - Part 3: Implement support for "calendar" option. r=tcampbell
This last part to support "calendar" requires a bit more code.

`GetCalendarDisplayName()` performs the following steps:
1. Validate the input matches the `type` nonterminal, per
   CanonicalCodeForDisplayNames, step 4.a.
2. Then convert it to lower case, because ICU expects lower case names and it
   needs to be in lower case for `LanguageTag::replaceUnicodeExtensionType()`.
3. Replace calendar name aliases with the preferred name, e.g. use "ethioaa"
   instead of "ethiopic-amete-alem".
4. Check the input isn't too large, just in case ICU somehow doesn't properly
   handle large string inputs.
5. Retrieve the old-style value of the calendar name, for example "gregorian"
   for the calendar name "gregory".
6. And finally call `uldn_keyValueDisplayName` to search for the localised name.

Our ICU data file doesn't yet include calendar names. To include calendar names
we need to enable them in "data_filter.json", rebuild the ICU data file, and
then reapply the update for tzdata 2021a. (Reapplying the tzdata changed
"intl/tzdata/GIT-INFO", but otherwise didn't change any time zone files.)

Adding the calendar names to the ICU data file results in a slight increase of
the overall data file size (79,184 bytes).

The existing "calendar.js" test file was renamed to "month-calendar.js", so
the test file for the new "calendar" type can be named "calendar.js".

Differential Revision: https://phabricator.services.mozilla.com/D116008
2021-06-01 07:45:44 +00:00
Chris Fallin
9e6185bf59 Bug 1706949 part 13 - Fix icu and intl for wasi. r=anba,glandium
Differential Revision: https://phabricator.services.mozilla.com/D113218
2021-05-26 06:44:09 +00:00
Axel Hecht
915204d819 Bug 1649441, remove icu/README.md now that it is in docs, r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D82984
2020-07-09 20:38:57 +00:00
André Bargull
4d1d96c31a Bug 1534160 - Part 2: Cherry-pick patch for Android time zone detection. r=jwalden
Cherry-pick the commit from <https://github.com/unicode-org/icu/pull/605>.

Depends on D82545

Differential Revision: https://phabricator.services.mozilla.com/D82546
2020-07-09 09:52:26 +00:00
André Bargull
dc07d1aa1e Bug 1534160 - Part 1: Re-run ICU updater to pick up latest changes to ICU 67 maintenance branch. r=jwalden
The change itself isn't important for us, because we don't use ICU's make-files,
but avoids confusion why additional changes were applied when running the update
script.

Differential Revision: https://phabricator.services.mozilla.com/D82545
2020-07-07 21:05:03 +00:00
Axel Hecht
ac4d08312c Bug 1614941, add more date formats to dsb and hsb, r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D62732
2020-07-07 11:46:05 +00:00
Ricky Stewart
0ba6a8762d Bug 1645779 - Make icu_sources_data.py Python 3-compliant r=jwalden,anba
This removes a dependency on `pymake`, which is Python 2-only, and thoroughly unnecessary since we just use it to find assignments of the form `OBJECTS = ...`. We can replicate this logic by just isolating lines that begin with that literal string, and everything else can stay the same. This is definitionally more brittle than actually using a parser, but it works fine for now, and the original implementation wasn't significantly better (it didn't handle any form of dynamism, anything more complicated than a single unconditional assignment with a space-separated list of literal strings representing outputs, etc.)

Differential Revision: https://phabricator.services.mozilla.com/D79896
2020-06-18 21:01:49 +00:00
Sylvestre Ledru
4b7c742212 Bug 1646405 - update the code using pyyaml to use the new path r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D80025
2020-06-18 19:40:28 +00:00
André Bargull
3a33d76bdf Bug 1642934: Automatically determine current CLDR version when updating langtags. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D78021
2020-06-12 11:19:50 +00:00
André Bargull
3d23887ba7 Bug 1636984 - Part 2: Reimport ICU to generate the data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D74682
2020-06-12 12:50:04 +00:00
Jeff Walden
5104a36433 Bug 1642505 - Add an ICU README file describing what ICU does, how to use it, and how to use and update Gecko's imported copy of it. r=anba
Differential Revision: https://phabricator.services.mozilla.com/D77719
2020-06-03 17:49:26 +00:00
André Bargull
b029ce9ac8 Bug 1557727 - Part 1: Add resources for Intl.DisplayNames to ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D52163
2020-05-19 11:17:21 +00:00
André Bargull
57a5eb29e7 Bug 1632434 - Part 1: Update in-tree ICU to release 67.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D72908
2020-04-29 23:47:31 +00:00
André Bargull
5020091e8c Bug 1610512 - Part 1: Update in-tree ICU to release 66.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D66555

--HG--
extra : moz-landing-system : lando
2020-03-19 01:09:56 +00:00
Andreea Pavel
0618bdbfe4 Backed out changeset f34592b66d45 undo typo on a CLOSED TREE 2020-01-06 14:35:59 +02:00
Andreea Pavel
e830f0abe2 No bug - fix typo to have a commit to triggering commit ingestion again. CLOSED TREE 2020-01-06 14:16:53 +02:00
André Bargull
e96ab7f00d Bug 1583269 - Part 2: Update in-tree ICU to release 65.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D49443

--HG--
rename : intl/icu/source/i18n/numparse_stringsegment.cpp => intl/icu/source/i18n/string_segment.cpp
rename : intl/icu/source/data/buildtool/__init__.py => intl/icu/source/python/icutools/databuilder/__init__.py
rename : intl/icu/source/data/buildtool/comment_stripper.py => intl/icu/source/python/icutools/databuilder/comment_stripper.py
rename : intl/icu/source/data/buildtool/locale_dependencies.py => intl/icu/source/python/icutools/databuilder/locale_dependencies.py
rename : intl/icu/source/data/buildtool/renderers/__init__.py => intl/icu/source/python/icutools/databuilder/renderers/__init__.py
rename : intl/icu/source/data/buildtool/renderers/makefile.py => intl/icu/source/python/icutools/databuilder/renderers/makefile.py
rename : intl/icu/source/data/buildtool/test/__init__.py => intl/icu/source/python/icutools/databuilder/test/__init__.py
rename : intl/icu/source/data/buildtool/test/__main__.py => intl/icu/source/python/icutools/databuilder/test/__main__.py
rename : intl/icu/source/data/buildtool/test/filtration_test.py => intl/icu/source/python/icutools/databuilder/test/filtration_test.py
extra : moz-landing-system : lando
2019-10-19 01:25:24 +00:00
André Bargull
d31b7c3f20 Bug 1569567 - Part 7: Remove currency codes and gender lists from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39670

--HG--
extra : moz-landing-system : lando
2019-07-30 08:03:11 +00:00
André Bargull
4bfe032920 Bug 1569567 - Part 6: Remove unused "locales" values from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39669

--HG--
extra : moz-landing-system : lando
2019-07-30 08:01:21 +00:00