Commit Graph

799 Commits

Author SHA1 Message Date
Sylvestre Ledru
dd5741407b Bug 1498586 - Add clang-format off to avoid the reformatting of the data structures r=Ehsan
Too hard/impossible for the tool to format correctly these structs

Differential Revision: https://phabricator.services.mozilla.com/D8569

--HG--
extra : moz-landing-system : lando
2018-10-12 20:48:24 +00:00
Henri Sivonen
b8545f2cf8 Bug 1495067 - Make HasRTLChars() consider Hebrew presentation forms as RTL (again) and not consider U+FEFF as RTL (again). r=jfkthame
* Update encoding_rs to 0.8.8.
 * Change U+FEFD and U+FEFE to RTL in IS_RTL_PRESENTATION_FORM to make the
   Rust and C++ code agree on what's RTL.

MozReview-Commit-ID: CuK6fN4pojG

Differential Revision: https://phabricator.services.mozilla.com/D7285

--HG--
extra : moz-landing-system : lando
2018-10-02 14:24:15 +00:00
Henri Sivonen
cbab098175 Bug 1485343 - Avoid locale-dependent C standard library functions in FTP code. r=valentin
MozReview-Commit-ID: CXcluPKLwIv

Differential Revision: https://phabricator.services.mozilla.com/D4315

--HG--
extra : moz-landing-system : lando
2018-08-27 09:11:30 +00:00
Thomas Wisniewski
78af5fd2ae Bug 1454590 - Align overrideMIMEType with the XMLHttpRequest Standard. r=hsivonen
MozReview-Commit-ID: 5k34F96jRPX

--HG--
extra : rebase_source : 95944acc3123406dbf490f2fd1837b8decaa3e0b
2018-08-13 16:12:10 -04:00
Paul Bone
a769b94ed4 Bug 1482002 - add nsCaseInsensitiveStringComparator default constructor r=bz
--HG--
extra : rebase_source : 33354a2466e0695350669d309713694ff5b7b6ca
extra : source : 45c85611bd318a4b788ae9884a78af2ebe99e30e
2018-08-09 14:37:30 +10:00
Jonathan Kew
98cb122caa Bug 1426827 - Treat Fitzpatrick skin-tone modifiers as cluster extenders when building textruns. r=m_kato 2018-07-25 09:38:10 +01:00
Jonathan Kew
c5cd6a1621 Bug 1477010 - Treat plane-14 tag characters as cluster extenders when building textruns, so that emoji flag sequences behave as single units. r=m_kato 2018-07-25 09:38:07 +01:00
Xidorn Quan
158c6391b2 Bug 1476485 - Remove pragma pack from nsUnicodeScriptCodes.h. r=jfkthame
MozReview-Commit-ID: LW64U7ccjVa

--HG--
extra : rebase_source : 0c95807a0a86be417d331c9f9b0a61ff2b04db23
2018-07-18 14:05:05 +10:00
André Bargull
19d00748a5 Bug 1466471 - Part 5: Regenerate Unicode files after ICU update. r=jfkthame 2018-06-22 05:02:03 -07:00
Chris Peterson
2afd829d0f Bug 1469769 - Part 6: Replace non-failing NS_NOTREACHED with MOZ_ASSERT_UNREACHABLE. r=froydnj
This patch is an automatic replacement of s/NS_NOTREACHED/MOZ_ASSERT_UNREACHABLE/. Reindenting long lines and whitespace fixups follow in patch 6b.

MozReview-Commit-ID: 5UQVHElSpCr

--HG--
extra : rebase_source : 4c1b2fc32b269342f07639266b64941e2270e9c4
extra : source : 907543f6eae716f23a6de52b1ffb1c82908d158a
2018-06-17 22:43:11 -07:00
Bobby Holley
2b985ab718 Bug 1451421 - Add a ToLowerCaseASCII utility method for nsAtom. r=hisvonen 2018-04-06 15:30:15 -07:00
Jonathan Kew
37d0b4ea9b Bug 1440943 - Make GetScriptTagForCode safely return UNKNOWN tag if called with a script code that is out of range for the system ICU version. r=m_kato 2018-02-27 10:34:25 +00:00
Henri Sivonen
5b05e804a9 Bug 1431025 - Use encoding_rs::mem::is_utf16_bidi() as the implementation of HasRTLChars(). r=jfkthame
MozReview-Commit-ID: KnaI7wIndVf

--HG--
extra : rebase_source : 6a00c8fc140c1cf070e8fa668e7e099f98621820
2018-01-18 14:28:15 +02:00
Henri Sivonen
a710d83a47 Bug 1428774 - Avoid surrogate math in HasRTLChars(). r=jfkthame
Behavior change: Certain unpaired high surrogates will result in
the text being considered RTL where that wasn't the case before.

MozReview-Commit-ID: JL7wiRjhslC

--HG--
extra : rebase_source : ecd521a97be8908bb839aca02d624d86d5b0337f
2018-01-09 10:55:41 +02:00
Henri Sivonen
381880a0e0 Bug 1428771 - Make UCS2_CHAR_IS_BIDI check for lead surrogates corresponding to U+1E800...U+1EFFF and rename to UTF16_CODE_UNIT_IS_BIDI. r=jfkthame
MozReview-Commit-ID: 9ZKF6SaN79n

--HG--
extra : rebase_source : 406f2647e65e2bdb97190b12564bafa6df39e6a8
2018-01-08 16:18:32 +02:00
Eric Rahm
07c97a5afe Bug 1423773 - Part 1: Remove usage of nsStringGlue.h. r=glandium
This removes an unnecessary level of indirection by replacing all
nsStringGlue.h instances with just nsString.h.

--HG--
extra : rebase_source : 340989240af4018f3ebfd92826ae11b0cb46d019
2017-12-06 16:52:51 -08:00
Makoto Kato
153c591749 Bug 1032671 - Part 4. Font fallback should detect emoji range for color emoji font. r=jfkthame
MozReview-Commit-ID: AeqSLUU9GRH

--HG--
extra : rebase_source : 3a3d0c70072b990d83b1304eb527f30307f6e944
2017-11-12 16:36:24 +09:00
Makoto Kato
b970e21a69 Bug 1032671 - Part 1. Add emoji presentation API for UTR#51. r=jfkthame
From ICU 57, ICU supports emoji presentation as draft API.

MozReview-Commit-ID: 6JgQMv4Ky9m

--HG--
extra : rebase_source : 60f451e7476f16ed48aeaccb1fc55d3962a2b4b2
2017-11-12 16:06:18 +09:00
Makoto Kato
1e66d08774 Bug 1418477 - Part 1. Should check error status of unum_open. r=jfkthame
We don't check error of unum_open, so we should check it.  Because
unum_setAttribute doesn't have UErrorCode parameter.

MozReview-Commit-ID: 3j7jeiKbdG

--HG--
extra : rebase_source : 61d0daf8f14f1a36623967d9d63648a8a88e25ae
2017-11-22 11:57:53 +09:00
André Bargull
4d1b9920dd Bug 1405993 - Part 6: Regenerate Unicode files after ICU update. r=jfkthame
--HG--
extra : rebase_source : 058ef6104e2aafb407ee951d4b1dd1ab79b6b002
2017-11-01 12:10:08 -07:00
Makoto Kato
945aa85d0c Bug 1292486 - Get rid of nsIUnicodeNormalizer interface. r=jfkthame
m-c and c-c don't use nsIUnicodeNormalizer interface now.

MozReview-Commit-ID: DGK7wBrcrob

--HG--
extra : rebase_source : 9260435fb2d4455b45920971c105a8d502c4e53e
extra : histedit_source : cf2863ebff742f160f30e6a15517f07490f1e6a6
2017-10-20 17:35:34 +09:00
Jonathan Kew
6472fbd7dc Bug 1402271 - patch 3 - Remove non-ENABLE_INTL_API code paths from the nsUnicodeProperties code. r=m_kato 2017-09-25 09:18:20 +01:00
Jonathan Kew
ae0f800c6e Bug 1402271 - patch 2 - Regenerate Unicode data tables with the stripped-down tool. r=m_kato 2017-09-25 09:18:14 +01:00
Jonathan Kew
26d09a9bd2 Bug 1402271 - patch 1 - Simplify the genUnicodePropertyData.pl tool to generate only the data we need to supplement ICU properties. r=m_kato 2017-09-25 09:18:05 +01:00
Jonathan Kew
de0c996277 Bug 1402273 - Build ICUUtils unconditionally, now that we no longer build without ENABLE_INTL_API on any platform. r=m_kato 2017-09-24 13:35:59 +01:00
Jonathan Kew
3bcb820ee6 Bug 1402053 - Remove our obsolete implementation of Unicode normalization, now that we can use ICU on all platforms. r=m_kato 2017-09-22 10:37:17 +01:00
Jonathan Kew
cc79ecacc0 Bug 1402090 - Remove obsolete ucdata code/tools, no longer used in the mozilla build. r=m_kato 2017-09-22 10:37:17 +01:00
Masayuki Nakano
6b9eda1dda Bug 1392181 - part2: HasRTLChars() should check if the character is at least equal or larger than the minimum RTL character, U+0590 r=emk
HasRTLChars() appears in profile of attachment 8848015 after landing the patches
for bug 1391538 because the landing made text in <input> or <textarea> always
treated as non-single byte characters.  Therefore, HasRTLChars() is now called
by nsTextFragment::SetTo() a lot in editors.

HasRTLChar() checks if it's in an RTL character for each character until it
becomes true.  However, if character is less than the minimum RTL character,
U+0590, it works faster at least for Western languages.

MozReview-Commit-ID: 4YecxQWUcmK

--HG--
extra : rebase_source : 172be670795f0e2155d4bd5044ee37f652367734
2017-08-21 18:03:21 +09:00
Simon Lindholm
8b0e1c2942 Bug 1387780 - Optimize string searching in MatchAutoCompleteFunction. r=adw, r=emk 2017-08-20 17:21:00 -04:00
Henri Sivonen
41573b4bfd Bug 1048191 - Remove capability to generate entities other than quot, amp, gt, lt and nbsp. r=emk.
MozReview-Commit-ID: CHQQzPHxrus

--HG--
extra : rebase_source : 0fad8c86a374c29ab9f691b53f6495aa8287cb65
2017-08-04 12:37:53 +03:00
Masatoshi Kimura
49662ba6d1 Bug 1202362 - Remove nsISaveAsCharset & nsSaveAsCharset. r=hsivonen
MozReview-Commit-ID: KbepWLdKQ5E

--HG--
extra : rebase_source : 56d97edbaf933dc981c21ca09a49661fa3a347ef
2017-08-03 16:16:32 +09:00
Nicholas Nethercote
c86dc10505 Bug 1380227 - Avoid many UTF16toUTF8 and UTF8toUTF16 conversions in nsStringBundle. r=emk.
Most of the names passed to nsIStringBundle::{Get,Format}StringFromUTF8Name
have one of the two following forms:

- a 16-bit C string literal, which is then converted to an 8-bit string in
  order for the lookup to occur;

- an 8-bit C string literal converted to a 16-bit string, which is then
  converted back to an 8-bit string in order for the lookup to occur.

This patch introduces and uses alternative methods that can take an 8-bit C
string literal, which requires changing some signatures in other methods and
functions. It replaces all C++ uses of the old methods.

The patch also changes the existing {Get,Format}StringFromName() methods so
they take an AUTF8String argument for the name instead of a wstring, because
that's nicer for JS code.

Even though there is a method for C++ code and a different one for JS code,
|binaryname| is used so that the existing method names can be used for the
common case in both languages.

The change reduces the number of NS_ConvertUTF8toUTF16 and
NS_ConvertUTF16toUTF8 conversions while running Speedometer v2 from ~270,000 to
~160,000. (Most of these conversions involved the string
"deprecatedReferrerDirective" in nsCSPParser.cpp.)

--HG--
extra : rebase_source : 3bee57a501035f76a81230d95186f8c3f460ff8e
2017-07-12 15:13:37 +10:00
Wes Kocher
19d135c982 Merge m-c to autoland, a=merge
MozReview-Commit-ID: 4R4GFHPiij
2017-07-06 16:19:38 -07:00
Sylvestre Ledru
4e9cf83ee8 Bug 1378712 - Remove all trailing whitespaces r=Ehsan
MozReview-Commit-ID: Kdz2xtTF9EG

--HG--
extra : rebase_source : 7235b3802f25bab29a8c6ba40a181a722f3df0ce
2017-07-06 14:00:35 +02:00
Jonathan Kew
ae5077eec2 Bug 1378683 - Fix incorrectly-written retry loop in nsUnicodeNormalizer. r=sylvestre 2017-07-06 11:33:23 +01:00
Jonathan Kew
e0b78e9b57 Bug 1377584 - Update casing (text-transform) test data to Unicode 10.0 repertoire. r=m_kato 2017-07-04 09:19:53 +01:00
Jonathan Kew
7be1139537 Bug 1376834 - Update data tables to Unicode 10.0 release. r=m_kato 2017-06-30 14:16:02 -07:00
Chris Peterson
dfd1e13cc5 Bug 1373525 - intl/unicharutil: Move ScopedUNumberFormatTraits class out of unnamed namespace. r=emk
Move the class definition out of an unnamed namespace because it is in a header files included in multiple source files. clang treats the header file's class declaration in an unnamed namespace as distinct in each compilation unit and emits -Wunused-member-function warnings because the member function release() is used in some compilation units but not others.

intl/unicharutil/util/ICUUtils.h:25:17 [-Wunused-member-function] unused member function 'empty'
intl/unicharutil/util/ICUUtils.h:26:17 [-Wunused-member-function] unused member function 'release'

MozReview-Commit-ID: 7AgzzzRgni4

--HG--
extra : source : aeed73b6225ba4834a25de0ec9e23592de25c871
extra : intermediate-source : d0788a9eba9621e04f6be30771acac5707d4a7e1
2017-06-11 14:45:24 -07:00
Henri Sivonen
432653453a Bug 1261841 part 2 - Use encoding_rs instead of uconv. r=emk,mystor.
MozReview-Commit-ID: 15Y5GTX98bv
2017-06-13 13:23:23 +03:00
Xidorn Quan
ac6cc1d36a Bug 1368418 part 3 - Remove nsCategoryImp. r=emk
MozReview-Commit-ID: 5qCoeqfM2s5

--HG--
extra : rebase_source : 6dc1693ce61bea4ec35469a3388c75a9fb64e5b3
2017-05-29 16:17:39 +10:00
Xidorn Quan
143db590ff Bug 1368418 part 2 - Remove nsCaseConversionImp2. r=emk
Code search indicates that it is used neither internally nor in any
addon. It should be safe to remove.

MozReview-Commit-ID: K3dBoydIwGk

--HG--
extra : rebase_source : 984aee342b0006af94eec1cd7fce123bccea4bd7
2017-05-29 16:10:36 +10:00
Jonathan Kew
ed530ec201 Bug 1353000 - Preparatory patch, explicitly make the Script enum a 16-bit type, so we can add a field to gfxShapedWord without making it bigger. r=jrmuizel 2017-04-12 14:55:10 +01:00
Jonathan Kew
26f06fc0de Bug 1358275 - Preliminary cleanup: refactor nsTextFragment::UpdateBidiFlag(), moving its logic into nsBidiUtils function HasRTLChars() and making that function more precise in the process. r=dholbert 2017-04-26 23:25:48 +01:00
Zibi Braniecki
3d91da8726 Bug 1347314 - Migrate calls to ChromeRegistry::GetSelectedLocale to use LocaleService::GetAppLocale. r=jfkthame,Pike
In cases, where the caller is looking for the locale to be used for JS Intl API,
we can now replace it with `undefined` which causes JS Intl API to use the default
locale which since bug 1346674 is resolved to the app locale.

This allows us to remove a lot of calls for the app locale.

The remaining ones are split between `AsBCP47` and `AsLangTag`.
Here, the `AsLangTag` is used, as described in the API docs, for cases where
the language string is used for localization purposes, such as language negotaition
matching to our language resources etc.
`AsBCP47` is used when the returned value is handed over to ICU API.

MozReview-Commit-ID: DzmFEUvMq3N

--HG--
extra : rebase_source : 513ed31d995864939aa893e73c81ffdf591a6617
2017-03-14 16:09:54 -07:00
Sebastian Hengst
0a04f3b9e2 Backed out changeset cc308a73ad05 (bug 1347314) for eslint failure in test_device.html. r=backout 2017-03-22 18:20:26 +01:00
Zibi Braniecki
c2cd68a689 Bug 1347314 - Migrate calls to ChromeRegistry::GetSelectedLocale to use LocaleService::GetAppLocale. r=jfkthame,Pike
In cases, where the caller is looking for the locale to be used for JS Intl API,
we can now replace it with `undefined` which causes JS Intl API to use the default
locale which since bug 1346674 is resolved to the app locale.

This allows us to remove a lot of calls for the app locale.

The remaining ones are split between `AsBCP47` and `AsLangTag`.
Here, the `AsLangTag` is used, as described in the API docs, for cases where
the language string is used for localization purposes, such as language negotaition
matching to our language resources etc.
`AsBCP47` is used when the returned value is handed over to ICU API.

MozReview-Commit-ID: DzmFEUvMq3N

--HG--
extra : rebase_source : 13fa4c397ba4c79303a2cd76684b5b8c4bd17331
2017-03-14 16:09:54 -07:00
David Major
ed0b8f8653 Bug 1344615: Remove nsXPCOMStrings.{h,cpp} r=bsmedberg
These are now dead code.

MozReview-Commit-ID: AClU0Qx3kmN

--HG--
extra : rebase_source : df83cf89292da1519bb26027c11e14923d5c54a0
2017-03-06 17:52:54 +13:00
David Major
058a3a25a4 Bug 1344615: Rewrite a few straggling users of NS_String* APIs. r=bsmedberg
I've moved the body of the APIs into the few remaining callers.

MozReview-Commit-ID: 9ALoSmQHkGM

--HG--
extra : rebase_source : e0e747dec23424446b18d53ab65e4fa262e16554
2017-03-06 17:52:09 +13:00
Benjamin Smedberg
3d381083df Bug 1332639 - Remove the external unicharutil library which isn't used and is now unlinkable, r=emk
MozReview-Commit-ID: UOPsyIOB8O

--HG--
extra : rebase_source : 38c986684710f54565ad6c99bdb9865205ce0255
2017-02-27 13:38:39 -05:00
Benjamin Smedberg
ca77995f5d Bug 1333826 - Remove SDK_FILES, SDK_LIBRARY, and related is_sdk support in the build goop, r=mshal
MozReview-Commit-ID: 52vPyDXdFte

--HG--
extra : rebase_source : c3217730bb70eb7319152dd07536b12f49d6a597
2017-01-30 11:24:10 -05:00