Commit Graph

9049 Commits

Author SHA1 Message Date
Axel Hecht
1343d506c0 Bug 1641184, use only the merge dir for repacks, r=nalexander
l10n-merge creates a full merge dir for a while now, let's
simplify the build logic to only read from that directory
during repacks and langpacks.

Differential Revision: https://phabricator.services.mozilla.com/D77023
2020-05-27 17:04:06 +00:00
Cameron McCormack
4d86697e24 Bug 1641108 - Add perf-reftest-singleton for bug 1640545 changes. r=emilio,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D76966
2020-05-27 12:01:53 +00:00
julianwels
2cb5d08b1f Bug 1625156 - Added tests for HTTPS Only Mode error page. r=nhnt11
Differential Revision: https://phabricator.services.mozilla.com/D75793
2020-05-26 11:45:34 +00:00
Kartikaya Gupta
cc4b5edc35 Bug 1638664 - Improve the way MozsearchIndexer merges analysis data. r=asuth
Instead of doing this:
a) read existing file into memory
b) append new entries
c) sort all entries
d) write unique entries back to file

We now do this:
a) sort new entries
b) loop through existing file entries, one at a time, writing them to a tmp file
c) insert the new entries in between the existing file entries in lexicographic order,
   and deduplicating the new entries
d) write any remaining new entries (that are lexicographically after the last
   entry in the pre-existing file), again deduplicating the entries
e) move tmp file back to original file location

This avoids reading the entire file into memory which could be potentially
hundreds of MB large.

The changes in FileOperations.* are needed to support these changes, as we now
have two files that we're dealing with - reading from one and writing to the
other. We still use a Mutex (Windows) or exclusive-flock (POSIX) on the file
for the duration of the entire operation, so we should still be robust in the
face of multiple concurrently running clang processes.

Differential Revision: https://phabricator.services.mozilla.com/D76202
2020-05-25 18:53:36 +00:00
Mike Hommey
dcc0980530 Bug 1636574 - Fixup for configure lint happiness.
Differential Revision: https://phabricator.services.mozilla.com/D76423
2020-05-22 01:24:09 +00:00
Mike Hommey
f2056ea3ec Bug 1636574 - Do not actually inject early options from mozconfig. r=rstewart
The configure sandbox has a list of arguments to handle, and removes
each of them when it resolves the corresponding options through e.g. a
`@depends`. When the configure sandbox is finished, what's supposed to
be left is unknown options.

The mozconfig injections adds elements to that list of arguments to
handle. The problem is that by the time the mozconfig injection happens,
some early options have already been handled by the sandbox and won't be
re-handled. Which means by the end of configure, the arguments are still
there, and the sandbox throws an error because it thinks they are for
unknown options.

Things were actually working before bug 1264527, essentially because we
had an explicit list of mozconfig variables that would be injected, and
that didn't include those early options.

So what we now do is to not actually inject those early options from
mozconfig.

Differential Revision: https://phabricator.services.mozilla.com/D76276
2020-05-21 15:28:13 +00:00
Mike Hommey
da55054404 Bug 1639569 - Define PYTHON3 in old-configure. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D76260
2020-05-21 15:28:25 +00:00
Cosmin Sabou
3a5c48b16c Bug 1639815 - Fix for win asan build bustages. r=glandium
CLOSED TREE
2020-05-22 03:23:16 +03:00
Mike Hommey
6ba1065508 Bug 1639815 - Move --enable-strip and --enable-install-strip to python configure. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D76291
2020-05-21 23:51:58 +00:00
Mike Hommey
711ffb4939 Bug 1639815 - Move --disable-icf to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76290
2020-05-21 22:38:47 +00:00
Mike Hommey
03b3bd5a35 Bug 1639815 - Move --enable-dtrace to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76289
2020-05-21 22:38:47 +00:00
Mike Hommey
114f6b0f27 Bug 1639815 - Move --enable-cpp-rtti to python configure. r=froydnj
This only moves the option, but still leaves it to the old-configure code to
add the appropriate flags to CXXFLAGS.

Differential Revision: https://phabricator.services.mozilla.com/D76288
2020-05-21 22:38:46 +00:00
Mike Hommey
79feb07ead Bug 1639815 - Move --enable-readline to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76287
2020-05-21 22:38:46 +00:00
Mike Hommey
0e16889c8a Bug 1639815 - Move --with-sixgill to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76286
2020-05-21 22:38:46 +00:00
Mike Hommey
af5718ca89 Bug 1639815 - Move --with-qemu-exe and --with-cross-lib to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76285
2020-05-21 22:38:46 +00:00
Bogdan Tara
0bff3c4d0b Backed out 7 changesets (bug 1639815) for --disable-install-strip related bustages CLOSED TREE
Backed out changeset 04a1388fc17d (bug 1639815)
Backed out changeset d48eea557b6d (bug 1639815)
Backed out changeset 6fba10f61bd2 (bug 1639815)
Backed out changeset cfb945f6c82f (bug 1639815)
Backed out changeset 16447c678749 (bug 1639815)
Backed out changeset 89475adf15b6 (bug 1639815)
Backed out changeset 94877a079054 (bug 1639815)
2020-05-22 01:33:22 +03:00
Mike Hommey
9725d351de Bug 1639815 - Move --enable-strip and --enable-install-strip to python configure. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D76291
2020-05-21 20:39:54 +00:00
Mike Hommey
1f62799146 Bug 1639815 - Move --disable-icf to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76290
2020-05-21 10:13:48 +00:00
Mike Hommey
1304fec22e Bug 1639815 - Move --enable-dtrace to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76289
2020-05-21 10:13:35 +00:00
Mike Hommey
8a47c95211 Bug 1639815 - Move --enable-cpp-rtti to python configure. r=froydnj
This only moves the option, but still leaves it to the old-configure code to
add the appropriate flags to CXXFLAGS.

Differential Revision: https://phabricator.services.mozilla.com/D76288
2020-05-21 10:13:27 +00:00
Mike Hommey
7ebe2d69fb Bug 1639815 - Move --enable-readline to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76287
2020-05-21 10:13:24 +00:00
Mike Hommey
3feaca35c7 Bug 1639815 - Move --with-sixgill to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76286
2020-05-21 10:10:31 +00:00
Mike Hommey
69d706ac05 Bug 1639815 - Move --with-qemu-exe and --with-cross-lib to python configure. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D76285
2020-05-21 10:11:21 +00:00
David Major
199714bdbe Bug 1639318 - Stick to clang-9 levels of CFG on arm64 r=froydnj
The expanded checks in clang 10 made arm64 builds hit CFG crashes on nsXPTCStubBase vtables on startup.

It's not clear why this doesn't happen on x86 builds. Given our current level of support for arm64, I can't really justify investigating this, although I suspect that fixing the underlying issue would be pretty much bug 1483885.

As a get-unblocked stopgap, `-guard:cf,nochecks` in clang 10 gives the same behavior as `-guard:cf` in clang 9.

Differential Revision: https://phabricator.services.mozilla.com/D76216
2020-05-21 02:11:23 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74930
2020-05-21 13:31:55 +00:00
Rob Lemley
5304de01a2 Bug 1639618 - Use correct find_symbolizer_linux patch when building clang-7. r=froydnj
The "clang-9" variant of the patch is no longer present. For clang-7, the patch
file to use is now "find_symbolizer_linux.patch".

Differential Revision: https://phabricator.services.mozilla.com/D76176
2020-05-20 16:56:35 +00:00
Razvan Maries
305c356967 Backed out changeset 415534347ba0 (bug 1636574) for build bustages. CLOSED TREE 2020-05-20 19:09:46 +03:00
Ricky Stewart
50eff9d473 Bug 1636574 - Allow setting PYTHON3 in mozconfig r=glandium
Configuration values defined above `mozconfig_options` in `init.configure` are those that can't be configured in `mozconfig`. As far as I can tell there is nothing wrong *in principle* with setting `PYTHON3` in `mozconfig`, so here we just bump `mozconfig_options` above `PYTHON3` configuration.

Side note, diagnosing this failure took a *long* time. The error message that this produced ("unknown option `PYTHON3`") is useless and the underlying algos being extremely mutable, I ended up having to spend a lot of time in the debugger and monitor all the underlying changes to a bunch of mutable data structures to determine where `PYTHON3` was getting lost. A better error message would be good here but I don't know how I would begin adding it.

Differential Revision: https://phabricator.services.mozilla.com/D75635
2020-05-20 15:39:29 +00:00
Ricky Stewart
a24b65434d Bug 1638995 - Run mach valgrind-test with Python 3 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D76057
2020-05-20 05:31:58 +00:00
Corentin Arnould
1f8a5ee33b Bug 1638830 - Remove MOZ_WEBRTC_HARDWARE_AEC_NS and its related code r=padenot
--enable-hardware-aec-ns option does nothing so it is deleted too.
removed `hardware_aec_ns` from gyp vars since it is never used

Differential Revision: https://phabricator.services.mozilla.com/D75798
2020-05-20 13:22:40 +00:00
Razvan Maries
40dbaf2901 Backed out changeset c17af0632260 (bug 1616692) as per Eric's request. CLOSED TREE 2020-05-20 08:29:18 +03:00
David Major
5157a6b486 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-20 07:39:23 +03:00
Dorel Luca
0a4406d5ef Backed out changeset 80ba3f3cfaf9 (bug 1616692) at dev's request. CLOSED TREE 2020-05-20 03:27:33 +03:00
Rob Lemley
bd812fce54 Bug 1631197 - Make mach valgrind-test work for Thunderbird builds. r=froydnj
Create a new MachCommandCondition, "is_firefox_or_thunderbird" which is then used
to allow mach valgrind-test work for Thunderbird builds.

Differential Revision: https://phabricator.services.mozilla.com/D73153
2020-05-19 00:10:06 +00:00
Thomas Duellmann
5123bc5ab2 Bug 1638576 - Correct spelling of "deprecated" (follow-up to bug 1611160). r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D75714
2020-05-17 20:20:38 +00:00
Emilio Cobos Álvarez
29382a0fc9 Bug 1638401 - Make liblowercase also wrap fxstatat. r=froydnj
This is needed to get a win cross build on my machine.

Differential Revision: https://phabricator.services.mozilla.com/D75589
2020-05-15 17:10:34 +00:00
David Major
38729b41a2 Bug 1638244 - Keep clang-7 toolchain on the old version of the find_symbolizer_linux patch r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D75506
2020-05-15 12:17:06 +00:00
Mike Hommey
160dc36a14 Bug 1638195 - Remove python configure knowledge of old configure arguments that were removed. r=nalexander
--enable-cookies, removed in bug 1623593.
  --enable-directshow, removed in bug 1370192.
  --enable-feeds, removed in bug 1514348.
  --enable-gconf, removed in bug 1433685.
  --enable-libjpeg-turbo, removed in bug 1515852.
  --enable-llvm-hacks, removed in bug 1484872.
  --enable-nfc, removed in bug 1310859.
  --enable-startup-notification, removed in bug 726479.
  --enable-synth-pico, removed in bug 1331696.
  --with-doc-include-dirs, --with-doc-input-dirs, --with-doc-output-dir,
  removed in bug 1435424
  --with-system-bz2, removed in bug 1418425.
  --with-unify-dist, removed in bug 1339182.

Differential Revision: https://phabricator.services.mozilla.com/D75464
2020-05-15 03:56:16 +00:00
Mike Hommey
28de21d935 Bug 1638193 - Remove build system support for iOS. r=nalexander
iOS support for Gecko has not been tested in years and is most probably
out of date. The build system part of it, specifically the checks in
build/autoconf/ios.m4, are not trivial to port to python configure, and
they prevent other things from moving to python configure (because some
of them change value when MOZ_IOS is set).

The code is left alone, although it could probably be stripped off as
well, but I'll leave that as an exercise for someone else.

Differential Revision: https://phabricator.services.mozilla.com/D75463
2020-05-15 03:56:16 +00:00
Sebastian Streich
479a4cb3a1 Bug 1636148 - Disable Building Principal->GetURI r=ckerschb
Differential Revision: https://phabricator.services.mozilla.com/D74249
2020-05-14 19:42:59 +00:00
Edwin Takahashi
ffa6cb8cbe Bug 1608837 - add necessary files to taskgraph sparse-profile for web-platform-tests chunking r=ahal
Changes:

  - add web-platform-tests files to the sparse-profile to support test chunking.

Differential Revision: https://phabricator.services.mozilla.com/D70752
2020-05-08 21:28:08 +00:00
Ricky Stewart
cbd2ddf64f Bug 1638036 - Delete reference to PY3 in configure r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D75346
2020-05-14 20:08:40 +00:00
Nathan Froyd
4b28d7c785 Bug 1637957 - ensure consistent output when checking for linker kind; r=firefox-build-system-reviewers,rstewart
If we don't do this, configure will happily think the linker kind is
"unknown", which then causes problems downstream.

Differential Revision: https://phabricator.services.mozilla.com/D75300
2020-05-14 17:50:14 +00:00
David Major
64f56df070 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-14 13:42:38 +00:00
David Major
bd18433165 Bug 1614375: bustage fix, add a couple more suppressions for straggler failures 2020-05-12 14:50:34 -04:00
Tarek Ziadé
080870795e Bug 1635136 - add a --push-to-try option r=aerickson
This patch is adding an option to push a perftest run in the CI.

It's based on :
- sparse profiles
- push_to_try
- options passed through try_task_config.json

Differential Revision: https://phabricator.services.mozilla.com/D74115
2020-05-12 21:19:48 +00:00
Mitchell Hentges
16d345e402 Bug 1636251: vendor sentry python package r=rstewart
urllib3 is needed by Sentry for its HTTP communication.

Differential Revision: https://phabricator.services.mozilla.com/D74737
2020-05-12 20:07:45 +00:00
David Major
26568e980b Bug 1635933 - Temporarily disable new pass manager on ubsan clang-10 r=froydnj
ubsan's generated code trips an optimization corner case in clang 10. This is a short-term workaround. In the best case, llvm.org/pr45835 will land a fix soon, and we can merge that for our clang-10 update and not even land this patch. However, in case we're living in anything other than the best case world, I don't want to block on that happening.

Differential Revision: https://phabricator.services.mozilla.com/D74727
2020-05-12 18:01:48 +00:00
Razvan Maries
6740f8e47d Backed out 2 changesets (bug 1616692, bug 1635933) for reftests perma failures. CLOSED TREE
Backed out changeset 7340fb8c2297 (bug 1616692)
Backed out changeset 5695aa933c38 (bug 1635933)
2020-05-12 20:59:06 +03:00
David Major
50334d3714 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-12 14:02:30 +00:00