Commit Graph

9151 Commits

Author SHA1 Message Date
Razvan Maries
891da67475 Backed out 6 changesets (bug 1685599) for WR bustages. CLOSED TREE
Backed out changeset 29eab2f84c77 (bug 1685599)
Backed out changeset 2839d8d39881 (bug 1685599)
Backed out changeset 3ba2f1c048c3 (bug 1685599)
Backed out changeset c7d4ecfc689a (bug 1685599)
Backed out changeset 5483ce4f5f4c (bug 1685599)
Backed out changeset 68fa5ecf205c (bug 1685599)
2021-01-08 09:04:37 +02:00
Mike Hommey
c3d2cb844a Bug 1685599 - Remove now unused macosx64-clang-9 and linux64-clang-9-macosx-cross toolchains. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D101081
2021-01-08 00:33:35 +00:00
Mike Hommey
88729bdea4 Bug 1685599 - Build macosx64-clang-11 with linux64-clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
Now that linux64-clang-11-macosx-cross doesn't need a macosx64-clang-*
to build, there is no circular dependency to avoid.

Differential Revision: https://phabricator.services.mozilla.com/D101080
2021-01-08 00:33:17 +00:00
Mike Hommey
1c7ff6f2c2 Bug 1685599 - Build a single macosx-cross toolchain. r=firefox-build-system-reviewers,mhentges
The new toolchain contains both aarch64 and x86_64 compiler-rts. We
could have a separate for each, but compiler-rt is small enough that
entirely separate toolchains is not warranted.

Differential Revision: https://phabricator.services.mozilla.com/D101079
2021-01-08 00:38:37 +00:00
Mike Hommey
6ca557af7a Bug 1685599 - Build a compiler-rt for x86_64. r=firefox-build-system-reviewers,mhentges
The llvm build system does support building a universal compiler-rt for
multiple platforms at once, but as far as I know it only supports doing
so with the same SDK, while we want to use separate SDKs for each, so
build the x86_64 compiler-rt separately.

Differential Revision: https://phabricator.services.mozilla.com/D101078
2021-01-08 00:37:11 +00:00
Mike Hommey
42378a1b72 Bug 1685599 - Build aarch64-compiler-rt using clang-11 instead of clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
We actually don't need the macosx-cross toolchain to build compiler-rt,
because building compiler-rt doesn't require compiler-rt (duh).

Differential Revision: https://phabricator.services.mozilla.com/D101077
2021-01-07 23:54:13 +00:00
Mike Hommey
3128330c17 Bug 1685599 - Build llvm-symbolizer separately. r=firefox-build-system-reviewers,mhentges
Only sanitizer builds require a native llvm-symbolizer executable.
Ideally, we'd build llvm-symbolizer from scratch, which would be faster,
but for now, let's go the easy route and just extract it from the
corresponding native clang builds.

We don't actually do anything with the llvm-symbolizer executable on
android builds, so we don't install it in $FINAL_TARGET, avoilding
the dependency on android builds (plus, we actually don't have an
android-native llvm-symbolizer, so even if it were already shipped, it
would be the wrong file).

Differential Revision: https://phabricator.services.mozilla.com/D101076
2021-01-07 23:53:19 +00:00
David Major
180d35da9f Bug 1685335 - Update to clang 11.0.1 r=firefox-build-system-reviewers,static-analysis-reviewers,andi,mhentges,sylvestre
In addition to the usual dot-release type of fixes, this also lets us drop a good amount of code that we had patched into our clang 11.

Differential Revision: https://phabricator.services.mozilla.com/D100959
2021-01-07 13:53:53 +00:00
Dorel Luca
f6a037e456 Backed out changeset 931f753c12c0 (bug 1682219) for btime failures. CLOSED TREE 2021-01-07 13:54:53 +02:00
Henrik Skupin
15f0a34f7b Bug 1682219 - [geckodriver] Build with Rust 1.49 for Linux. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D100877
2021-01-07 08:09:19 +00:00
Ben Hearsum
1f3e5bcb0e Bug 1685302: Increase update verify chunks on macOS. r=taskgraph-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D100930
2021-01-06 17:41:57 +00:00
Florin Strugariu
f64bc187a4 Bug 1663449 - Disable conditioned profiles on raptor webext tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D100874
2021-01-06 14:03:52 +00:00
Mike Hommey
15c4d4af6e Bug 1685244 - Update sccache to a version with patched tiny-http. r=firefox-build-system-reviewers,mhentges
Bug 1683824 updated to the 0.2.14 tag, but that's patched in order to
publish to crates.io such that tiny-http is not patched anymore.
Unfortunately, that breaks sccache-dist, which is a known issue and will
eventually fixed when addressing
https://github.com/mozilla/sccache/issues/912.
So here we update to a corresponding version on master (the first that
bumps the version to the next number).

Differential Revision: https://phabricator.services.mozilla.com/D100863
2021-01-06 14:01:13 +00:00
Andi-Bogdan Postelnicu
d7fb68e56d Bug 1683613 - For non-unified build have a task that runs checks when merging to mozilla-central r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D100796
2021-01-05 19:40:23 +00:00
Gabriele Svelto
7c4527f7ab Bug 1621475 - Generate symbol files in MinGW builds r=tjr
This uses the new cross-platform dump_syms tool to generate symbols for MinGW
builds, just like on all other platforms.

Differential Revision: https://phabricator.services.mozilla.com/D100707
2021-01-06 08:22:31 +00:00
Mike Hommey
968967eb1d Bug 1684956 - Update builders to rustc 1.49. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D100726
2021-01-06 00:00:13 +00:00
Jeff Muizelaar
3c2a15cd74 Bug 1684799 - Add github sync job for qcms. r=jmaher,taskgraph-reviewers
This is basically just a copy of the existing webrender sync job.

Differential Revision: https://phabricator.services.mozilla.com/D100646
2021-01-05 14:09:46 +00:00
Mike Hommey
b94996533d Bug 1684954 - Upgrade rustc to 1.49 final for arm64 mac builds. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D100725
2021-01-05 00:01:21 +00:00
Mike Hommey
64f1e310ff Bug 1683824 - Update sccache to 0.2.14. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D100288
2021-01-04 20:46:16 +00:00
ffxbld
767246ba4b No Bug, taskcluster/docker/funsize-update-generator/requirements.txt pip-update. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D100652
2021-01-04 15:26:32 +00:00
Cosmin Sabou
815fecbfa9 Backed out changeset 140b5dff0375 for causing a spike in Bug 1521378. CLOSED TREE 2021-01-04 18:26:23 +02:00
ffxbld
3ed9338732 No Bug, taskcluster/docker/funsize-update-generator/requirements.txt pip-update. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D100652
2021-01-04 15:26:32 +00:00
Emilio Cobos Álvarez
78414576b9 Bug 1684350 - Update cbindgen to 0.16.0. r=andi
I was waiting for a better reason to do this, because the cbindgen
changes from 0.15.0 to 0.16.0 don't break trunk builds. But since
downstream has updated (see bug 1684180) and there's no reason not to,
let's do this to avoid future churn.

Differential Revision: https://phabricator.services.mozilla.com/D100499
2020-12-28 13:42:06 +00:00
Aaron Klotz
3d65781eff Bug 1654817: Part 1 - Convert e10s-multi transform to an e10s-single transform; r=taskgraph-reviewers,jmaher
Since e10s-multi is going to be enabled by default, this gives us the ability
to run junit in a secondary, e10s-single configuration so that we can see them
both side-by-side for a little while, at least until we're settled in with the
e10s-multi configuration.

Differential Revision: https://phabricator.services.mozilla.com/D94883
2020-11-23 17:16:07 +00:00
Andrew Erickson
9b230b2b7b Bug 1665012: configure taskgraph to send jobs to s7g devices at bitbar r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100157
2020-12-18 21:38:02 +00:00
Tarek Ziadé
b11e11098e Bug 1683092 - Don't use a shippable build r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D100125
2020-12-18 15:41:20 +00:00
Mike Hommey
6e7d937be7 Bug 1682660 - Set CMAKE_RANLIB when building compiler-rt. r=dmajor
Without it, the build uses /usr/bin/ranlib, which, for some reason,
doesn't fail, but does weird things.

Differential Revision: https://phabricator.services.mozilla.com/D100073
2020-12-18 04:42:16 +00:00
Mike Hommey
a734bb41a9 Bug 1682660 - Wrap clang to pass all the necessary flags when building compiler-rt. r=dmajor
When building compiler-rt for macOS, its build system assumes the
compiler used is a native macOS clang, drops all the cmake C/C++ flags,
and adds its own.

Because we do need to pass `-target $target` (otherwise we end up with
ELF x86_64 objects) and `-mcpu=apple-a12` for the correct baseline for
arm64 macOS, and because there is unfortunately no cmake variable that
the compiler-rt build system will use, and because CMAKE_C*_COMPILER
need to be a program without arguments, we need to wrap the compiler.

While here, add `-v` to the ninja call to have more useful logs.

Differential Revision: https://phabricator.services.mozilla.com/D99841
2020-12-18 01:50:07 +00:00
Tarek Ziadé
4c874857ed Bug 1682829 - Automate a fuzzing smoke test in the CI r=decoder
Adds a smoke test script we can use in the CI to smoke test Firefox prior to
bigger tests.

Differential Revision: https://phabricator.services.mozilla.com/D100008
2020-12-17 13:22:16 +00:00
David Major
b870772aae Bug 1563019 - Enable ASan for rust code in linux64-asan builds r=decoder,mhentges
This patch enables ASan for rust code in the `linux64-asan/{debug,opt}` and `linux64-asan-fuzzing` build tasks. Since it is a `-Z` unstable flag, we'll move to the same `linux64-rust-nightly` toolchain that TSan builds use.

For the time being, the ASan Nightly Reporter builds are left alone, until we're more familiar with the perf impacts of this landing.

Differential Revision: https://phabricator.services.mozilla.com/D99556
2020-12-15 17:38:48 +00:00
Tom Ritter
e09dac517f Bug 1676934 - Remove holly from run-on-projects. a=fix CLOSED TREE
Subscribers: rjl

Bug #: 1676934

Differential Revision: https://phabricator.services.mozilla.com/D99839
2020-12-15 22:58:36 +02:00
Alexis Beingessner
3dad9f7cae Bug 1682344 - enable mochitest-a11y under tsan. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D99718
2020-12-15 14:21:24 +00:00
Tom Ritter
b5397a3ef6 Bug 1676934 - Create an Updatebot Docker image and job r=releng-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D97040
2020-12-15 19:19:32 +00:00
David Major
43a2ab175a Bug 1682405 - Clean up unused clang toolchains (mostly clang-9) r=firefox-build-system-reviewers,mhentges
At this point it's pretty clear that we won't be reverting to clang-9.

This doesn't remove everything with clang-9 in the name. I did a mark-and-sweep GC by hand so this only removes unused entries. Some are still active, e.g. linux64-clang-9 is used to build a number of misc helper tools.

Differential Revision: https://phabricator.services.mozilla.com/D99721
2020-12-15 17:46:10 +00:00
David Major
fc36c569fc Bug 1682320 - Increase timeout for win64-ccov builds r=marco DONTBUILD
Looking at the "Similar Jobs" list on m-c Treeherder, by eyeball about 10% of builds are running over time.

Differential Revision: https://phabricator.services.mozilla.com/D99686
2020-12-14 21:44:06 +00:00
James Graham
040d0a70a2 Bug 1678663 - Run wpt tests under Python 3 on Taskcluster, r=bc
Differential Revision: https://phabricator.services.mozilla.com/D99251
2020-12-14 14:17:33 +00:00
Jamie Nicol
57b9ef1959 Bug 1681962 - Update cargo-apk CI dependency to a version which can read the new Cargo.lock file format. r=jrmuizel
Depends on D99456

Differential Revision: https://phabricator.services.mozilla.com/D99457
2020-12-11 17:00:48 +00:00
Mike Hommey
d79dcf5161 Bug 1623520 - Switch Windows asan and fuzzing builds to cross-builds. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D79417
2020-12-11 05:06:12 +00:00
David Major
5c14f2ff01 Bug 1681823 - Fix typo in clang-tidy-external Treeherder symbol r=andi DONTBUILD
I noticed this while trying to "add new jobs" for something nearby.

Differential Revision: https://phabricator.services.mozilla.com/D99385
2020-12-10 20:34:50 +00:00
Mike Hommey
fc82043bfb Bug 1681654 - Upgrade rustc to 1.49 beta 3 for arm64 mac builds. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D99314
2020-12-10 19:59:21 +00:00
Sebastian Hengst
d9f1f90a4e Bug 1681720 - fix addition of suffix '-bk' to backfilled tasks. r=aki,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D99347
2020-12-10 16:50:22 +00:00
James Graham
3c9ea32e23 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-10 14:02:38 +00:00
Mike Hommey
a5ae57fe22 Bug 1681441 - Update valgrind package to Debian's 3.16.1. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D99182
2020-12-09 15:50:05 +00:00
shravanrn@gmail.com
d475a75904 Bug 1670878: Instantiating a large number of wasm library sandboxes crashes due to overuse of file descriptors r=tjr
Instantiating a wasm library duplicates a file descriptor for /dev/null 3 times to be used as input, output and error streams for the wasm sandboxed code. When a lot of sandboxes are created and destroyed, a lot of descriptors are duplicated and closed. While this should be fine, POSIX does not seem to happy with the opening and closing of many file descriptors --- this could perhaps be some strange interaction with Firefox's seccomp filters and cross-process file descriptor handling as it is difficult to repro this outside of firefox.

However, the simpler fix here was to just eliminate the duplication of /dev/null and return an error when input, output or error streams are accessed by wasm sandboxed code. This means calls to printf will fail, but no code I know off actually checks the int error code returned by printf and this change is certainly compatible with existing sandboxed components.

Differential Revision: https://phabricator.services.mozilla.com/D99160
2020-12-09 21:54:03 +00:00
Mihai Alexandru Michis
05ce4b0dac Backed out changeset ea5674f9a511 (bug 1680752) for causing android failures.
CLOSED TREE
2020-12-09 23:06:23 +02:00
James Graham
dfd62d5a30 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-09 16:49:23 +00:00
Alexis Beingessner
c7d78f4a93 Bug 1680124 - add example patch file for rust builds. r=dmajor
This is step 1 to make the docs here better, as discussed. Another followup
will come in a day or two to update the text/links of the docs to refer to
this and the latest version of repack-rust.

Differential Revision: https://phabricator.services.mozilla.com/D99128
2020-12-08 19:53:17 +00:00
Aki Sasaki
de98fbb5d1 Bug 1668693 - fix too-long treeherder symbols on backfill. r=aryx,taskgraph-reviewers,jmaher DONTBUILD
We ended up with a symbol `mda2-dafa26b89ed-bk-1754415059f-bk`, which is longer
than the allowed schema length of 25 characters. Let's keep the existing
backfill suffix per sheriffs.

Differential Revision: https://phabricator.services.mozilla.com/D98694
2020-12-08 19:01:53 +00:00
Sebastian Hengst
33446223da Bug 1681319 - add macOS DevEdition with WebRender enabled as Tier 1 platform. r=jmaher DONTBUILD
Triggered by the platform name change in bug 1673071 when macOS switched to
running its tests with WebRender enabled.

Differential Revision: https://phabricator.services.mozilla.com/D99095
2020-12-08 15:17:47 +00:00
David Major
c0208a72b1 Bug 1681123 - Bump mingw-w64 revision to fix _aligned_malloc in clang 12 r=tjr
clang 12 (specifically https://reviews.llvm.org/D91379) made some refactorings to libc++ that exposed a problem in the MinGW headers. That has now been fixed upstream.

In the meantime the headers also gained definitions for ProcessPayloadRestrictionPolicy, so we can remove our workaround for that.

Differential Revision: https://phabricator.services.mozilla.com/D98945
2020-12-07 17:55:27 +00:00