Commit Graph

10234 Commits

Author SHA1 Message Date
Ben Hearsum
37d7a1c9e2 Bug 1714200: raise m1 tests to tier 1. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D125009
2021-09-15 14:23:37 +00:00
Mike Hommey
a8a8259e4c Bug 1730820 - Remove the macosx64-grcov toolchain. r=marco
The task has actually never produced a mac binary: it builds a linux
one. And nothing depends on the task so it's not worth fixing.

Differential Revision: https://phabricator.services.mozilla.com/D125632
2021-09-15 10:31:53 +00:00
Mike Hommey
4dbe34f810 Bug 1730825 - Build NSIS as a relocatable binary. r=firefox-build-system-reviewers,andi
The reason the error mentioned in build-mingw32-nsis.sh happens is that
the default mode NSIS builds in is a fully-installed mode, where it
hardcodes the locations of its data files. This is why nsis needs to
be used from the same place it's built for. But there's another mode,
enabled with NSIS_CONFIG_CONST_DATA_PATH=no, that makes it relocatable,
and makes it find its data files relatively to the nsis binary.

However, there's a bug in the nsis build scripts, which makes the nsis
binary installed in the destination directory instead of a bin/
subdirectory, while the source code itself looks for data files relative
to the parent directory of the directory that contains the executable.
So we need to set PREFIX_BIN to force the executable to be installed in
a bin/ subdirectory.

There is also an issue in nsis itself when it's executed by anything
other than a shell, which we patch out.

Differential Revision: https://phabricator.services.mozilla.com/D125638
2021-09-15 08:33:06 +00:00
Mike Hommey
f7c5a8e8cd Bug 1730825 - Ship the linux64-mingw32-nsis toolchain in a nsis/ directory. r=firefox-build-system-reviewers,andi
While the comment at the top of build-mingw32-nsis.sh is true, it only
applies to nsis being in the same path in the build tasks as it was
built from in the toolchain task. So we don't actually need to build
it in a mingw32/bin directory, and can ship it in a nsis/bin directory,
as long as that's where we build it.

That makes the toolchain match the expectations from bootstrap, which
also makes PATH adjustments for nsis unnecessary, no other toolchain
used in those builds providing a binary in mingw32/bin.

Differential Revision: https://phabricator.services.mozilla.com/D125637
2021-09-15 08:33:05 +00:00
Mike Hommey
7e693067b8 Bug 1730825 - Bootstrap nsis for Windows builds. r=firefox-build-system-reviewers,andi
And at the same time, make the toolchain artifact directly usable on
cross-compiles.

Differential Revision: https://phabricator.services.mozilla.com/D125635
2021-09-15 08:33:04 +00:00
Mike Hommey
a346591234 Bug 1730680 - Update minimum supported rust version to 1.53.0. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D125630
2021-09-15 08:10:09 +00:00
Mike Hommey
cfaeef1efd Bug 1730078 - Build clang stage 1 with system gcc. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D125162
2021-09-15 02:39:53 +00:00
Mike Hommey
3631977b63 Bug 1730078 - Build clang-tidy with clang. r=firefox-build-system-reviewers,andi
There are complications with building a 1-stage clang with gcc, so just
use clang. Eventually, the clang-tidy toolchains will be removed in
favor of providing clang-tidy from the clang toolchain itself anyways.

Differential Revision: https://phabricator.services.mozilla.com/D125158
2021-09-15 02:39:52 +00:00
Mike Hommey
b76a8b0919 Bug 1730078 - Build gcc-11 with system gcc. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D125157
2021-09-15 02:39:52 +00:00
Mike Hommey
da41cd5a40 Bug 1730078 - Build binutils with system gcc. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D125156
2021-09-15 02:39:51 +00:00
Mike Hommey
b3ea935824 Bug 1730078 - Build gn with system gcc. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D125155
2021-09-15 02:39:51 +00:00
Mike Hommey
9a5513a7d8 Bug 1726506 - Upgrade toolchain tasks to the Debian 11-based image. r=taskgraph-reviewers,bhearsum
And remove the Debian 10-based one.

Differential Revision: https://phabricator.services.mozilla.com/D122833
2021-09-15 02:22:14 +00:00
Mike Hommey
4b9f8db275 Bug 1726506 - Build linux grcov with the linux build sysroot. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D124166
2021-09-15 02:22:13 +00:00
Mike Hommey
0aae65e107 Bug 1726506 - Build cctools-port with the toolchain sysroot. r=firefox-build-system-reviewers,mhentges
And while here, remove tooltool-downloads attribute that is unused, and
add verbosity to ninja output.

Differential Revision: https://phabricator.services.mozilla.com/D124164
2021-09-15 02:22:13 +00:00
Mike Hommey
dd72dc7fb3 Bug 1728507 - Upgrade NSIS to 3.07. r=firefox-build-system-reviewers,agashlin,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D124163
2021-09-14 23:18:22 +00:00
Mike Hommey
c27d5e43d1 Bug 1728507 - Pass the nsis version to scons. r=firefox-build-system-reviewers,mhentges
Rather than rewriting SConstruct.

Differential Revision: https://phabricator.services.mozilla.com/D124162
2021-09-14 23:18:22 +00:00
Ben Hearsum
c76ecf6846 No bug: sync taskgraph registry changes from out-of-tree taskgraph (D124492) into gecko taskgraph. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D125212
2021-09-13 15:33:16 +00:00
Joel Maher
68ade77751 Bug 1699423 - enable osx 10.15 tp6 tests on chrome/chromium. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D125297
2021-09-13 14:20:32 +00:00
Michelle Goossens
7938c60f93 Bug 1730412 - Migrate windows10-mingw from AWS to Azure r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D125349
2021-09-13 14:18:30 +00:00
Joel Maher
89ff0585b6 Bug 1730483 - stop running 'damp' on win32. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D125387
2021-09-13 13:31:57 +00:00
Michelle Goossens
d4018f8ad0 Bug 1727925 - Part 4: Migrate wpt and wpt-headless on Windows 10-32 from AWS to Azure r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D125305
2021-09-12 22:14:42 +00:00
Andrew Halberstadt
ced89bafdb Bug 1730255 - [ci] Don't 'always-target' Python tests on MacOS, r=taskgraph-reviewers,jmaher
We set always-target: true for Python unittest tasks. This means they show up on every push (when appropriate files are modified). The reasoning behind this is that they run so fast anyway, and if you modify the relevant code then you almost always want to see the unittests for said code on your try pushes.

However on MacOS, the pool is limited. Given the differences between Linux and Mac for most Python unittests are likely extremely small, I don't think the cost of bogging down the Mac pool outweighs the benefits here.

Differential Revision: https://phabricator.services.mozilla.com/D125281
2021-09-10 21:03:19 +00:00
Andrew Halberstadt
0e657b5df8 Bug 1697066 - [ci] Stop running ccov M-swr(bc) tasks as we already run them with fission, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D125217
2021-09-10 17:43:52 +00:00
Michelle Goossens
d835eb1793 Bug 1727925 - Part 3: Migrate six more windows10-32 test suites from AWS to Azure r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D124192
2021-09-10 11:51:00 +00:00
Robert Mader
ccca4a019d Bug 1729464 - Update runtime to org.freedesktop.Platform 21.08,
It contains a more recent version of GTK, fixing some Wayland issues
that are still present in the 20.08 version (notably degraded
performance due to missing opaque region API in GTK).

Further more it ships more recent Mesa, which should also have
a positive effect on some hardware.

Differential Revision: https://phabricator.services.mozilla.com/D124801
2021-09-09 23:11:39 +00:00
Mike Hommey
2f75037f7a Bug 1727470 - Update builders to rustc 1.55. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D124735
2021-09-09 21:02:28 +00:00
Andrew Halberstadt
6e0d14a9c9 Bug 1697066 - [ci] Run ccov tasks with fission enabled, r=releng-reviewers,jmaher
Here's the task diff for mozilla-central:
+test-linux1804-64-ccov-qr/opt-mochitest-browser-chrome-swr-fis-e10s
-test-linux1804-64-ccov-qr/opt-mochitest-devtools-chrome-e10s
+test-linux1804-64-ccov-qr/opt-mochitest-devtools-chrome-fis-e10s
-test-linux1804-64-ccov-qr/opt-mochitest-plain-e10s
+test-linux1804-64-ccov-qr/opt-mochitest-plain-fis-e10s
+test-linux1804-64-ccov-qr/opt-mochitest-plain-fis-xorig-e10s
-test-linux1804-64-ccov-qr/opt-web-platform-tests-e10s
+test-linux1804-64-ccov-qr/opt-web-platform-tests-fis-e10s

Note we weren't previously running any ccov browser-chrome tasks on Linux so
that's why no task was removed on that configuration.

Differential Revision: https://phabricator.services.mozilla.com/D124400
2021-09-09 17:29:17 +00:00
Steve Fink
5854963fb3 Bug 1726619 - Replace MOZ_LOW_PARALLELISM_BUILD with automated heuristic parallelism based on memory usage, and use for hazard builds r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D123147
2021-09-09 16:15:11 +00:00
Mike Hommey
b2dd8f3c30 Bug 1729611 - Remove the separate llvm-dsymutil toolchain. r=firefox-build-system-reviewers,mhentges
It made sense when we did have problems with the one shipped with clang
and needed an explicitly newer version, but that hasn't been true in a
while. On the contrary, we're now using a version older than clang for
no reason other than having forgotten to update it.

Differential Revision: https://phabricator.services.mozilla.com/D124886
2021-09-09 00:11:47 +00:00
Mike Hommey
692e4afda9 Bug 1729610 - Remove taskcluster/scripts/misc/source-test-clang-setup-macos64.sh. r=firefox-build-system-reviewers,mhentges DONTBUILD
It isn't used anymore after bug 1725171.

Differential Revision: https://phabricator.services.mozilla.com/D124874
2021-09-08 23:59:54 +00:00
Mike Hommey
0749043212 Bug 1729615 - Throw an error early when a task has multiple conflicting fetches. r=taskgraph-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D124894
2021-09-08 23:53:34 +00:00
Mike Hommey
9ef9a07ff2 Bug 1729406 - Use .tar.zst for most toolchain artifacts. r=firefox-build-system-reviewers,andi
We leave the following ones unchanged:
- geckodriver because the results are used to releases on github.
- sixgill because the script that creates it is not in-tree.
- *-dist-toolchain because sccache is not expecting a .tar.zst.

We use native tar support in most cases, except for toolchain scripts also
used on Windows, for which we use our zstdpy script.

Differential Revision: https://phabricator.services.mozilla.com/D124733
2021-09-08 23:46:51 +00:00
Mike Hommey
a3d6b7df1b Bug 1729406 - Only install win64-dump_syms on windows workers. r=firefox-build-system-reviewers,andi
The linux workers used for windows builds currently install both
win64-dump_syms and linux64-dump_syms, and the only reason it works is
that their artifacts have different names currently, which is not going
to be the case anymore.

Differential Revision: https://phabricator.services.mozilla.com/D124879
2021-09-08 23:46:51 +00:00
Mike Hommey
671ce29ae9 Bug 1729694 - Install python2.7 in the static-analysis-build docker image
It used to be installed as a side effect of something else, but is not
installed anymore after the upgrade to Debian 11.

Differential Revision: https://phabricator.services.mozilla.com/D124984
2021-09-08 22:42:58 +00:00
Sandor Molnar
d7e1622ea0 Backed out changeset 249602f9a5d4 (bug 1729413) reverted temporary fix on dev's request. CLOSED TREE 2021-09-09 00:45:21 +03:00
Andrew Halberstadt
92e2a8c3e5 Bug 1729060 - [taskgraph] Add '-J' warning back in when comparing diffs, r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D124837
2021-09-08 20:31:46 +00:00
Andrew Halberstadt
07b4805381 Bug 1729060 - [taskgraph] Use --diff implementation from 'main.py', r=taskgraph-reviewers,bhearsum
This replaces Gecko's old '--diff' implementation with the one included with
standalone taskgraph.

Note this revision is a straight sync from standalone taskgraph and should not
contain any additional changes.

Depends on D124835

Differential Revision: https://phabricator.services.mozilla.com/D124836
2021-09-08 20:31:46 +00:00
Andrew Halberstadt
9fcafc82af Bug 1729060 - [taskgraph] Include 'basename' of current directory in log path, r=taskgraph-reviewers,jmaher
This ensures logs from e.g Gecko won't get mixed up with ones from Fenix.

Depends on D124832

Differential Revision: https://phabricator.services.mozilla.com/D124835
2021-09-08 20:31:45 +00:00
Andrew Halberstadt
2484082a96 Bug 1729060 - [taskgraph] Sync standalone taskgraph's --diff implementation, r=taskgraph-reviewers,bhearsum
This syncs the patches from bug 1720715 in standalone taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D124832
2021-09-08 20:31:45 +00:00
Iulian Moraru
82a880399a Backed out 2 changesets (bug 1729406) for causing toolchain-wrench-deps build bustages. CLOSED TREE
Backed out changeset 2b28ac860723 (bug 1729406)
Backed out changeset 89c9940d7402 (bug 1729406)
2021-09-08 16:08:40 +03:00
Cristian Tuns
1ca9370acb Backed out changeset b0603eb272ae (bug 1729464) for causing Docker Images bustages. CLOSED TREE 2021-09-08 07:20:08 -04:00
Robert Mader
57bfb23d77 Bug 1729464 - Update runtime to org.freedesktop.Platform 21.08,
It contains a more recent version of GTK, fixing some Wayland issues
that are still present in the 20.08 version (notably degraded
performance due to missing opaque region API in GTK).

Further more it ships more recent Mesa, which should also have
a positive effect on some hardware.

Differential Revision: https://phabricator.services.mozilla.com/D124801
2021-09-08 10:54:01 +00:00
Mike Hommey
cc6d99c4e2 Bug 1729406 - Use .tar.zst for most toolchain artifacts. r=firefox-build-system-reviewers,andi
We leave the following ones unchanged:
- geckodriver because the results are used to releases on github.
- sixgill because the script that creates it is not in-tree.
- *-dist-toolchain because sccache is not expecting a .tar.zst.

We use native tar support in most cases, except for toolchain scripts also
used on Windows, for which we use our zstdpy script.

Differential Revision: https://phabricator.services.mozilla.com/D124733
2021-09-08 08:00:54 +00:00
Mike Hommey
48802dcd1a Bug 1729406 - Only install win64-dump_syms on windows workers. r=firefox-build-system-reviewers,andi
The linux workers used for windows builds currently install both
win64-dump_syms and linux64-dump_syms, and the only reason it works is
that their artifacts have different names currently, which is not going
to be the case anymore.

Differential Revision: https://phabricator.services.mozilla.com/D124879
2021-09-08 08:00:54 +00:00
Mike Hommey
08c4939025 Bug 1729413 - Revert the android-build docker image to Debian 10. r=bustage-fix CLOSED TREE
Somehow, there appears to be a problem with GNU make.

Differential Revision: https://phabricator.services.mozilla.com/D124881
2021-09-08 06:11:55 +00:00
Cosmin Sabou
e097f3b06f Backed out changeset 40f514ec207e (bug 1729406) for causing windows build bustages. CLOSED TREE 2021-09-08 07:43:48 +03:00
Mike Hommey
c7391546a8 Bug 1729406 - Use .tar.zst for most toolchain artifacts. r=firefox-build-system-reviewers,andi
We leave the following ones unchanged:
- geckodriver because the results are used to releases on github.
- sixgill because the script that creates it is not in-tree.
- *-dist-toolchain because sccache is not expecting a .tar.zst.

We use native tar support in most cases, except for toolchain scripts also
used on Windows, for which we use our zstdpy script.

Differential Revision: https://phabricator.services.mozilla.com/D124733
2021-09-08 03:44:03 +00:00
Noemi Erli
2c90034df8 Backed out changeset d6d54748247b (bug 1729406) for causing Win build bustages CLOSED TREE 2021-09-08 05:26:26 +03:00
Mike Hommey
ae9fad3fae Bug 1729413 - Upgrade the custom-v8 docker image to Debian 11. r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D124746
2021-09-08 00:40:33 +00:00
Mike Hommey
efbd876d00 Bug 1729413 - Upgrade the upload symbols task to a Debian 11 docker image. r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D124745
2021-09-08 00:40:32 +00:00