Commit Graph

9187 Commits

Author SHA1 Message Date
Geoff Brown
fc9db06c35 Bug 1685878 - Remove remoteautomation.py; r=jmaher
remoteautomation.py is an old collection of code used by android mochitest and android reftest;
it survived the removal of automation.py. This patch removes remoteautomation.py, moving the
majority of the functionality to a new class in mozdevice. Some features are simplified or
removed, and the remainder moved into the remote mochitest/reftest harnesses.

Differential Revision: https://phabricator.services.mozilla.com/D102239
2021-01-20 17:00:18 +00:00
Yura Zenevich
13a44570ff Bug 1667998 - [ci] Add cli flag in desktop_unittest.py. Ensure M-a11y-checks runs on Linux x64 opt build. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D102042
2021-01-20 14:25:26 +00:00
Yura Zenevich
25379561f0 Bug 1667998 - [ci] Create a new 'a11y-checks' test variant. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100840
2021-01-15 18:20:39 +00:00
Mike Hommey
88ad155866 Bug 1687425 - Make load_tasks_for_kind faster when dealing with one task kind. r=taskgraph-reviewers,jmaher
by avoiding to load the unneeded yaml files.

Differential Revision: https://phabricator.services.mozilla.com/D102350
2021-01-19 23:41:48 +00:00
Mihai Tabara
f416097388 Bug 1687360 - bump partials Balrog info retrievel timeout. r=releng-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D102293
2021-01-19 13:23:53 +00:00
Mike Hommey
e4bf32e4f8 Bug 1686888 - Stop building dump_syms. r=gsvelto
Now that we use an external dump_syms, we don't need to build
breakpad's.

This means we also don't need the dump_syms_rust_demangle crate anymore.

Differential Revision: https://phabricator.services.mozilla.com/D101865
2021-01-15 10:31:48 +00:00
Noemi Erli
8ad2a18a79 Backed out 5 changesets (bug 1667998) for breaking a11y checks CLOSED TREE
Backed out changeset 633dda979b22 (bug 1667998)
Backed out changeset c9838cdb1303 (bug 1667998)
Backed out changeset 501c54cf59be (bug 1667998)
Backed out changeset 615b74c822ec (bug 1667998)
Backed out changeset 6d187c01fcb3 (bug 1667998)
2021-01-15 20:16:06 +02:00
Gregory Mierzwinski
3260ec02f5 Bug 1686323 - Update task description for tasks produced through gecko-profile. r=jmaher
This patch appends " (profiling)" to the end of the descriptions of tasks produced by the gecko-profile action.

Differential Revision: https://phabricator.services.mozilla.com/D101504
2021-01-15 17:03:06 +00:00
Yura Zenevich
41bc7e7bef Bug 1667998 - [ci] Create a new 'a11y-checks' test variant. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100840
2021-01-15 16:54:13 +00:00
David Major
85ac6eda0a Bug 1686510 - Add a diff task for linux64 reproducible builds (except wasm sandboxing) r=glandium
The previous blockers for having this task are no longer an issue, as far as I can tell. The only perma-failure is bug 1612035. Until that's addressed we can remove those files with `pre-diff-commands` and have something rather than nothing.

Differential Revision: https://phabricator.services.mozilla.com/D101630
2021-01-15 14:23:47 +00:00
Gregory Mierzwinski
28c3011f51 Bug 1686118 - Always run downstream tasks on browsertime test retriggers. r=jmaher,bhearsum
This patch makes it so that any retrigger actions being performed from Treeherder on browsertime tasks (through add-new-jobs, retrigger, and retrigger-multiple) will always retrigger the vismet (visual-metrics) tasks correctly. Furthermore, when a vismet task is retriggered, we'll retrigger the browsertime test task.

Differential Revision: https://phabricator.services.mozilla.com/D101404
2021-01-14 13:54:29 +00:00
David Major
ab26127584 Bug 1686321 - Pass patches as arguments to build-compiler-rt.sh r=glandium
rename_gcov_flush_clang_11.patch doesn't apply cleanly to clang 12 and will need to be forked. Turning the filename into a parameter will let us have the tasks exist side by side.

Differential Revision: https://phabricator.services.mozilla.com/D101495
2021-01-14 03:41:08 +00:00
Mike Hommey
858b15ba2e Bug 1685034 - Upgrade sccache to 0.2.15. r=firefox-build-system-reviewers,andi,mhentges
The new release contains https://github.com/mozilla/sccache/pull/922

Differential Revision: https://phabricator.services.mozilla.com/D101509
2021-01-13 14:47:47 +00:00
David Major
8d9b340913 Bug 1686507 - Raise diff-reproducible-linux32-generated-files to tier 1 r=glandium
Unlike the binary diffs, the generated-files diffs have been stable for a long time. If these tasks ever start failing, it would be good to learn about that at tier-1 speed.

Differential Revision: https://phabricator.services.mozilla.com/D101629
2021-01-13 23:05:42 +00:00
Bartłomiej Piotrowski
262f61fb26 Bug 1677959 - upgrade freedesktop-sdk runtime to 20.08 r=mtabara
The BaseApp has been renamed to follow org.mozilla.firefox ID.
Additionally update the Docker image used to run the flatpak build.

Differential Revision: https://phabricator.services.mozilla.com/D100647
2021-01-13 15:44:23 +00:00
Aki Sasaki
506b573b77 Bug 1677914 - enable chain of trust on pgo profile tasks. r=releng-reviewers,mtabara
Depends on D97470

Differential Revision: https://phabricator.services.mozilla.com/D93457
2021-01-13 01:01:11 +00:00
Aki Sasaki
e05831c081 Bug 1677914 - enable chain of trust on mac builders. r=taskgraph-reviewers,jmaher,glandium
Differential Revision: https://phabricator.services.mozilla.com/D97470
2021-01-13 01:01:11 +00:00
Aki Sasaki
20ea21b26d Bug 1677914 - generate osx pgo profiles on b-osx-1015 pool. r=taskgraph-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D101498
2021-01-13 01:01:11 +00:00
Mike Hommey
5784a24c72 Bug 1686177 - Remove leftover from bug 1426785. r=releng-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D101442
2021-01-12 21:51:10 +00:00
Dan Mosedale
e91d8deeea Bug 1684936 - update NodeJS to 10.23.1 for latest sec fixes r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D100810
2021-01-07 17:06:42 +00:00
Henrik Skupin
534447f898 Bug 1682219 - [geckodriver] Build with Rust 1.49 for Linux. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D100877
2021-01-12 15:52:39 +00:00
Mike Hommey
5a27f487f8 Bug 1685854 - Apply gcov_flush patch to compiler-rt. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D101294
2021-01-11 13:45:06 +00:00
Sebastian Hengst
6216521110 Bug 1683471 - disable github-sync-wgpu task because currently it's an expected permanent failure. r=kvark DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D101373
2021-01-11 18:13:39 +00:00
Gregory Mierzwinski
bd5d469bc8 Bug 1685731 - Increase max-run-time for controlled perf tests. r=perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D101194
2021-01-11 14:20:45 +00:00
Alex Ionescu
31ddf859c5 Bug 1677068 Disable videoRecordingStart visual metric r=perftest-reviewers,Bebe
try push: https://treeherder.mozilla.org/#/jobs?repo=try&revision=83e34d3d91c21c6e925c0a6a269ffcf338e2e356

Differential Revision: https://phabricator.services.mozilla.com/D100989
2021-01-11 06:43:18 +00:00
Emilio Cobos Álvarez
c60fdae7a4 Bug 1685957 - Use xargs to test non-unified builds. r=andi
Passing all the directories to mach allows to take more advantage of
parallelism (plus not having to start up mach and the whole export once
for every directory, which itself takes a bit of time)

This takes:

    GECKO_PATH=. taskcluster/scripts/misc/source-test-clang-non-unified.sh

from about ten mins to under two minutes on my machine.

Differential Revision: https://phabricator.services.mozilla.com/D101320
2021-01-11 04:25:29 +00:00
Mike Hommey
3ea697e776 Bug 1685650 - Remove clang-9 and affiliated toolchains. r=firefox-build-system-reviewers,andi,dmajor
They are now unused.

Differential Revision: https://phabricator.services.mozilla.com/D101121
2021-01-08 20:48:37 +00:00
Mike Hommey
ec54e3eaf7 Bug 1685650 - Upgrade toolchains using clang 9 to clang 11. r=firefox-build-system-reviewers,andi,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D101120
2021-01-08 20:48:37 +00:00
Mike Hommey
96dd8d7fd7 Bug 1685599 - Remove now unused macosx64-clang-9 and linux64-clang-9-macosx-cross toolchains. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D101081
2021-01-08 18:51:53 +00:00
Mike Hommey
2c6e48cbcf Bug 1685599 - Build macosx64-clang-11 with linux64-clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
Now that linux64-clang-11-macosx-cross doesn't need a macosx64-clang-*
to build, there is no circular dependency to avoid.

Differential Revision: https://phabricator.services.mozilla.com/D101080
2021-01-08 18:51:53 +00:00
Mike Hommey
eb3781ebc5 Bug 1685599 - Build a single macosx-cross toolchain. r=firefox-build-system-reviewers,mhentges
The new toolchain contains both aarch64 and x86_64 compiler-rts. We
could have a separate for each, but compiler-rt is small enough that
entirely separate toolchains is not warranted.

Differential Revision: https://phabricator.services.mozilla.com/D101079
2021-01-08 18:51:53 +00:00
Mike Hommey
fd26bcb560 Bug 1685599 - Build a compiler-rt for x86_64. r=firefox-build-system-reviewers,mhentges
The llvm build system does support building a universal compiler-rt for
multiple platforms at once, but as far as I know it only supports doing
so with the same SDK, while we want to use separate SDKs for each, so
build the x86_64 compiler-rt separately.

Differential Revision: https://phabricator.services.mozilla.com/D101078
2021-01-08 18:51:52 +00:00
Mike Hommey
533d1be24e Bug 1685599 - Build aarch64-compiler-rt using clang-11 instead of clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
We actually don't need the macosx-cross toolchain to build compiler-rt,
because building compiler-rt doesn't require compiler-rt (duh).

Differential Revision: https://phabricator.services.mozilla.com/D101077
2021-01-08 18:51:52 +00:00
Mike Hommey
feb2c466f7 Bug 1685599 - Don't rely on macosx-cross toolchain containing a mac native libLLVM. r=firefox-build-system-reviewers,andi,dmajor
The webrender wrench macos build, which is cross-compiled, needs a
macOS native libLLVM (a .dylib) to link against. The file is currently
part of the macosx-cross toolchain, but that was more incidental than
intentional. As we're going to change the macosx-cross toolchain in a
way that will remove the libLLVM.dylib, pull the file from the macOS
native clang.

Differential Revision: https://phabricator.services.mozilla.com/D101150
2021-01-08 18:51:54 +00:00
Mike Hommey
b9cdcbef46 Bug 1685599 - Build llvm-symbolizer separately. r=firefox-build-system-reviewers,mhentges
Only sanitizer builds require a native llvm-symbolizer executable.
Ideally, we'd build llvm-symbolizer from scratch, which would be faster,
but for now, let's go the easy route and just extract it from the
corresponding native clang builds.

We don't actually do anything with the llvm-symbolizer executable on
android builds, so we don't install it in $FINAL_TARGET, avoilding
the dependency on android builds (plus, we actually don't have an
android-native llvm-symbolizer, so even if it were already shipped, it
would be the wrong file).

Differential Revision: https://phabricator.services.mozilla.com/D101076
2021-01-08 18:51:52 +00:00
Andi-Bogdan Postelnicu
1e28ebf0b0 Bug 1685760 - For non-unified make the test task tier 1 and run on integration. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D101197
2021-01-08 19:24:44 +00:00
Razvan Maries
891da67475 Backed out 6 changesets (bug 1685599) for WR bustages. CLOSED TREE
Backed out changeset 29eab2f84c77 (bug 1685599)
Backed out changeset 2839d8d39881 (bug 1685599)
Backed out changeset 3ba2f1c048c3 (bug 1685599)
Backed out changeset c7d4ecfc689a (bug 1685599)
Backed out changeset 5483ce4f5f4c (bug 1685599)
Backed out changeset 68fa5ecf205c (bug 1685599)
2021-01-08 09:04:37 +02:00
Mike Hommey
c3d2cb844a Bug 1685599 - Remove now unused macosx64-clang-9 and linux64-clang-9-macosx-cross toolchains. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D101081
2021-01-08 00:33:35 +00:00
Mike Hommey
88729bdea4 Bug 1685599 - Build macosx64-clang-11 with linux64-clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
Now that linux64-clang-11-macosx-cross doesn't need a macosx64-clang-*
to build, there is no circular dependency to avoid.

Differential Revision: https://phabricator.services.mozilla.com/D101080
2021-01-08 00:33:17 +00:00
Mike Hommey
1c7ff6f2c2 Bug 1685599 - Build a single macosx-cross toolchain. r=firefox-build-system-reviewers,mhentges
The new toolchain contains both aarch64 and x86_64 compiler-rts. We
could have a separate for each, but compiler-rt is small enough that
entirely separate toolchains is not warranted.

Differential Revision: https://phabricator.services.mozilla.com/D101079
2021-01-08 00:38:37 +00:00
Mike Hommey
6ca557af7a Bug 1685599 - Build a compiler-rt for x86_64. r=firefox-build-system-reviewers,mhentges
The llvm build system does support building a universal compiler-rt for
multiple platforms at once, but as far as I know it only supports doing
so with the same SDK, while we want to use separate SDKs for each, so
build the x86_64 compiler-rt separately.

Differential Revision: https://phabricator.services.mozilla.com/D101078
2021-01-08 00:37:11 +00:00
Mike Hommey
42378a1b72 Bug 1685599 - Build aarch64-compiler-rt using clang-11 instead of clang-11-macosx-cross. r=firefox-build-system-reviewers,mhentges
We actually don't need the macosx-cross toolchain to build compiler-rt,
because building compiler-rt doesn't require compiler-rt (duh).

Differential Revision: https://phabricator.services.mozilla.com/D101077
2021-01-07 23:54:13 +00:00
Mike Hommey
3128330c17 Bug 1685599 - Build llvm-symbolizer separately. r=firefox-build-system-reviewers,mhentges
Only sanitizer builds require a native llvm-symbolizer executable.
Ideally, we'd build llvm-symbolizer from scratch, which would be faster,
but for now, let's go the easy route and just extract it from the
corresponding native clang builds.

We don't actually do anything with the llvm-symbolizer executable on
android builds, so we don't install it in $FINAL_TARGET, avoilding
the dependency on android builds (plus, we actually don't have an
android-native llvm-symbolizer, so even if it were already shipped, it
would be the wrong file).

Differential Revision: https://phabricator.services.mozilla.com/D101076
2021-01-07 23:53:19 +00:00
David Major
180d35da9f Bug 1685335 - Update to clang 11.0.1 r=firefox-build-system-reviewers,static-analysis-reviewers,andi,mhentges,sylvestre
In addition to the usual dot-release type of fixes, this also lets us drop a good amount of code that we had patched into our clang 11.

Differential Revision: https://phabricator.services.mozilla.com/D100959
2021-01-07 13:53:53 +00:00
Dorel Luca
f6a037e456 Backed out changeset 931f753c12c0 (bug 1682219) for btime failures. CLOSED TREE 2021-01-07 13:54:53 +02:00
Henrik Skupin
15f0a34f7b Bug 1682219 - [geckodriver] Build with Rust 1.49 for Linux. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D100877
2021-01-07 08:09:19 +00:00
Ben Hearsum
1f3e5bcb0e Bug 1685302: Increase update verify chunks on macOS. r=taskgraph-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D100930
2021-01-06 17:41:57 +00:00
Florin Strugariu
f64bc187a4 Bug 1663449 - Disable conditioned profiles on raptor webext tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D100874
2021-01-06 14:03:52 +00:00
Mike Hommey
15c4d4af6e Bug 1685244 - Update sccache to a version with patched tiny-http. r=firefox-build-system-reviewers,mhentges
Bug 1683824 updated to the 0.2.14 tag, but that's patched in order to
publish to crates.io such that tiny-http is not patched anymore.
Unfortunately, that breaks sccache-dist, which is a known issue and will
eventually fixed when addressing
https://github.com/mozilla/sccache/issues/912.
So here we update to a corresponding version on master (the first that
bumps the version to the next number).

Differential Revision: https://phabricator.services.mozilla.com/D100863
2021-01-06 14:01:13 +00:00
Andi-Bogdan Postelnicu
d7fb68e56d Bug 1683613 - For non-unified build have a task that runs checks when merging to mozilla-central r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D100796
2021-01-05 19:40:23 +00:00