Commit Graph

7019 Commits

Author SHA1 Message Date
Eric Rahm
501f996371 Bug 1594344 - Part 1: Add dump_syms toolchain. r=froydnj
This defines a new `dump_syms` toolchain that uses the rust implementation of `dump_syms`.

Differential Revision: https://phabricator.services.mozilla.com/D53318

--HG--
extra : moz-landing-system : lando
2019-12-13 10:26:49 +00:00
Tom Prince
6584c53585 Bug 1600432: [taskgraph] Don't read .taskcluster.yml when loading the test; r=mtabara
The documentation tasks do not include .taskcluster.yml, so fail when trying to
load the tests to generate documentation automatically.

Differential Revision: https://phabricator.services.mozilla.com/D57054

--HG--
extra : moz-landing-system : lando
2019-12-13 07:34:13 +00:00
Noemi Erli
24e02f049b Backed out 3 changesets (bug 1528374) per tomprice's request for breaking macOS signing jobs CLOSED TREE
Backed out changeset 5a6fa3b5123b (bug 1528374)
Backed out changeset 32f3b1b3fe3b (bug 1528374)
Backed out changeset a412a319534c (bug 1528374)
2019-12-13 06:48:05 +02:00
Chris Manchester
3138b4cffd Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-12 19:31:17 +00:00
Chris Manchester
4427d60713 Bug 1528374 - Find python3 correctly for 1014-pgo workers. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D56833

--HG--
extra : moz-landing-system : lando
2019-12-13 04:14:19 +00:00
Tom Prince
59d82e0ffc Bug 1596775: Add tasks to upload symbols to server; r=glandium,marco
Differential Revision: https://phabricator.services.mozilla.com/D55329

--HG--
extra : moz-landing-system : lando
2019-12-12 02:03:53 +00:00
Tom Prince
457d8cb26b Bug 1596775: Cleanup shellcheck errors on imported code; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D55326

--HG--
extra : moz-landing-system : lando
2019-12-11 10:14:30 +00:00
Tom Prince
deebac5353 Bug 1596775: Add tasks from extraction system symbols; r=glandium,marco
Differential Revision: https://phabricator.services.mozilla.com/D55323

--HG--
extra : moz-landing-system : lando
2019-12-12 02:04:54 +00:00
Tom Prince
f0235b4f0c Bug 1596775: Import scripts for uploading windows system symbols; r=marco
This imports the code from
https://github.com/marco-c/breakpad-win-update-symbols

Differential Revision: https://phabricator.services.mozilla.com/D55322

--HG--
extra : moz-landing-system : lando
2019-12-11 10:14:29 +00:00
Tom Prince
9e2fc7ebbc Bug 1596775: Import scripts for downloading macOS system symbols; r=marco
Import the code from
https://github.com/marco-c/breakpad-mac-update-symbols/
and
https://github.com/marco-c/breakpad-scrape-system-symbols

Differential Revision: https://phabricator.services.mozilla.com/D55321

--HG--
extra : moz-landing-system : lando
2019-12-12 02:05:21 +00:00
Tom Prince
0bdcc1c550 Bug 1554771: Allow reruning tasks not in the full task graph from treeherder; r=Callek
Rerunning via action (i.e. from treeherder) currently fails for partials, as the
task isn't in the full task graph (since the parameters for the push-task don't
have the partials). Since (at least currently) all tasks not in the full graph
are release tasks, assume that they require reruns, not retriggers, to allow easier
handling of tasks via treeherder.

Differential Revision: https://phabricator.services.mozilla.com/D56516

--HG--
extra : moz-landing-system : lando
2019-12-12 02:35:18 +00:00
Geoff Brown
a9a9e51768 Bug 1603477 - Increase max-run-time for windows ccov devtools; r=marco
Differential Revision: https://phabricator.services.mozilla.com/D56960

--HG--
extra : moz-landing-system : lando
2019-12-12 16:54:44 +00:00
Tom Ritter
9a59ac123c Bug 1590624 - Update the mingw-clang compiler to clang 9 r=dmajor
We can remove our backported objcopy patches, we'll need to update
llvm-mingw for toolchain fixes, and we need to add binutils to compile
this newer version of clang because the system binutils is too old.

Differential Revision: https://phabricator.services.mozilla.com/D50152

--HG--
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-9-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-mingw.sh
extra : moz-landing-system : lando
2019-12-12 07:43:53 +00:00
Geoff Lankow
d16795145d Bug 1583353 - Add mochitest-browser-chrome-thunderbird and mozmill to chunked test blacklist r=egao
Differential Revision: https://phabricator.services.mozilla.com/D56847

--HG--
extra : moz-landing-system : lando
2019-12-12 07:20:15 +00:00
Andreea Pavel
a533b175dd Backed out 4 changesets (bug 1590624) for breaking gecko decision task on a CLOSED TREE
Backed out changeset 2ac8dd1d709d (bug 1590624)
Backed out changeset 8432398c212a (bug 1590624)
Backed out changeset 2b28154aacdb (bug 1590624)
Backed out changeset d305e4160ee4 (bug 1590624)

--HG--
rename : build/build-clang/clang-9-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
2019-12-12 08:35:11 +02:00
Tom Ritter
7a2045b616 Bug 1590624 - Update the mingw-clang compiler to clang 9 r=dmajor
We can remove our backported objcopy patches, we'll need to update
llvm-mingw for toolchain fixes, and we need to add binutils to compile
this newer version of clang because the system binutils is too old.

Differential Revision: https://phabricator.services.mozilla.com/D50152

--HG--
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-9-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-mingw.sh
extra : moz-landing-system : lando
2019-12-10 18:56:45 +00:00
Steve Fink
ff0af787c2 Bug 1602312 - sixgill fix for reentrant call to XIL_GetFunctionFields
Differential Revision: https://phabricator.services.mozilla.com/D56825

--HG--
extra : moz-landing-system : lando
2019-12-12 00:44:54 +00:00
Stephen Donner
c424194edf Bug 1600838 - Make conditioned profiles for desktop Firefox the default, in Raptor and Browsertime. r=tarek,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D55833

--HG--
extra : moz-landing-system : lando
2019-12-11 22:43:03 +00:00
Matt Brandt
5b66f2de9e Bug 1602979 - [iris firefox] Disable redundant Try build email notifications r=ashughes
Differential Revision: https://phabricator.services.mozilla.com/D56649

--HG--
extra : moz-landing-system : lando
2019-12-11 20:58:33 +00:00
Andrew Halberstadt
e9dda38093 Bug 1583353 - [ci] Chunk mochitest-media and devtools-chrome in the taskgraph, r=gbrown
Depends on D52730

Differential Revision: https://phabricator.services.mozilla.com/D56598

--HG--
extra : moz-landing-system : lando
2019-12-10 21:04:38 +00:00
Andrew Halberstadt
f62b63c837 Bug 1583353 - [taskgraph.decision] Create an artifact mapping tasks to the test manifests that are run within r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D52730

--HG--
extra : moz-landing-system : lando
2019-12-10 19:45:23 +00:00
Andrew Halberstadt
26e9db86f8 Bug 1583353 - [taskgraph] Implement test chunking in transforms r=gbrown
We've long handled chunks by defining the total number of chunks in our CI
configuration, and then passing that value down into the test harnesses at task
runtime (via the '--this-chunk' and '--total-chunks' parameters).  The test
harness then runs an algorithm to determine which tests should be run in "this"
chunk.

There are several problems with this approach, but by far the biggest is that
we can't use test information in our scheduling algorithms. The information
simply isn't available yet. This patch switches things around such that we
determine which tests go in which tasks during the taskgraph generation. This
means we have perfect information around which tasks are running which tests,
and if e.g a ccov or machine learning algorithm deems a particular test
important, we can make sure to *only* schedule the tasks that contain that
test.

I'm planning to enable this a couple suites at a time so we don't accidentally
stop running tests. This specifically only enables this mode for
'mochitest-media', 'mochitest-browser-chrome' and 'mochitest-devtools-chrome'.
I chose these suites because they are the ones that are already using the
'chunk_by_runtime' algorithm.

Differential Revision: https://phabricator.services.mozilla.com/D52729

--HG--
extra : moz-landing-system : lando
2019-12-11 21:10:48 +00:00
Tarek Ziadé
bfe666563e Bug 1585013 - Add gecko profiling support to raptor-browsertime r=rwood,perftest-reviewers
Adds support for --gekoprofile with --browsertime in raptor.

Differential Revision: https://phabricator.services.mozilla.com/D50959

--HG--
extra : moz-landing-system : lando
2019-12-11 20:38:00 +00:00
Edwin Takahashi
d8185fdaf4 Bug 1602863 - use ubuntu1804 image for webrender r=jmaher
Changes:

Use ubuntu1804-test image instead of desktop1604-test for webrender(wrench) tasks.

Differential Revision: https://phabricator.services.mozilla.com/D56675

--HG--
extra : moz-landing-system : lando
2019-12-11 20:28:45 +00:00
Edwin Takahashi
2f3a3b594c Bug 1602863 - use ubuntu1804 image for harness-test tasks r=jmaher
Changes:

Migrate the harness test jobs to use ubuntu1804 test image instead of desktop1604-test.

Differential Revision: https://phabricator.services.mozilla.com/D56578

--HG--
extra : moz-landing-system : lando
2019-12-11 11:22:14 +00:00
Edwin Takahashi
1bc152bf6d Bug 1602863 - use ubuntu1804 image for talos tasks r=jmaher
Changes:

Use the `ubuntu1804-test` image for talos tests.

Differential Revision: https://phabricator.services.mozilla.com/D56678

--HG--
extra : moz-landing-system : lando
2019-12-11 20:06:45 +00:00
Aki Sasaki
9c34902a5b Bug 1500321 - fix taskgraph tests.
Depends on D56608

Differential Revision: https://phabricator.services.mozilla.com/D56785

--HG--
extra : moz-landing-system : lando
2019-12-11 19:58:43 +00:00
Aki Sasaki
50639a3541 Bug 1500321 - only run always-target tasks on hg-push. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D56608

--HG--
extra : moz-landing-system : lando
2019-12-11 18:51:01 +00:00
Mihai Tabara
b44959e7d8 Bug 1603106 - daily betas scheduled to be shipped instead of pushed. r=bhearsum
Automatically ship daily betas

Differential Revision: https://phabricator.services.mozilla.com/D56735

--HG--
extra : moz-landing-system : lando
2019-12-11 17:08:23 +00:00
James Graham
e6adb1482b Bug 1601981 - Make wpt fission tests tier 2, r=ahal,neha
This also reduces the configuration to just the -qr subset of the
configuration that runs for mochitest -fis.

Differential Revision: https://phabricator.services.mozilla.com/D56197

--HG--
extra : moz-landing-system : lando
2019-12-09 22:32:26 +00:00
Marian Raiciof
14cd1737c5 Bug 1602761 - Run regular speedometer tests against Fennec v68 and Fenix using a cron job r=perftest-reviewers,sparky,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D56544

--HG--
extra : moz-landing-system : lando
2019-12-11 08:47:00 +00:00
Geoff Brown
9a69c6610b Bug 1601387 - Avoid some ActiveData over-flows in 'mach test-info report'; r=jmaher
Adjust ActiveData queries so that no query matches more than the ActiveData maximum
of 10000 records (crashtest excepted, until bug 1596567 is fixed). This provides a
dramatic improvement in the quality of run counts and run times reported for wpt and
reftests. Also adjusts some of the update mechanisms to handle duplicate paths better.
Also adds more (verbose) logging of match counts, report run times, etc in anticipation
of further refinements.

Differential Revision: https://phabricator.services.mozilla.com/D56616

--HG--
extra : moz-landing-system : lando
2019-12-10 21:41:34 +00:00
Edwin Takahashi
7bad3b9a56 Bug 1602863 - use ubuntu1804 image for linux32/android profile generation tasks r=jmaher
Changes:

Use ubuntu1804 test image as a direct drop-in replacement for linux profile generation tasks.

Differential Revision: https://phabricator.services.mozilla.com/D56605

--HG--
extra : moz-landing-system : lando
2019-12-10 20:28:51 +00:00
Andrew Halberstadt
4e51876f56 Bug 1600904 - [lint.yaml] Fix Python 3 related error and the issues that snuck in because of it, r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D55798

--HG--
extra : moz-landing-system : lando
2019-12-10 19:18:31 +00:00
Kimberly Sereduck
e8d0d59593 Bug 1601772 - [Iris Firefox] Add Fluxbox to the Linux workers r=mbrandt,ashughes
Differential Revision: https://phabricator.services.mozilla.com/D56561

--HG--
extra : moz-landing-system : lando
2019-12-10 19:52:12 +00:00
Gregory Mierzwinski
1853724f26 Bug 1587080 - Part 3: Add task for perfdocs verification through mozlint. r=ahal
This is the final patch for perfdocs. It adds a taskcluster task called perfdocs-verify into mozlint that will run the performance documentation verification.

Depends on D53648

Differential Revision: https://phabricator.services.mozilla.com/D53649

--HG--
extra : moz-landing-system : lando
2019-12-10 17:04:31 +00:00
Noemi Erli
72d7d8ff5e Backed out 4 changesets (bug 1587080) for causing perfdocs Lint failure CLOSED TREE
Backed out changeset 254fd0c3af4a (bug 1587080)
Backed out changeset 34efe80bfd61 (bug 1587080)
Backed out changeset 4a552742b1cd (bug 1587080)
Backed out changeset 22afcb56e8ea (bug 1587080)
2019-12-10 19:01:07 +02:00
Gregory Mierzwinski
9685873c8c Bug 1587080 - Part 3: Add task for perfdocs verification through mozlint. r=ahal
This is the final patch for perfdocs. It adds a taskcluster task called perfdocs-verify into mozlint that will run the performance documentation verification.

Depends on D53648

Differential Revision: https://phabricator.services.mozilla.com/D53649

--HG--
extra : moz-landing-system : lando
2019-12-10 15:53:01 +00:00
Dorel Luca
682cfaa718 Backed out 3 changesets (bug 1594344) for Decision task failure on taskcluster/ci/toolchain/rust-size.yml. CLOSED TREE
Backed out changeset 3208e2b16458 (bug 1594344)
Backed out changeset 57b641bb4d4b (bug 1594344)
Backed out changeset 36458762149d (bug 1594344)

--HG--
rename : taskcluster/ci/toolchain/dump-syms.yml => taskcluster/ci/toolchain/rust-size.yml
rename : taskcluster/scripts/misc/build-dump-syms.sh => taskcluster/scripts/misc/build-rust-size.sh
2019-12-10 15:59:12 +02:00
Eric Rahm
add4cfcb1e Bug 1594344 - Part 2: Fetch dump_syms toolchain on Windows builds. r=firefox-build-system-reviewers,chmanchester
This installs the rust-based `dump_syms` toolchain on Windows builds.

Differential Revision: https://phabricator.services.mozilla.com/D53319

--HG--
extra : moz-landing-system : lando
2019-12-10 13:37:09 +00:00
Eric Rahm
824f9f7edb Bug 1594344 - Part 1: Add dump_syms toolchain. r=froydnj
This defines a new `dump_syms` toolchain that uses the rust implementation of `dump_syms`.

Differential Revision: https://phabricator.services.mozilla.com/D53318

--HG--
rename : taskcluster/ci/toolchain/rust-size.yml => taskcluster/ci/toolchain/dump-syms.yml
rename : taskcluster/scripts/misc/build-rust-size.sh => taskcluster/scripts/misc/build-dump-syms.sh
extra : moz-landing-system : lando
2019-12-10 13:36:31 +00:00
alexandru.ionescu
bae763d008 Bug 1596367 Turn off testing and performance sherffinig on mozilla-inbound r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D55637

--HG--
extra : moz-landing-system : lando
2019-12-10 13:27:00 +00:00
Anthony Hughes
112c0c3f77 Bug 1601418 - Update to Iris Core v=0.8.4 r=mbrandt
Try run passed:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=039bd55c74a82067bed11c6b75fe172a8c81d687

Note failures are known, acceptable issues which should be resolved soon.

Differential Revision: https://phabricator.services.mozilla.com/D56507

--HG--
extra : moz-landing-system : lando
2019-12-10 00:53:41 +00:00
Chris Manchester
ddc7528852 Bug 1579981 - Remove old rust toolchains and bump dependencies. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D56439

--HG--
extra : moz-landing-system : lando
2019-12-09 20:59:06 +00:00
Mike Shal
e1d461164f Bug 1557788 - Rename MOZ_PGO_PROFILE_USE to TASKCLUSTER_PGO_PROFILE_USE; r=firefox-build-system-reviewers,chmanchester
MOZ_PGO_PROFILE_USE is used to enable certain features in the automation
mozconfigs for profile-use builds, including the MOZ_PROFILE_USE
configure option. They aren't easily combined into one flag due to the
extra settings that are enabled only in automation mozconfigs.

Renaming the former variable to TASKCLUSTER_PGO_PROFILE_USE makes it
slightly more obvious where it comes from and avoids confusion.

Differential Revision: https://phabricator.services.mozilla.com/D56117

--HG--
extra : moz-landing-system : lando
2019-12-09 18:03:57 +00:00
Mike Shal
43f8eb0fbd Bug 1557788 - Remove NEED_XVFB from Linux instrumented and rusttest builds; r=firefox-build-system-reviewers,chmanchester
xvfb was used to create a virtual framebuffer for running Firefox during
build jobs to support PGO profile generation. That now runs in a
separate task, so we don't need this flag for builds anymore.

Note that other Linux builds still need xvfb in order to run xpcshell in
'make check'.

Differential Revision: https://phabricator.services.mozilla.com/D56111

--HG--
extra : moz-landing-system : lando
2019-12-09 18:02:34 +00:00
Tom Ritter
abf34f1281 Bug 1601701 - Build libssp as part of the mingw-clang toolchain build r=froydnj
llvm-mingw has found a way to build libssp indepdendent of gcc which
is great. We set up some stuff to support that and then use that method.

Differential Revision: https://phabricator.services.mozilla.com/D56248

--HG--
extra : moz-landing-system : lando
2019-12-09 14:57:37 +00:00
Tom Ritter
8ee3a8ca4b Bug 1601701 - Bump the mingw-w64 revision r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D56275

--HG--
extra : moz-landing-system : lando
2019-12-08 21:55:47 +00:00
Sylvestre Ledru
156e24bc25 Bug 1601611 - Create a group for the sphinx doc generation r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D55953

--HG--
extra : moz-landing-system : lando
2019-12-09 18:48:53 +00:00
Rob Wood
44378fa04c Bug 1600392 - Use a single test INI and taskcluster configuration file for all raptor-browsertime android page-load test r=perftest-reviewers,davehunt,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D56392

--HG--
extra : moz-landing-system : lando
2019-12-09 18:01:05 +00:00