Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-10-19 16:25:38 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
716,940 Commits 615 Branches 98 Tags 5.9 GiB
7ff1c0fb61
Commit Graph

8353 Commits

Author SHA1 Message Date
Gregory Mierzwinski
83d7628dc7 Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt 
This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests.

Differential Revision: https://phabricator.services.mozilla.com/D77674
 2020-06-12 11:38:26 +00:00
Adam Gashlin
aec8dd9651 Bug 1645162 - Use nightly key for oak MARs. r=sfraser 
Differential Revision: https://phabricator.services.mozilla.com/D79401
 2020-06-12 08:06:51 +00:00
Simon Fraser
65cbd9e05b Bug 1643625 Clear up references to MAR_OLD_FORMAT in packaging tools r=nthomas 
I think we don't need these checks any more.

Differential Revision: https://phabricator.services.mozilla.com/D78480
 2020-06-11 22:23:10 +00:00
Ben Hearsum
3f2018eaf1 Bug 1641948: remove android opt builds from non-mozilla-central branches; reduce frequency of fat-aar builds. r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D78547
 2020-06-11 19:25:07 +00:00
Tom Prince
9d6432258c Bug 1630710: Add link to specfic as specific task in treeherder; r=Callek 
Since treeherder added support for linking to a specific task, lets make use of
it in taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D76049
 2020-06-11 23:45:58 +00:00
Gregory Mierzwinski
06555779e5 Bug 1645135 - Disable conditioned-profiles for raptor-webext geckoview P2 tests. r=perftest-reviewers,davehunt 
This patch disables conditioned-profiles on geckoview P2 raptor-webext tests temporarily.

Differential Revision: https://phabricator.services.mozilla.com/D79331
 2020-06-11 21:04:03 +00:00
Mihai Tabara
97baffd8ad Bug 1645001 - remove vanilla bouncer as deps in release automation. r=jcristau 
Differential Revision: https://phabricator.services.mozilla.com/D79268
 2020-06-11 12:13:21 +00:00
Joel Maher
f16377e4f4 Bug 1591466 - do not adjust tier and optimization for mobile. r=sparky 
do not adjust tier and optimization for mobile.

Differential Revision: https://phabricator.services.mozilla.com/D79279
 2020-06-11 14:38:01 +00:00
Gregory Mierzwinski
9a6913c3d3 Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek 
This patch adds a new method to test multiple Fenix builds within one test run.

Depends on D78926

Differential Revision: https://phabricator.services.mozilla.com/D79107
 2020-06-10 22:10:35 +00:00
Bogdan Tara
633c636ab1 Backed out 3 changesets (bug 1644706, bug 1644437, bug 1644368) for python related bustage CLOSED TREE 
Backed out changeset 2a6645398c5a (bug 1644706)
Backed out changeset e695f5748e04 (bug 1644437)
Backed out changeset d615591507b9 (bug 1644368)
 2020-06-11 01:04:33 +03:00
Gregory Mierzwinski
8d81e0549f Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek 
This patch adds a new method to test multiple Fenix builds within one test run.

Depends on D78926

Differential Revision: https://phabricator.services.mozilla.com/D79107
 2020-06-10 21:18:57 +00:00
Tooru Fujisawa
a2591607d9 Bug 1641369 - Part 5: Make sure the workspace is clean in SM package build. r=sfink 
Differential Revision: https://phabricator.services.mozilla.com/D77643
 2020-06-03 05:34:20 +00:00
Tooru Fujisawa
34aa7e8d55 Bug 1641369 - Part 3: Move objdir of SpiderMonkey jobs outside of checkouts directory. r=tomprince 
Depends on D77642

Differential Revision: https://phabricator.services.mozilla.com/D77991
 2020-06-10 18:27:18 +00:00
Tooru Fujisawa
ad7ff99b9d Bug 1641369 - Part 2: Stop caching workspace directory in SpiderMonkey jobs. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D77642
 2020-06-10 18:21:38 +00:00
Tooru Fujisawa
d2368696d6 Bug 1641369 - Part 1: Use GECKO_PATH instead of SRCDIR in SpiderMonkey jobs. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D77990
 2020-06-10 18:21:20 +00:00
Gregory Mierzwinski
b4e1c09e30 Bug 1644787 - Disable all raptor-webext geckoview pageload tests. r=perftest-reviewers,davehunt 
This patch is the final patch for the raptor to browsertime geckoview migration. It disables all raptor-webext geckoview pageload tests running in production.

Differential Revision: https://phabricator.services.mozilla.com/D79157
 2020-06-10 18:44:00 +00:00
Mitchell Hentges
0bc6909185 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart 
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
 2020-06-10 16:10:08 +00:00
Gregory Mierzwinski
5222ae9898 Bug 1644491 - Run fennec68 youtube tests once a week. r=perftest-reviewers,davehunt 
This patch disables fennec68 youtube playback tests on mozilla-central and runs them once a week through the fennec_v68 cron job.

Differential Revision: https://phabricator.services.mozilla.com/D78937
 2020-06-10 17:02:17 +00:00
Joel Maher
bd184eb8bb Bug 1591466 - split raptor tests into tier-1 (high value) and tier-2 (lower value). r=sparky 
split raptor tests into tier-1 (high value) and tier-2 (lower value)

Differential Revision: https://phabricator.services.mozilla.com/D78247
 2020-06-10 15:00:58 +00:00
Simon Fraser
4fbe0ba259 Bug 1644712 Remove datadog metrics submission from partials r=mtabara 
Differential Revision: https://phabricator.services.mozilla.com/D79121
 2020-06-10 13:04:29 +00:00
Mihai Tabara
7bd3b1d36c Bug 1635525 - fix broken nazgul links and deps. r=rail 
Differential Revision: https://phabricator.services.mozilla.com/D79084
 2020-06-10 14:17:02 +00:00
Mike Hommey
01f30cd88f Bug 1643504 - Fix WR bustage. r=fix CLOSED TREE 2020-06-10 00:41:49 +03:00
Mike Hommey
ef2aafa5a5 Bug 1643504 - Remove not unused Debian stretch-based docker images. r=firefox-build-system-reviewers,rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D78433
 2020-06-09 01:01:33 +00:00
Mike Hommey
57fa3660c9 Bug 1643504 - Upgrade webrender and wgpu docker images to Debian buster. r=kats 
Differential Revision: https://phabricator.services.mozilla.com/D78419
 2020-06-09 13:35:40 +00:00
Florin Strugariu
cfbc528f9c Bug 1641820 - Remove chrome variant of binast test. r=sparky,perftest-reviewers 
Differential Revision: https://phabricator.services.mozilla.com/D78869
 2020-06-09 18:35:24 +00:00
Andrew Halberstadt
851c45354a Bug 1643811 - [ci] Add a SCHEDULES rule to exclusively run browser-chrome tests when '**/test/browser_*' files are modified, r=gbrown,Gijs 
Also makes sure that 'mochitest-devtools-chrome' tasks are triggered by the
'mochitest-browser-chrome' component since they use the same manifest / test
formats.

Depends on D78906

Differential Revision: https://phabricator.services.mozilla.com/D78927
 2020-06-09 17:14:09 +00:00
Noemi Erli
9017f973e3 Backed out 4 changesets (bug 1621960) for causing Android bustages CLOSED TREE 
Backed out changeset f36a95234a5f (bug 1621960)
Backed out changeset 0e4661c9061d (bug 1621960)
Backed out changeset 3e2cbe4dd777 (bug 1621960)
Backed out changeset d7eb101e5df7 (bug 1621960)
 2020-06-09 20:59:26 +03:00
Mitchell Hentges
4006a0890c Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart 
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
 2020-06-09 16:44:51 +00:00
Razvan Maries
ef73a88351 Backed out changeset 37a5223eda5f (bug 1643625) for Rpk bustages. CLOSED TREE 2020-06-09 18:30:01 +03:00
Simon Fraser
1422db5e20 Bug 1643625 Clear up references to MAR_OLD_FORMAT in packaging tools r=nthomas 
I think we don't need these checks any more.

Differential Revision: https://phabricator.services.mozilla.com/D78480
 2020-06-09 11:53:26 +00:00
Kunchanapalli Shriram
75c48c9453 Bug 1518313 - Removes --geckoProfile from talos-test mach command and replaces it with --gecko-profile; r=AlexandruIonescu,perftest-reviewers 
Also removes import argparse as per https://bugzilla.mozilla.org/show_bug.cgi?id=1518313#c15
Addresses defect found in code analysis as per https://code-review.moz.tools/#/diff/242580
Changes parameters value as per https://phabricator.services.mozilla.com/D66380#2132590

Differential Revision: https://phabricator.services.mozilla.com/D66380
 2020-06-09 13:22:15 +00:00
Simon Fraser
d5c5c1164e Bug 1598055 Fix up output redirection in ubuntu1804-test creation r=egao 
I think this is meant to be a 'stderr into stdout' redirection

Differential Revision: https://phabricator.services.mozilla.com/D78482
 2020-06-08 19:21:23 +00:00
Mike Hommey
7142d5cabc Bug 1643504 - Upgrade visual metrics docker image to Debian buster. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D78421
 2020-06-09 01:02:04 +00:00
Gregory Mierzwinski
141cc114ba Bug 1644256 - Make raptor-youtube-playback test use 2019 branch. r=perftest-reviewers,davehunt 
The old raptor-youtube-playback test was converted to a 2020 branch H264 test and this patch reverts that change. It also adds a new test (and task) for the H264 standard tests.

Differential Revision: https://phabricator.services.mozilla.com/D78803
 2020-06-09 00:18:27 +00:00
Mike Hommey
a5ea1d83c5 Bug 1643504 - Upgrade code-review task to Debian buster. r=sylvestre,andi 
Differential Revision: https://phabricator.services.mozilla.com/D78432
 2020-06-08 21:46:07 +00:00
Mike Hommey
a0dec00425 Bug 1643504 - Upgrade coverity tasks to Debian buster. r=andi 
Differential Revision: https://phabricator.services.mozilla.com/D78429
 2020-06-08 21:42:02 +00:00
Mike Hommey
d5ce330d0b Bug 1643504 - Upgrade static analysis docker image to Debian buster. r=andi 
An explicit install of the libstdc++ dev package is now necessary.
See https://bugzilla.mozilla.org/show_bug.cgi?id=1578535#c6

Differential Revision: https://phabricator.services.mozilla.com/D78422
 2020-06-08 21:45:02 +00:00
Mike Hommey
afac0aa5fb Bug 1643504 - Upgrade android build docker images to Debian buster. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D78418
 2020-06-08 10:53:29 +00:00
Simon Fraser
61d97f3f00 Bug 1642351 Set tasks_for in merge automation action to prevent source-tests r=rail 
Differential Revision: https://phabricator.services.mozilla.com/D78672
 2020-06-08 16:46:25 +00:00
Joel Maher
eeadf81538 Bug 1643284 - require --full to schedule talos/raptor profiling jobs on try. r=davehunt,ahal 
require --full to schedule talos/raptor profiling jobs on try.

Differential Revision: https://phabricator.services.mozilla.com/D78250
 2020-06-08 15:19:55 +00:00
Tarek Ziadé
7489c5233a Bug 1642779 - implement the 'androidlog' test r=acreskey,sparky 
Add a layer that scans the android logcat

Differential Revision: https://phabricator.services.mozilla.com/D78268
 2020-06-08 10:47:52 +00:00
Narcis Beleuzu
c4c6cd3a30 Backed out changeset c324ff9bf17e (bug 1643504) for breaking Docker Images. CLOSED TREE 2020-06-08 02:01:41 +03:00
Mike Hommey
75e08f6365 Bug 1643504 - Upgrade release-notify-started tasks to Debian buster. r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D78430
 2020-06-07 22:29:17 +00:00
Mike Hommey
266e2a5a8c Bug 1643504 - Build wine on Debian buster. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D78428
 2020-06-07 22:29:15 +00:00
Mike Hommey
2acf07e0d0 Bug 1643504 - Upgrade Windows searchfox task to Debian buster. r=kats 
Differential Revision: https://phabricator.services.mozilla.com/D78431
 2020-06-07 22:29:07 +00:00
Mike Hommey
65b8d3beb1 Bug 1643504 - Upgrade the Linux64 generate-profile task to Debian buster. r=firefox-build-system-reviewers,rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D78427
 2020-06-07 22:29:05 +00:00
Mike Hommey
33f75a13db Bug 1643504 - Upgrade Windows cross builds to Debian buster. r=firefox-build-system-reviewers,rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D78426
 2020-06-07 22:29:02 +00:00
Mike Hommey
80c76c5881 Bug 1643504 - Upgrade Linux plain builds to Debian buster. r=firefox-build-system-reviewers,rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D78425
 2020-06-07 22:29:00 +00:00
Mike Hommey
a79f981981 Bug 1643504 - Upgrade mingw build docker image to Debian buster. r=firefox-build-system-reviewers,rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D78424
 2020-06-07 22:28:58 +00:00
Mike Hommey
bcf92befab Bug 1643504 - Upgrade partner repack docker image to Debian buster. r=bhearsum 
Differential Revision: https://phabricator.services.mozilla.com/D78423
 2020-06-07 22:28:55 +00:00
Mike Hommey
4e9162942f Bug 1643504 - Upgrade custom-v8 docker image to Debian buster. r=jmaher 
Differential Revision: https://phabricator.services.mozilla.com/D78420
 2020-06-07 22:28:58 +00:00
Mike Hommey
563675005b Bug 1643504 - Upgrade android build docker images to Debian buster. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D78418
 2020-06-07 22:28:57 +00:00
Bogdan Tara
72a33db2ac Backed out changeset 2ed99d13012d (bug 1591466) on ahal's request 2020-06-06 06:49:13 +03:00
Andrew Halberstadt
c40751d405 Bug 1641131 - [taskgraph] Filter out devedition builds and tests with |mach try auto|, r=marco 
Differential Revision: https://phabricator.services.mozilla.com/D78569
 2020-06-05 20:28:44 +00:00
Joel Maher
7ea3ea9209 Bug 1591466 - split raptor tests into tier-1 (high value) and tier-2 (lower value). r=sparky 
split raptor tests into tier-1 (high value) and tier-2 (lower value)

Differential Revision: https://phabricator.services.mozilla.com/D78247
 2020-06-05 21:07:21 +00:00
Bogdan Tara
7e299a95cf Backed out 3 changesets (bug 1640278) for verify lint failure CLOSED TREE 
Backed out changeset e63b60fe21fe (bug 1640278)
Backed out changeset dbf1e5788c22 (bug 1640278)
Backed out changeset 27ae032f17be (bug 1640278)
 2020-06-05 22:59:20 +03:00
Justin Wood
7fa31e9752 Bug 1640278 - Fix bustage because empty {} is a dict not a set CLOSED TREE 
Differential Revision: https://phabricator.services.mozilla.com/D78564
 2020-06-05 19:40:48 +00:00
Justin Wood
fe8c054562 Bug 1640278 - Fixup run-on-projects verification failures. r=sylvestre 
This is in-part a followup to 1638260 which fixed some cases of this problem.

Differential Revision: https://phabricator.services.mozilla.com/D76746
 2020-06-05 14:52:03 +00:00
Justin Wood
b1ec9e9331 Bug 1640278 - Do validation of run-on-projects. r=catlee 
Differential Revision: https://phabricator.services.mozilla.com/D76540
 2020-06-05 16:41:21 +00:00
Sylvestre Ledru
c5a6924cbf Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink 
Differential Revision: https://phabricator.services.mozilla.com/D78275
 2020-06-05 16:39:58 +00:00
Narcis Beleuzu
3fe80978c1 Backed out changeset c5e87f7e82af (bug 1643335) for breaking the Gecko Decision Task. CLOSED TREE 2020-06-05 19:37:04 +03:00
Sylvestre Ledru
07064e1400 Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink 
Differential Revision: https://phabricator.services.mozilla.com/D78275
 2020-06-05 16:01:43 +00:00
Andrew Halberstadt
191a0b1695 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher 
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
 2020-06-05 15:38:24 +00:00
Gregory Mierzwinski
acf95bb010 Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe 
This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests.

Differential Revision: https://phabricator.services.mozilla.com/D77474
 2020-06-05 11:00:49 +00:00
Simon Fraser
d8029a3fe7 Bug 1643661 Fix shell quoting with hg commands r=mtabara 
shellcheck will moan about this, as it's potentially unsafe

Differential Revision: https://phabricator.services.mozilla.com/D78486
 2020-06-05 12:06:21 +00:00
Marco Castelluccio
9e95f1a2e5 Bug 1637544 - Add a 'project' to the fake parameters used during taskgraph tests. r=tomprince DONTBUILD 
Differential Revision: https://phabricator.services.mozilla.com/D78399
 2020-06-04 21:52:34 +00:00
Marco Castelluccio
525a47b947 Bug 1637544 - Run no-sccache verification only on release projects. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D77248
 2020-06-04 19:40:54 +00:00
Marco Castelluccio
b2e275bf31 Bug 1637544 - Support project-specific verifications in taskgraph. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D77247
 2020-06-04 19:40:46 +00:00
Andrew Halberstadt
0f1bc1a064 Bug 1633866 - [taskgraph] Improve 'guess_mozinfo_from_task' for more balanced chunks, r=gbrown 
Adds a few properties to the mozinfo guess that were previously missing.

Differential Revision: https://phabricator.services.mozilla.com/D78156
 2020-06-04 18:35:07 +00:00
Andrew Halberstadt
ddaf15c72f Bug 1633866 - [taskgraph] Implement a multiplier to tweak the duration for certain platforms / suites, r=gbrown 
This is needed because xpcshell runs in parallel. Therefore we need to know the number
of threads are used (which varies by platform) in order to accurately determine how
many chunks are needed.

This allows us to specify a platform / suite specific multiplier to compensate via trial
and error.

Differential Revision: https://phabricator.services.mozilla.com/D78153
 2020-06-04 15:34:51 +00:00
Andrew Halberstadt
d4001d553e Bug 1633866 - [taskgraph] Truncate runtimes that exceed DYNAMIC_CHUNK_DURATION so they don't artificially increase chunks, r=gbrown 
For example, assume we have three manifests:

foo -> 98 minutes
bar -> 1 minute
baz -> 1 minute

And let's say we want average chunk lengths of ~20 minutes. The calculation
would currently say we need 5 chunks ((98 + 1 + 1) / 20). Even if set the max
chunks to the # of manifests, it would still return 3. Clearly this only needs
at most 2 chunks to run.

By truncating the runtime, we'd have:

foo -> 20 minutes (truncated)
bar -> 1 minute
baz -> 1 minute

So we'd actually only assign one chunk (round((20 + 1 + 1) / 20)). Despite
having a single 100 minute chunk, this outcome is desirable as we now avoid the
overhead of a second chunk that only runs 2 minutes worth of tests.

Depends on D77871

Differential Revision: https://phabricator.services.mozilla.com/D77873
 2020-06-03 21:00:43 +00:00
Andrew Halberstadt
b3fbd0cf70 Bug 1633866 - [taskgraph] Always use chunk number as symbol if it would otherwise be empty, r=jmaher 
Depends on D76523

Differential Revision: https://phabricator.services.mozilla.com/D77871
 2020-06-02 18:56:54 +00:00
Andrew Halberstadt
27d78d7059 Bug 1633866 - [taskgraph] Create a 'bugbug' based test manifest loader, r=marco 
Loads manifests using bugbug's push/schedules endpoint. For now we use as low
confidence threshold to select manifests. This is to try and both:

1) Improve regression detection rate
2) Save resources

at the same time. This way we theoretically shouldn't regress either dimension.

Note that we still optimize with CT_MEDIUM. My thinking is that at least all
of the "extra" stuff is still guaranteed to be relevant. Though we may want to
consider making these two thresholds match.

Differential Revision: https://phabricator.services.mozilla.com/D76523
 2020-06-04 18:45:09 +00:00
Andrew Halberstadt
be4e9089ec Bug 1633866 - [taskgraph] Simplify how 'suites' are handled in manifest resolving and chunking, r=egao 
This change is a straight refactor and results in identical full taskgraphs.

Differential Revision: https://phabricator.services.mozilla.com/D77543
 2020-06-02 20:00:46 +00:00
Razvan Maries
e46cf863d7 Backed out changeset 447cbc28fda3 (bug 1641948) for Android 7 perma failures. CLOSED TREE 2020-06-04 18:55:43 +03:00
Razvan Maries
179572857b Backed out changeset d51c3c722d65 (bug 1643335) for breaking Gecko Decision Task. CLOSED TREE 2020-06-04 18:29:19 +03:00
Sylvestre Ledru
0f57f34c18 Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink 
Differential Revision: https://phabricator.services.mozilla.com/D78275
 2020-06-04 15:19:38 +00:00
Ben Hearsum
dd5a8a4ba7 Bug 1642713: allow diff-artifact tasks to be optimized by push interval r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D77859
 2020-06-04 14:27:42 +00:00
Ben Hearsum
3dca5e3f67 Bug 1641948: remove android opt builds from non-mozilla-central branches; reduce frequency of fat-aar builds r=snorp,Callek 
snorp - I'm not sure if you want/need to review this yourself so I'm flagging you as optional.

Differential Revision: https://phabricator.services.mozilla.com/D77834
 2020-06-03 20:52:38 +00:00
Ed Lee
96ed60b4bd Bug 1641863 - Upgrade Node 10.x (in preparation for ESR 78) r=Standard8. CLOSED TREE 
Node v10.21.0 (LTS) just released https://nodejs.org/en/blog/release/v10.21.0/

Differential Revision: https://phabricator.services.mozilla.com/D77904
 2020-06-03 18:00:52 +00:00
Tom Prince
9eac413f54 Bug 1642446: Add an attribute to annotate toolchain tasks used by mach bootstrap; r=firefox-build-system-reviewers,rstewart 
Toolchains that are used for local development need to be built on a level-3
branch to installable via `mach bootstrap`. Add an attribute to track the fact
that a toolchain is used that way, and:
- ensure that everything installed via `mach boostrap` has that attribute set
- ensure that everything with that attribute set is built on trunk projects

We could additionally verify that attribute is only set on things used by
bootstrap, but bootstrap doesn't currently have an exhaustive list of things
that it might install, making that difficult.

Differential Revision: https://phabricator.services.mozilla.com/D77706
 2020-06-03 15:55:26 +00:00
Nathan Froyd
40348063b3 Bug 1643029 - remove build-.*-aarch64 from being hidden behind --full; r=ahal 
It's not good to hide Android AArch64 builds, a tier 1 platform, behind `--full`.

Differential Revision: https://phabricator.services.mozilla.com/D78070
 2020-06-03 16:15:43 +00:00
Andrew Halberstadt
3428cd2244 Bug 1601782 - [ci] Enable crashtest-fis on same platforms where reftest-fis is running, r=jmaher 
This adds the following task:
test-linux1804-64-qr/debug-crashtest-fis-e10s

Differential Revision: https://phabricator.services.mozilla.com/D78030
 2020-06-03 14:09:42 +00:00
Kartikaya Gupta
b086844bd9 Bug 1642720 - Disable reftests on win7/mingw builds. r=tjr 
These reftests seem to hang quite frequently, caused by the content process
hanging on file create/open operations. See dependencies of bug 1642719 for
some examples.

Differential Revision: https://phabricator.services.mozilla.com/D77875
 2020-06-03 14:17:08 +00:00
Marco Castelluccio
6b213d3c19 Bug 1637810 - Define a new strategy that optimizes builds away if they are not selected by bugbug. r=ahal DONTBUILD 
Differential Revision: https://phabricator.services.mozilla.com/D75621
 2020-06-03 09:53:17 +00:00
Tom Prince
8073961f7e Bug 1641971: [taskgraph] Use task-reference to refer to the decision task in task; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77552
 2020-06-03 02:35:00 +00:00
Tom Prince
ca6c9020de Bug 1641971: [taskgraph] Always pass an explicit decision task id to create_tasks; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77551
 2020-06-03 02:35:03 +00:00
Tom Prince
9f3450be95 Bug 1641971: [taskgraph] Pass explicit decision task id to action.json generation; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77550
 2020-06-03 02:35:05 +00:00
Tom Prince
86711ecee8 Bug 1641971: Use task-reference to pass the decision task id to shadow schedulers; r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D77549
 2020-06-03 02:35:07 +00:00
Tom Prince
581eba974b Bug 1641971: Pass mach perftest options explicitly, rather than inpsect parameters; r=tarek 
Differential Revision: https://phabricator.services.mozilla.com/D77548
 2020-06-03 02:35:09 +00:00
Tom Prince
6617f03f05 Bug 1641971: Allow references to decision task via task-reference/artifact-reference; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77547
 2020-06-03 02:43:34 +00:00
Tom Prince
01e244f62c Bug 1641971: Allow making references to a task itself in the task definition; r=Callek 
This is to support linking to the a specific task in taskcluster.

Differential Revision: https://phabricator.services.mozilla.com/D77529
 2020-06-03 02:35:14 +00:00
Henrik Skupin
12f6324f02 Bug 1623128 - [remote] Run Puppeteer unit tests on ubuntu18.04. r=egao 
Differential Revision: https://phabricator.services.mozilla.com/D77765
 2020-06-03 04:07:43 +00:00
Mike Hommey
98b889cf83 Bug 1622963 - Install python 3.6 in build docker images. CLOSED TREE 
Differential Revision: https://phabricator.services.mozilla.com/D77753
 2020-06-02 03:51:14 +00:00
Narcis Beleuzu
479c45bbea Backed out 7 changesets (bug 1641971) for breaking Gecko Decision Task opt . CLOSED TREE 
Backed out changeset a039e60a26d2 (bug 1641971)
Backed out changeset e7d4c490c31a (bug 1641971)
Backed out changeset f2322981b294 (bug 1641971)
Backed out changeset d123b08d2c20 (bug 1641971)
Backed out changeset 57772c0b9b3e (bug 1641971)
Backed out changeset 11a887f73dbb (bug 1641971)
Backed out changeset e9c7a59d4bc5 (bug 1641971)
 2020-06-03 05:30:51 +03:00
Mitchell Hentges
658f5f0eeb Bug 1642411: Removes unused test-macosx.sh script r=ahal 
A grep through the repository and a brief discussion with #releng seems to point towards this script not being used.

Differential Revision: https://phabricator.services.mozilla.com/D77689
 2020-06-02 18:55:35 +00:00
Tom Prince
6f0a7bbba6 Bug 1641971: [taskgraph] Use task-reference to refer to the decision task in task; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77552
 2020-06-02 18:23:23 +00:00
Tom Prince
f32e4a4f4d Bug 1641971: [taskgraph] Always pass an explicit decision task id to create_tasks; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77551
 2020-06-02 18:23:19 +00:00
Tom Prince
7c6a413ca9 Bug 1641971: [taskgraph] Pass explicit decision task id to action.json generation; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77550
 2020-06-02 18:23:20 +00:00
Tom Prince
73b2e6f745 Bug 1641971: Use task-reference to pass the decision task id to shadow schedulers; r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D77549
 2020-06-02 18:23:11 +00:00
Tom Prince
11aedca9b2 Bug 1641971: Pass mach perftest options explicitly, rather than inpsect parameters; r=tarek 
Differential Revision: https://phabricator.services.mozilla.com/D77548
 2020-06-02 18:23:07 +00:00
Tom Prince
602da9cdcd Bug 1641971: Allow references to decision task via task-reference/artifact-reference; r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77547
 2020-06-02 18:50:10 +00:00
Tom Prince
de6126516d Bug 1641971: Allow making references to a task itself in the task definition; r=Callek 
This is to support linking to the a specific task in taskcluster.

Differential Revision: https://phabricator.services.mozilla.com/D77529
 2020-06-02 18:22:55 +00:00
Chris AtLee
4925d4d08e Bug 1638990: Use requests for fetching parameters r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D76133
 2020-05-28 19:01:42 +00:00
Chris AtLee
b6edad89bf Bug 1638990: Sort values in taskgraph in order to make comparing output easier r=rstewart 
Differential Revision: https://phabricator.services.mozilla.com/D77320
 2020-05-29 15:01:50 +00:00
Sylvestre Ledru
273a7905e6 Bug 1635826 - platform docs: Document WebRender tasks r=jbonisteel 
Differential Revision: https://phabricator.services.mozilla.com/D77677
 2020-06-01 15:28:13 +00:00
Sylvestre Ledru
c5994e6bba Bug 1628289 - platform docs: the Documentation jobs moved away from the linting section 
Depends on D76185

Differential Revision: https://phabricator.services.mozilla.com/D77657
 2020-06-01 15:28:13 +00:00
Sylvestre Ledru
58f742cd8b Bug 1635826 - platform docs: Remove the nightly platforms r=Callek 
Remove in treeherder in this patch:
1568eaf479

Differential Revision: https://phabricator.services.mozilla.com/D76185
 2020-06-01 11:11:22 +00:00
Edwin Takahashi
3efe2edb5c Bug 1641395 - install amd64 variants of existing i386 packages and insert additional startup parameters for pulseaudio r=jmaher 
Changes:
  - install the `amd64` variants of various packages alongside `i386` packages
  - install `amd64` version of `fontconfig` instead
  - additional command line arguments for pulseaudio initialization
  - do not add configuration files to `~/.pulse` in the docker image

Differential Revision: https://phabricator.services.mozilla.com/D77512
 2020-06-01 20:44:47 +00:00
Agi Sferro
4e005a2cbd Bug 1641711 - Update artifacts for mozlint-android. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D77544
 2020-06-01 15:57:58 +00:00
Tom Prince
98dd864200 No bug: Don't use proxy for accessing taskcluster index; r=Callek 
The index is not protected by scopes, so don't use the proxy to access it

Differential Revision: https://phabricator.services.mozilla.com/D77537
 2020-05-29 21:37:46 +00:00
emilfs
7e13ebcb0a Bug 1628289 - move documentation jobs from lint/opt to doc/opt. r=sylvestre 
Differential Revision: https://phabricator.services.mozilla.com/D77481
 2020-05-29 21:12:13 +00:00
Mitchell Hentges
2a66b39bc4 Bug 1641962: Defer imports of distutils.util to ensure bootstrap can run r=rstewart,perftest-reviewers,sparky 
Differential Revision: https://phabricator.services.mozilla.com/D77516
 2020-05-29 20:17:27 +00:00
Andrew Halberstadt
f0e5f6ed7b Bug 1633866 - [taskgraph] Create a system to choose how test manifests are loaded via a parameter, r=tomprince 
Currently test manifests are loaded by instantiating a TestResolver and
traversing moz.build files to find manifests.

With 'manifest-scheduling', we'll want to grab the manifests directly from the
bugbug service instead. Initially we'll want to enable manifest-scheduling with
|mach try auto|, but not on autoland yet.

This patch will allow |mach try auto| to set the parameter that causes bugbug
to be used (see future commits in this bug).

Differential Revision: https://phabricator.services.mozilla.com/D76522
 2020-05-29 18:51:14 +00:00
Bogdan Tara
c72f5589b1 Backed out changeset 2c18e64584af (bug 1641131) for gecko decision task bustage CLOSED TREE 2020-05-29 18:33:23 +03:00
Andrew Halberstadt
ec4749227c Bug 1641131 - [taskgraph] Make 'repackage' and 'repackage-signing' tasks copy their dependency's optimization, r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77346
 2020-05-29 14:43:29 +00:00
Andrew Halberstadt
12b0e45ee9 Bug 1641131 - [taskgraph] Make 'upload-symbols' tasks copy their dependency's optimization r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77048
 2020-05-29 14:42:51 +00:00
Andrew Halberstadt
ad57d3a5df Bug 1641131 - [taskgraph] Make 'upload-generated-sources' tasks copy their dependency's optimization r=Callek 
This should ensure that they are never the cause of their dependency being scheduled
and only run when they do.

Differential Revision: https://phabricator.services.mozilla.com/D76988
 2020-05-29 14:42:44 +00:00
Andrew Halberstadt
bd5660af34 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher 
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
 2020-05-29 14:48:07 +00:00
Andrew Halberstadt
1b2e865f8c Bug 1641283 - [taskgraph.optimize] Increase debug logging of optimization phase, r=tomprince 
For each task, this sheds a bit of light on why it was removed or kept.

Differential Revision: https://phabricator.services.mozilla.com/D77147
 2020-05-29 14:48:07 +00:00
Andrew Halberstadt
e5ab1dc839 Bug 1641283 - [taskgraph] Upload bugbug push schedules API data to an artifact rather than the log, r=marco 
Differential Revision: https://phabricator.services.mozilla.com/D77140
 2020-05-29 14:39:38 +00:00
Tarek Ziadé
77da205d14 Bug 1640627 - added android logs options r=sparky 
--android-capture-logcat  - captures the logcat
--android-clear-logcat - clears the logcat on start
--android-capture-adb - captures the adb commands

Differential Revision: https://phabricator.services.mozilla.com/D77038
 2020-05-28 16:42:37 +00:00
Sebastian Hengst
cc52ab7df9 Backed out 3 changesets (bug 1641131) for gecko decision task bustage. CLOSED TREE 
Backed out changeset 6f3a65196d88 (bug 1641131)
Backed out changeset 2e034897a64f (bug 1641131)
Backed out changeset 48e73dbc588e (bug 1641131)
 2020-05-29 10:26:05 +02:00
Ben Hearsum
1e7c40890d Bug 1641656: reduce frequency of asan debug builds to once every 10 pushes on autoland r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77340
 2020-05-28 19:41:03 +00:00
Andrew Halberstadt
cd4e4a87cb Bug 1641131 - [taskgraph] Make 'upload-symbols' tasks copy their dependency's optimization r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D77048
 2020-05-28 14:19:25 +00:00
Andrew Halberstadt
0cf7f3077f Bug 1641131 - [taskgraph] Make 'upload-generated-sources' tasks copy their dependency's optimization r=Callek 
This should ensure that they are never the cause of their dependency being scheduled
and only run when they do.

Differential Revision: https://phabricator.services.mozilla.com/D76988
 2020-05-28 14:18:21 +00:00
Andrew Halberstadt
edd18338b6 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher 
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
 2020-05-27 16:22:27 +00:00
Chris AtLee
3f6a61cb75 Bug 1640961: Force geckodriver to be rebuilt on release branches r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D77155
 2020-05-27 21:58:13 +00:00
Bob Clary
4a9bf38979 Bug 1641702 - Fix unterminated string in run-on-projects for build-linux/debug, r=sylvestre 
Differential Revision: https://phabricator.services.mozilla.com/D77366
 2020-05-28 22:28:52 +00:00
Ben Hearsum
8a3685a875 Bug 1641642: Reduce GCP build frequency to once every 25 pushes r=dhouse 
Differential Revision: https://phabricator.services.mozilla.com/D77323
 2020-05-28 19:56:17 +00:00
Gregory Mierzwinski
621397543d Bug 1641555 - Disable some chrome live site tests. r=perftest-reviewers,Bebe 
This patch prevents some extra live site tests from running on chrome.

Differential Revision: https://phabricator.services.mozilla.com/D77255
 2020-05-28 13:42:58 +00:00
Florin Strugariu
346e44142a Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky 
Differential Revision: https://phabricator.services.mozilla.com/D72946
 2020-05-27 15:55:46 +00:00
egao
45a93dd0b7 Bug 1637011 - refactor web-platform-tests chunking process in chunking.py r=ahal 
Changes:

  - for web-platform-tests codepath, no longer perform filtering of the runtimes information to a list of key:value.
  - for web-platform-tests codepath, load runtimes information into an OrderedDict in order from highest to lowest runtime.
  - if any test paths remain after initial chunking by runtime information, distribute such paths across all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D76538
 2020-05-27 20:21:48 +00:00
Jamie Nicol
bfd4af6e88 Bug 1585050 - Run mochitests on android emulator with webrender enabled. r=ktaeleman 
Differential Revision: https://phabricator.services.mozilla.com/D77000
 2020-05-27 16:43:48 +00:00
Ben Hearsum
34915064c5 Bug 1637542: Disable {linux64,win32,win64} opt and linux64 artifact builds on autoland. r=jmaher 
The opt builds were originally disabled in bug 1522111, but were re-enabled when webgpu was added.

Differential Revision: https://phabricator.services.mozilla.com/D76906
 2020-05-27 17:53:38 +00:00
Dzmitry Malyshau
abaaa872a5 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert 
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
 2020-05-27 16:49:03 +00:00
Andrew Halberstadt
a829c1fad0 Bug 1640382 - [taskgraph] Don't try to set 'schedules-component' on tasks that use 'when.files-changed', r=gbrown 
Differential Revision: https://phabricator.services.mozilla.com/D76979
 2020-05-27 14:37:37 +00:00
Sylvestre Ledru
03c7506984 no bug - run-on-project: Add a new note r=Callek 
Differential Revision: https://phabricator.services.mozilla.com/D76730
 2020-05-27 14:24:58 +00:00
Gregory Mierzwinski
804a5e3ba6 Bug 1641017 - Fix browsertime mobile run-on-projects settings. r=perftest-reviewers,AlexandruIonescu 
This patch fixes the run-on-projects settings for browsertime mobile tests which were regressed from a bad merge (or multiple large patches landing very close to each other).

Differential Revision: https://phabricator.services.mozilla.com/D76911
 2020-05-27 06:10:37 +00:00
Andrew Halberstadt
cc77d57a4a Bug 1641065 - [taskgraph.optimize] Refactor the 'test_optimziation' flag to a set of projects, r=marco 
Instead of a boolean, it's now a set of projects for which tasks should be removed.
If they project doesn't match the specified set it will be kept.

This ensures tasks that have these optimzers applied won't run on |mach try auto|.

Differential Revision: https://phabricator.services.mozilla.com/D76987
 2020-05-27 11:52:54 +00:00
Sylvestre Ledru
1432104c95 Bug 1641168 - Don't run mingw tests in autoland r=aryx,marco 
Differential Revision: https://phabricator.services.mozilla.com/D77005
 2020-05-27 09:46:30 +00:00
egao
a769706988 Bug 1638183 - increase xorg client count to 2048 for ubuntu1804-test docker image r=jmaher 
Changes:
  - apply an explicit increase in the number of xorg client count to 2048.
  - remove the custom.conf file as it was not making any difference in the behavior of the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D76897
 2020-05-26 19:40:29 +00:00
Bogdan Tara
6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau
67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert 
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
 2020-05-26 21:15:40 +00:00
Tom Prince
9e8692e9d1 Bug 1639334: Set run-on-projects for gv-junit-e10s-multi correctly; r=ahal 
The original patch add `run-on-projects` to `TEST_VARIANTS`, but nothing
currently looks at that. Move it into a `replace` block, which gets merged with
the task definition.

This is enough to handle this specific change, but if more control is needed
per-test, we should revisit how this is handled. Fission supports
`fission-run-on-projects` and `fission-tier` to override those values based on
the variants, but it would probably make sense to generalize those to have more
general way of specifying variant-specific configuration.

Differential Revision: https://phabricator.services.mozilla.com/D76772
 2020-05-26 14:40:56 +00:00
Gregory Mierzwinski
18cd0c676d Bug 1640429 - Run v8 fetch with --force. r=jmaher 
This patch attempts to fix the long-running customv8 toolchain tasks by adding a --force to the `fetch v8` call. This additional option prevents `fetch` from checking for existing .gclient files (which should never exist) to help with the long delay we are seeing in this call.

Differential Revision: https://phabricator.services.mozilla.com/D76857
 2020-05-26 15:42:22 +00:00
Kershaw Chang
9fe6da812b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D58112
 2020-05-26 14:30:16 +00:00
Andrew Halberstadt
4c80f3f36b Bug 1640890 - [ci] Use 'push-interval-10' optimization on fuzzing builds, r=bc 
This has the same effect as the 'backstop' optimization except it *doesn't*
optimize tasks on non-autoland branches.

Differential Revision: https://phabricator.services.mozilla.com/D76842
 2020-05-26 13:45:03 +00:00
Gregory Mierzwinski
008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici 
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
 2020-05-26 11:20:27 +00:00
Butkovits Atila
f167b5c275 Backed out 6 changesets (bug 1602832) for causing perma failure at test_trr_case_sensitivity.js. CLOSED TREE 
Backed out changeset 0e9c378df995 (bug 1602832)
Backed out changeset 534fedb3836e (bug 1602832)
Backed out changeset db012c05d64e (bug 1602832)
Backed out changeset ca0c207dca21 (bug 1602832)
Backed out changeset bea1f3aeea49 (bug 1602832)
Backed out changeset 2d54acd78124 (bug 1602832)
 2020-05-26 13:09:07 +03:00
Kershaw Chang
917b0cce29 Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D58112
 2020-05-26 08:35:22 +00:00
Andrew Halberstadt
f5b5676618 Bug 1633866 - [taskgraph] Implement the ability for tasks to dynamically specify chunks, r=gbrown,jmaher 
This allows tasks to opt into dynamic chunking. This means rather than define
the chunks ahead of time, in-tree manifest runtime data is used to guess how
many chunks are needed for a reasonable average task runtime (currently 20
min).

Only suites that are chunked in the taskgraph, and therefore whose manifests
are known ahead of time, can opt into this feature.

Differential Revision: https://phabricator.services.mozilla.com/D76497
 2020-05-25 18:52:12 +00:00
Kartikaya Gupta
4e7d703303 Bug 1638664 - Run the windows searchfox build as cross-compilation on Linux. r=asuth 
This updates the task definition for the win64 searchfox job to closely match
the win64/debug task definition in taskcluster/ci/build/windows.yml. So, instead
of running the build with the mozsearch-plugin on a windows worker, it runs
on a Linux worker and does a cross-compile of windows code. The end result in
terms of searchfox artifacts is equivalent, except for absolute filename paths.
I verified that with mozsearch/mozsearch#299 and mozsearch/mozsearch-mozilla#87
in place, searchfox correctly indexes windows-only C++ and Rust code.

Differential Revision: https://phabricator.services.mozilla.com/D76721
 2020-05-25 18:53:08 +00:00
Andrew Halberstadt
3901f12775 Bug 1640580 - [taskgraph.util.bugbug] Translate WPT paths from relative source directory to WPT ids, r=marco 
Differential Revision: https://phabricator.services.mozilla.com/D76719
 2020-05-25 15:44:58 +00:00
egao
8e54528b9d Bug 1637463 - support loading of runtime information for a specific suite r=ahal 
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
 2020-05-24 00:24:05 +00:00
Mihai Alexandru Michis
74ff68a9a5 Backed out 3 changesets (bug 1637463) for causing bc jobs to timeout. 
CLOSED TREE

Backed out changeset 93efb53380c2 (bug 1637463)
Backed out changeset 5c8ccda5f1b1 (bug 1637463)
Backed out changeset a5fc1b604238 (bug 1637463)
 2020-05-23 02:35:26 +03:00
egao
d40fc31a1b Bug 1637463 - support loading of runtime information for a specific suite r=ahal 
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
 2020-05-22 18:31:47 +00:00
Marco Castelluccio
30cfe57424 Bug 1640047 - Don't take into account bugbug's known tasks if they are likely wrong. r=ahal DONTBUILD 
Differential Revision: https://phabricator.services.mozilla.com/D76418
 2020-05-22 15:28:43 +00:00
Andrew Halberstadt
0591e31c1f Bug 1639349 - [ci] Set up a SCHEDULES rule to exclude non-webrender tests on webrender-only pushes, r=gbrown 
Depends on D76433

Differential Revision: https://phabricator.services.mozilla.com/D76434
 2020-05-22 14:03:46 +00:00
Andrew Halberstadt
e6fc2d3678 Bug 1639349 - [taskgraph] Set schedules-component for test kind in an independent transform, r=gbrown 
Depends on D76306

Differential Revision: https://phabricator.services.mozilla.com/D76433
 2020-05-22 14:03:46 +00:00
Ben Hearsum
d7624bd580 Bug 1638014: blacklist shippable tests from try when there is an opt version of the test available r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D76012
 2020-05-22 17:45:06 +00:00
Rob Wu
27981af497 Bug 1636158 - Update the addons-mlbf.bin attachment via periodic_file_updates.sh r=sfraser 
Tested by running the following code and verifying that the script runs
successfully and generates a reasonable diff with the latest metadata
and matching attachment content:

```
$ cd taskcluster/docker/periodic-updates/
$ tar -czf- -s "#$(git rev-parse --show-cdup)#topsrcdir/#" . $(awk -v d="$(git rev-parse --show-cdup)" '/^# %include/{print d$3}' Dockerfile) | docker build - -t hsts-local
$ docker run -e DO_REMOTE_SETTINGS=1 -e PRODUCT="firefox" -e BRANCH="mozilla-central" -e USE_MOZILLA_CENTRAL=1 hsts-local
```

After that, I opened a shell in the container, built Firefox and ran the
following test, to confirm that the updated records are used correctly:

```
mach test toolkit/mozapps/extensions/test/xpcshell/rs-blocklist/test_blocklist_mlbf_dump.js
```

Differential Revision: https://phabricator.services.mozilla.com/D76158
 2020-05-22 01:37:37 +00:00
Tom Prince
2bf24e6359 Bug 1639955: Use prefix for geckodriver toolchain artifacts; r=aki 
We originally switched it to use just `public/` becuase iscript broke with the
extra path, but that broke out-of-tree consumers. Now that iscript is fixed,
switch it back.

Differential Revision: https://phabricator.services.mozilla.com/D76409
 2020-05-22 03:38:32 +00:00
Tom Prince
9703222150 Bug 1639955: Include toolchain-artifact in the cached-task digest; r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D76410
 2020-05-22 03:38:29 +00:00
Chris AtLee
4c1292f8f8 Bug 1637381: Fix reference to old tarball for win64-clang-tidy r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D76420
 2020-05-22 01:12:56 +00:00
Justin Wood
d582323fcb Bug 1640057 - Make condition profile fetch use the correct directory (en-US from shippable). r=aki 
Fixes bustage from 1623355.

Differential Revision: https://phabricator.services.mozilla.com/D76424
 2020-05-22 01:47:28 +00:00
Sylvestre Ledru
27f8422c60 Bug 1635826 - platform docs: improve the list of platforms r=marco DONTBUILD 
* document more jobs
* document when some are running
* remove some old jobs
  - stylo seq a9c044b771
  - webrender pgo https://github.com/mozilla/treeherder/pull/6437

Differential Revision: https://phabricator.services.mozilla.com/D76184
 2020-05-21 09:16:12 +00:00
Bob Clary
5d2b7338b8 Bug 1639886 - Allow the Backstop optimization strategy to be used outside of the test optimization, r=ahal. 
Differential Revision: https://phabricator.services.mozilla.com/D76350
 2020-05-21 20:53:20 +00:00
Andrew Halberstadt
5ad7af589e Bug 1633866 - [taskgraph] Refactor logic around manifest chunking, r=egao 
This sets things up to be a little bit easier and cleaner to modify going
forward. The taskgraph before/after this change is identical.

Differential Revision: https://phabricator.services.mozilla.com/D74452
 2020-05-21 15:58:24 +00:00
Justin Wood
e49ff70dad Followup to Bug 1623355 - Part 1, specifically fix typo in 'nightly'. CLOSED TREE 
Differential Revision: https://phabricator.services.mozilla.com/D76352
 2020-05-21 18:07:22 +00:00
Chris AtLee
b34b110320 Bug 1637381: Install zstandard on linting images on a CLOSED TREE 
Differential Revision: https://phabricator.services.mozilla.com/D76348
 2020-05-21 17:31:01 +00:00
Gregory Mierzwinski
c4ae7d3f70 Bug 1639374 - Disable majority of browsertime desktops. r=perftest-reviewers,Bebe 
This patch disables the majority of browsertime desktop tests. First, we disable all of the tests on autoland so no more browsertime tests run there. These benchmark tests that were running there will be enabled on mozilla-central along with the rest of the tests. Finally, all browsertime tests will be further restricted to running on the linx64-shippable platform.

Differential Revision: https://phabricator.services.mozilla.com/D76212
 2020-05-21 14:07:15 +00:00
Justin Wood
6c368aa658 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki 
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
 2020-05-21 16:31:04 +00:00
Justin Wood
3f24c1f0f0 Bug 1617481 - Remove nightly index's. r=aki 
They only really worked for promoted builds when the build was generated on the nightly cron anyway.

Differential Revision: https://phabricator.services.mozilla.com/D74509
 2020-05-21 16:30:11 +00:00
Justin Wood
f8829d41ab Bug 1636637 - Remove now-redundant geckoview fat aar (non-shippable). r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74508
 2020-05-21 16:30:03 +00:00
Justin Wood
b2ef4dc0b7 Bug 1636637 - Make geckoview shippable its own treeherder line and update its index. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74507
 2020-05-21 16:30:01 +00:00
Justin Wood
4cff028d95 Bug 1636635 - Swap devedition to shippable index and use non-Nightly treeherder symbols. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74506
 2020-05-21 16:29:59 +00:00
Justin Wood
ec5c1d56da Bug 1623355 - Part 9/9 - Remove 'pgo' support from performance testing target tasks. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74961
 2020-05-21 16:29:51 +00:00
Justin Wood
27e43125b2 Bug 1623355 - Part 8/9 - Set new shippable index's for Android shippable builds. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74360
 2020-05-21 16:29:48 +00:00
Justin Wood
66aebeae94 Bug 1623355 - Part 7/9 - Set treeherder symbols appropriately for Android Shippable. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74359
 2020-05-21 16:29:46 +00:00
Justin Wood
d02f213610 Bug 1623355 - Part 6/9 - Remove Android PGO build types. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74309
 2020-05-21 16:29:44 +00:00
Justin Wood
897aafaf58 Bug 1623355 - Part 5/9 - Rename pgo instrumentation steps to shippable. And make condition profiles use shippable. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74308
 2020-05-21 16:29:41 +00:00
Justin Wood
15cec74666 Bug 1623355 - Part 4/9 - Point tests based on pgo builds to use shippable builds. r=aki 
This needs to remove nightly attribute from android shippable.

Differential Revision: https://phabricator.services.mozilla.com/D74307
 2020-05-21 16:29:37 +00:00
Justin Wood
7633ba28c6 Bug 1623355 - Part 3/9 - Rename android pgo tests to -shippable/opt and adjust run-on-platforms to cope. r=aki 
This keeps all tests that were running as pgo, continuing to run in the same places.

Differential Revision: https://phabricator.services.mozilla.com/D74306
 2020-05-21 16:29:34 +00:00
Justin Wood
f9bb21ade0 Bug 1623355 - Part 2/9 - Add shippable as a valid target for performance test cron targets. r=aki 
Differential Revision: https://phabricator.services.mozilla.com/D74960
 2020-05-21 16:31:23 +00:00
Tom Prince
24d507a5bc Bug 1623355 - Part 1/9 - Set geckoview artifact names to match mozharness on non-release branches; r=Callek 
For shippable builds on non-release branches, mozharness defaults to using
`nightly-{project}`. The update channel is encoded in the artifact filenames
for non release-channel builds, so update taskgraph to generate the correct
artifact names on non-release branches.

Differential Revision: https://phabricator.services.mozilla.com/D76274
 2020-05-21 16:32:06 +00:00
Marco Castelluccio
39d348c1c5 Bug 1639812 - Don't apply 'skip-unless-schedules' when overriding 'build-fuzzing' strategy. r=ahal 
Differential Revision: https://phabricator.services.mozilla.com/D76306
 2020-05-21 13:38:57 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D74930
 2020-05-21 13:31:55 +00:00
Chris AtLee
b1c32e06b2 Bug 1637381: Use zstd for rust toolchains r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D74929
 2020-05-21 13:30:56 +00:00
Chris AtLee
72cc360dcd Bug 1637381: Use python3 for repack_rust.py r=glandium 
repack_rust.py was the only toolchain build using a python script directly. we
don't need it to use the `mach python` wrapper, so remove that special casing
from the transform.

Differential Revision: https://phabricator.services.mozilla.com/D75702
 2020-05-21 13:30:54 +00:00
Chris AtLee
d0a9a8b30b Bug 1637381: Use zstd for android toolchains r=firefox-build-system-reviewers,glandium 
Differential Revision: https://phabricator.services.mozilla.com/D74928
 2020-05-21 13:29:13 +00:00
Chris AtLee
3befa9e65b Bug 1637381: Add zstdpy script r=glandium 
This is a simple command line utility for doing zstd compression/decompression
of stdin to stdout. It depends on python's zstandard module being available.

Differential Revision: https://phabricator.services.mozilla.com/D75358
 2020-05-21 13:28:55 +00:00
Chris AtLee
ac6909cd9a Bug 1637381: Add python-zstandard to ubuntu test images so they can unpack toolchains r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D75356
 2020-05-21 13:28:45 +00:00
Chris AtLee
cd35328624 Bug 1637381: Add support for extracting zst files to mozbuild tooltool r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D75203
 2020-05-21 13:28:33 +00:00
Chris AtLee
ef685f3549 Bug 1637379: Optimize android toolchains r=gbrown 
Create an emulator toolchain
Stop including mozboot/sdk-*.zip in our tarball

Differential Revision: https://phabricator.services.mozilla.com/D74931
 2020-05-21 13:28:10 +00:00
Sylvestre Ledru
b39fdab18d Bug 1638050 - Taskcluster config: Do not run mingw jobs on m-b or m-r r=jmaher,tjr 
mingw is used by Tor, we don't ship it
as they are based on esr, no need to run mingw on every uplift in m-b or m-r

Differential Revision: https://phabricator.services.mozilla.com/D76132
 2020-05-20 20:38:01 +00:00
Tom Prince
ca0e268b05 No bug: Rename list of labels to ignore on try to UNCOMMON_TRY_TASK_LABELS; r=ahal 
Give it a more descriptive name, and avoid using `blacklist` in the name.

Differential Revision: https://phabricator.services.mozilla.com/D76031
 2020-05-20 13:18:19 +00:00
Andrew Halberstadt
a87fdb1bdb Bug 1634551 - [taskgraph] Move WPT group assignment into the TestResolver, r=egao 
This moves the creation of WPT groups into the TestResolver, where all kinds of
other consumers will be able to access them.

Differential Revision: https://phabricator.services.mozilla.com/D76085
 2020-05-20 17:51:20 +00:00
Gregory Mierzwinski
53f1f9dbb8 Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher 
This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running.

Differential Revision: https://phabricator.services.mozilla.com/D74986
 2020-05-20 16:53:07 +00:00
Gregory Mierzwinski
b43121d47b Bug 1639193 - Disable youtube AV1 raptor tests on most platforms. r=perftest-reviewers,Bebe 
This patch prevents the AV1 youtube playback tests from running on platforms where they are completely failing.

Differential Revision: https://phabricator.services.mozilla.com/D75942
 2020-05-20 14:34:37 +00:00