Commit Graph

4734 Commits

Author SHA1 Message Date
Mike Hommey
7142d5cabc Bug 1643504 - Upgrade visual metrics docker image to Debian buster. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78421
2020-06-09 01:02:04 +00:00
Gregory Mierzwinski
141cc114ba Bug 1644256 - Make raptor-youtube-playback test use 2019 branch. r=perftest-reviewers,davehunt
The old raptor-youtube-playback test was converted to a 2020 branch H264 test and this patch reverts that change. It also adds a new test (and task) for the H264 standard tests.

Differential Revision: https://phabricator.services.mozilla.com/D78803
2020-06-09 00:18:27 +00:00
Mike Hommey
a5ea1d83c5 Bug 1643504 - Upgrade code-review task to Debian buster. r=sylvestre,andi
Differential Revision: https://phabricator.services.mozilla.com/D78432
2020-06-08 21:46:07 +00:00
Mike Hommey
a0dec00425 Bug 1643504 - Upgrade coverity tasks to Debian buster. r=andi
Differential Revision: https://phabricator.services.mozilla.com/D78429
2020-06-08 21:42:02 +00:00
Mike Hommey
d5ce330d0b Bug 1643504 - Upgrade static analysis docker image to Debian buster. r=andi
An explicit install of the libstdc++ dev package is now necessary.
See https://bugzilla.mozilla.org/show_bug.cgi?id=1578535#c6

Differential Revision: https://phabricator.services.mozilla.com/D78422
2020-06-08 21:45:02 +00:00
Mike Hommey
afac0aa5fb Bug 1643504 - Upgrade android build docker images to Debian buster. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78418
2020-06-08 10:53:29 +00:00
Tarek Ziadé
7489c5233a Bug 1642779 - implement the 'androidlog' test r=acreskey,sparky
Add a layer that scans the android logcat

Differential Revision: https://phabricator.services.mozilla.com/D78268
2020-06-08 10:47:52 +00:00
Narcis Beleuzu
c4c6cd3a30 Backed out changeset c324ff9bf17e (bug 1643504) for breaking Docker Images. CLOSED TREE 2020-06-08 02:01:41 +03:00
Mike Hommey
75e08f6365 Bug 1643504 - Upgrade release-notify-started tasks to Debian buster. r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D78430
2020-06-07 22:29:17 +00:00
Mike Hommey
266e2a5a8c Bug 1643504 - Build wine on Debian buster. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78428
2020-06-07 22:29:15 +00:00
Mike Hommey
2acf07e0d0 Bug 1643504 - Upgrade Windows searchfox task to Debian buster. r=kats
Differential Revision: https://phabricator.services.mozilla.com/D78431
2020-06-07 22:29:07 +00:00
Mike Hommey
65b8d3beb1 Bug 1643504 - Upgrade the Linux64 generate-profile task to Debian buster. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D78427
2020-06-07 22:29:05 +00:00
Mike Hommey
33f75a13db Bug 1643504 - Upgrade Windows cross builds to Debian buster. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D78426
2020-06-07 22:29:02 +00:00
Mike Hommey
80c76c5881 Bug 1643504 - Upgrade Linux plain builds to Debian buster. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D78425
2020-06-07 22:29:00 +00:00
Mike Hommey
a79f981981 Bug 1643504 - Upgrade mingw build docker image to Debian buster. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D78424
2020-06-07 22:28:58 +00:00
Mike Hommey
bcf92befab Bug 1643504 - Upgrade partner repack docker image to Debian buster. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D78423
2020-06-07 22:28:55 +00:00
Mike Hommey
4e9162942f Bug 1643504 - Upgrade custom-v8 docker image to Debian buster. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D78420
2020-06-07 22:28:58 +00:00
Mike Hommey
563675005b Bug 1643504 - Upgrade android build docker images to Debian buster. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78418
2020-06-07 22:28:57 +00:00
Bogdan Tara
72a33db2ac Backed out changeset 2ed99d13012d (bug 1591466) on ahal's request 2020-06-06 06:49:13 +03:00
Joel Maher
7ea3ea9209 Bug 1591466 - split raptor tests into tier-1 (high value) and tier-2 (lower value). r=sparky
split raptor tests into tier-1 (high value) and tier-2 (lower value)

Differential Revision: https://phabricator.services.mozilla.com/D78247
2020-06-05 21:07:21 +00:00
Bogdan Tara
7e299a95cf Backed out 3 changesets (bug 1640278) for verify lint failure CLOSED TREE
Backed out changeset e63b60fe21fe (bug 1640278)
Backed out changeset dbf1e5788c22 (bug 1640278)
Backed out changeset 27ae032f17be (bug 1640278)
2020-06-05 22:59:20 +03:00
Justin Wood
fe8c054562 Bug 1640278 - Fixup run-on-projects verification failures. r=sylvestre
This is in-part a followup to 1638260 which fixed some cases of this problem.

Differential Revision: https://phabricator.services.mozilla.com/D76746
2020-06-05 14:52:03 +00:00
Sylvestre Ledru
c5a6924cbf Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink
Differential Revision: https://phabricator.services.mozilla.com/D78275
2020-06-05 16:39:58 +00:00
Narcis Beleuzu
3fe80978c1 Backed out changeset c5e87f7e82af (bug 1643335) for breaking the Gecko Decision Task. CLOSED TREE 2020-06-05 19:37:04 +03:00
Sylvestre Ledru
07064e1400 Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink
Differential Revision: https://phabricator.services.mozilla.com/D78275
2020-06-05 16:01:43 +00:00
Andrew Halberstadt
191a0b1695 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-06-05 15:38:24 +00:00
Gregory Mierzwinski
acf95bb010 Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe
This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests.

Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
Razvan Maries
e46cf863d7 Backed out changeset 447cbc28fda3 (bug 1641948) for Android 7 perma failures. CLOSED TREE 2020-06-04 18:55:43 +03:00
Razvan Maries
179572857b Backed out changeset d51c3c722d65 (bug 1643335) for breaking Gecko Decision Task. CLOSED TREE 2020-06-04 18:29:19 +03:00
Sylvestre Ledru
0f57f34c18 Bug 1643335 - Run hazard-linux64-haz/debug less often r=jmaher,sfink
Differential Revision: https://phabricator.services.mozilla.com/D78275
2020-06-04 15:19:38 +00:00
Ben Hearsum
dd5a8a4ba7 Bug 1642713: allow diff-artifact tasks to be optimized by push interval r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D77859
2020-06-04 14:27:42 +00:00
Ben Hearsum
3dca5e3f67 Bug 1641948: remove android opt builds from non-mozilla-central branches; reduce frequency of fat-aar builds r=snorp,Callek
snorp - I'm not sure if you want/need to review this yourself so I'm flagging you as optional.

Differential Revision: https://phabricator.services.mozilla.com/D77834
2020-06-03 20:52:38 +00:00
Tom Prince
9eac413f54 Bug 1642446: Add an attribute to annotate toolchain tasks used by mach bootstrap; r=firefox-build-system-reviewers,rstewart
Toolchains that are used for local development need to be built on a level-3
branch to installable via `mach bootstrap`. Add an attribute to track the fact
that a toolchain is used that way, and:
- ensure that everything installed via `mach boostrap` has that attribute set
- ensure that everything with that attribute set is built on trunk projects

We could additionally verify that attribute is only set on things used by
bootstrap, but bootstrap doesn't currently have an exhaustive list of things
that it might install, making that difficult.

Differential Revision: https://phabricator.services.mozilla.com/D77706
2020-06-03 15:55:26 +00:00
Andrew Halberstadt
3428cd2244 Bug 1601782 - [ci] Enable crashtest-fis on same platforms where reftest-fis is running, r=jmaher
This adds the following task:
test-linux1804-64-qr/debug-crashtest-fis-e10s

Differential Revision: https://phabricator.services.mozilla.com/D78030
2020-06-03 14:09:42 +00:00
Kartikaya Gupta
b086844bd9 Bug 1642720 - Disable reftests on win7/mingw builds. r=tjr
These reftests seem to hang quite frequently, caused by the content process
hanging on file create/open operations. See dependencies of bug 1642719 for
some examples.

Differential Revision: https://phabricator.services.mozilla.com/D77875
2020-06-03 14:17:08 +00:00
Tom Prince
86711ecee8 Bug 1641971: Use task-reference to pass the decision task id to shadow schedulers; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D77549
2020-06-03 02:35:07 +00:00
Tom Prince
581eba974b Bug 1641971: Pass mach perftest options explicitly, rather than inpsect parameters; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D77548
2020-06-03 02:35:09 +00:00
Henrik Skupin
12f6324f02 Bug 1623128 - [remote] Run Puppeteer unit tests on ubuntu18.04. r=egao
Differential Revision: https://phabricator.services.mozilla.com/D77765
2020-06-03 04:07:43 +00:00
Mike Hommey
98b889cf83 Bug 1622963 - Install python 3.6 in build docker images. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D77753
2020-06-02 03:51:14 +00:00
Narcis Beleuzu
479c45bbea Backed out 7 changesets (bug 1641971) for breaking Gecko Decision Task opt . CLOSED TREE
Backed out changeset a039e60a26d2 (bug 1641971)
Backed out changeset e7d4c490c31a (bug 1641971)
Backed out changeset f2322981b294 (bug 1641971)
Backed out changeset d123b08d2c20 (bug 1641971)
Backed out changeset 57772c0b9b3e (bug 1641971)
Backed out changeset 11a887f73dbb (bug 1641971)
Backed out changeset e9c7a59d4bc5 (bug 1641971)
2020-06-03 05:30:51 +03:00
Tom Prince
73b2e6f745 Bug 1641971: Use task-reference to pass the decision task id to shadow schedulers; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D77549
2020-06-02 18:23:11 +00:00
Tom Prince
11aedca9b2 Bug 1641971: Pass mach perftest options explicitly, rather than inpsect parameters; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D77548
2020-06-02 18:23:07 +00:00
Agi Sferro
4e005a2cbd Bug 1641711 - Update artifacts for mozlint-android. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D77544
2020-06-01 15:57:58 +00:00
emilfs
7e13ebcb0a Bug 1628289 - move documentation jobs from lint/opt to doc/opt. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D77481
2020-05-29 21:12:13 +00:00
Bogdan Tara
c72f5589b1 Backed out changeset 2c18e64584af (bug 1641131) for gecko decision task bustage CLOSED TREE 2020-05-29 18:33:23 +03:00
Andrew Halberstadt
bd5660af34 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-05-29 14:48:07 +00:00
Tarek Ziadé
77da205d14 Bug 1640627 - added android logs options r=sparky
--android-capture-logcat  - captures the logcat
--android-clear-logcat - clears the logcat on start
--android-capture-adb - captures the adb commands

Differential Revision: https://phabricator.services.mozilla.com/D77038
2020-05-28 16:42:37 +00:00
Sebastian Hengst
cc52ab7df9 Backed out 3 changesets (bug 1641131) for gecko decision task bustage. CLOSED TREE
Backed out changeset 6f3a65196d88 (bug 1641131)
Backed out changeset 2e034897a64f (bug 1641131)
Backed out changeset 48e73dbc588e (bug 1641131)
2020-05-29 10:26:05 +02:00
Ben Hearsum
1e7c40890d Bug 1641656: reduce frequency of asan debug builds to once every 10 pushes on autoland r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D77340
2020-05-28 19:41:03 +00:00
Andrew Halberstadt
edd18338b6 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-05-27 16:22:27 +00:00
Chris AtLee
3f6a61cb75 Bug 1640961: Force geckodriver to be rebuilt on release branches r=aki
Differential Revision: https://phabricator.services.mozilla.com/D77155
2020-05-27 21:58:13 +00:00
Bob Clary
4a9bf38979 Bug 1641702 - Fix unterminated string in run-on-projects for build-linux/debug, r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D77366
2020-05-28 22:28:52 +00:00
Ben Hearsum
8a3685a875 Bug 1641642: Reduce GCP build frequency to once every 25 pushes r=dhouse
Differential Revision: https://phabricator.services.mozilla.com/D77323
2020-05-28 19:56:17 +00:00
Florin Strugariu
346e44142a Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
Jamie Nicol
bfd4af6e88 Bug 1585050 - Run mochitests on android emulator with webrender enabled. r=ktaeleman
Differential Revision: https://phabricator.services.mozilla.com/D77000
2020-05-27 16:43:48 +00:00
Ben Hearsum
34915064c5 Bug 1637542: Disable {linux64,win32,win64} opt and linux64 artifact builds on autoland. r=jmaher
The opt builds were originally disabled in bug 1522111, but were re-enabled when webgpu was added.

Differential Revision: https://phabricator.services.mozilla.com/D76906
2020-05-27 17:53:38 +00:00
Dzmitry Malyshau
abaaa872a5 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-27 16:49:03 +00:00
Gregory Mierzwinski
804a5e3ba6 Bug 1641017 - Fix browsertime mobile run-on-projects settings. r=perftest-reviewers,AlexandruIonescu
This patch fixes the run-on-projects settings for browsertime mobile tests which were regressed from a bad merge (or multiple large patches landing very close to each other).

Differential Revision: https://phabricator.services.mozilla.com/D76911
2020-05-27 06:10:37 +00:00
Sylvestre Ledru
1432104c95 Bug 1641168 - Don't run mingw tests in autoland r=aryx,marco
Differential Revision: https://phabricator.services.mozilla.com/D77005
2020-05-27 09:46:30 +00:00
Bogdan Tara
6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau
67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-26 21:15:40 +00:00
Kershaw Chang
9fe6da812b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 14:30:16 +00:00
Gregory Mierzwinski
008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Butkovits Atila
f167b5c275 Backed out 6 changesets (bug 1602832) for causing perma failure at test_trr_case_sensitivity.js. CLOSED TREE
Backed out changeset 0e9c378df995 (bug 1602832)
Backed out changeset 534fedb3836e (bug 1602832)
Backed out changeset db012c05d64e (bug 1602832)
Backed out changeset ca0c207dca21 (bug 1602832)
Backed out changeset bea1f3aeea49 (bug 1602832)
Backed out changeset 2d54acd78124 (bug 1602832)
2020-05-26 13:09:07 +03:00
Kershaw Chang
917b0cce29 Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 08:35:22 +00:00
Kartikaya Gupta
4e7d703303 Bug 1638664 - Run the windows searchfox build as cross-compilation on Linux. r=asuth
This updates the task definition for the win64 searchfox job to closely match
the win64/debug task definition in taskcluster/ci/build/windows.yml. So, instead
of running the build with the mozsearch-plugin on a windows worker, it runs
on a Linux worker and does a cross-compile of windows code. The end result in
terms of searchfox artifacts is equivalent, except for absolute filename paths.
I verified that with mozsearch/mozsearch#299 and mozsearch/mozsearch-mozilla#87
in place, searchfox correctly indexes windows-only C++ and Rust code.

Differential Revision: https://phabricator.services.mozilla.com/D76721
2020-05-25 18:53:08 +00:00
Tom Prince
2bf24e6359 Bug 1639955: Use prefix for geckodriver toolchain artifacts; r=aki
We originally switched it to use just `public/` becuase iscript broke with the
extra path, but that broke out-of-tree consumers. Now that iscript is fixed,
switch it back.

Differential Revision: https://phabricator.services.mozilla.com/D76409
2020-05-22 03:38:32 +00:00
Chris AtLee
4c1292f8f8 Bug 1637381: Fix reference to old tarball for win64-clang-tidy r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D76420
2020-05-22 01:12:56 +00:00
Justin Wood
d582323fcb Bug 1640057 - Make condition profile fetch use the correct directory (en-US from shippable). r=aki
Fixes bustage from 1623355.

Differential Revision: https://phabricator.services.mozilla.com/D76424
2020-05-22 01:47:28 +00:00
Gregory Mierzwinski
c4ae7d3f70 Bug 1639374 - Disable majority of browsertime desktops. r=perftest-reviewers,Bebe
This patch disables the majority of browsertime desktop tests. First, we disable all of the tests on autoland so no more browsertime tests run there. These benchmark tests that were running there will be enabled on mozilla-central along with the rest of the tests. Finally, all browsertime tests will be further restricted to running on the linx64-shippable platform.

Differential Revision: https://phabricator.services.mozilla.com/D76212
2020-05-21 14:07:15 +00:00
Justin Wood
f8829d41ab Bug 1636637 - Remove now-redundant geckoview fat aar (non-shippable). r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74508
2020-05-21 16:30:03 +00:00
Justin Wood
b2ef4dc0b7 Bug 1636637 - Make geckoview shippable its own treeherder line and update its index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74507
2020-05-21 16:30:01 +00:00
Justin Wood
4cff028d95 Bug 1636635 - Swap devedition to shippable index and use non-Nightly treeherder symbols. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74506
2020-05-21 16:29:59 +00:00
Justin Wood
27e43125b2 Bug 1623355 - Part 8/9 - Set new shippable index's for Android shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74360
2020-05-21 16:29:48 +00:00
Justin Wood
66aebeae94 Bug 1623355 - Part 7/9 - Set treeherder symbols appropriately for Android Shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74359
2020-05-21 16:29:46 +00:00
Justin Wood
d02f213610 Bug 1623355 - Part 6/9 - Remove Android PGO build types. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74309
2020-05-21 16:29:44 +00:00
Justin Wood
897aafaf58 Bug 1623355 - Part 5/9 - Rename pgo instrumentation steps to shippable. And make condition profiles use shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74308
2020-05-21 16:29:41 +00:00
Justin Wood
15cec74666 Bug 1623355 - Part 4/9 - Point tests based on pgo builds to use shippable builds. r=aki
This needs to remove nightly attribute from android shippable.

Differential Revision: https://phabricator.services.mozilla.com/D74307
2020-05-21 16:29:37 +00:00
Justin Wood
7633ba28c6 Bug 1623355 - Part 3/9 - Rename android pgo tests to -shippable/opt and adjust run-on-platforms to cope. r=aki
This keeps all tests that were running as pgo, continuing to run in the same places.

Differential Revision: https://phabricator.services.mozilla.com/D74306
2020-05-21 16:29:34 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74930
2020-05-21 13:31:55 +00:00
Chris AtLee
b1c32e06b2 Bug 1637381: Use zstd for rust toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74929
2020-05-21 13:30:56 +00:00
Chris AtLee
d0a9a8b30b Bug 1637381: Use zstd for android toolchains r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D74928
2020-05-21 13:29:13 +00:00
Chris AtLee
ef685f3549 Bug 1637379: Optimize android toolchains r=gbrown
Create an emulator toolchain
Stop including mozboot/sdk-*.zip in our tarball

Differential Revision: https://phabricator.services.mozilla.com/D74931
2020-05-21 13:28:10 +00:00
Sylvestre Ledru
b39fdab18d Bug 1638050 - Taskcluster config: Do not run mingw jobs on m-b or m-r r=jmaher,tjr
mingw is used by Tor, we don't ship it
as they are based on esr, no need to run mingw on every uplift in m-b or m-r

Differential Revision: https://phabricator.services.mozilla.com/D76132
2020-05-20 20:38:01 +00:00
Gregory Mierzwinski
53f1f9dbb8 Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher
This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running.

Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
Gregory Mierzwinski
b43121d47b Bug 1639193 - Disable youtube AV1 raptor tests on most platforms. r=perftest-reviewers,Bebe
This patch prevents the AV1 youtube playback tests from running on platforms where they are completely failing.

Differential Revision: https://phabricator.services.mozilla.com/D75942
2020-05-20 14:34:37 +00:00
Razvan Maries
cf5da96e9f Backed out changeset 2371dd3a498e (bug 1615255) for scheduling browsertime pageload tests for every push. CLOSED TREE 2020-05-20 18:07:19 +03:00
Gregory Mierzwinski
804f13b582 Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher
This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running.

Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 12:27:28 +00:00
Atila Butkovits
b06ea134bf Backed out changeset 6c0be4e34346 (bug 1615255) for creating geckoview backlog CLOSED TREE 2020-05-20 11:54:02 +03:00
Razvan Maries
40dbaf2901 Backed out changeset c17af0632260 (bug 1616692) as per Eric's request. CLOSED TREE 2020-05-20 08:29:18 +03:00
Andrew Halberstadt
1fb24f2aaf Bug 1637383 - [taskgraph.optimize] Simply run fuzzing builds every 10th push on autoland, r=jmaher
Rather than use 'skip-unless-schedules' for fuzzing builds (which results in them running on pretty
much every push), we use the backstop. This gets them to run on a fixed schedule every 10 pushes.

Differential Revision: https://phabricator.services.mozilla.com/D74933
2020-05-19 19:29:28 +00:00
David Major
5157a6b486 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-20 07:39:23 +03:00
Dorel Luca
0a4406d5ef Backed out changeset 80ba3f3cfaf9 (bug 1616692) at dev's request. CLOSED TREE 2020-05-20 03:27:33 +03:00
Tom Prince
b2d8bbc41a Bug 1577110: Don't add default toolchain artifact directory if already specified; r=glandium
If a task has explicitly specified artifact paths, don't additionally specify
the default paths. If the task has private artifacts, having a directory
that uploads public artifacts seems like an attractive nuissance.

Differential Revision: https://phabricator.services.mozilla.com/D74200
2020-05-19 22:44:45 +00:00
Gregory Mierzwinski
7788d4b576 Bug 1639211 - Implement --perfherder-app in mozperftest Perfherder layer. r=mozperftest-reviewers,tarek
This patch adds a new --perfherder-app that can be used to specify the shorthand name of the application being tested. The choices here are limited to what the perfherder schema can accept. We also add these settings to the existing taskcluster tasks to split the perfherder data. A couple tests are also added for this new flag.

Differential Revision: https://phabricator.services.mozilla.com/D76010
2020-05-19 19:07:27 +00:00
Gregory Mierzwinski
e96baf70af Bug 1636682 - Make some small improvements to the similarity metric. r=tarek
This patch makes two main changes:
1.Calculates 2 sets of metrics, one that is calculated against it's last task (same label) and another that is calculated against the live site variant if it exists.
    i. Live site tests only have one calculated.
2. Use task label instead of building it ourselves to ensure that the smilarity metrics use the correct page load variant and make the queries more robust.

Differential Revision: https://phabricator.services.mozilla.com/D74529
2020-05-19 20:00:50 +00:00
Coroiu Cristina
44c378a7fb Backed out 5 changesets (bug 1602832) for browser-chrome failures at toolkit/mozapps/extensions/test/xpinstall/browser_doorhanger_installs.js on a CLOSED TREE
Backed out changeset 059a7f44d1a9 (bug 1602832)
Backed out changeset 2f3cc391b48a (bug 1602832)
Backed out changeset 24d1ce1b0ac9 (bug 1602832)
Backed out changeset 5ea85726cc48 (bug 1602832)
Backed out changeset ee00e846104e (bug 1602832)
2020-05-19 23:05:26 +03:00
Tarek Ziadé
7d6014b5a8 Bug 1635573 - vendor coverage r=ahal
Vendor coverage, and make sure we can run out of third_party as much as possible

Differential Revision: https://phabricator.services.mozilla.com/D74531
2020-05-19 15:04:28 +00:00
egao
42e3da4a1c Bug 1638492 - temporarily increase linux1804-64-asan/opt web-platform-tests max-run-time value to 14400 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D75995
2020-05-19 17:28:38 +00:00
Gregory Mierzwinski
093f9492b3 Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe
This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running.

Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-14 10:12:35 +00:00
Kershaw Chang
acec70fe2b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-19 12:56:50 +00:00
Tooru Fujisawa
489d2dd3de Bug 1627424 - Fix run-on-projects for SM(smoosh) jobs. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D75953
2020-05-19 14:13:09 +00:00
Andrew Halberstadt
abd500dfbc Bug 1638260 - [ci] Fix missing apostrophe causing sm-warp task not to run, r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D75945
2020-05-19 13:31:30 +00:00
Narcis Beleuzu
da52584dcb Backed out 13 changesets (bug 1636637, bug 1623355, bug 1636635, bug 1617481) buid signing failures. CLOSED TREE
Backed out changeset 1b340fa71d16 (bug 1617481)
Backed out changeset 607d65d6e48a (bug 1617481)
Backed out changeset d3b4ed0caa09 (bug 1636637)
Backed out changeset bff6ecc8bb12 (bug 1636637)
Backed out changeset 12774c2e7cfc (bug 1636635)
Backed out changeset f94e3f8179a5 (bug 1623355)
Backed out changeset 001eb6623a75 (bug 1623355)
Backed out changeset 87331010321a (bug 1623355)
Backed out changeset fd76f6bc0797 (bug 1623355)
Backed out changeset b4ffd5ccbfc7 (bug 1623355)
Backed out changeset 888df247ba6e (bug 1623355)
Backed out changeset dc3076515342 (bug 1623355)
Backed out changeset de5f01ae37fa (bug 1623355)
2020-05-18 21:37:31 +03:00
Justin Wood
7aeda5bc94 Bug 1636637 - Remove now-redundant geckoview fat aar (non-shippable). r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74508
2020-05-18 14:41:09 +00:00
Justin Wood
78e9d289ff Bug 1636637 - Make geckoview shippable its own treeherder line and update its index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74507
2020-05-18 14:41:07 +00:00
Justin Wood
2b4846d68c Bug 1636635 - Swap devedition to shippable index and use non-Nightly treeherder symbols. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74506
2020-05-18 14:41:05 +00:00
Justin Wood
85ded20c61 Bug 1623355 - Part 7/8 - Set new shippable index's for Android shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74360
2020-05-18 14:41:00 +00:00
Justin Wood
d439ce34de Bug 1623355 - Part 6/8 - Set treeherder symbols appropriately for Android Shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74359
2020-05-18 14:40:58 +00:00
Justin Wood
d3913e0de6 Bug 1623355 - Part 5/8 - Remove Android PGO build types. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74309
2020-05-18 14:40:55 +00:00
Justin Wood
ae31449283 Bug 1623355 - Part 4/8 - Rename pgo instrumentation steps to shippable. And make condition profiles use shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74308
2020-05-18 14:40:53 +00:00
Justin Wood
1b65c38785 Bug 1623355 - Part 3/8 - Point tests based on pgo builds to use shippable builds. r=aki
This needs to remove nightly attribute from android shippable.

Differential Revision: https://phabricator.services.mozilla.com/D74307
2020-05-18 14:39:32 +00:00
Justin Wood
9254b69cce Bug 1623355 - Part 2/8 - Rename android pgo tests to -shippable/opt and adjust run-on-platforms to cope. r=aki
This keeps all tests that were running as pgo, continuing to run in the same places.

Differential Revision: https://phabricator.services.mozilla.com/D74306
2020-05-18 14:39:19 +00:00
Justin Wood
0601141538 Bug 1623082 - Remove nightly attribute from asan shippable, has the side affect that we now build them on push to m-c. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D73900
2020-05-18 15:06:15 +00:00
Justin Wood
0252f4b779 Bug 1623082 - Remove nightly attribute from jobs. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D67158
2020-05-18 14:38:41 +00:00
Justin Wood
d23fa3724c Bug 1623082 - Add shippable attributes where there is nightly attributes in taskcluster/ci. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D67157
2020-05-18 14:38:19 +00:00
Justin Wood
950bc5c811 Bug 1617484 - Rename android-*-nightly to android-*-shippable. Don't actually promote yet. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D67153
2020-05-18 14:37:25 +00:00
Justin Wood
d55e3df106 Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D67152
2020-05-18 14:37:12 +00:00
Justin Wood
ec4fc52cee Bug 1617482 - Switch asan-reporter-nightly to use a shippable index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D64500
2020-05-18 14:35:48 +00:00
Justin Wood
361525ab9b Bug 1617481 - Remove android-l10n standalone. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D63946
2020-05-18 14:35:35 +00:00
Justin Wood
36ea2ece85 Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D63950
2020-05-18 14:35:28 +00:00
Justin Wood
4629d5f139 Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D63948
2020-05-18 14:34:45 +00:00
Tom Ritter
ec109c0eed Bug 1619683 - Build CodeQL Databases r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D65170
2020-05-15 04:03:39 +00:00
Sylvestre Ledru
1529fe96cb Bug 1638260 - Remove all the 'try' values in run-on-projects r=ahal
They are not doing anything as try will choose jobs anyway.
And this is misleading for developers on what it is doing.

Differential Revision: https://phabricator.services.mozilla.com/D75490
2020-05-15 15:01:19 +00:00
Andrew Halberstadt
fa3e4c8dc8 Bug 1637385 - [taskgraph] Add a 'bugbug_disperse_high' shadow scheduler, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D75402
2020-05-15 14:03:45 +00:00
Andrew Halberstadt
737a6680a6 Bug 1637385 - [taskgraph] Replace 'bugbug_debug' shadow-scheduler with 'bugbug_debug_disperse', r=marco
The bugbug_debug algorithm wasn't a very high performer, but combining it with
'disperse' may yield some interesting results.

Differential Revision: https://phabricator.services.mozilla.com/D75401
2020-05-15 14:03:10 +00:00
Andrew Halberstadt
4b335c6cd5 Bug 1637385 - [taskgraph] Remove the bugbug 'combined' flag and related shadow-scheduler, r=marco
This feature A) scheduled way too many tasks, and B) won't be that useful anyway once we
switch to manifest-scheduling.

Differential Revision: https://phabricator.services.mozilla.com/D75399
2020-05-15 14:04:56 +00:00
Sylvestre Ledru
aa185d4837 Bug 1635826 - Remove an unrelated change to mingw r=marco
Depends on D75490

Differential Revision: https://phabricator.services.mozilla.com/D75493
2020-05-15 10:16:33 +00:00
Sylvestre Ledru
bd20e19fc3 Bug 1635826 - platform docs: split the big table into smaller docs r=marco DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D75139
2020-05-15 07:54:57 +00:00
Tom Prince
0f5b2fffbb Bug 1628832: [KaiOS] Substiture trust-domain in worker alias definitions; r=Callek
To help support KaiOS, we are running the kaios project branch in automation, with a
different trust domain. Allow configuring worker aliases using `trust-domain`, so
that they worker aliases do not need to be adjusted on that branch.

Differential Revision: https://phabricator.services.mozilla.com/D75240
2020-05-14 18:46:11 +00:00
Marco Castelluccio
62701e08b4 Bug 1636902 - Run opt base-toolchains builds only on mozilla-central, and debug ones only on backstop pushes. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D75352
2020-05-14 18:35:04 +00:00
David Major
64f56df070 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-14 13:42:38 +00:00
Chris AtLee
51984d5c6c Bug 1557741: Use fetches for tests that need geckodriver. r=jgraham
Differential Revision: https://phabricator.services.mozilla.com/D74645
2020-05-13 21:13:51 +00:00
Tarek Ziadé
e5c6044cc3 Bug 1636179 - switch mpu to perftest-test r=sparky
This patch will use perftest-test on any code change in python/mozperftest

Differential Revision: https://phabricator.services.mozilla.com/D75080
2020-05-14 13:01:59 +00:00
Tarek Ziadé
c84c8756b8 Bug 1637231 - add applink tests r=acreskey
Adds tests for applink for gve/fenix on p2/g5

Differential Revision: https://phabricator.services.mozilla.com/D75097
2020-05-14 13:01:59 +00:00
Sylvestre Ledru
e1332c6207 Bug 1636494 - Move the codespell, file-perm and file-whitespace linting jobs to tier-2 r=linter-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D74435
2020-05-13 09:32:40 +00:00
Edwin Takahashi
a5cebeaa21 Bug 1608837 - perform task chunking in decision task for web-platform-tests r=ahal,jgraham
Changes:

Perform chunking of the web-platform-test in the decision task, using a runtime-weighted strategy.

Valid web-platform-tests will have its here attribute extracted to build a dictionary of test paths keyed by the top-level directory of the test path.

Once the dictionary is built, the keys are compared against test runtime data extracted from ActiveData in descending order. For all keys where test runtime information exists, chunk from the longest running key.

For remaining keys, equally distribute among all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D71417
2020-05-12 22:38:48 +00:00
Tarek Ziadé
080870795e Bug 1635136 - add a --push-to-try option r=aerickson
This patch is adding an option to push a perftest run in the CI.

It's based on :
- sparse profiles
- push_to_try
- options passed through try_task_config.json

Differential Revision: https://phabricator.services.mozilla.com/D74115
2020-05-12 21:19:48 +00:00
Razvan Maries
a9b2e6dd6f Backed out changeset 58cbc2929fb3 (bug 1616692) for reftests perma failures. CLOSED TREE 2020-05-12 21:05:56 +03:00
Razvan Maries
6740f8e47d Backed out 2 changesets (bug 1616692, bug 1635933) for reftests perma failures. CLOSED TREE
Backed out changeset 7340fb8c2297 (bug 1616692)
Backed out changeset 5695aa933c38 (bug 1635933)
2020-05-12 20:59:06 +03:00
David Major
ab03279627 Bug 1616692: followup, fix sccache task bustage. CLOSED TREE 2020-05-12 11:57:35 -04:00
Calixte Denizet
d26662bb72 Bug 1623299 - Update grcov to 0.5.14 r=marco
Update grcov and replace use of '--ignore-dir' by '--ignore'

Differential Revision: https://phabricator.services.mozilla.com/D74819
2020-05-12 09:19:49 +00:00
David Major
50334d3714 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-12 14:02:30 +00:00
Simon Fraser
e121833b24 Bug 1636697 Stop ASAN partial generation r=catlee
Due to the resource usage (over 8Gb memory per libxul), cost and low impact, stop generating partials for asan builds

Differential Revision: https://phabricator.services.mozilla.com/D74710
2020-05-11 17:20:40 +00:00
Mitchell Hentges
b8108d6064 Bug 1632429: Migrate |./mach try| to python 3; r=rstewart,ahal
|./mach try| subcommands are now compatible with both python 2 and 3.

Hand-tested with many combinations of subcommand and subcommand flags.

Updates tryselect unit tests to use Python 3.

Differential Revision: https://phabricator.services.mozilla.com/D73398
2020-05-06 22:17:14 +00:00
Wander Lairson Costa
8e66e30a42 Bug 1637000: Increase the maximum runtime for xpcshell in android emulator r=gbrown
Since we now run those tests in baremetal (which runs more parallel jobs
than packet.net), the variance of the time it takes to execute xpcshell
tests increased.

Differential Revision: https://phabricator.services.mozilla.com/D74703
2020-05-11 16:58:44 +00:00
Marian Raiciof
bdc71cf0b1 Bug 1626917 - Run talos and js-bench tests only on shippable builds r=perftest-reviewers,igoldan,ahal,sparky
Differential Revision: https://phabricator.services.mozilla.com/D69892
2020-05-07 21:10:49 +00:00
Tarek Ziadé
1c3d120187 Bug 1636684 - deactivate complex condprofs r=sparky
deactivate complex condprofs

Differential Revision: https://phabricator.services.mozilla.com/D74532
2020-05-09 15:15:45 +00:00
Chris AtLee
d08430e9aa Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-08 18:03:50 +00:00
Julian Descottes
dfdca5ac67 Bug 1619681 - Run DevTools node tests during phabricator code reviews r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D74326
2020-05-08 16:52:28 +00:00