Commit Graph

8098 Commits

Author SHA1 Message Date
Sylvestre Ledru
273a7905e6 Bug 1635826 - platform docs: Document WebRender tasks r=jbonisteel
Differential Revision: https://phabricator.services.mozilla.com/D77677
2020-06-01 15:28:13 +00:00
Sylvestre Ledru
c5994e6bba Bug 1628289 - platform docs: the Documentation jobs moved away from the linting section
Depends on D76185

Differential Revision: https://phabricator.services.mozilla.com/D77657
2020-06-01 15:28:13 +00:00
Sylvestre Ledru
58f742cd8b Bug 1635826 - platform docs: Remove the nightly platforms r=Callek
Remove in treeherder in this patch:
1568eaf479

Differential Revision: https://phabricator.services.mozilla.com/D76185
2020-06-01 11:11:22 +00:00
Edwin Takahashi
3efe2edb5c Bug 1641395 - install amd64 variants of existing i386 packages and insert additional startup parameters for pulseaudio r=jmaher
Changes:
  - install the `amd64` variants of various packages alongside `i386` packages
  - install `amd64` version of `fontconfig` instead
  - additional command line arguments for pulseaudio initialization
  - do not add configuration files to `~/.pulse` in the docker image

Differential Revision: https://phabricator.services.mozilla.com/D77512
2020-06-01 20:44:47 +00:00
Agi Sferro
4e005a2cbd Bug 1641711 - Update artifacts for mozlint-android. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D77544
2020-06-01 15:57:58 +00:00
Tom Prince
98dd864200 No bug: Don't use proxy for accessing taskcluster index; r=Callek
The index is not protected by scopes, so don't use the proxy to access it

Differential Revision: https://phabricator.services.mozilla.com/D77537
2020-05-29 21:37:46 +00:00
emilfs
7e13ebcb0a Bug 1628289 - move documentation jobs from lint/opt to doc/opt. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D77481
2020-05-29 21:12:13 +00:00
Mitchell Hentges
2a66b39bc4 Bug 1641962: Defer imports of distutils.util to ensure bootstrap can run r=rstewart,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D77516
2020-05-29 20:17:27 +00:00
Andrew Halberstadt
f0e5f6ed7b Bug 1633866 - [taskgraph] Create a system to choose how test manifests are loaded via a parameter, r=tomprince
Currently test manifests are loaded by instantiating a TestResolver and
traversing moz.build files to find manifests.

With 'manifest-scheduling', we'll want to grab the manifests directly from the
bugbug service instead. Initially we'll want to enable manifest-scheduling with
|mach try auto|, but not on autoland yet.

This patch will allow |mach try auto| to set the parameter that causes bugbug
to be used (see future commits in this bug).

Differential Revision: https://phabricator.services.mozilla.com/D76522
2020-05-29 18:51:14 +00:00
Bogdan Tara
c72f5589b1 Backed out changeset 2c18e64584af (bug 1641131) for gecko decision task bustage CLOSED TREE 2020-05-29 18:33:23 +03:00
Andrew Halberstadt
ec4749227c Bug 1641131 - [taskgraph] Make 'repackage' and 'repackage-signing' tasks copy their dependency's optimization, r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D77346
2020-05-29 14:43:29 +00:00
Andrew Halberstadt
12b0e45ee9 Bug 1641131 - [taskgraph] Make 'upload-symbols' tasks copy their dependency's optimization r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D77048
2020-05-29 14:42:51 +00:00
Andrew Halberstadt
ad57d3a5df Bug 1641131 - [taskgraph] Make 'upload-generated-sources' tasks copy their dependency's optimization r=Callek
This should ensure that they are never the cause of their dependency being scheduled
and only run when they do.

Differential Revision: https://phabricator.services.mozilla.com/D76988
2020-05-29 14:42:44 +00:00
Andrew Halberstadt
bd5660af34 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-05-29 14:48:07 +00:00
Andrew Halberstadt
1b2e865f8c Bug 1641283 - [taskgraph.optimize] Increase debug logging of optimization phase, r=tomprince
For each task, this sheds a bit of light on why it was removed or kept.

Differential Revision: https://phabricator.services.mozilla.com/D77147
2020-05-29 14:48:07 +00:00
Andrew Halberstadt
e5ab1dc839 Bug 1641283 - [taskgraph] Upload bugbug push schedules API data to an artifact rather than the log, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D77140
2020-05-29 14:39:38 +00:00
Tarek Ziadé
77da205d14 Bug 1640627 - added android logs options r=sparky
--android-capture-logcat  - captures the logcat
--android-clear-logcat - clears the logcat on start
--android-capture-adb - captures the adb commands

Differential Revision: https://phabricator.services.mozilla.com/D77038
2020-05-28 16:42:37 +00:00
Sebastian Hengst
cc52ab7df9 Backed out 3 changesets (bug 1641131) for gecko decision task bustage. CLOSED TREE
Backed out changeset 6f3a65196d88 (bug 1641131)
Backed out changeset 2e034897a64f (bug 1641131)
Backed out changeset 48e73dbc588e (bug 1641131)
2020-05-29 10:26:05 +02:00
Ben Hearsum
1e7c40890d Bug 1641656: reduce frequency of asan debug builds to once every 10 pushes on autoland r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D77340
2020-05-28 19:41:03 +00:00
Andrew Halberstadt
cd4e4a87cb Bug 1641131 - [taskgraph] Make 'upload-symbols' tasks copy their dependency's optimization r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D77048
2020-05-28 14:19:25 +00:00
Andrew Halberstadt
0cf7f3077f Bug 1641131 - [taskgraph] Make 'upload-generated-sources' tasks copy their dependency's optimization r=Callek
This should ensure that they are never the cause of their dependency being scheduled
and only run when they do.

Differential Revision: https://phabricator.services.mozilla.com/D76988
2020-05-28 14:18:21 +00:00
Andrew Halberstadt
edd18338b6 Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher
The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*'
requires a 'schedules-component' that goes ignored. Fix this.

Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-05-27 16:22:27 +00:00
Chris AtLee
3f6a61cb75 Bug 1640961: Force geckodriver to be rebuilt on release branches r=aki
Differential Revision: https://phabricator.services.mozilla.com/D77155
2020-05-27 21:58:13 +00:00
Bob Clary
4a9bf38979 Bug 1641702 - Fix unterminated string in run-on-projects for build-linux/debug, r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D77366
2020-05-28 22:28:52 +00:00
Ben Hearsum
8a3685a875 Bug 1641642: Reduce GCP build frequency to once every 25 pushes r=dhouse
Differential Revision: https://phabricator.services.mozilla.com/D77323
2020-05-28 19:56:17 +00:00
Gregory Mierzwinski
621397543d Bug 1641555 - Disable some chrome live site tests. r=perftest-reviewers,Bebe
This patch prevents some extra live site tests from running on chrome.

Differential Revision: https://phabricator.services.mozilla.com/D77255
2020-05-28 13:42:58 +00:00
Florin Strugariu
346e44142a Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
egao
45a93dd0b7 Bug 1637011 - refactor web-platform-tests chunking process in chunking.py r=ahal
Changes:

  - for web-platform-tests codepath, no longer perform filtering of the runtimes information to a list of key:value.
  - for web-platform-tests codepath, load runtimes information into an OrderedDict in order from highest to lowest runtime.
  - if any test paths remain after initial chunking by runtime information, distribute such paths across all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D76538
2020-05-27 20:21:48 +00:00
Jamie Nicol
bfd4af6e88 Bug 1585050 - Run mochitests on android emulator with webrender enabled. r=ktaeleman
Differential Revision: https://phabricator.services.mozilla.com/D77000
2020-05-27 16:43:48 +00:00
Ben Hearsum
34915064c5 Bug 1637542: Disable {linux64,win32,win64} opt and linux64 artifact builds on autoland. r=jmaher
The opt builds were originally disabled in bug 1522111, but were re-enabled when webgpu was added.

Differential Revision: https://phabricator.services.mozilla.com/D76906
2020-05-27 17:53:38 +00:00
Dzmitry Malyshau
abaaa872a5 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-27 16:49:03 +00:00
Andrew Halberstadt
a829c1fad0 Bug 1640382 - [taskgraph] Don't try to set 'schedules-component' on tasks that use 'when.files-changed', r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D76979
2020-05-27 14:37:37 +00:00
Sylvestre Ledru
03c7506984 no bug - run-on-project: Add a new note r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D76730
2020-05-27 14:24:58 +00:00
Gregory Mierzwinski
804a5e3ba6 Bug 1641017 - Fix browsertime mobile run-on-projects settings. r=perftest-reviewers,AlexandruIonescu
This patch fixes the run-on-projects settings for browsertime mobile tests which were regressed from a bad merge (or multiple large patches landing very close to each other).

Differential Revision: https://phabricator.services.mozilla.com/D76911
2020-05-27 06:10:37 +00:00
Andrew Halberstadt
cc77d57a4a Bug 1641065 - [taskgraph.optimize] Refactor the 'test_optimziation' flag to a set of projects, r=marco
Instead of a boolean, it's now a set of projects for which tasks should be removed.
If they project doesn't match the specified set it will be kept.

This ensures tasks that have these optimzers applied won't run on |mach try auto|.

Differential Revision: https://phabricator.services.mozilla.com/D76987
2020-05-27 11:52:54 +00:00
Sylvestre Ledru
1432104c95 Bug 1641168 - Don't run mingw tests in autoland r=aryx,marco
Differential Revision: https://phabricator.services.mozilla.com/D77005
2020-05-27 09:46:30 +00:00
egao
a769706988 Bug 1638183 - increase xorg client count to 2048 for ubuntu1804-test docker image r=jmaher
Changes:
  - apply an explicit increase in the number of xorg client count to 2048.
  - remove the custom.conf file as it was not making any difference in the behavior of the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D76897
2020-05-26 19:40:29 +00:00
Bogdan Tara
6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau
67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-26 21:15:40 +00:00
Tom Prince
9e8692e9d1 Bug 1639334: Set run-on-projects for gv-junit-e10s-multi correctly; r=ahal
The original patch add `run-on-projects` to `TEST_VARIANTS`, but nothing
currently looks at that. Move it into a `replace` block, which gets merged with
the task definition.

This is enough to handle this specific change, but if more control is needed
per-test, we should revisit how this is handled. Fission supports
`fission-run-on-projects` and `fission-tier` to override those values based on
the variants, but it would probably make sense to generalize those to have more
general way of specifying variant-specific configuration.

Differential Revision: https://phabricator.services.mozilla.com/D76772
2020-05-26 14:40:56 +00:00
Gregory Mierzwinski
18cd0c676d Bug 1640429 - Run v8 fetch with --force. r=jmaher
This patch attempts to fix the long-running customv8 toolchain tasks by adding a --force to the `fetch v8` call. This additional option prevents `fetch` from checking for existing .gclient files (which should never exist) to help with the long delay we are seeing in this call.

Differential Revision: https://phabricator.services.mozilla.com/D76857
2020-05-26 15:42:22 +00:00
Kershaw Chang
9fe6da812b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 14:30:16 +00:00
Andrew Halberstadt
4c80f3f36b Bug 1640890 - [ci] Use 'push-interval-10' optimization on fuzzing builds, r=bc
This has the same effect as the 'backstop' optimization except it *doesn't*
optimize tasks on non-autoland branches.

Differential Revision: https://phabricator.services.mozilla.com/D76842
2020-05-26 13:45:03 +00:00
Gregory Mierzwinski
008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Butkovits Atila
f167b5c275 Backed out 6 changesets (bug 1602832) for causing perma failure at test_trr_case_sensitivity.js. CLOSED TREE
Backed out changeset 0e9c378df995 (bug 1602832)
Backed out changeset 534fedb3836e (bug 1602832)
Backed out changeset db012c05d64e (bug 1602832)
Backed out changeset ca0c207dca21 (bug 1602832)
Backed out changeset bea1f3aeea49 (bug 1602832)
Backed out changeset 2d54acd78124 (bug 1602832)
2020-05-26 13:09:07 +03:00
Kershaw Chang
917b0cce29 Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 08:35:22 +00:00
Andrew Halberstadt
f5b5676618 Bug 1633866 - [taskgraph] Implement the ability for tasks to dynamically specify chunks, r=gbrown,jmaher
This allows tasks to opt into dynamic chunking. This means rather than define
the chunks ahead of time, in-tree manifest runtime data is used to guess how
many chunks are needed for a reasonable average task runtime (currently 20
min).

Only suites that are chunked in the taskgraph, and therefore whose manifests
are known ahead of time, can opt into this feature.

Differential Revision: https://phabricator.services.mozilla.com/D76497
2020-05-25 18:52:12 +00:00
Kartikaya Gupta
4e7d703303 Bug 1638664 - Run the windows searchfox build as cross-compilation on Linux. r=asuth
This updates the task definition for the win64 searchfox job to closely match
the win64/debug task definition in taskcluster/ci/build/windows.yml. So, instead
of running the build with the mozsearch-plugin on a windows worker, it runs
on a Linux worker and does a cross-compile of windows code. The end result in
terms of searchfox artifacts is equivalent, except for absolute filename paths.
I verified that with mozsearch/mozsearch#299 and mozsearch/mozsearch-mozilla#87
in place, searchfox correctly indexes windows-only C++ and Rust code.

Differential Revision: https://phabricator.services.mozilla.com/D76721
2020-05-25 18:53:08 +00:00
Andrew Halberstadt
3901f12775 Bug 1640580 - [taskgraph.util.bugbug] Translate WPT paths from relative source directory to WPT ids, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D76719
2020-05-25 15:44:58 +00:00
egao
8e54528b9d Bug 1637463 - support loading of runtime information for a specific suite r=ahal
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
2020-05-24 00:24:05 +00:00