Commit Graph

8063 Commits

Author SHA1 Message Date
Sylvestre Ledru
1432104c95 Bug 1641168 - Don't run mingw tests in autoland r=aryx,marco
Differential Revision: https://phabricator.services.mozilla.com/D77005
2020-05-27 09:46:30 +00:00
egao
a769706988 Bug 1638183 - increase xorg client count to 2048 for ubuntu1804-test docker image r=jmaher
Changes:
  - apply an explicit increase in the number of xorg client count to 2048.
  - remove the custom.conf file as it was not making any difference in the behavior of the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D76897
2020-05-26 19:40:29 +00:00
Bogdan Tara
6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau
67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-26 21:15:40 +00:00
Tom Prince
9e8692e9d1 Bug 1639334: Set run-on-projects for gv-junit-e10s-multi correctly; r=ahal
The original patch add `run-on-projects` to `TEST_VARIANTS`, but nothing
currently looks at that. Move it into a `replace` block, which gets merged with
the task definition.

This is enough to handle this specific change, but if more control is needed
per-test, we should revisit how this is handled. Fission supports
`fission-run-on-projects` and `fission-tier` to override those values based on
the variants, but it would probably make sense to generalize those to have more
general way of specifying variant-specific configuration.

Differential Revision: https://phabricator.services.mozilla.com/D76772
2020-05-26 14:40:56 +00:00
Gregory Mierzwinski
18cd0c676d Bug 1640429 - Run v8 fetch with --force. r=jmaher
This patch attempts to fix the long-running customv8 toolchain tasks by adding a --force to the `fetch v8` call. This additional option prevents `fetch` from checking for existing .gclient files (which should never exist) to help with the long delay we are seeing in this call.

Differential Revision: https://phabricator.services.mozilla.com/D76857
2020-05-26 15:42:22 +00:00
Kershaw Chang
9fe6da812b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 14:30:16 +00:00
Andrew Halberstadt
4c80f3f36b Bug 1640890 - [ci] Use 'push-interval-10' optimization on fuzzing builds, r=bc
This has the same effect as the 'backstop' optimization except it *doesn't*
optimize tasks on non-autoland branches.

Differential Revision: https://phabricator.services.mozilla.com/D76842
2020-05-26 13:45:03 +00:00
Gregory Mierzwinski
008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Butkovits Atila
f167b5c275 Backed out 6 changesets (bug 1602832) for causing perma failure at test_trr_case_sensitivity.js. CLOSED TREE
Backed out changeset 0e9c378df995 (bug 1602832)
Backed out changeset 534fedb3836e (bug 1602832)
Backed out changeset db012c05d64e (bug 1602832)
Backed out changeset ca0c207dca21 (bug 1602832)
Backed out changeset bea1f3aeea49 (bug 1602832)
Backed out changeset 2d54acd78124 (bug 1602832)
2020-05-26 13:09:07 +03:00
Kershaw Chang
917b0cce29 Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 08:35:22 +00:00
Andrew Halberstadt
f5b5676618 Bug 1633866 - [taskgraph] Implement the ability for tasks to dynamically specify chunks, r=gbrown,jmaher
This allows tasks to opt into dynamic chunking. This means rather than define
the chunks ahead of time, in-tree manifest runtime data is used to guess how
many chunks are needed for a reasonable average task runtime (currently 20
min).

Only suites that are chunked in the taskgraph, and therefore whose manifests
are known ahead of time, can opt into this feature.

Differential Revision: https://phabricator.services.mozilla.com/D76497
2020-05-25 18:52:12 +00:00
Kartikaya Gupta
4e7d703303 Bug 1638664 - Run the windows searchfox build as cross-compilation on Linux. r=asuth
This updates the task definition for the win64 searchfox job to closely match
the win64/debug task definition in taskcluster/ci/build/windows.yml. So, instead
of running the build with the mozsearch-plugin on a windows worker, it runs
on a Linux worker and does a cross-compile of windows code. The end result in
terms of searchfox artifacts is equivalent, except for absolute filename paths.
I verified that with mozsearch/mozsearch#299 and mozsearch/mozsearch-mozilla#87
in place, searchfox correctly indexes windows-only C++ and Rust code.

Differential Revision: https://phabricator.services.mozilla.com/D76721
2020-05-25 18:53:08 +00:00
Andrew Halberstadt
3901f12775 Bug 1640580 - [taskgraph.util.bugbug] Translate WPT paths from relative source directory to WPT ids, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D76719
2020-05-25 15:44:58 +00:00
egao
8e54528b9d Bug 1637463 - support loading of runtime information for a specific suite r=ahal
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
2020-05-24 00:24:05 +00:00
Mihai Alexandru Michis
74ff68a9a5 Backed out 3 changesets (bug 1637463) for causing bc jobs to timeout.
CLOSED TREE

Backed out changeset 93efb53380c2 (bug 1637463)
Backed out changeset 5c8ccda5f1b1 (bug 1637463)
Backed out changeset a5fc1b604238 (bug 1637463)
2020-05-23 02:35:26 +03:00
egao
d40fc31a1b Bug 1637463 - support loading of runtime information for a specific suite r=ahal
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
2020-05-22 18:31:47 +00:00
Marco Castelluccio
30cfe57424 Bug 1640047 - Don't take into account bugbug's known tasks if they are likely wrong. r=ahal DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D76418
2020-05-22 15:28:43 +00:00
Andrew Halberstadt
0591e31c1f Bug 1639349 - [ci] Set up a SCHEDULES rule to exclude non-webrender tests on webrender-only pushes, r=gbrown
Depends on D76433

Differential Revision: https://phabricator.services.mozilla.com/D76434
2020-05-22 14:03:46 +00:00
Andrew Halberstadt
e6fc2d3678 Bug 1639349 - [taskgraph] Set schedules-component for test kind in an independent transform, r=gbrown
Depends on D76306

Differential Revision: https://phabricator.services.mozilla.com/D76433
2020-05-22 14:03:46 +00:00
Ben Hearsum
d7624bd580 Bug 1638014: blacklist shippable tests from try when there is an opt version of the test available r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D76012
2020-05-22 17:45:06 +00:00
Rob Wu
27981af497 Bug 1636158 - Update the addons-mlbf.bin attachment via periodic_file_updates.sh r=sfraser
Tested by running the following code and verifying that the script runs
successfully and generates a reasonable diff with the latest metadata
and matching attachment content:

```
$ cd taskcluster/docker/periodic-updates/
$ tar -czf- -s "#$(git rev-parse --show-cdup)#topsrcdir/#" . $(awk -v d="$(git rev-parse --show-cdup)" '/^# %include/{print d$3}' Dockerfile) | docker build - -t hsts-local
$ docker run -e DO_REMOTE_SETTINGS=1 -e PRODUCT="firefox" -e BRANCH="mozilla-central" -e USE_MOZILLA_CENTRAL=1 hsts-local
```

After that, I opened a shell in the container, built Firefox and ran the
following test, to confirm that the updated records are used correctly:

```
mach test toolkit/mozapps/extensions/test/xpcshell/rs-blocklist/test_blocklist_mlbf_dump.js
```

Differential Revision: https://phabricator.services.mozilla.com/D76158
2020-05-22 01:37:37 +00:00
Tom Prince
2bf24e6359 Bug 1639955: Use prefix for geckodriver toolchain artifacts; r=aki
We originally switched it to use just `public/` becuase iscript broke with the
extra path, but that broke out-of-tree consumers. Now that iscript is fixed,
switch it back.

Differential Revision: https://phabricator.services.mozilla.com/D76409
2020-05-22 03:38:32 +00:00
Tom Prince
9703222150 Bug 1639955: Include toolchain-artifact in the cached-task digest; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D76410
2020-05-22 03:38:29 +00:00
Chris AtLee
4c1292f8f8 Bug 1637381: Fix reference to old tarball for win64-clang-tidy r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D76420
2020-05-22 01:12:56 +00:00
Justin Wood
d582323fcb Bug 1640057 - Make condition profile fetch use the correct directory (en-US from shippable). r=aki
Fixes bustage from 1623355.

Differential Revision: https://phabricator.services.mozilla.com/D76424
2020-05-22 01:47:28 +00:00
Sylvestre Ledru
27f8422c60 Bug 1635826 - platform docs: improve the list of platforms r=marco DONTBUILD
* document more jobs
* document when some are running
* remove some old jobs
  - stylo seq a9c044b771
  - webrender pgo https://github.com/mozilla/treeherder/pull/6437

Differential Revision: https://phabricator.services.mozilla.com/D76184
2020-05-21 09:16:12 +00:00
Bob Clary
5d2b7338b8 Bug 1639886 - Allow the Backstop optimization strategy to be used outside of the test optimization, r=ahal.
Differential Revision: https://phabricator.services.mozilla.com/D76350
2020-05-21 20:53:20 +00:00
Andrew Halberstadt
5ad7af589e Bug 1633866 - [taskgraph] Refactor logic around manifest chunking, r=egao
This sets things up to be a little bit easier and cleaner to modify going
forward. The taskgraph before/after this change is identical.

Differential Revision: https://phabricator.services.mozilla.com/D74452
2020-05-21 15:58:24 +00:00
Justin Wood
e49ff70dad Followup to Bug 1623355 - Part 1, specifically fix typo in 'nightly'. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D76352
2020-05-21 18:07:22 +00:00
Chris AtLee
b34b110320 Bug 1637381: Install zstandard on linting images on a CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D76348
2020-05-21 17:31:01 +00:00
Gregory Mierzwinski
c4ae7d3f70 Bug 1639374 - Disable majority of browsertime desktops. r=perftest-reviewers,Bebe
This patch disables the majority of browsertime desktop tests. First, we disable all of the tests on autoland so no more browsertime tests run there. These benchmark tests that were running there will be enabled on mozilla-central along with the rest of the tests. Finally, all browsertime tests will be further restricted to running on the linx64-shippable platform.

Differential Revision: https://phabricator.services.mozilla.com/D76212
2020-05-21 14:07:15 +00:00
Justin Wood
6c368aa658 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
2020-05-21 16:31:04 +00:00
Justin Wood
3f24c1f0f0 Bug 1617481 - Remove nightly index's. r=aki
They only really worked for promoted builds when the build was generated on the nightly cron anyway.

Differential Revision: https://phabricator.services.mozilla.com/D74509
2020-05-21 16:30:11 +00:00
Justin Wood
f8829d41ab Bug 1636637 - Remove now-redundant geckoview fat aar (non-shippable). r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74508
2020-05-21 16:30:03 +00:00
Justin Wood
b2ef4dc0b7 Bug 1636637 - Make geckoview shippable its own treeherder line and update its index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74507
2020-05-21 16:30:01 +00:00
Justin Wood
4cff028d95 Bug 1636635 - Swap devedition to shippable index and use non-Nightly treeherder symbols. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74506
2020-05-21 16:29:59 +00:00
Justin Wood
ec5c1d56da Bug 1623355 - Part 9/9 - Remove 'pgo' support from performance testing target tasks. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74961
2020-05-21 16:29:51 +00:00
Justin Wood
27e43125b2 Bug 1623355 - Part 8/9 - Set new shippable index's for Android shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74360
2020-05-21 16:29:48 +00:00
Justin Wood
66aebeae94 Bug 1623355 - Part 7/9 - Set treeherder symbols appropriately for Android Shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74359
2020-05-21 16:29:46 +00:00
Justin Wood
d02f213610 Bug 1623355 - Part 6/9 - Remove Android PGO build types. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74309
2020-05-21 16:29:44 +00:00
Justin Wood
897aafaf58 Bug 1623355 - Part 5/9 - Rename pgo instrumentation steps to shippable. And make condition profiles use shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74308
2020-05-21 16:29:41 +00:00
Justin Wood
15cec74666 Bug 1623355 - Part 4/9 - Point tests based on pgo builds to use shippable builds. r=aki
This needs to remove nightly attribute from android shippable.

Differential Revision: https://phabricator.services.mozilla.com/D74307
2020-05-21 16:29:37 +00:00
Justin Wood
7633ba28c6 Bug 1623355 - Part 3/9 - Rename android pgo tests to -shippable/opt and adjust run-on-platforms to cope. r=aki
This keeps all tests that were running as pgo, continuing to run in the same places.

Differential Revision: https://phabricator.services.mozilla.com/D74306
2020-05-21 16:29:34 +00:00
Justin Wood
f9bb21ade0 Bug 1623355 - Part 2/9 - Add shippable as a valid target for performance test cron targets. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74960
2020-05-21 16:31:23 +00:00
Tom Prince
24d507a5bc Bug 1623355 - Part 1/9 - Set geckoview artifact names to match mozharness on non-release branches; r=Callek
For shippable builds on non-release branches, mozharness defaults to using
`nightly-{project}`. The update channel is encoded in the artifact filenames
for non release-channel builds, so update taskgraph to generate the correct
artifact names on non-release branches.

Differential Revision: https://phabricator.services.mozilla.com/D76274
2020-05-21 16:32:06 +00:00
Marco Castelluccio
39d348c1c5 Bug 1639812 - Don't apply 'skip-unless-schedules' when overriding 'build-fuzzing' strategy. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D76306
2020-05-21 13:38:57 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74930
2020-05-21 13:31:55 +00:00
Chris AtLee
b1c32e06b2 Bug 1637381: Use zstd for rust toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74929
2020-05-21 13:30:56 +00:00
Chris AtLee
72cc360dcd Bug 1637381: Use python3 for repack_rust.py r=glandium
repack_rust.py was the only toolchain build using a python script directly. we
don't need it to use the `mach python` wrapper, so remove that special casing
from the transform.

Differential Revision: https://phabricator.services.mozilla.com/D75702
2020-05-21 13:30:54 +00:00