Commit Graph

2850 Commits

Author SHA1 Message Date
Andrew Halberstadt
91116caeac Bug 1587206 - [lint.flake8] Enable E117 across the tree, r=sylvestre
Prevents over-indentation.

Depends on D48611

Differential Revision: https://phabricator.services.mozilla.com/D48612

--HG--
extra : moz-landing-system : lando
2019-10-10 18:51:45 +00:00
Andrew Halberstadt
2b0d90e3ad Bug 1587206 - [lint.flake8] Enable F632 across the tree, r=sylvestre
This ensures we use ==/!= to strings and ints (instead of is/is not).

Differential Revision: https://phabricator.services.mozilla.com/D48609

--HG--
extra : moz-landing-system : lando
2019-10-10 18:50:33 +00:00
Johan Lorenzo
c9a42567f6 Bug 1586748 - Re-enable build-signing for N and Ngv tasks and clean up unused fennec manifests/kinds r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D48831

--HG--
extra : moz-landing-system : lando
2019-10-10 17:53:54 +00:00
Florin Strugariu
ebb01d89e7 Bug 1585289 - Move any raptor related command from setup_talos to setup_raptor from taskcluster/taskgraph/transforms/tests.py r=perftest-reviewers,rwood,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D47748

--HG--
extra : moz-landing-system : lando
2019-10-08 14:50:45 +00:00
Chris AtLee
473f352250 Bug 1542819: Use worker aliases for signing to unbreak TB. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D48406

--HG--
extra : moz-landing-system : lando
2019-10-07 18:47:40 +00:00
Chris AtLee
4ac0642434 Bug 1542819: Use GCP signing workers r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D48199

--HG--
extra : moz-landing-system : lando
2019-10-04 15:58:27 +00:00
Nick Alexander
c46ec74815 Bug 1580356 - Remove Fennec (Firefox for Android). r=snorp,mshal
This does many things:

1) stops producing (and consuming) `FennecJNI*` JNI wrappers
2) removes the :app and :thirdparty Gradle projects
3) removes relevant pieces of the Gradle target configuration
4) updates lints
5) purges old configurations

After this commit, the `mobile/android` project/application builds
only GeckoView.

Differential Revision: https://phabricator.services.mozilla.com/D46536

--HG--
extra : moz-landing-system : lando
2019-10-04 20:55:11 +00:00
Matt Brandt
268d795936 Bug 1586067 - [iris firefox] Run only the nightly build validation tests r=KWierso
Differential Revision: https://phabricator.services.mozilla.com/D48132

--HG--
extra : moz-landing-system : lando
2019-10-03 22:34:24 +00:00
Tom Prince
7e6f319939 No bug: [taskgraph] Be more explict about the type of config in taskgraph.decision; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D48001

--HG--
extra : moz-landing-system : lando
2019-10-03 02:46:35 +00:00
Tom Prince
ecba850f66 No bug: [taskgraph] Improve the error message in Graph.transitive_closure; r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D48000

--HG--
extra : moz-landing-system : lando
2019-10-03 01:27:02 +00:00
Nick Alexander
2dc031e1d6 Bug 1585198 - Use win32-node for aarch64 Browsertime tests. r=stephendonner
Just like Bug 1582972.

Differential Revision: https://phabricator.services.mozilla.com/D47924

--HG--
extra : moz-landing-system : lando
2019-10-03 16:26:17 +00:00
Wes Kocher
c4acd9439a Bug 1573271 - Run the iris test suite in CI on Windows and Linux r=grenade,tomprince
This patch enables the iris test suite to run in CI against Windows and Linux shippable builds on mozilla-central and try. The framework is in place for Iris to run against MacOS in CI, but it is currently disabled while bootstrapping issues are sorted out.

Linux uses a new docker image based on the debian10-test parent image that installs preinstalls most of Iris's dependencies. Windows installs a few dependencies using the scoop package manager. Both then install the rest of the python dependencies via pip.

This adds a new toolchain artifact to fetch the iris_firefox git repo without touching the outside network.

Differential Revision: https://phabricator.services.mozilla.com/D41638

--HG--
extra : moz-landing-system : lando
2019-10-02 01:58:31 +00:00
Geoff Brown
7510bc4913 Bug 1582881 - Promote select fission tests to tier 1; r=ahal
This changes certain fission tests to run tier 1 and start running on integration branches:
  linux64-qr/debug mochitest-plain
  linux64-qr/debug mochitest-media
  linux64-qr/debug mochitest-webgl*
  linux64/debug browser-chrome
All other fission tests continue to run as tier 2.

Differential Revision: https://phabricator.services.mozilla.com/D47295

--HG--
extra : moz-landing-system : lando
2019-09-27 01:25:33 +00:00
Stephen Donner
3b89e2688e Bug 1581580: Add limited set of --browsertime Raptor tests to make it easier to smoke-test changes. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D47562

--HG--
extra : moz-landing-system : lando
2019-10-01 17:48:29 +00:00
Mihai Tabara
b2c81917c8 Bug 1580478 - enable GCP balrogworkers.r=catlee a=release
Switch balrogworkers from AWS to GCP

Differential Revision: https://phabricator.services.mozilla.com/D47606

--HG--
extra : moz-landing-system : lando
2019-09-30 19:01:22 +00:00
Chris AtLee
4a7ce514be Bug 1540276: Migrate authenticode signing to autograph r=Callek,mshal
Differential Revision: https://phabricator.services.mozilla.com/D47114

--HG--
extra : moz-landing-system : lando
2019-09-30 13:57:32 +00:00
Gregory Mierzwinski
cecd7f36da Bug 1583650 - Add general performance testing cron task. r=perftest-reviewers,davehunt
This patch modifies the existing android_power_testing cron task to make it a more general performance testing task that runs a set of tests 3 times a week. The tests that will be running in this task are all chrome, chromium, android CPU+memory, and android power tests.

Differential Revision: https://phabricator.services.mozilla.com/D47140

--HG--
extra : moz-landing-system : lando
2019-09-27 15:51:46 +00:00
Brindusan Cristian
a0b352e6c9 Backed out changeset 666a99f27c23 (bug 1582881) for high-frequency mochitest failures at test_ext_contentscript_about_blank.html. CLOSED TREE
--HG--
extra : histedit_source : fc3f3d671547209ffe242940e2c5ef1777a2c33e
2019-09-27 04:06:15 +03:00
Gregory Mierzwinski
f62dd43b6a Bug 1575575 - Add fullscreen and windowed youtube-playback power tests. r=perftest-reviewers,stephendonner,dhouse,rwood
This patch adds fullscreen and windowed youtube tests for the V9 and H264 encoding at 1080p30 and 1080p60. Each subtest runs for 20 page cycles which amounts to about 5 minutes each. It also begins adding these to power test tasks running on the macosx-1014 reference hardware.

Differential Revision: https://phabricator.services.mozilla.com/D45067

--HG--
extra : moz-landing-system : lando
2019-09-26 22:18:54 +00:00
Geoff Brown
9859c641fc Bug 1582881 - Promote select fission tests to tier 1; r=ahal
This changes certain fission tests to run tier 1 and start running on integration branches:
  linux64-qr/debug mochitest-plain
  linux64-qr/debug mochitest-media
  linux64-qr/debug mochitest-webgl*
  linux64/debug browser-chrome
All other fission tests continue to run as tier 2.

Differential Revision: https://phabricator.services.mozilla.com/D47295

--HG--
extra : moz-landing-system : lando
2019-09-26 21:52:07 +00:00
Kris Maglione
e57df5ef8b Bug 1583386: Part 2 - Enable DocumentChannel in mochitest Fission runs. r=mattwoodrow,ahal
Differential Revision: https://phabricator.services.mozilla.com/D47009

--HG--
extra : moz-landing-system : lando
2019-09-26 20:02:44 +00:00
Kris Maglione
790387cced Bug 1583386: Part 1 - Enable serviceworker rewrite in mochitest Fission runs. r=mattwoodrow,ahal
Differential Revision: https://phabricator.services.mozilla.com/D47008

--HG--
extra : moz-landing-system : lando
2019-09-26 19:51:28 +00:00
Nick Alexander
3bf9f51b30 Bug 1575014 - Fix ./mach try --gecko-profile .... r=tomprince,ahal
An error crept in, resulting in:
```
[task ...] InterpreterError: InterpreterError: infix: [..] expects integer [..] integer
```

At some point, `suite` became a string name and not an object with a
string `name` member.  However, in the interim, the diversity of
`command` structures has made the template approach untenable.
Therefore, this commit converts `GeckoProfile` to a `TryConfig`.  The
existing test clearly wasn't helpful, and it doesn't really map to a
`TryConfig` test, so it was removed.

Differential Revision: https://phabricator.services.mozilla.com/D41603

--HG--
extra : moz-landing-system : lando
2019-09-25 20:18:17 +00:00
Mihai Tabara
64ed1642ed Bug 1581149 - switch to new GCP shipitworkers. r=catlee a=release
Differential Revision: https://phabricator.services.mozilla.com/D46768

--HG--
extra : moz-landing-system : lando
2019-09-24 12:09:24 +00:00
Geoff Brown
66b180e290 Bug 1577037 - Stop running all Fennec performance tests; r=perftest-reviewers,stephendonner,sparky,Bebe
Stop running all Raptor tests that run against Fennec. Raptor tests running
against geckoview and geckoview products continues.

Differential Revision: https://phabricator.services.mozilla.com/D44511

--HG--
extra : moz-landing-system : lando
2019-09-23 16:49:29 +00:00
Mike Shal
7edb453ba0 Bug 1582221 - Use geckoview-androidTest instead of Fennec for Android PGO; r=snorp
Differential Revision: https://phabricator.services.mozilla.com/D46505

--HG--
extra : moz-landing-system : lando
2019-09-20 15:17:41 +00:00
Mike Hommey
207ea86b60 Bug 1578963 - Enable run-task on aarch64 laptop workers. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D39100

--HG--
extra : moz-landing-system : lando
2019-09-05 02:45:12 +00:00
Tarek Ziadé
c6736e8bc9 Bug 1581819 - flip the cron job to build conditioned profiles daily r=dustin
Adds a cron to run the conditioned profiles

Differential Revision: https://phabricator.services.mozilla.com/D46148

--HG--
extra : moz-landing-system : lando
2019-09-17 14:23:55 +00:00
Chris AtLee
c7e39a09e2 Bug 1540276: Switch to autograph for windows signing r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D43829

--HG--
extra : moz-landing-system : lando
2019-08-29 01:18:27 +00:00
Mihai Tabara
cfc233eac3 Bug 1537713 - switch Devedition to declarative artifacts.r=sfraser a=release
Switch Devedition to declarative artifacts

Differential Revision: https://phabricator.services.mozilla.com/D45259

--HG--
extra : moz-landing-system : lando
2019-09-11 15:46:14 +00:00
Johan Lorenzo
d470201871 Bug 1573751 - Fix geckoview nightly signing on try r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D45037

--HG--
extra : moz-landing-system : lando
2019-09-10 13:38:47 +00:00
Wander Lairson Costa
1e4f81ec22 Bug 1572236: Support sccache in Google Storage r=chmanchester,dustin
With the migration from AWS to GCP, we also need to migrate sccache
buckets from S3 to Google Storage.

The problem is how we deal with regions, since there isn't an exact
correspondence on the region names between the two cloud providers.

To make the transition smoother, docker-worker (and soon generic-worker)
provides a new environment variable called TASKCLUSTER_WORKER_LOCATION,
with information about the cloud provider the task is running on. Using
this new variable, we configure sccache to use the corresponding storage
service of the cloud provider where the task runs.

The bucket names in Google Storage are shorter because GCS imposes a
limit of 30 characteres for the names.

Ref: https://github.com/taskcluster/taskcluster-rfcs/pull/148/files

Differential Revision: https://phabricator.services.mozilla.com/D44845

--HG--
extra : moz-landing-system : lando
2019-09-09 16:51:42 +00:00
Rail Aliiev
9b09aece8c Bug 1579476 - Switch to new GCP beetmover workers r=mtabara
Switch to new GCP beetmover workers

Differential Revision: https://phabricator.services.mozilla.com/D45045

--HG--
extra : moz-landing-system : lando
2019-09-07 00:00:25 +00:00
Edwin Takahashi
e40edba52f Bug 1565332 - add option to toggle linux desktop tests to run on debian 10 r=ahal
Adds command line option for developers to run tests against experimental debian 10 image (from D42597).

This is an experimental flag and will be removed once debian 10 image is used for production CI tests.

Differential Revision: https://phabricator.services.mozilla.com/D44236

--HG--
extra : moz-landing-system : lando
2019-09-07 01:07:23 +00:00
Bob Clary
3d9a65450d Bug 1579446 - [test isolation] Improve test detection in isolate_test.py action, r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D45068

--HG--
extra : moz-landing-system : lando
2019-09-06 20:54:38 +00:00
Nathan Froyd
fa2fdbb6ff Bug 1579483 - add scopes for private toolchain artifacts in interactive tasks; r=dustin
Without these scopes, we can't build Android configs from interactive
tasks, because we can't fetch the NDK and SDK from their toolchain tasks.

Differential Revision: https://phabricator.services.mozilla.com/D45048

--HG--
extra : moz-landing-system : lando
2019-09-06 19:12:37 +00:00
Nick Alexander
19d52d9edc Bug 1566174 - Part 2: Add browsertime dependencies to Raptor tasks when --browsertime flag is present. r=rwood,tomprince
This commit prepares the decks for turning specific Raptor tasks into
Raptor + browsertime tasks.  The `--browsertime` flag to `mach try
...` flips the switch; eventually, the Raptor harness will recognize
the `--browsertime` flag and use browsertime to perform the pageload
measurements.

To run browsertime, we need:

1) Node.js
2) the browsertime `node_modules` (provided by the
   `toolchain-browsertime` task)
3) ffmpeg (for producing videos from captured frames)
4) chromedriver (in the future, when targeting Chrome/Chromium)
5) geckodriver (provided by the `toolchain-*-geckodriver` tasks)
6) `PATH` configured

This commit arranges those things.

Since the configuration varies by test platform, and eventually we
expect the changes implemented by the flag to be moved into YAML task
definitions, we elect to use `by-test-platform` conditionals as much
as possible.  The end expression is pleasant, thanks to
`evaluate_keyed_by`.

Handling PATH, however, is a rabbit hole.  At this time, it's not
possible to use `fetch` task repackaging, because `releng-hardware`
doesn't support `zstandard` (Bug 1576244) and there's no appetite to
avoid `zstandard` entirely (Bug 1576698).  Generally PATH is
configured using `mozharness` configuration files, which can execute
arbitrary Python and configure the PATH only for browsertime jobs.
However, the Raptor mozharness script itself runs the Raptor harness
in a stripped down environment, throwing away modifications to PATH.
It's not clear what impacts changing that has, so we leave it alone,
and add a `--browsertime-ffmpeg` flag and custom handling in the
Raptor harness.  This can transition smoothly into a browsertime flag
(so that the PATH doesn't need to be set at all) and into a unified
interface for Raptor and `mach browsertime` to configure the
browsertime execution environment.

Differential Revision: https://phabricator.services.mozilla.com/D38781

--HG--
extra : moz-landing-system : lando
2019-09-06 18:53:49 +00:00
Andrew Halberstadt
a62a7b265e Bug 1578510 - [taskgraph] Add pushdate.{build_date}.latest route to generic v2 index, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D44523

--HG--
extra : moz-landing-system : lando
2019-09-05 21:11:45 +00:00
Mike Hommey
b9fe30993d Bug 1543893 - Set TASKCLUSTER_ROOT_URL on workers that don't set it. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D39151

--HG--
extra : moz-landing-system : lando
2019-07-26 21:55:27 +00:00
Geoff Brown
be67d46e14 Bug 1577037 - Stop running all Fennec functional tests; r=bc
Stop running all Fennec functional (non-performance) tests:
 - stop running all Android 4.3 tests
 - switch android-em-7 cppunit and android-hw jittest from the Fennec apk to the
   geckoview apk (no difference in behavior expected)
 - stop running Android 7.0 marionette tests, since they also run against Fennec
 - remove android-em-4.* references from taskcluster configs
 - remove android instance: extra-large references from taskcluster configs,
   since they only affect aws, which is no longer used for Android

Android-hw raptor tests running against Fennec remain; I will prepare a separate
patch for those.

Differential Revision: https://phabricator.services.mozilla.com/D43684

--HG--
extra : moz-landing-system : lando
2019-09-04 15:58:36 +00:00
Andrew Halberstadt
4412fb9d2d Bug 1572089 - [ci] Migrate Win10-64 virtual-with-gpu tasks to a cheaper workertype, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D43820

--HG--
extra : moz-landing-system : lando
2019-09-04 17:32:42 +00:00
Andrew Halberstadt
b7728b502a Bug 1572089 - [taskgraph] Remove unused WINDOWS_WORKER_TYPES from tests transform, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D43819

--HG--
extra : moz-landing-system : lando
2019-09-04 17:32:35 +00:00
Barret Rennie
a9de9d21e2 Bug 1563090 - Fetch visual metrics task definition from a template r=nalexander,tomprince,ahal
The `./mach try {fuzzy,chooser}` commands now support a `--visual-metrics-jobs`
option which can be used to pass the job descriptions to the visual-metrics
task.

Differential Revision: https://phabricator.services.mozilla.com/D41878

--HG--
extra : moz-landing-system : lando
2019-09-04 16:42:45 +00:00
Narcis Beleuzu
3fca079bae Backed out 2 changesets (bug 1563090) for Linting failure on run-visual-metrics.py . CLOSED TREE
Backed out changeset 1b2389663474 (bug 1563090)
Backed out changeset 9071c90b2e84 (bug 1563090)
2019-09-04 19:03:58 +03:00
Barret Rennie
08de8af0da Bug 1563090 - Fetch visual metrics task definition from a template r=nalexander,tomprince,ahal
The `./mach try {fuzzy,chooser}` commands now support a `--visual-metrics-jobs`
option which can be used to pass the job descriptions to the visual-metrics
task.

Differential Revision: https://phabricator.services.mozilla.com/D41878

--HG--
extra : moz-landing-system : lando
2019-09-04 13:16:57 +00:00
Andrew Halberstadt
af43092d2c Bug 1576957 - [ci] Stop running raptor with fission on Ash; run normal raptor tasks instead, r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D43809

--HG--
extra : moz-landing-system : lando
2019-09-04 15:23:20 +00:00
Justin Wood
f950d9f8a9 Bug 1578289 - fix addon beetmoving failure in declarative artifacts too. r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D44401

--HG--
extra : moz-landing-system : lando
2019-09-03 09:09:22 +00:00
Justin Wood
bc8f1f8edd Bug 1578263 - Use release-type in param eval rather than release-level. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D44392

--HG--
extra : moz-landing-system : lando
2019-09-02 16:08:40 +00:00
Andrew Halberstadt
8f5dbf7720 Bug 1576957 - [ci] Turn off shippable builds and tests on Ash, r=gbrown
Depends on D43807

Differential Revision: https://phabricator.services.mozilla.com/D43808

--HG--
extra : moz-landing-system : lando
2019-08-28 21:40:20 +00:00
Andrew Halberstadt
05f6b0f313 Bug 1576957 - [ci] Turn off QuantumRender tasks on Ash, r=gbrown
Depends on D43806

Differential Revision: https://phabricator.services.mozilla.com/D43807

--HG--
extra : moz-landing-system : lando
2019-08-28 22:06:01 +00:00