Commit Graph

1316 Commits

Author SHA1 Message Date
Edwin Takahashi
5d26f83a10 Bug 1602863 - update linux64 platform regex in yaml files to be compatible with linux64 and linux1804 strings r=gbrown
Changes:

Update `linux64` regex to in yaml files for suites that have been migrated over to run on ubuntu1804.

Current naming convention: `linux64-asan/opt`.
New naming convention: `linux1804-64-asan/opt`
Future (potential) convention: `linux2004-64-asan/opt`

Using the `linux.*64` regex will result in a match for all three of the names above. This will ensure that we don't need to constantly update the regex for each new version, while being specific enough.

Differential Revision: https://phabricator.services.mozilla.com/D59572

--HG--
extra : moz-landing-system : lando
2020-01-14 17:35:00 +00:00
Rob Wood
ea5d2d626d Bug 1609150 - Turn off failing visual metrics jobs for fennec r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D59888

--HG--
extra : moz-landing-system : lando
2020-01-14 18:43:19 +00:00
Geoff Brown
d8063e54fb Bug 1607961 - Move some android-hw P2 tests from arm7 to aarch64; r=bc
Move all mochitest, crashtests, and plain reftests currently running on android-hw-p2
against arm7 builds to aarch64 builds (the great majority of geckoview users on P2 are
now using aarch64 builds -- we want to stay relevant). jittest and jsreftest continue
to run on arm7, providing essential arm7 support; aarch64 coverage continues to be
provided by SM(p) on Windows/aarch64 laptops.

Differential Revision: https://phabricator.services.mozilla.com/D59804

--HG--
extra : moz-landing-system : lando
2020-01-14 16:29:48 +00:00
Edwin Takahashi
d70fe8bfb8 Bug 1602863 - run mochitest-remote on linux1804 (including ccov) and deactivate on linux64 r=jmaher
Changes:

Run `mochitest-remote` with ubuntu1804, including the `ccov` platform variant.
Disable the test suite from running on ubuntu1604 under `linux64` label, including the `ccov` variant.

Differential Revision: https://phabricator.services.mozilla.com/D59585

--HG--
extra : moz-landing-system : lando
2020-01-14 01:43:54 +00:00
Edwin Takahashi
eb3fb8bd66 Bug 1608885 - correct accidental disabling of wr tests for windows r=gbrown
Changes:

Restore the original state of `web-platform-tests` test set in `test-sets.yml`.
Changes in D59403 had the unintended side effect of removing `web-platform-tests-reftests` and `web-platform-tests-crashtests` from the main test set, which was used for both `linux64` and `windows` platforms.

`position-sticky-scroll-with-clip-and-abspos-ref.html` was failing because the test no longer needed a `fuzzy` annotation for `webrender` variant.

Differential Revision: https://phabricator.services.mozilla.com/D59752

--HG--
extra : moz-landing-system : lando
2020-01-13 21:31:53 +00:00
Rob Wood
73c92a684c Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D59737

--HG--
extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
Razvan Maries
55782f1de7 Backed out 37442417fc24 (Bug 1602863) as per edwin's request. CLOSED TREE 2020-01-13 20:31:03 +02:00
Edwin Takahashi
7b485ae170 Bug 1608251 - re-enable linux1804-64-ccov variant and migrate mochitest-webgl/awsy tests r=jmaher
Changes:

Re-enable the `test-linux1804-ccov/opt` variant.
Create a new `linux1804-ccov-tests` test set.

Add `awsy` to ubuntu1804 and remove it correspondingly from ubuntu1604.
Add `mochitest-webgl` tests to ubuntu1804 an remove it from ubunt1604.

Differential Revision: https://phabricator.services.mozilla.com/D59593

--HG--
extra : moz-landing-system : lando
2020-01-13 17:10:06 +00:00
Razvan Maries
0bf2848479 Backed out changeset ba5a1a2c62f6 (bug 1602863) for perma fails on position-sticky-scroll-with-clip-and-abspos.html. 2020-01-11 11:31:08 +02:00
Mihai Alexandru Michis
227405cbbd Backed out changeset fd1001cea260 (bug 1607344) for causing wpt failures regarding single_stylo_traversal.
CLOSED TREE
2020-01-11 09:55:56 +02:00
Stephen Donner
37fa3ade04 Fix Bug 1607344; remove legacy stylo-seq linux64 jobs. r=erahm,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59466

--HG--
extra : moz-landing-system : lando
2020-01-11 07:20:50 +00:00
Edwin Takahashi
b78715faad Bug 1602863 - run web-platform-tests on ubuntu1804 except ccov r=jmaher
Changes:

Rename the `web-platform-tests-1804` set to `web-platform-tests`.

Create a new set with name `web-platform-tests-wdspec` which will hold only the `wdspec` test to be run on ubuntu1604.

Use the now-named `web-platform-tests` set to be used for ubuntu1804 platforms.

Differential Revision: https://phabricator.services.mozilla.com/D59449

--HG--
extra : moz-landing-system : lando
2020-01-11 01:33:53 +00:00
Daniel Varga
9eb6230a1d Backed out 2 changesets (bug 1602108, bug 1602863) for causing mochitest failure at browser/browser_accessibility_panel_toolbar_pref_scroll.js
CLOSED TREE

Backed out changeset bf9cd5aea492 (bug 1602863)
Backed out changeset c656cb682586 (bug 1602108)

--HG--
extra : rebase_source : 16b901e23b6c0cadaea5ef159901f0a1dea3aa50
2020-01-11 03:27:56 +02:00
Dorel Luca
d926e77afc Backed out changeset 9e4f3963ad86 (bug 1602863) for WTP Failures. CLOSED TREE 2020-01-11 02:01:28 +02:00
Daniel Varga
5546045f1c Backed out changeset 05f81cc8b39c (bug 1607344) for causing multiple failures at builds/worker/workspace/mozharness/mozharness/base/script.py
CLOSED TREE
2020-01-11 01:33:35 +02:00
Edwin Takahashi
85122690d3 Bug 1602863 - run mochitest-devtools-chrome on ubuntu1804 docker image r=jmaher
Changes:

Run the `mochitest-devtools-chrome` suite with ubuntu1804 docker image.

Update references to linux64 in `mochitest.yml` for mochitest-devtools-chrome to refer to `linux1804-64`.

Depends on D59570

Differential Revision: https://phabricator.services.mozilla.com/D59571

--HG--
extra : moz-landing-system : lando
2020-01-10 23:20:28 +00:00
Stephen Donner
ace7e6d13b Fix Bug 1607344; remove legacy stylo-seq linux64 jobs. r=erahm,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59466

--HG--
extra : moz-landing-system : lando
2020-01-10 21:39:19 +00:00
Edwin Takahashi
97cc2f34de Bug 1602863 - run web-platform-tests on ubuntu1804 except ccov r=jmaher
Changes:

Rename the `web-platform-tests-1804` set to `web-platform-tests`.

Create a new set with name `web-platform-tests-wdspec` which will hold only the `wdspec` test to be run on ubuntu1604.

Use the now-named `web-platform-tests` set to be used for ubuntu1804 platforms.

Differential Revision: https://phabricator.services.mozilla.com/D59449

--HG--
extra : moz-landing-system : lando
2020-01-10 17:18:17 +00:00
Edwin Takahashi
299b3e80ad Bug 1602863 - run webgl on ubuntu1804, part 2 r=jmaher
Changes:

Add webgl tests to the linux1804-tests set, not just the linux1804-qr-tests set.

Differential Revision: https://phabricator.services.mozilla.com/D59457

--HG--
extra : moz-landing-system : lando
2020-01-10 19:25:39 +00:00
Edwin Takahashi
b49ddf126a Bug 1600387 - run jittest with ubuntu1804 r=jmaher
Changes:

Add `jittest` to the linux1804-test set.

This will have no effect until `ccov` variant is enabled for ubuntu1804.

Differential Revision: https://phabricator.services.mozilla.com/D59456

--HG--
extra : moz-landing-system : lando
2020-01-10 19:23:07 +00:00
Edwin Takahashi
0694c5d5b1 Bug 1602863 - run reftest-no-accel on ubuntu1804 docker image r=jmaher
Changes:

Now that mfenced-12.html is disabled, run `reftest-no-accel` on ubuntu1804.

Differential Revision: https://phabricator.services.mozilla.com/D59448

--HG--
extra : moz-landing-system : lando
2020-01-10 18:09:29 +00:00
Edwin Takahashi
1292ac382f Bug 1602863 - run firefox-ui-tests on ubuntu1804 docker image r=jmaher
Changes:

Run `firefox-ui-tests` on ubuntu1804.

Differential Revision: https://phabricator.services.mozilla.com/D59447

--HG--
extra : moz-landing-system : lando
2020-01-10 18:10:24 +00:00
Marco Castelluccio
9bbdae6a99 Bug 1607965 - Make Windows coverage build an opt build. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59292

--HG--
rename : testing/mozharness/configs/builds/taskcluster_sub_win64/ccov_debug.py => testing/mozharness/configs/builds/taskcluster_sub_win64/ccov_opt.py
extra : moz-landing-system : lando
2020-01-10 09:51:17 +00:00
Edwin Takahashi
d447a96547 Bug 1602863 - run web-platform-test-reftests and web-platform-test-crashtests with ubuntu1804 docker image except ccov r=jmaher
Changes:

Run `web-platform-tests-crashtests`, `web-platform-tests-reftests` with ubuntu1804 docker image.

This is a piecemeal migration, since the main `web-platform-tests` is not ready for ubuntu1804 yet due to several issues.

Depends on D59386.

Differential Revision: https://phabricator.services.mozilla.com/D59403

--HG--
extra : moz-landing-system : lando
2020-01-09 21:30:53 +00:00
Edwin Takahashi
2b5519636e Bug 1602863 - run mochitest-webgl suites on ubuntu1804 docker image r=jmaher
Changes:

Run mochitest-webgl suites on ubuntu1804.

Update the expectation of a test to remove the `headless` specification.

Differential Revision: https://phabricator.services.mozilla.com/D59401

--HG--
extra : moz-landing-system : lando
2020-01-09 20:49:35 +00:00
Edwin Takahashi
cac140ed88 Bug 1602863 - run telemetry and test-verify with ubuntu1804 docker image r=jmaher
Changes:

Run telemetry and test-verify on ubuntu1804.

Differential Revision: https://phabricator.services.mozilla.com/D59393

--HG--
extra : moz-landing-system : lando
2020-01-09 20:48:49 +00:00
Edwin Takahashi
63d2768c7f Bug 1602863 - run mochitest-a11y with ubuntu1804 docker image r=jmaher
Changes:

Run `mochitest-a11y` on ubuntu1804 image.

On the `ubuntu1804` image, bug 1429575 is a relatively frequent occurrence.

Differential Revision: https://phabricator.services.mozilla.com/D59220

--HG--
extra : moz-landing-system : lando
2020-01-09 19:08:57 +00:00
Edwin Takahashi
b2e141b8ed Bug 1599197 - do not run linux32 on autoland or try by default r=jmaher,gbrown
Changes:

Do not run `linux32` builds on `try` or `autoland` by default, but ensure it is able to run on all other repos (eg. `mozilla-beta`).

Filter out all tasks with `linux-shippable` in the name, including builds, auxiliary tasks (balrog, etc).

Differential Revision: https://phabricator.services.mozilla.com/D58982

--HG--
extra : moz-landing-system : lando
2020-01-09 01:09:07 +00:00
Edwin Takahashi
e4b8074522 Bug 1602863 - run web-platform-tests-wdspec-headless and mochitest-webgpu with ubuntu1804 docker image r=jmaher
Changes:

Run `web-platform-tests-wdspec-headless` and `mochitest-webgpu` with ubunt1804 image.

Changes to the `linux64` references in `web-platform.yml` and `mochitest.yml` are not necessary.

Differential Revision: https://phabricator.services.mozilla.com/D59209

--HG--
extra : moz-landing-system : lando
2020-01-09 00:10:27 +00:00
Edwin Takahashi
4acb44342d Bug 1602863 - temporarily disable linux1804-64-asan-qr and linux1804-64-ccov platforms r=jmaher
Changes:

**linux1804-64-asan-qr**, bug 1607620
This platform references the `linux-qr-smoketests` test set which is not one of the `linux1804` labeled test sets.

So the changes in D58964 meant that these tests were enabled for `linux1804-qr-asan/opt`, which is fine except the `reftest` suites has 1 failure.

Temporarily disable this platform for the time being while reftest failure is worked out. This does not mean we lose coverage, since the ubuntu1604 variant `linux64-asan-qr/opt` is still running on all repos.

**linux1804-64-ccov platforms**, bug 1607887
ccov on ubuntu1804 is not ready yet, as per :marco in D58739. Technically speaking the disabling should have taken place in that patch, but that escaped my mind then.

Differential Revision: https://phabricator.services.mozilla.com/D59214

--HG--
extra : moz-landing-system : lando
2020-01-08 22:48:08 +00:00
Edwin Takahashi
839dd8fd43 Bug 1602863 - run mochitest-headless suite with ubuntu1804 docker image r=jmaher
Changes:

Run the `mochitest-headless` suite with ubuntu1804 image

No updates to linux64 references in `mochitest.yml` is necessary.

Differential Revision: https://phabricator.services.mozilla.com/D59195

--HG--
extra : moz-landing-system : lando
2020-01-08 20:00:42 +00:00
Edwin Takahashi
3fbd21f3c5 Bug 1602863 - run reftest using ubuntu1804 test image r=jmaher
Changes:

Run the reftest suite with ubuntu1804 test image.

Depends on D54851.

Differential Revision: https://phabricator.services.mozilla.com/D58816

--HG--
extra : moz-landing-system : lando
2020-01-08 18:37:36 +00:00
Edwin Takahashi
a1f18402ce Bug 1602863 - update references to linux64 in awsy.yml to linux1804-64 r=Marian
Changes:

Due to changes I made in D58204 and D58464, `awsy` was migrated to run under the `linux1804-64` label. This was fine except `awsy.yml` used `linux64` to set scheduling.

This patch will update the references to `linux1804-64` and restore proper scheduling of tasks.

Differential Revision: https://phabricator.services.mozilla.com/D59017

--HG--
extra : moz-landing-system : lando
2020-01-08 18:32:40 +00:00
alexandru.ionescu
afa20661a0 Bug 1607254 Add firefox warm page load tests back on mozilla-central r=davehunt,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D59095

--HG--
extra : moz-landing-system : lando
2020-01-08 12:20:37 +00:00
Edwin Takahashi
1724bf3a70 Bug 1602863 - update references to linux64 in yaml files for xpcshell and mochitest-media to linux1804 r=jmaher
Changes:

Update references to `linux64` in the YAML files to read `linux1804-64`.

Differential Revision: https://phabricator.services.mozilla.com/D59024

--HG--
extra : moz-landing-system : lando
2020-01-07 23:55:56 +00:00
Edwin Takahashi
f9b97109ba Bug 1602863 - run desktop-screenshot-capture tests with ubuntu1804 docker image r=jmaher
Changes:

Run mochitest-screenshots with ubuntu1804, and remove from running under `linux64` label.

Also update the references in `mochitest.yml` for the `run-on-projects` scheduler.

Differential Revision: https://phabricator.services.mozilla.com/D58864

--HG--
extra : moz-landing-system : lando
2020-01-08 00:00:13 +00:00
Edwin Takahashi
5f422b375c Bug 1602863 - run gtest and jsreftests with ubuntu1804 docker image r=jmaher
Changes:

GTest and Jsreftests can be run on ubuntu1804 safely.

Differential Revision: https://phabricator.services.mozilla.com/D58837

--HG--
extra : moz-landing-system : lando
2020-01-07 23:56:09 +00:00
Jeff Gilbert
dfde69a462 Bug 1585683 - Add mochitest-webgpu jobs, add subsuite = webgpu. r=jmaher,kvark
Differential Revision: https://phabricator.services.mozilla.com/D58892

--HG--
extra : moz-landing-system : lando
2020-01-07 22:42:07 +00:00
Bogdan Tara
c0e1f5a876 Backed out changeset 33ccfb45bb3f (bug 1585683) on jgilbert's request 2020-01-07 23:21:45 +02:00
Edwin Takahashi
5470cd05bc Bug 1607496 - fix taskgraph warning about linux-qr-smoketests caused by missing test-sets line r=jmaher
Changes:

The `test-sets:` line was missing, which caused warnings.

Also correct the name of the test platform combination.

Differential Revision: https://phabricator.services.mozilla.com/D58964

--HG--
extra : moz-landing-system : lando
2020-01-07 20:05:26 +00:00
Jeff Gilbert
4d2067b9ca Bug 1585683 - Add mochitest-webgpu jobs, add subsuite = webgpu. r=jmaher,kvark
Differential Revision: https://phabricator.services.mozilla.com/D58892

--HG--
extra : moz-landing-system : lando
2020-01-07 20:58:37 +00:00
Jeff Gilbert
3a05991f4e Bug 1606039 - Enable webgl1-core/1-ext/2-core tests on Android HW. r=lsalzman
Differential Revision: https://phabricator.services.mozilla.com/D58906

--HG--
extra : moz-landing-system : lando
2020-01-07 19:19:38 +00:00
Edwin Takahashi
eee843b9a7 Bug 1602863 - run xpcshell suite on ubuntu1804 test image for all linux variants except ccov r=jmaher
Changes:

Run `xpcshell` test suite on ubuntu1804 for all platforms except `linux64-ccov`.

Modify the test in `test_fuzzy.py` to refer to the new `test-linux1804` xpcshell task label.

Add a new test in `test_fuzzy.py` to test the `-q` functionality without a test path.

Differential Revision: https://phabricator.services.mozilla.com/D58740

--HG--
extra : moz-landing-system : lando
2020-01-07 18:31:55 +00:00
Edwin Takahashi
ae23925872 Bug 1602863 - remove linux64/opt stylo sequential platform combination r=jmaher
Changes:

Remove the linux64/opt stylo combination since the only test it ran was the `awsy-stylo-sequential` which is now duplicated by linux1804-64-stylo-sequential/opt.

Differential Revision: https://phabricator.services.mozilla.com/D58873

--HG--
extra : moz-landing-system : lando
2020-01-07 18:24:59 +00:00
Edwin Takahashi
e4aa121407 Bug 1602863 - run marionette-headless with ubuntu1804 docker image r=jmaher
Changes:

Run `marionette-headless` with ubuntu1804 instead of desktop1604.

`marionette-headless-fission` is ignored because it already fails with normal desktop1604-test image.

Differential Revision: https://phabricator.services.mozilla.com/D58868

--HG--
extra : moz-landing-system : lando
2020-01-07 11:37:33 +00:00
Edwin Takahashi
d1af0a1c8e Bug 1599197 - demote linux32-shippable/opt tasks to tier 2 and limit builds to try and mozilla-central r=jmaher,gbrown
Changes:

Demote linux32-shippable/opt tasks to tier 2 on all repositories. Other linux32 jobs are defined but do not appear to run.

Limit the build of linux32-shippable/opt to `try`/`mozilla-central`.

Differential Revision: https://phabricator.services.mozilla.com/D58207

--HG--
extra : moz-landing-system : lando
2020-01-06 18:42:02 +00:00
Ciure Andrei
11eedd07fe Backed out changeset 1410db0871ba (bug 1599197) for causing linting failures CLOSED TREE 2020-01-06 19:13:04 +02:00
Edwin Takahashi
47cd631c5c Bug 1599197 - demote linux32-shippable/opt tasks to tier 2 and limit builds to try and mozilla-central r=jmaher,gbrown
Changes:

Demote linux32-shippable/opt tasks to tier 2 on all repositories. Other linux32 jobs are defined but do not appear to run.

Limit the build of linux32-shippable/opt to `try`/`mozilla-central`.

Differential Revision: https://phabricator.services.mozilla.com/D58207

--HG--
extra : moz-landing-system : lando
2020-01-06 16:53:39 +00:00
Edwin Takahashi
5a3945950a Bug 1602863 - run mochitest-media on ubuntu1804 for all linux platform variants execpt ccov r=jmaher
Changes:

Run `mochitest-media` using ubuntu1804.

Differential Revision: https://phabricator.services.mozilla.com/D58742

--HG--
extra : moz-landing-system : lando
2020-01-06 11:40:07 +00:00
Edwin Takahashi
b91bc21cb6 Bug 1606861 - revert changes to linux64-ccov labels and exclude the platform from further ubuntu1804 migration changes r=marco,jmaher
Changes:

Exclude the `linux-ccov` platform from ubuntu1804 migration plans for the time being.

The `linux64-ccov` test platform originally ran the `common-tests` test set so change the `linux-common-tests` to refer to `common-tests`. This should restore all sets of tests to the `linux64-ccov` label.

Differential Revision: https://phabricator.services.mozilla.com/D58739

--HG--
extra : moz-landing-system : lando
2020-01-06 16:44:55 +00:00