Changes:
Reorganize, reorder and review the sets defined in test-sets.yml to be more conducive to future changes.
Also, migrate `mochitest-valgrind` to run with linux1804.
Reorganize:
Group similar sets together, separated by whether it is a feature test set or operating system test set.
Review:
Remove test sets that are no longer used.
Rename test sets to be more descriptive of what it contains.
Differential Revision: https://phabricator.services.mozilla.com/D60198
--HG--
extra : moz-landing-system : lando
Changes:
`mochitest-e10s` is ready to migrate to ubuntu1804 for all platform variants.
Failures are intermittent on non-fission runs.
Note that on `mozilla-central`, `linux64-ccov/opt` does not run `mochitest-e10s` and this behavior is carried over. Fission variant is also not run on `mozilla-central`.
Try push with fission and ccov is included for sake of completeness.
Differential Revision: https://phabricator.services.mozilla.com/D59970
--HG--
extra : moz-landing-system : lando
Changes:
Migrate more tests to run under linux1804-64-ccov and disable them from linux64-ccov.
- code-coverage
- web-platform-tests (reftests, vanilla, crashtests)
- gtest (not run on mozilla-central or autoland)
- test-verify
- xpcshell
Differential Revision: https://phabricator.services.mozilla.com/D60192
--HG--
extra : moz-landing-system : lando
Attempt to stop running remaining raptor tests on android-hw-p2 against armv7 pgo builds
by removing the test sets from the platform definition. These had been left in place
so that they could continue to run on try, but I think that loss is quite small: tests
can still be run on android-hw-p2 against armv7 opt builds, all builds on G5, and all
aarch64 builds on P2.
Differential Revision: https://phabricator.services.mozilla.com/D60090
--HG--
extra : moz-landing-system : lando
This was regressed by the change from arm7 to aarch64 builds; easily corrected.
Differential Revision: https://phabricator.services.mozilla.com/D59968
--HG--
extra : moz-landing-system : lando
Changes:
Run the `mochitest-devtools-chrome` suite with ubuntu1804 for all platform variants, including `ccov`.
Differential Revision: https://phabricator.services.mozilla.com/D59571
--HG--
extra : moz-landing-system : lando
We are migrating the worker used by builds from AWS to GCP. We have had tier- 3 GCP builds for initial testing. We are replacing those with tier-3 AWS builds to ensure they keep working so we are able to switch back.
Differential Revision: https://phabricator.services.mozilla.com/D60042
--HG--
extra : moz-landing-system : lando
Changes:
Migrate over tests that are either green, or do not run by default on mozilla-central, to run under the linux1804-64-ccov/opt label.
Differential Revision: https://phabricator.services.mozilla.com/D59978
--HG--
extra : moz-landing-system : lando
Changes:
Enable reftest/reftest-no-accel on ubuntu1804/linux1018.
Remove reftest/reftest-no-accel from running on ubuntu1604/linux64.
Differential Revision: https://phabricator.services.mozilla.com/D59825
--HG--
extra : moz-landing-system : lando
Changes:
`mochitest-e10s` is ready to migrate to ubuntu1804 for all platform variants.
Failures are intermittent on non-fission runs.
Note that on `mozilla-central`, `linux64-ccov/opt` does not run `mochitest-e10s` and this behavior is carried over. Fission variant is also not run on `mozilla-central`.
Try push with fission and ccov is included for sake of completeness.
Differential Revision: https://phabricator.services.mozilla.com/D59970
--HG--
extra : moz-landing-system : lando
Changes:
`linux1804-64-asan-qr/opt` was originally disabled because reftest fuzzy values were incorrect.
This change will re-enable the platform combination on CI, and remove the corresponding linux64 variant since all tests that run on the `asan-qr` variant is now migrated.
Differential Revision: https://phabricator.services.mozilla.com/D59974
--HG--
extra : moz-landing-system : lando
Currently, when task system-symbols-mac doesn't produce artifacts because of no data, then the task system-symbols-mac-upload-symbols is failing too.
So this patch aims to not fail the task in such a case.
Differential Revision: https://phabricator.services.mozilla.com/D59848
--HG--
extra : moz-landing-system : lando
Changes:
Update `linux64` regex to in yaml files for suites that have been migrated over to run on ubuntu1804.
Current naming convention: `linux64-asan/opt`.
New naming convention: `linux1804-64-asan/opt`
Future (potential) convention: `linux2004-64-asan/opt`
Using the `linux.*64` regex will result in a match for all three of the names above. This will ensure that we don't need to constantly update the regex for each new version, while being specific enough.
Differential Revision: https://phabricator.services.mozilla.com/D59572
--HG--
extra : moz-landing-system : lando
Move all mochitest, crashtests, and plain reftests currently running on android-hw-p2
against arm7 builds to aarch64 builds (the great majority of geckoview users on P2 are
now using aarch64 builds -- we want to stay relevant). jittest and jsreftest continue
to run on arm7, providing essential arm7 support; aarch64 coverage continues to be
provided by SM(p) on Windows/aarch64 laptops.
Differential Revision: https://phabricator.services.mozilla.com/D59804
--HG--
extra : moz-landing-system : lando
Changes:
Rename the `web-platform-tests-1804` set to `web-platform-tests`.
Create a new set with name `web-platform-tests-wdspec` which will hold only the `wdspec` test to be run on ubuntu1604.
Use the now-named `web-platform-tests` set to be used for ubuntu1804 platforms.
Differential Revision: https://phabricator.services.mozilla.com/D59449
--HG--
extra : moz-landing-system : lando
Changes:
Run `mochitest-remote` with ubuntu1804, including the `ccov` platform variant.
Disable the test suite from running on ubuntu1604 under `linux64` label, including the `ccov` variant.
Differential Revision: https://phabricator.services.mozilla.com/D59585
--HG--
extra : moz-landing-system : lando
Changes:
Diffoscope linux32 (diff-reproducible-linux32) was triggering linux-shippable jobs on autoland.
For good measure, specify for `geckodriver-repack` that it should not run on autoland.
Also restrict `linux-shippable` build on gcp from taking place on autoland. It is a tier 3 job so not visible normally.
Differential Revision: https://phabricator.services.mozilla.com/D59444
--HG--
extra : moz-landing-system : lando
Changes:
Restore the original state of `web-platform-tests` test set in `test-sets.yml`.
Changes in D59403 had the unintended side effect of removing `web-platform-tests-reftests` and `web-platform-tests-crashtests` from the main test set, which was used for both `linux64` and `windows` platforms.
`position-sticky-scroll-with-clip-and-abspos-ref.html` was failing because the test no longer needed a `fuzzy` annotation for `webrender` variant.
Differential Revision: https://phabricator.services.mozilla.com/D59752
--HG--
extra : moz-landing-system : lando
Changes:
Re-enable the `test-linux1804-ccov/opt` variant.
Create a new `linux1804-ccov-tests` test set.
Add `awsy` to ubuntu1804 and remove it correspondingly from ubuntu1604.
Add `mochitest-webgl` tests to ubuntu1804 an remove it from ubunt1604.
Differential Revision: https://phabricator.services.mozilla.com/D59593
--HG--
extra : moz-landing-system : lando
Changes:
Rename the `web-platform-tests-1804` set to `web-platform-tests`.
Create a new set with name `web-platform-tests-wdspec` which will hold only the `wdspec` test to be run on ubuntu1604.
Use the now-named `web-platform-tests` set to be used for ubuntu1804 platforms.
Differential Revision: https://phabricator.services.mozilla.com/D59449
--HG--
extra : moz-landing-system : lando
CLOSED TREE
Backed out changeset bf9cd5aea492 (bug 1602863)
Backed out changeset c656cb682586 (bug 1602108)
--HG--
extra : rebase_source : 16b901e23b6c0cadaea5ef159901f0a1dea3aa50
