We don't need to package tests for builds that we don't actually run
tests from, but it is tricky to align this correctly by setting
MOZ_AUTOMATION_PACKAGE_TESTS=0 in relevant mozconfigs. Instead we can
set the environment variable in the task definition, and use a full
taskgraph verification check to ensure that the flag is only set on
builds that have tests.
The one tricky task is win64-aarch64-shippable/opt, which copies tests
from another build rather than building them itself. For this reason, it
explicitly sets MOZ_AUTOMATION_PACKAGE_TESTS: '0' in the environment
even though that is now the default. This is why the exception is only
raised if MOZ_AUTOMATION_PACKAGE_TESTS is not set at all, rather than
checking that it is set to 1.
Differential Revision: https://phabricator.services.mozilla.com/D59426
--HG--
extra : moz-landing-system : lando
Changes:
Rename the `web-platform-tests-1804` set to `web-platform-tests`.
Create a new set with name `web-platform-tests-wdspec` which will hold only the `wdspec` test to be run on ubuntu1604.
Use the now-named `web-platform-tests` set to be used for ubuntu1804 platforms.
Differential Revision: https://phabricator.services.mozilla.com/D59449
--HG--
extra : moz-landing-system : lando
Otherwise we won't package the necessary libraries, which leads to
peculiar runtime failures.
Depends on D59555
Differential Revision: https://phabricator.services.mozilla.com/D59556
--HG--
extra : moz-landing-system : lando
...so that we can correctly declare that we are using sandboxed
library(ies) from our "parent" build, but not check for all the tools to
compile code.
Depends on D59554
Differential Revision: https://phabricator.services.mozilla.com/D59555
--HG--
extra : moz-landing-system : lando
This change eliminates a lot of repetition, and paves the way for the
next change.
Differential Revision: https://phabricator.services.mozilla.com/D59554
--HG--
extra : moz-landing-system : lando
Additionally, stop indicating that we collect this in the content process (we don't).
Differential Revision: https://phabricator.services.mozilla.com/D59193
--HG--
extra : moz-landing-system : lando
Changes:
Restore the original state of `web-platform-tests` test set in `test-sets.yml`.
Changes in D59403 had the unintended side effect of removing `web-platform-tests-reftests` and `web-platform-tests-crashtests` from the main test set, which was used for both `linux64` and `windows` platforms.
`position-sticky-scroll-with-clip-and-abspos-ref.html` was failing because the test no longer needed a `fuzzy` annotation for `webrender` variant.
Differential Revision: https://phabricator.services.mozilla.com/D59752
--HG--
extra : moz-landing-system : lando
Order fields in similar orders and cleanup comments.
- Instance Pointer
- NextFrameSlot
- Flags
- Binding Counts
- Bindings
Differential Revision: https://phabricator.services.mozilla.com/D59730
--HG--
extra : moz-landing-system : lando
This gets rid of the last use of the 'which' module left in the tree. So not
only will this help 'configure' become a little more Python 3 compatible, but
we can now remove 'third_party/python/which'.
Differential Revision: https://phabricator.services.mozilla.com/D37427
--HG--
extra : moz-landing-system : lando
Changes:
Add webgl tests to the linux1804-tests set, not just the linux1804-qr-tests set.
Differential Revision: https://phabricator.services.mozilla.com/D59457
--HG--
extra : moz-landing-system : lando
Changes:
Add `jittest` to the linux1804-test set.
This will have no effect until `ccov` variant is enabled for ubuntu1804.
Differential Revision: https://phabricator.services.mozilla.com/D59456
--HG--
extra : moz-landing-system : lando
Changes:
With permission from test owner, mark this test with updated expectation of `["OK", "TIMEOUT"]` for ubuntu1804 and opt and fission.
Differential Revision: https://phabricator.services.mozilla.com/D59406
--HG--
extra : moz-landing-system : lando
Changes:
Several tests in `screen-orientation` subsuite are flaky when run on ubuntu1804 with either `webrender` or `asan`. Mark them with expectation of ["OK", "ERROR"] to compensate.
Differential Revision: https://phabricator.services.mozilla.com/D57651
--HG--
extra : moz-landing-system : lando
Bug 1510424/D13135 remove them from Windows along with Android by mistake.
This patch also moves some code to separate Android only logic from other
platforms to avoid making similar mistakes.
Differential Revision: https://phabricator.services.mozilla.com/D59248
--HG--
extra : moz-landing-system : lando
