Commit Graph

50 Commits

Author SHA1 Message Date
Geoff Brown
95425ecdd7 Bug 1505174 - Increase task chunks for ccov wdspec to avoid timeouts; r=me,a=test-only
--HG--
extra : rebase_source : 6331efc561e92dfe089cc1ea2e91a36021df2289
2018-11-14 06:42:46 -07:00
Geoff Brown
ae4719559e Bug 1506262 - Update mozharness config for Android 7.0 x86 wpt; r=kwierso 2018-11-10 10:43:35 -07:00
James Graham
679ffd4520 Bug 1505739 - Enable wpt CSS reftests on Mac, r=automatedtester
Differential Revision: https://phabricator.services.mozilla.com/D11309

--HG--
extra : moz-landing-system : lando
2018-11-09 10:39:24 +00:00
Geoff Brown
a0ed4e35ec Bug 1500177 - Increase task max-run-time for linux64/ccov wpt; r=marco 2018-11-08 08:30:26 -07:00
Marco Castelluccio
9093a3183c Bug 1446791 - Add more windows 10 debug chunks for wpt. r=aryx
--HG--
extra : rebase_source : f3d45209a7d6d9a0afaa28a90ce6ba99f5bb9449
2018-10-30 14:39:47 +01:00
James Graham
bb19587996 Bug 1481723 - Enable wpt css tests on Windows, r=ato
MozReview-Commit-ID: ekP5TOSaRM

Differential Revision: https://phabricator.services.mozilla.com/D7201
2018-10-18 15:54:30 +01:00
Andrew Halberstadt
753b405990 Bug 1470266 - [ci] Schedule serviceworker-e10s web-platform-test tasks with linux64/debug on mozilla-central, r=jgraham,jmaher
This duplicates all web-platform-test mozharness based tests except with
dom.serviceWorkers.parent_intercept set to true.

Differential Revision: https://phabricator.services.mozilla.com/D8916

--HG--
extra : moz-landing-system : lando
2018-10-17 14:39:40 +00:00
Ryan VanderMeulen
fa11ed5377 Bug 1499075 - Adjust the number of OSX wpt chunks for more consistent runtimes with other platforms. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8730

--HG--
extra : moz-landing-system : lando
2018-10-17 13:28:03 +00:00
Ryan VanderMeulen
17c3deee2a Bug 1496059 - Turn off tests for Windows MSVC builds. r=froydnj,ahal,jmaher
Also removes the signing jobs since they're not needed anymore.

Differential Revision: https://phabricator.services.mozilla.com/D8455

--HG--
extra : moz-landing-system : lando
2018-10-12 17:44:51 +00:00
Geoff Brown
bba2b8f3b3 Bug 1495430 - Add taskcluster config for android wpt, disabled for now; r=me,a=test-only 2018-10-11 16:23:01 -06:00
Gregory Mierzwinski
19ecc0e49a Bug 1496791 - Disable linux64-jsdcov completely. r=jmaher
This patch removes linux64-jsdcov from the available builds on taskcluster along with any hacks used to run it. It also removes any 'coverage' entries that were added to skip tests.

Differential Revision: https://phabricator.services.mozilla.com/D7919

--HG--
extra : moz-landing-system : lando
2018-10-05 21:06:25 +00:00
Gurzau Raul
d28f5d5a5e Backed out changeset 5bb92b2866b2 (bug 1446791) for failing at embedded-content/the-area-element/area-coords.html 2018-09-12 17:55:39 +03:00
James Graham
c39c649d3e Bug 1446791 - Add more windows 10 debug chunks for wpt r=aryx
These builds were frequently timing out.

Differential Revision: https://phabricator.services.mozilla.com/D5164

--HG--
extra : moz-landing-system : lando
2018-09-12 12:28:11 +00:00
Henrik Skupin
0d43d1a4cf Bug 1488682 - [wdspec] Split Wd test jobs into two chunks for all platforms. r=jgraham
--HG--
extra : rebase_source : 8471d706d5a42afcbeda3a121ac3fc091a74686b
2018-09-05 13:53:57 +02:00
Geoff Brown
caf7f524d7 Bug 1487886 - Run linux64/ccov wdspec in 2 chunks; r=marco 2018-09-03 08:57:53 -06:00
Calixte Denizet
86611a3a40 Bug 1471543 - Increase timeout and chunks for some test suites on macosx64 coverage builds. r=jmaher
This makes chunks and timeouts on the MacOSX64 coverage build closer to what we have defined for the Windows build.

Differential Revision: https://phabricator.services.mozilla.com/D2149

--HG--
extra : moz-landing-system : lando
2018-08-17 13:38:39 +00:00
James Graham
c3de1dbc41 Bug 1354232 - Run web-platform-tests on linux64-asan, r=maja_zf
MozReview-Commit-ID: Git2qiGEShN
2018-07-19 16:32:17 +01:00
Andrew Halberstadt
0a7333067e Bug 1475196 - [ci] Stop scheduling test-verify tasks on Windows msvc builds on inbound/autoland r=jmaher
Depends on D2137.

Differential Revision: https://phabricator.services.mozilla.com/D2138

--HG--
extra : moz-landing-system : lando
2018-07-17 11:18:41 +00:00
Kartikaya Gupta
047b6d3cb6 Bug 1475541 - Make QR test jobs tier-1 by default. r=aryx
This patch makes the QR test platforms tier-1 by default, and removes
the ad-hoc bits that were making individual QR jobs tier-1 before.
However, it also explicitly downgrades some QR jobs to tier-2 or tier-3;
comments in the yml files indicate why.

MozReview-Commit-ID: 1UfPuhcMvIW

--HG--
extra : rebase_source : a2347f6a5929246aaba7656b59c0b8f7aa4ca081
2018-07-13 09:44:06 -04:00
Geoff Brown
f78d451be3 Bug 1469288 - Increase test chunks for linux/debug wpt; r=jmaher 2018-06-19 09:44:45 -06:00
Chris AtLee
fa5a347e98 Bug 1467895: Disable linux64-qr web-platform-tests on inbound and autoland r=kats
Differential Revision: https://phabricator.services.mozilla.com/D1646
2018-06-13 20:47:52 +00:00
Joel Maher
81aa9c0648 Bug 1466578 - do not run test-verify on ASAN builds. r=gbrown 2018-06-06 14:35:43 -04:00
Marco Castelluccio
e68fca00eb Bug 1466077 - Make all ccov test suites inherit the run-on-projects from their ccov build. r=jmaher
--HG--
extra : rebase_source : b6426ce82bd02cdcbd644befa6f53fb81cedc1d6
2018-06-01 17:54:25 +02:00
David Major
527f952a0b Bug 1360120: Promote win64-asan builds and tests to tier 2. r=dustin
I've deliberately left as tier-3 the following tests:
- gtest (perma-OOM, likely from ASan malloc-meddling)
- xpcshell (builds need to be signed plus other failures too)

--HG--
extra : rebase_source : 812bf0de11e91c4e952cb5da9163241bd9386246
2018-06-01 10:18:27 -04:00
Marco Castelluccio
9b7be08a60 Bug 1466077 - Don't schedule test-verify on any ccov build. r=jmaher
--HG--
extra : rebase_source : 328b6e861ee883774b80a33d39e4a364cc266e16
2018-06-01 12:15:03 +02:00
Joel Maher
28e3660b54 Bug 1400895 - Better try support for test-verify. r=ahal 2018-05-23 10:00:03 -04:00
Chris AtLee
6e7f604585 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : aebc03899ad88aa2838825c14a45c59e1e59be05
extra : source : ba91fec47e908619d9a8f550ee65cd78f67e3d59
2018-05-04 13:51:35 -04:00
Narcis Beleuzu
495eed2d41 Backed out changeset ba91fec47e90 (bug 1237182) for breaking the Windows 2012 Nightlies. a=backout 2018-05-12 17:33:18 +03:00
Chris AtLee
ef68c91c87 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 5ad7974462d14c00916fd0c88e06843e0f1f4276
2018-05-04 13:51:35 -04:00
Kartikaya Gupta
543d2897ba Bug 1432515 - Enable QR test suites on all branches where the corresponding non-QR versions run. r=milan
Note in particular that tasks that were previously set to run on just
['mozilla-central', 'try'] will now also run on inbound and autoland, in
addition to mozilla-beta and other release branches. In some cases (e.g.
for talos tests) this might result in a significant increase in load on
CI infrastructure. For the tasks that were already running on ['trunk',
'try'] the extra load from the release branches should be relatively
small and will only take effect once 62 moves off nightly into beta.

MozReview-Commit-ID: 6sn9q6rCxOK

--HG--
extra : rebase_source : c228adf059a950aec3e311ae11915caf345e854f
2018-05-09 15:24:38 -04:00
Dorel Luca
979ac450c8 Backed out changeset 67d2aa892562 (bug 1237182) for breaking Decision task. CLOSED TREE 2018-05-10 21:20:39 +03:00
Chris AtLee
714c7498fd Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 18ceefd30a5e5df3be7dc4152256b4407f61e8eb
2018-05-04 13:51:35 -04:00
Marco Castelluccio
b75436a02f Bug 1455481 - Only schedule TC and TCw on mozilla-central and try. r=gbrown
--HG--
extra : rebase_source : bb1c845b322f70074102dbc3d2f54a073bb473b0
2018-04-20 01:55:14 +02:00
Marco Castelluccio
7e52f8d35c Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 1dcbefe05533b1295761a966484b2b250c3a6fa5
2018-04-19 19:19:31 +02:00
Brindusan Cristian
de7724a73a Backed out 3 changesets (bug 1431753) for android mochitest failures on mozharness/base/script.py CLOSED TREE
Backed out changeset bc062fa71ca7 (bug 1431753)
Backed out changeset df038cacff14 (bug 1431753)
Backed out changeset 381cc9c492f3 (bug 1431753)

--HG--
rename : testing/mozharness/mozharness/mozilla/testing/per_test_base.py => testing/mozharness/mozharness/mozilla/testing/verify_tools.py
2018-04-19 22:31:24 +03:00
Marco Castelluccio
ac95649c98 Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 8e151ddc81d528f85e2a4acbd7623935d4246b4f
2018-04-19 19:19:31 +02:00
Kartikaya Gupta
a41c002240 Bug 1448086 - Ensure QR tests are disabled on beta and project branches. r=aryx
This updates the existing entries to use the 'trunk' shorthand notation,
and adds missing entries for mochitests, reftests, jsreftests, and the
three categories of web-platform-tests.

MozReview-Commit-ID: KTgfidGFPNu

--HG--
extra : rebase_source : 3287477c1c9846c4d3a00275e0cb8ae422c48262
2018-03-22 14:54:17 -04:00
Greg Mierzwinski
f9771d3cbc Bug 1445838 - Increase task timeout on code coverage (ccov) test tasks. r=marco
Increases the max-run-time for all test tasks on ccov builds.

MozReview-Commit-ID: KtArHMWKgbH

--HG--
extra : rebase_source : 61b6831ba39f005992ce3ec5db5568ad9ce95a36
2018-03-14 17:49:48 -04:00
Geoff Brown
828cdfd870 Bug 1431125 - Increase max-run-time of test-verify and test-verify-wpt; r=jmaher
These tasks are expected to run quickly (5 - 30 minutes) normally, but there can be a wide range of run times.
2018-02-28 11:49:07 -07:00
Joel Maher
3e42ad5221 Bug 1433276 - adjust non-e10s test scheduling. r=ahal 2018-01-27 04:49:36 -05:00
Marco Castelluccio
29c0c6bdf5 Bug 1433403 - Don't run test-verify on Windows code coverage build. r=jmaher
--HG--
extra : rebase_source : ea11380b6e13b1d2edfb165990d3ebe34c950692
2018-01-26 11:58:47 +01:00
Geoff Brown
84ebbf0452 Bug 1432872 - Stop running test-verify on beta and release; r=ryanvm
test-verify failures on merges are low-value: They usually just repeat/confirm
the test results from the origin branch.
2018-01-24 13:59:43 -07:00
Andrew Halberstadt
7d764294a7 Bug 1386857 - [ci] Remove the 'tc' treeherder group prefix from all tasks, r=dustin
There are now only a handful of buildbot jobs remaining and the concern over
outdated treeherder exclusion profiles has largely been resolved.

This does remove the tc() group from a substantial number of tasks which will
now show up as top level tasks, potentially adding clutter. In some cases, we
might want to re-add a new group (e.g group builds or compiled tests together).
However rather than try to predict the best group names for tasks I'm unfamiliar
with, I think it's best to land this as is. Then if things are looking too
cluttered at the root namespace, file follow-up bugs as needed.

MozReview-Commit-ID: 8SMwjDwAOzV

--HG--
extra : rebase_source : 2f6d89d11c139bdcd404e7537db799d0e36ee4c3
2018-01-12 15:49:58 -05:00
Marco Castelluccio
46a981bbc9 Bug 1428542 - Split web platform tests into 15 chunks instead of 12 for Windows code coverage builds. r=jmaher
--HG--
extra : rebase_source : c1592cd7aad420daaf407659616204bb4b2cb8fc
2018-01-09 18:52:39 +01:00
Dustin J. Mitchell
46f2dcd06b Bug 1403322: Switch jsreftests, jittests, test-verify to SCHEDULES; r=ahal
..and remove support for when.files-changed in the test kind.  It is still used
for other kinds, and that will be addressed in other bugs.

This is re-landing of this bug, now without running test-verify excessively.

MozReview-Commit-ID: GBilXAktICZ

--HG--
extra : rebase_source : 6cc9a3b5a365d74689946bfa0296f51bc08c2113
2017-12-20 00:39:21 +00:00
Geoff Brown
dee2ea3e6a Bug 1423918 - Run TVw as tier 2; r=me, a=test-only
TVw, test-verify-wpt, is just like TV/test-verify, but for web-platform
tests. It has been running as tier 3 for several weeks. Recent runs are
trouble free. See https://developer.mozilla.org/en-US/docs/Test_Verification
2017-12-07 08:41:31 -07:00
Steve Armand
f9ec1d54e7 Bug 1414824 - Enable stricter linting in taskcluster yaml files. r=Callek
MozReview-Commit-ID: AX1cDUkwrBh

--HG--
extra : rebase_source : 4e3d0f5e4b7d1b4d2196c431ae03bc2e9b95387b
2017-11-11 00:36:41 -05:00
Geoff Brown
fdfeb55ba7 Bug 1411660 - Schedule test-verify-wpt on all desktop platforms, tier 3; r=jmaher 2017-11-17 14:18:57 -07:00
Andrew Halberstadt
7ab103c502 Bug 1388478 - Use job-defaults to simplify 'test' configs where appropriate, r=jmaher
This is mostly a refactor, moving shared defaults to the top of the file where
appropriate.

The only change this makes, is modifying a couple of the macosx talos tasks to
use the osx mozharness config. They were previously using the linux config
which was likely a bug.

MozReview-Commit-ID: 2c0muPZrHZ

--HG--
extra : rebase_source : c05f03e812972fa0c237f1dfa5f07c9a47cc30ce
2017-10-17 16:46:06 -04:00
Andrew Halberstadt
54564fe68d Bug 1388478 - Split tests.yml into several smaller suite-specific files, r=dustin,jmaher
This is a simple refactor into separate files. No task definitions should be
modified by this patch.

Most tasks are moved into suite-specific .yml files. A handful of miscellaneous
tasks are defined directly in kind.yml under the 'jobs' key.

MozReview-Commit-ID: 7piXDA6tGI0

--HG--
extra : rebase_source : a91fbb6d0bf740a28a042470b3f9d4a4e309d1f0
2017-10-17 16:25:41 -04:00