Bug 1352113 - Shippable Builds - Adjust tests to align shippable sets with what was on pgo (where pgo exists) and opt. r=jmaher

I did a bunch of manual testing with this, the biggest uncertainties lie around beta and central/nightly.

We are adding shippable-qr to beta because of replacing nightly too.

Autoland and inbound should have the same sets of tasks.

beta -
    - adds mochitest-plain-headless-{1..4} to beta (not currently run)
    - adds raptor to run on shippable for beta
        - currently runs on opt on beta, and for nightly tasks on beta only webaudio-chrome runs.
    - adds talos to shippable tasks, on beta talos only runs against opt.

central -
    - adds browser-screenshots to nightly graph
    - adds mochitest-plain-headless-{1..4} to nightly graph
    - adds browser-instrumentation to shippable

Differential Revision: https://phabricator.services.mozilla.com/D23122

--HG--
extra : moz-landing-system : lando
This commit is contained in:
Justin Wood 2019-03-26 01:36:35 +00:00
parent 00acc96f73
commit 32feb31df5
3 changed files with 11 additions and 9 deletions

View File

@ -42,14 +42,17 @@ gtest:
instance-size: xlarge
run-on-projects:
by-test-platform:
windows.*-pgo/.*: [] # permafails on pgo
windows.*-shippable/.*: [] # permafails on shippable
windows.*-pgo/.*: [] # permafails on pgo too
windows.*-nightly/.*: [] # permafails on nightly too
windows10-64-asan/opt: [] # permafails on asan too
.*-devedition/.*: [] # don't run on devedition
default: built-projects
tier:
by-test-platform:
windows7-32-shippable.*: 3
windows7-32-pgo.*: 3
windows10-64-shippable.*: 3
windows10-64-pgo.*: 3
windows10-64-asan.*: 3
default: default

View File

@ -130,7 +130,7 @@ browser-instrumentation:
tier: 3
run-on-projects:
by-test-platform:
windows.*-nightly/.*: ["mozilla-central"]
windows.*-(?:nightly|shippable)/.*: ["mozilla-central"]
default: []
max-run-time: 14400
mozharness:
@ -144,12 +144,11 @@ browser-screenshots:
loopback-video: true
run-on-projects:
by-test-platform:
# We don't want debug, pgo, devedition or nightly builds
windows7-32-pgo(?:-qr)?/opt: ['mozilla-central', 'integration']
windows10-64-pgo(?:-qr)?/opt: ['mozilla-central', 'integration']
windows7-32(?:-pgo|-shippable)(?:-qr)?/opt: ['mozilla-central', 'integration']
windows10-64(?:-pgo|-shippable)(?:-qr)?/opt: ['mozilla-central', 'integration']
(?:windows10-64|windows7-32|linux64)(?:-qr)?/opt: ['mozilla-central']
linux64-pgo(?:-qr)?/opt: ['mozilla-central', 'integration']
macosx64/opt: ['mozilla-central', 'integration']
linux64-(?:pgo|shippable)(?:-qr)?/opt: ['mozilla-central', 'integration']
macosx64(?:-shippable)?/opt: ['mozilla-central', 'integration']
default: []
max-run-time: 3600
mozharness:

View File

@ -107,13 +107,13 @@ web-platform-tests-reftests:
by-test-platform:
android.*: ['mozilla-central', 'try']
windows10-aarch64/opt: ['try', 'mozilla-central']
linux64-pgo-qr/.*: ['release', 'try'] # skip on integration branches due to high load
linux64(?:-pgo|-shippable)?-qr/.*: ['release', 'try'] # skip on integration branches due to high load
default: built-projects
tier:
by-test-platform:
android.*: 2
linux64-asan/opt: 2
linux64-qr/.*: 2 # can't be tier-1 if it's not running on integration branches
linux64(?:-pgo|-shippable)?-qr/.*: 2 # can't be tier-1 if it's not running on integration branches
default: default
mozharness:
extra-options: