Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-10-08 19:04:45 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
63ad6129d4
gecko-dev/taskcluster/ci/test/browsertime-mobile.yml

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

198 lines
6.3 KiB
YAML
Raw Normal View History

Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this
# file, You can obtain one at http://mozilla.org/MPL/2.0/.
---
job-defaults:
Bug 1590834 - Increase raptor-browsertime android maximum taskcluster job time r=perftest-reviewers,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D50276 --HG-- extra : moz-landing-system : lando
2019-10-24 13:25:24 +00:00
max-run-time: 3600
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
suite: raptor
workdir: /builds/worker
run-on-projects:
by-app:
Bug 1604527 - Enable raptor-browsertime with visual metrics on Fenix (webrender off) and GVE for central and try only r=sparky Differential Revision: https://phabricator.services.mozilla.com/D58294 --HG-- extra : moz-landing-system : lando
2019-12-27 18:24:49 +00:00
fenix:
by-test-platform:
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central", "try"]
default: []
Bug 1604547 - Stop running 32-bit raptor tests on android P2; r=jmaher Stop running raptor tests on Android P2 devices against 32-bit (armv7, or "api-16") builds. This will reduce our android-hw P2 load without losing meaningful test coverage (armv7 on G5 and aarch64 on P2 are more relevant). Tests running on Android G5 are unchanged. Tests running against 64 bit builds (aarch64) are unchanged. Non-raptor tests are unchanged. Differential Revision: https://phabricator.services.mozilla.com/D57717 --HG-- extra : moz-landing-system : lando
2019-12-19 19:53:22 +00:00
geckoview:
by-test-platform:
Bug 1604527 - Enable raptor-browsertime with visual metrics on Fenix (webrender off) and GVE for central and try only r=sparky Differential Revision: https://phabricator.services.mozilla.com/D58294 --HG-- extra : moz-landing-system : lando
2019-12-27 18:24:49 +00:00
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central", "try"]
default: []
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec:
by-test-platform:
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central", "try"]
default: []
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: []
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
tier: 3
target:
by-app:
fenix:
by-test-platform:
android-hw.*-aarch64.*/.*:
Bug 1601006 - Fix download location of fenix performancetest apk in CI for raptor-browsertime r=stephendonner Differential Revision: https://phabricator.services.mozilla.com/D55864 --HG-- extra : moz-landing-system : lando
2019-12-04 21:16:29 +00:00
index: project.mobile.fenix.v2.performance-test.latest
name: build/arm64-v8a/geckoNightly/target.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
default:
Bug 1601006 - Fix download location of fenix performancetest apk in CI for raptor-browsertime r=stephendonner Differential Revision: https://phabricator.services.mozilla.com/D55864 --HG-- extra : moz-landing-system : lando
2019-12-04 21:16:29 +00:00
index: project.mobile.fenix.v2.performance-test.latest
name: build/armeabi-v7a/geckoNightly/target.apk
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec:
by-test-platform:
android-hw-p2-8-0-android-aarch64.*:
index: gecko.v2.mozilla-esr68.latest.mobile.android-aarch64-opt
name: build/target.apk
default:
index: gecko.v2.mozilla-esr68.latest.mobile.android-api-16-opt
name: build/target.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow:
by-test-platform:
android-hw.*-aarch64.*/.*:
index: project.mobile.reference-browser.v2.raptor.latest.aarch64
name: target.apk
default:
index: project.mobile.reference-browser.v2.raptor.latest.arm
name: target.apk
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: geckoview_example.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
e10s: true
virtualization: hardware
activity:
by-app:
fenix: org.mozilla.fenix.IntentReceiverActivity
geckoview: org.mozilla.geckoview_example.GeckoViewActivity
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec: org.mozilla.gecko.BrowserApp
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow: org.mozilla.reference.browser.BrowserTestActivity
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: None
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
binary-path:
by-app:
fenix: org.mozilla.fenix.performancetest
geckoview: org.mozilla.geckoview_example
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec: org.mozilla.fennec_aurora
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow: org.mozilla.reference.browser.raptor
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: None
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
mozharness:
script: raptor_script.py
config:
- raptor/android_hw_config.py
extra-options:
- --browsertime
Bug 1600392 - Use a single test INI and taskcluster configuration file for all raptor-browsertime android page-load test r=perftest-reviewers,davehunt,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D56392 --HG-- extra : moz-landing-system : lando
2019-12-09 18:01:05 +00:00
browsertime-tp6m:
description: "Raptor (browsertime) tp6 page-load tests on android"
raptor-test: tp6m
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
raptor-subtests:
by-app:
fenix:
- allrecipes
- amazon
- amazon-search
- bbc
- bing
- bing-search-restaurants
- booking
- cnn
- cnn-ampstories
- ebay-kleinanzeigen
- ebay-kleinanzeigen-search
- espn
- facebook
- facebook-cristiano
- google
- google-maps
- google-search-restaurants
- instagram
- imdb
- jianshu
- microsoft-support
- reddit
- stackoverflow
- web-de
- wikipedia
- youtube
- youtube-watch
default:
- amazon
- youtube
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
apps: ["geckoview", "fenix", "fennec", "chrome-m"]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
run-on-projects:
by-raptor-test:
amazon:
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
by-app:
chrome-m: []
default:
by-test-platform:
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central", "try"]
default: []
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
youtube:
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
by-app:
chrome-m: []
default:
by-test-platform:
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central", "try"]
default: []
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
default: []
pageload:
by-app:
fenix: both
default: cold
Bug 1609150 - Turn off failing visual metrics jobs for fennec r=perftest-reviewers,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D59888 --HG-- extra : moz-landing-system : lando
2020-01-14 18:43:19 +00:00
run-visual-metrics:
by-app:
fennec: false
default: true
Bug 1600392 - Use a single test INI and taskcluster configuration file for all raptor-browsertime android page-load test r=perftest-reviewers,davehunt,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D56392 --HG-- extra : moz-landing-system : lando
2019-12-09 18:01:05 +00:00
treeherder-symbol: Btime(tp6m)
Bug 1601011 - Add gecko profiling support to raptor-browsertime (android) r=rwood Differential Revision: https://phabricator.services.mozilla.com/D57329 --HG-- extra : moz-landing-system : lando
2019-12-17 08:04:47 +00:00
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
browsertime-tp6m-live:
description: "Raptor (browsertime) tp6 live site page-load tests on android"
raptor-test: tp6m
raptor-subtests:
- amazon-search
- bbc
- booking-sf
- cnn-ampstories
- discord
- espn
- expedia
- facebook-cristiano
- fashionbeans
- google
- google-accounts
- imdb-firefox
- jianshu
- medium-article
- microsoft-support
- nytimes
- people-article
- reddit-thread
- rumble-fox
- stackoverflow-question
- urbandictionary-define
- wikia-marvel
- youtube-watch
apps: ["fenix", "chrome-m"]
run-on-projects: []
pageload: cold
run-visual-metrics: true
treeherder-symbol: Btime-live(tp6m)
mozharness:
extra-options:
- --live-sites
Bug 1601011 - Add gecko profiling support to raptor-browsertime (android) r=rwood Differential Revision: https://phabricator.services.mozilla.com/D57329 --HG-- extra : moz-landing-system : lando
2019-12-17 08:04:47 +00:00
browsertime-tp6m-profiling:
description: "Raptor (browsertime) tp6 page-load tests on android with Gecko profiling"
raptor-test: tp6m
raptor-subtests: ['amazon', 'youtube']
apps: ["geckoview"]
pageload: cold
treeherder-symbol: Btime-Prof(tp6m)
mozharness:
script: raptor_script.py
config:
- raptor/android_hw_config.py
extra-options:
- --browsertime
- --gecko-profile
Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek Differential Revision: https://phabricator.services.mozilla.com/D61305 --HG-- extra : moz-landing-system : lando
2020-02-05 08:59:19 +00:00
Bug 1627279 - Use speedometer rather than raptor-speedometer-APP in browsertime tests. r=perftest-reviewers,alexandru.irimovici This patch changes the test that browsertime runs for speedometer from `raptor-speedometer-APP` to `speedometer` and changes some other small issues like the missing app name in the `extraOptions` field in the perfherder data. Differential Revision: https://phabricator.services.mozilla.com/D69581 --HG-- extra : moz-landing-system : lando
2020-04-07 13:27:30 +00:00
browsertime-speedometer-mobile:
description: "Browsertime Speedometer on Android"
Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek Differential Revision: https://phabricator.services.mozilla.com/D61305 --HG-- extra : moz-landing-system : lando
2020-02-05 08:59:19 +00:00
apps: ["geckoview", "fenix", "fennec"]
treeherder-symbol: Btime(sp)
mozharness:
extra-options:
- --browsertime
Bug 1627279 - Use speedometer rather than raptor-speedometer-APP in browsertime tests. r=perftest-reviewers,alexandru.irimovici This patch changes the test that browsertime runs for speedometer from `raptor-speedometer-APP` to `speedometer` and changes some other small issues like the missing app name in the `extraOptions` field in the perfherder data. Differential Revision: https://phabricator.services.mozilla.com/D69581 --HG-- extra : moz-landing-system : lando
2020-04-07 13:27:30 +00:00
- --test=speedometer
Reference in New Issue Copy Permalink