Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-10-08 10:44:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
2c33b47941
gecko-dev/taskcluster/ci/test/browsertime-mobile.yml

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

301 lines
10 KiB
YAML
Raw Normal View History

Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this
# file, You can obtain one at http://mozilla.org/MPL/2.0/.
---
job-defaults:
Bug 1590834 - Increase raptor-browsertime android maximum taskcluster job time r=perftest-reviewers,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D50276 --HG-- extra : moz-landing-system : lando
2019-10-24 13:25:24 +00:00
max-run-time: 3600
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
suite: raptor
workdir: /builds/worker
run-on-projects:
by-app:
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
refbrow: []
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: []
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
default:
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
by-test-platform:
Bug 1640278 - Fixup run-on-projects verification failures. r=sylvestre This is in-part a followup to 1638260 which fixed some cases of this problem. Depends on D76540 Differential Revision: https://phabricator.services.mozilla.com/D76746
2020-07-01 14:04:19 +00:00
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central"]
android-hw-p2-.*aarch64-shippable/opt: ["mozilla-central"]
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
default: []
Bug 1623421 - Add WebRender visual metrics pageload tests Android r=perftest-reviewers,sparky This patch is allowing visual metrics android pageload tests to run with webrender. Differential Revision: https://phabricator.services.mozilla.com/D70668
2020-06-23 10:36:33 +00:00
webrender-run-on-projects: []
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
tier: 3
target:
by-app:
fenix:
by-test-platform:
android-hw.*-aarch64.*/.*:
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
index: mobile.v2.fenix.nightly.latest.arm64-v8a
Bug 1601006 - Fix download location of fenix performancetest apk in CI for raptor-browsertime r=stephendonner Differential Revision: https://phabricator.services.mozilla.com/D55864 --HG-- extra : moz-landing-system : lando
2019-12-04 21:16:29 +00:00
name: build/arm64-v8a/geckoNightly/target.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
default:
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
index: mobile.v2.fenix.nightly.latest.armeabi-v7a
Bug 1601006 - Fix download location of fenix performancetest apk in CI for raptor-browsertime r=stephendonner Differential Revision: https://phabricator.services.mozilla.com/D55864 --HG-- extra : moz-landing-system : lando
2019-12-04 21:16:29 +00:00
name: build/armeabi-v7a/geckoNightly/target.apk
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec:
by-test-platform:
android-hw-p2-8-0-android-aarch64.*:
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
index: gecko.v2.mozilla-esr68.signed-nightly.nightly.latest.mobile.android-aarch64-release-opt
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
name: build/target.apk
default:
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
index: gecko.v2.mozilla-esr68.signed-nightly.nightly.latest.mobile.android-api-16-release-opt
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
name: build/target.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow:
by-test-platform:
android-hw.*-aarch64.*/.*:
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
index: mobile.v2.reference-browser.raptor.latest.arm64-v8a
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
name: target.arm64-v8a.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
default:
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
index: mobile.v2.reference-browser.raptor.latest.armeabi-v7a
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
name: target.armeabi-v7a.apk
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: geckoview_example.apk
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
e10s: true
virtualization: hardware
activity:
by-app:
fenix: org.mozilla.fenix.IntentReceiverActivity
geckoview: org.mozilla.geckoview_example.GeckoViewActivity
Bug 1607891 - Add fennec (68) support to raptor-browsertime r=tarek Differential Revision: https://phabricator.services.mozilla.com/D59737 --HG-- extra : moz-landing-system : lando
2020-01-13 20:08:07 +00:00
fennec: org.mozilla.gecko.BrowserApp
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow: org.mozilla.reference.browser.BrowserTestActivity
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: None
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
binary-path:
by-app:
Bug 1652979 - Use org.mozilla.fenix package name for raptor/browsertime tests. r=jlorenzo Differential Revision: https://phabricator.services.mozilla.com/D83677
2020-07-21 14:45:01 +00:00
fenix: org.mozilla.fenix
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
geckoview: org.mozilla.geckoview_example
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: org.mozilla.firefox
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
refbrow: org.mozilla.reference.browser.raptor
Bug 1615257 - Enable google chrome android browsertime tests. r=perftest-reviewers,AlexandruIonescu This patch adds the capability to run Google Chrome for Android tests through Raptor-Browsertime. Chrome must be available on the device being tested, and there are no installation steps being added in this patch since CI already has the latest Chrome version available to test with. That said, this patch adds the ability to find the version of Chrome that is being tested and stores this in the Perfherder artifact. Getting this version is also necessary to be able to run Chrome with the correct chromedriver. Two tests are initially be enabled for Chrome in this patch: Amazon, and YouTube. They will only run through a cron task three days a week. The other changes done in this patch are required for Chrome to work with Raptor-Browsertime. Differential Revision: https://phabricator.services.mozilla.com/D65610 --HG-- extra : moz-landing-system : lando
2020-03-27 14:31:28 +00:00
default: None
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
mozharness:
script: raptor_script.py
config:
- raptor/android_hw_config.py
extra-options:
- --browsertime
Bug 1650871 - Add option to disable firefox window recorder. r=perftest-reviewers,AlexandruIonescu This patch adds an option to disable the firefox window recorder in browsertime, it also adds it to the browsertime-mobile taskcluster config since it is disabled there (but not on desktop). Differential Revision: https://phabricator.services.mozilla.com/D82431
2020-07-08 07:50:11 +00:00
# Bug 1635749, disable window recorder temporarily
- --browsertime-no-ffwindowrecorder
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
optimization:
Bug 1641131 - [taskgraph] Fix the 'push-interval-*' schema to not require an argument, r=jmaher The Backstop optimization doesn't take any arguments, yet the schema for 'push-optimization-*' requires a 'schedules-component' that goes ignored. Fix this. Differential Revision: https://phabricator.services.mozilla.com/D77058
2020-06-05 15:38:24 +00:00
push-interval-25: null
Bug 1623421 - Add WebRender visual metrics pageload tests Android r=perftest-reviewers,sparky This patch is allowing visual metrics android pageload tests to run with webrender. Differential Revision: https://phabricator.services.mozilla.com/D70668
2020-06-23 10:36:33 +00:00
variants:
by-app:
chrome-m: []
Bug 1648902 Remove webrender variant from fennec r=perftest-reviewers,Bebe Differential Revision: https://phabricator.services.mozilla.com/D81660
2020-06-30 10:37:22 +00:00
fennec: []
Bug 1623421 - Add WebRender visual metrics pageload tests Android r=perftest-reviewers,sparky This patch is allowing visual metrics android pageload tests to run with webrender. Differential Revision: https://phabricator.services.mozilla.com/D70668
2020-06-23 10:36:33 +00:00
default: ["webrender"]
Bug 1587826 - [ci] Use a transform to split raptor apps r=tomprince,perftest-reviewers,rwood Differential Revision: https://phabricator.services.mozilla.com/D48979 --HG-- extra : moz-landing-system : lando
2019-10-15 17:05:13 +00:00
Bug 1600392 - Use a single test INI and taskcluster configuration file for all raptor-browsertime android page-load test r=perftest-reviewers,davehunt,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D56392 --HG-- extra : moz-landing-system : lando
2019-12-09 18:01:05 +00:00
browsertime-tp6m:
description: "Raptor (browsertime) tp6 page-load tests on android"
raptor-test: tp6m
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
raptor-subtests:
by-app:
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
chrome-m:
- amazon
- youtube
default:
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- allrecipes
- amazon
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [amazon-search, amazon-s]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- bbc
- bing
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [bing-search-restaurants, bing-s-r]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- booking
- cnn
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [cnn-ampstories, cnn-amp]
- [ebay-kleinanzeigen, ebay-k]
- [ebay-kleinanzeigen-search, ebay-k-s]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- espn
- facebook
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [facebook-cristiano, fb-cris]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- google
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [google-maps, gmaps]
- [google-search-restaurants, gsearch-r]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- instagram
- imdb
- jianshu
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [microsoft-support, micros-sup]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- reddit
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [stackoverflow, stacko]
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
- web-de
- wikipedia
- youtube
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [youtube-watch, youtube-w]
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
apps: ["geckoview", "fenix", "fennec", "chrome-m", "refbrow"]
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
tier:
by-raptor-test:
amazon:
by-app:
fenix: 1
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
geckoview: 1
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
refbrow: 2
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: 2
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
default: 3
default:
by-app:
geckoview: 1
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
refbrow: 2
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: 2
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
default: 3
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
run-on-projects:
by-raptor-test:
amazon:
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
by-app:
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
fenix: []
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
chrome-m: []
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: []
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
geckoview:
by-pageload:
cold:
by-test-platform:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
&android-cold-settings
Bug 1649539 - Disable non-shippable G5 raptor tests in production. r=perftest-reviewers,Bebe A patch landed recently which added this build. This patch disables it in production. Differential Revision: https://phabricator.services.mozilla.com/D81733
2020-07-02 19:46:36 +00:00
android-hw-g5-7-0-arm7-api-16-shippable/opt: ['trunk', 'mozilla-beta']
android-hw-p2-8-0-android-aarch64-shippable/opt: ['trunk', 'mozilla-beta']
default: []
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
warm:
by-test-platform:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
&android-warm-settings
Bug 1649539 - Disable non-shippable G5 raptor tests in production. r=perftest-reviewers,Bebe A patch landed recently which added this build. This patch disables it in production. Differential Revision: https://phabricator.services.mozilla.com/D81733
2020-07-02 19:46:36 +00:00
android-hw-g5-7-0-arm7-api-16-shippable/opt: ['mozilla-central']
android-hw-p2-8-0-android-aarch64-shippable/opt: ['mozilla-central']
default: []
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
default:
by-test-platform:
Bug 1640278 - Fixup run-on-projects verification failures. r=sylvestre This is in-part a followup to 1638260 which fixed some cases of this problem. Depends on D76540 Differential Revision: https://phabricator.services.mozilla.com/D76746
2020-07-01 14:04:19 +00:00
android-hw-p2-.*aarch64-shippable/opt: ["mozilla-central"]
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
default: []
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
youtube:
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
by-app:
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
fenix: []
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
chrome-m: []
Bug 1641877 - Migrate reference browser raptor pageload tests to browsertime. r=perftest-reviewers,Bebe This patch moves all existing reference browser pageload tests from raptor-webext to browsertime. We also delete all raptor-webext reference browser tests. Differential Revision: https://phabricator.services.mozilla.com/D77474
2020-06-05 11:00:49 +00:00
refbrow: []
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
fennec: []
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
geckoview:
by-pageload:
cold:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
by-test-platform: *android-cold-settings
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
warm:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
by-test-platform: *android-warm-settings
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
default:
by-test-platform:
Bug 1649539 - Disable non-shippable G5 raptor tests in production. r=perftest-reviewers,Bebe A patch landed recently which added this build. This patch disables it in production. Differential Revision: https://phabricator.services.mozilla.com/D81733
2020-07-02 19:46:36 +00:00
android-hw-p2-.*aarch64-shippable/opt: ["mozilla-central", "try"]
Bug 1627246 - Disable Browsertime Chrome Release tests running on mozilla-central. r=perftest-reviewers,Marian This patch disabled chrome release tests on mozilla-central and has them run through the cron task instead. Differential Revision: https://phabricator.services.mozilla.com/D69570 --HG-- extra : moz-landing-system : lando
2020-04-03 14:31:22 +00:00
default: []
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
default:
by-pageload:
cold:
by-app:
geckoview:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
by-test-platform: *android-cold-settings
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
default: []
warm:
by-app:
geckoview:
Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt This patch does a few small things to clean up our CI tests: (1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others). (2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case. (3) Fennec vismet tests were previously excluded but are now included. (4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week. Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
by-test-platform: *android-warm-settings
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
default: []
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
pageload:
by-app:
fenix: both
Bug 1615255 - Enable all geckoview browsertime pageload tests. r=perftest-reviewers,Bebe,jmaher This patch enables all cold and warm pageload tests for browsertime anywhere that the raptor tests are running. Differential Revision: https://phabricator.services.mozilla.com/D74986
2020-05-20 16:53:07 +00:00
geckoview: both
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
refbrow: both
fennec: both
Bug 1616332 - Add all fenix pageload tests to raptor-browsertime. r=perftest-reviewers,ahal,AlexandruIonescu This patch adds all Fenix pageload tests to raptor-browsertime. To handle how the task is specified (specifying run-on-projects by raptor-test) the raptor.py taskgraph transforms had to be modified. The transform modifications change a couple things. First, the `raptor-subtests` is now the first thing to have it's keyed-by entries handled because it's values are used as keyed-by entries on other fields such as run-on-projects. Once it's values are resolved, we immediately split/clone the task into one per subtest entry (adding a `chunk-number` field that is used for more setup in the next transforms). After this, the rest of the fields have their keyed-by entries resolved. Differential Revision: https://phabricator.services.mozilla.com/D63222 --HG-- extra : moz-landing-system : lando
2020-02-24 12:57:20 +00:00
default: cold
Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests. Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
run-visual-metrics: true
Bug 1600392 - Use a single test INI and taskcluster configuration file for all raptor-browsertime android page-load test r=perftest-reviewers,davehunt,stephendonner Differential Revision: https://phabricator.services.mozilla.com/D56392 --HG-- extra : moz-landing-system : lando
2019-12-09 18:01:05 +00:00
treeherder-symbol: Btime(tp6m)
Bug 1601011 - Add gecko profiling support to raptor-browsertime (android) r=rwood Differential Revision: https://phabricator.services.mozilla.com/D57329 --HG-- extra : moz-landing-system : lando
2019-12-17 08:04:47 +00:00
Bug 1621344 - Add Android Browsertime youtube-playback tests r=perftest-reviewers,sparky,AlexandruIonescu Differential Revision: https://phabricator.services.mozilla.com/D67437
2020-07-02 09:33:41 +00:00
browsertime-youtube-playback-mobile:
description: "Browsertime YouTube Playback on Android"
treeherder-symbol: Btime(ytp)
raptor-subtests:
- [youtube-playback, ytp]
- [youtube-playback-av1-sfr, ytp-av1-sfr]
- [youtube-playback-h264-sfr, ytp-h264-sfr]
- [youtube-playback-h264-std, ytp-h264-std]
- [youtube-playback-vp9-sfr, ytp-vp9-sfr]
- [youtube-playback-widevine-h264-sfr, ytp-widevine-h264-sfr]
- [youtube-playback-widevine-hfr, ytp-widevine-hfr]
- [youtube-playback-widevine-vp9-sfr, ytp-widevine-vp9-sfr]
apps: ["fenix", "geckoview", "refbrow"]
run-on-projects: []
mozharness:
extra-options:
- --browsertime
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
browsertime-tp6m-live:
description: "Raptor (browsertime) tp6 live site page-load tests on android"
raptor-test: tp6m
raptor-subtests:
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- allrecipes
- amazon
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [amazon-search, amazon-s]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- bbc
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- bing
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [bing-search-restaurants, bing-s-r]
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- booking
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- booking-sf
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- cnn
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [cnn-ampstories, cnn-amp]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- discord
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [ebay-kleinanzeigen, ebay-k]
- [ebay-kleinanzeigen-search, ebay-k-s]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- espn
- expedia
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- facebook
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [facebook-cristiano, fb-cris]
- [fashionbeans, fashbea]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- google
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [google-accounts, gacc]
- [google-maps, gmaps]
- [google-search-restaurants, gsearch-r]
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- instagram
- imdb
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [imdb-firefox, imdb-f]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- jianshu
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [medium-article, medium]
- [microsoft-support, micros-sup]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- nytimes
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [people-article, people]
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- reddit
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [reddit-thread, reddit-thr]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
- rumble-fox
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [stackoverflow, stacko]
- [stackoverflow-question, stack-q]
- [urbandictionary-define, urbict-def]
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- web-de
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [wikia-marvel, wikia-m]
Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing. Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
- wikipedia
- youtube
Bug 1633874 - Update taskcluster settings to the new raptor file structure r=perftest-reviewers,sparky Differential Revision: https://phabricator.services.mozilla.com/D72946
2020-05-27 15:55:46 +00:00
- [youtube-watch, youtube-w]
Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday. Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
apps: ["fenix", "chrome-m"]
run-on-projects: []
pageload: cold
run-visual-metrics: true
treeherder-symbol: Btime-live(tp6m)
mozharness:
extra-options:
- --live-sites
Bug 1601011 - Add gecko profiling support to raptor-browsertime (android) r=rwood Differential Revision: https://phabricator.services.mozilla.com/D57329 --HG-- extra : moz-landing-system : lando
2019-12-17 08:04:47 +00:00
browsertime-tp6m-profiling:
description: "Raptor (browsertime) tp6 page-load tests on android with Gecko profiling"
raptor-test: tp6m
raptor-subtests: ['amazon', 'youtube']
apps: ["geckoview"]
pageload: cold
treeherder-symbol: Btime-Prof(tp6m)
mozharness:
script: raptor_script.py
config:
- raptor/android_hw_config.py
extra-options:
- --browsertime
- --gecko-profile
Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek Differential Revision: https://phabricator.services.mozilla.com/D61305 --HG-- extra : moz-landing-system : lando
2020-02-05 08:59:19 +00:00
Bug 1627279 - Use speedometer rather than raptor-speedometer-APP in browsertime tests. r=perftest-reviewers,alexandru.irimovici This patch changes the test that browsertime runs for speedometer from `raptor-speedometer-APP` to `speedometer` and changes some other small issues like the missing app name in the `extraOptions` field in the perfherder data. Differential Revision: https://phabricator.services.mozilla.com/D69581 --HG-- extra : moz-landing-system : lando
2020-04-07 13:27:30 +00:00
browsertime-speedometer-mobile:
description: "Browsertime Speedometer on Android"
Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek Differential Revision: https://phabricator.services.mozilla.com/D61305 --HG-- extra : moz-landing-system : lando
2020-02-05 08:59:19 +00:00
apps: ["geckoview", "fenix", "fennec"]
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
tier:
by-app:
fenix: 1
default: 3
run-on-projects:
by-app:
fenix: []
default:
by-test-platform:
Bug 1640278 - Fixup run-on-projects verification failures. r=sylvestre This is in-part a followup to 1638260 which fixed some cases of this problem. Depends on D76540 Differential Revision: https://phabricator.services.mozilla.com/D76746
2020-07-01 14:04:19 +00:00
android-hw-p2-.*aarch64.*/pgo: ["mozilla-central"]
android-hw-p2-.*aarch64-shippable/opt: ["mozilla-central"]
Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe This patch does a few things: (1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push. (2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task). (3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push. (4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant. (5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant. Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
default: []
Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek Differential Revision: https://phabricator.services.mozilla.com/D61305 --HG-- extra : moz-landing-system : lando
2020-02-05 08:59:19 +00:00
treeherder-symbol: Btime(sp)
mozharness:
extra-options:
- --browsertime
Bug 1627279 - Use speedometer rather than raptor-speedometer-APP in browsertime tests. r=perftest-reviewers,alexandru.irimovici This patch changes the test that browsertime runs for speedometer from `raptor-speedometer-APP` to `speedometer` and changes some other small issues like the missing app name in the `extraOptions` field in the perfherder data. Differential Revision: https://phabricator.services.mozilla.com/D69581 --HG-- extra : moz-landing-system : lando
2020-04-07 13:27:30 +00:00
- --test=speedometer
Reference in New Issue Copy Permalink