Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-11-24 21:31:04 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Bug 1734414 - Remove media autoplay pref settings from our profiles. r=perftest-reviewers,kimberlythegeek,AlexandruIonescu

Browse Source 
Differential Revision: https://phabricator.services.mozilla.com/D130990
This commit is contained in:
afinder 2021-12-02 12:16:23 +00:00
parent 1fe0118917
commit c2eafbc0e5
6 changed files with 96 additions and 43 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

25
testing/perfdocs/generated/raptor.rst
View File

@ -1158,6 +1158,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 360000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
@ -1216,6 +1217,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<http://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&exclude=1,2&muted=true>`__
@ -1238,6 +1240,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1264,6 +1267,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
@ -1286,6 +1290,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
@ -1308,7 +1313,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
@ -1331,7 +1336,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
@ -1354,6 +1359,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1405,6 +1411,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1455,6 +1462,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
@ -1477,6 +1485,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
@ -1499,7 +1508,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
@ -1522,7 +1531,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
@ -1545,6 +1554,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1595,7 +1605,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1646,7 +1656,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -1697,7 +1707,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: {"media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
@ -2123,7 +2133,6 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **playback**: mitmproxy
* **playback pageset manifest**: mitm6-linux-firefox-cnn.manifest
* **playback version**: 6.0.2
* **preferences**: {"media.autoplay.default": 5, "media.autoplay.ask-permission": true, "media.autoplay.blocking_policy": 1, "media.autoplay.block-webaudio": true, "media.allowed-to-play.enabled": false, "media.block-autoplay-until-in-foreground": true}
* **secondary url**: `<https://www.cnn.com/weather>`__
* **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
* **type**: pageload

8
testing/profiles/raptor/user.js
View File

@ -43,3 +43,11 @@ user_pref('datareporting.healthreport.uploadEnabled', false);
// profiles we use to analyze performance regressions.
// https://bugzilla.mozilla.org/show_bug.cgi?id=1706180
user_pref('toolkit.telemetry.initDelay', 99999999);
// disable autoplay for raptor tests
user_pref('media.autoplay.default', 5);
user_pref('media.autoplay.ask-permission', true);
user_pref('media.autoplay.blocking_policy', 1);
user_pref('media.autoplay.block-webaudio', true);
user_pref('media.allowed-to-play.enabled', false);
user_pref('media.block-autoplay-until-in-foreground', true);

12
testing/raptor/raptor/browsertime/base.py
View File

@ -215,18 +215,6 @@ class Browsertime(Perftest):
# Wait a bit longer when we run live site tests
page_cycle_delay = "5000"
# Prevent live sites from autoplaying media
self.profile.set_preferences(
{
"media.autoplay.default": 5,
"media.autoplay.ask-permission": True,
"media.autoplay.blocking_policy": 1,
"media.autoplay.block-webaudio": True,
"media.allowed-to-play.enabled": False,
"media.block-autoplay-until-in-foreground": True,
}
)
# All the configurations in the browsertime_options variable initialization
# and the secondary_url are priority 3, since none overlap they are grouped together
browsertime_options = [

6
testing/raptor/raptor/tests/benchmarks/webaudio.ini
View File

@ -16,5 +16,11 @@ page_timeout = 360000
test_url = http://<host>:<port>/webaudio/index.html?raptor
type = benchmark
unit = score
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false}
[webaudio]

82
testing/raptor/raptor/tests/benchmarks/youtube-playback.ini
View File

@ -28,6 +28,12 @@ subtest_unit = score
type = benchmark
unit = score
use_live_sites = true
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false}
[youtube-playback]
alert_on = H264.1080p30@1X_dropped_frames,
@ -69,14 +75,26 @@ test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-
[youtube-playback-h264-full-1080p30]
apps = firefox
preferences = {"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2
[youtube-playback-h264-full-1080p60]
apps = firefox
preferences = {"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2
[youtube-playback-h264-sfr]
@ -99,14 +117,26 @@ test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-
[youtube-playback-v9-full-1080p30]
apps = firefox
preferences = {"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2
[youtube-playback-v9-full-1080p60]
apps = firefox
preferences = {"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"full-screen-api.allow-trusted-requests-only": false,
"full-screen-api.warning.timeout": 0}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2
[youtube-playback-vp9-sfr]
@ -115,21 +145,39 @@ test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-
[youtube-playback-widevine-h264-sfr]
apps = firefox, geckoview, fenix, refbrow, chrome
preferences = {"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
[youtube-playback-widevine-hfr]
apps = firefox, geckoview, fenix, refbrow, chrome
preferences = {"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
[youtube-playback-widevine-vp9-sfr]
apps = firefox, geckoview, fenix, refbrow, chrome
preferences = {"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
preferences = {"media.autoplay.default": 0,
"media.autoplay.ask-permission": false,
"media.autoplay.blocking_policy": 0,
"media.autoplay.block-webaudio": false,
"media.allowed-to-play.enabled": true,
"media.block-autoplay-until-in-foreground": false,
"media.eme.enabled": true,
"media.gmp-manager.updateEnabled": true,
"media.eme.require-app-approval": false}
test_url = https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

6
testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.ini
View File

@ -42,12 +42,6 @@ test_url = https://www.buzzfeed.com/
[cnn]
playback_pageset_manifest = mitm6-linux-firefox-cnn.manifest
playback_version = 6.0.2
preferences = {"media.autoplay.default": 5,
"media.autoplay.ask-permission": true,
"media.autoplay.blocking_policy": 1,
"media.autoplay.block-webaudio": true,
"media.allowed-to-play.enabled": false,
"media.block-autoplay-until-in-foreground": true}
secondary_url = https://www.cnn.com/weather
test_url = https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html