Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-11-23 12:51:06 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Bug 1890306 - Add mitmproxy 10 for use on android performance testing. r=perftest-reviewers,sparky

Browse Source 
This patch makes available the mitm 10 binary for android, and at the
moment only runs it on recordings using version 8 as there are errors on
older versions so we might as well wait until we record those.

These subset of sites are bild-de, allrecipes, instagram, and sina

Differential Revision: https://phabricator.services.mozilla.com/D223829
This commit is contained in:
KS 2024-10-02 17:43:20 +00:00
parent 64e0348ee5
commit 0989e534a0
4 changed files with 45 additions and 31 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
testing/mozbase/mozproxy/mozproxy/backends/mitm/manifests/mitmproxy-rel-bin-10.4.2-linux64.manifest Normal file
View File

@ -0,0 +1,10 @@
[
{
"filename": "mitmproxy-10.4.2-linux-x86_64.tar.gz",
"size": 146945838,
"algorithm": "sha512",
"digest": "847bb55651b67b248fa33242484335e4c5fc1ead914fb297052a856447c7681853d8b3c9a59aa4634e4db738f907aa918ef804198bc7b58ebe5af0323ced3944",
"unpack": true,
"visibility": "public"
}
]

2
testing/mozbase/mozproxy/mozproxy/backends/mitm/mitm.py
View File

@ -293,7 +293,7 @@ class Mitmproxy(Playback):
else:
# playback mode
if len(self.playback_files) > 0:
if self.config["playback_version"] == "8.1.1":
if self.config["playback_version"] in ["8.1.1", "10.4.2"]:
command.extend(
[
"--set",

60
testing/perfdocs/generated/raptor.rst
View File

@ -28102,7 +28102,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm8-android-gve-allrecipes.manifest
* **playback version**: 8.1.1
* **playback version**: 10.4.2
* **support class**: browsertime_pageload.py
* **test url**: `<https://www.allrecipes.com/>`__
* **type**: pageload
@ -28251,7 +28251,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#26>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#27>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -28826,7 +28826,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#29>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#30>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -28996,13 +28996,13 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#32>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#33>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm8-android-fenix-bild-de.manifest
* **playback version**: 8.1.1
* **playback version**: 10.4.2
* **support class**: browsertime_pageload.py
* **test url**: `<https://www.bild.de/sport/american-football/nfl/super-bowl-rekordquote-fuer-die-nfl-87139668.bild.html>`__
* **type**: pageload
@ -29216,7 +29216,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#36>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#38>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -29436,7 +29436,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#39>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#41>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -29656,7 +29656,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#42>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#44>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -29876,7 +29876,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#45>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#47>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -30376,7 +30376,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#48>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#50>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -30596,7 +30596,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#51>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#53>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -30816,7 +30816,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#54>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#56>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -31036,7 +31036,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#57>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#59>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -31256,7 +31256,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#60>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#62>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -31591,7 +31591,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#63>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#65>`__
* **login**: true
* **lower is better**: true
* **page cycles**: 25
@ -31937,7 +31937,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#68>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#70>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -32157,7 +32157,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#71>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#73>`__
* **login**: true
* **lower is better**: true
* **page cycles**: 25
@ -32313,7 +32313,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#76>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#78>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -32533,7 +32533,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#79>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#81>`__
* **login**: true
* **lower is better**: true
* **page cycles**: 25
@ -32754,7 +32754,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#84>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#86>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -33219,14 +33219,14 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#87>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#89>`__
* **login**: true
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm8-android-gve-instagram.manifest
* **playback version**: 8.1.1
* **playback version**: 10.4.2
* **support class**: browsertime_pageload.py
* **test url**: `<https://www.instagram.com>`__
* **type**: pageload
@ -33730,7 +33730,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#92>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#95>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -33885,7 +33885,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#95>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#98>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -34350,13 +34350,13 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#98>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#101>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm8-android-fenix-sina.manifest
* **playback version**: 8.1.1
* **playback version**: 10.4.2
* **support class**: browsertime_pageload.py
* **test url**: `<https://www.sina.com.cn/>`__
* **type**: pageload
@ -34530,7 +34530,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#102>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#106>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -34750,7 +34750,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#105>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#109>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -35265,7 +35265,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#108>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#112>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -35730,7 +35730,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **benchmark page**: true
* **browser cycles**: 15
* **expected**: pass
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#111>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#115>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000

4
testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml
View File

@ -20,6 +20,7 @@ support_class = "browsertime_pageload.py"
## Keep this test list in alphabetical order
[allrecipes]
playback_version = "10.4.2"
test_url = "https://www.allrecipes.com/"
playback_pageset_manifest = "mitm8-android-gve-{subtest}.manifest"
@ -30,6 +31,7 @@ test_url = "https://www.amazon.com"
test_url = "https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone"
[bild-de]
playback_version = "10.4.2"
playback_pageset_manifest = "mitm8-android-fenix-{subtest}.manifest"
test_url = "https://www.bild.de/sport/american-football/nfl/super-bowl-rekordquote-fuer-die-nfl-87139668.bild.html"
@ -85,6 +87,7 @@ test_url = "https://www.google.com/search?q=restaurants+near+me"
test_url = "https://m.imdb.com/"
[instagram]
playback_version = "10.4.2"
login = true
playback_pageset_manifest = "mitm8-android-gve-{subtest}.manifest"
test_url = "https://www.instagram.com"
@ -96,6 +99,7 @@ test_url = "https://support.microsoft.com/en-us"
test_url = "https://www.reddit.com"
[sina]
playback_version = "10.4.2"
playback_pageset_manifest = "mitm8-android-fenix-{subtest}.manifest"
test_url = "https://www.sina.com.cn/"