Bug 1918730 - Run speedometer3 on windows 11 reference hardware. r=perftest-reviewers,kshampur

Differential Revision: https://phabricator.services.mozilla.com/D226495
This commit is contained in:
Greg Mierzwinski 2024-10-23 12:13:05 +00:00
parent 48c3cfc76d
commit de7f92bd76
5 changed files with 97 additions and 677 deletions

View File

@ -362,6 +362,12 @@ browsertime-benchmark:
safari-tp: []
default:
- [speedometer3, sp3]
windows11-64-.*-hw-ref.*:
by-app:
safari: []
safari-tp: []
default:
- [speedometer3, sp3]
default:
by-app:
firefox:
@ -447,11 +453,13 @@ browsertime-benchmark:
# Bug 1909894, windows 10 + sp3 temporarily
windows10-64.*shippable.*-qr.*: [mozilla-central]
(linux|windows11-64|macosx1015|macosx1400).*shippable-qr.*: [trunk]
windows11-64-.*-hw-ref-shippable.*: [mozilla-central]
.*nightlyasrelease.*: [autoland, mozilla-central]
default: []
custom-car:
by-test-platform:
(linux|windows).*shippable-qr.*: [mozilla-central]
windows11-64-.*-hw-ref-shippable.*: [mozilla-central]
default: []
safari-tp:
by-test-platform:

View File

@ -185,7 +185,7 @@ windows11-64-2009-hw-ref-shippable/opt:
msix: repackage-signing-msix-win64/opt
default: build-signing-win64/opt
test-sets:
- talos-ref-hw
- browsertime-ref-hw
- windows-ref-hw-tests
windows11-64-2009-hw-ref/opt:
@ -195,7 +195,7 @@ windows11-64-2009-hw-ref/opt:
msix: repackage-signing-msix-win64/opt
default: build-signing-win64/opt
test-sets:
- talos-ref-hw
- browsertime-ref-hw
- windows-ref-hw-tests
windows11-64-shippable-qr/opt:

View File

@ -84,9 +84,6 @@ talos-profiling:
- talos-realworld-webextensions-profiling
- talos-webgl-profiling
talos-ref-hw:
- talos-webgl
# Bug 1909894, windows 10 + sp3 temporarily
browsertime-benchmark:
- browsertime-benchmark
@ -134,6 +131,9 @@ browsertime-high-priority:
- browsertime-benchmark
- browsertime-tp6
browsertime-ref-hw:
- browsertime-benchmark
awsy:
- awsy
- awsy-base

View File

@ -3308,6 +3308,48 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3721,6 +3763,48 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1

View File

@ -1152,48 +1152,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -2328,48 +2286,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -2536,48 +2452,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3002,48 +2876,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3211,48 +3043,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3420,48 +3210,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3629,48 +3377,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -3838,48 +3544,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -4047,48 +3711,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -4256,48 +3878,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -4465,48 +4045,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -4674,48 +4212,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -4883,48 +4379,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -5092,48 +4546,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -5301,48 +4713,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -5510,48 +4880,6 @@ For the sample commands found below, note that the capitalization used is import
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-2009-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **talos-webgl**
- ❌
- ❌
- ❌
- ❌
* - **talos-webgl-swr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1