Commit Graph
715 Commits
Author SHA1 Message Date
Dave Townsend 2cbd17ec23 Bug 2043602: Run automated browser-chrome and mochitest-chrome and talos tests with Nova enabled. r=sparky,perftest-reviewers,taskgraph-reviewers,ahal
Adds the following tasks to mozilla-central:

mochitest-chrome with nova enabled
browser-chrome with nova enabled
browser-chrome with nova and vertical tabs enabled
various performance tests with nova enabled

Differential Revision: https://phabricator.services.mozilla.com/D303348
2026-06-09 19:31:54 +00:00
Chun-Min Chang 8779aef476 Bug 2044691 - Restrict WebCodecs camera tests to Firefox r=sparky,perftest-reviewers
The WebCodecs camera variants (ve-*-cam) acquire frames from a fake camera
that is only available in Firefox, via the media.navigator.streams.fake family
of preferences. On Chrome and custom-car (Chromium) those preferences have no
effect, so the camera tests find no video input device and permafail. Remove
the camera variants from the chrome and custom-car subtest lists; they continue
to run on Firefox. The canvas (non-camera) variants are unaffected.

Differential Revision: https://phabricator.services.mozilla.com/D304619
2026-06-09 17:36:58 +00:00
agoloman 1dc7023890 Revert "Bug 2043602: Run automated browser-chrome and mochitest-chrome and talos tests with Nova enabled. r=sparky,perftest-reviewers,taskgraph-reviewers,ahal" for causing awsy failures.
This reverts commit 2268b86368.
2026-06-09 17:35:46 +00:00
Dave Townsend 2268b86368 Bug 2043602: Run automated browser-chrome and mochitest-chrome and talos tests with Nova enabled. r=sparky,perftest-reviewers,taskgraph-reviewers,ahal
Adds the following tasks to mozilla-central:

mochitest-chrome with nova enabled
browser-chrome with nova enabled
browser-chrome with nova and vertical tabs enabled
various performance tests with nova enabled

Differential Revision: https://phabricator.services.mozilla.com/D303348
2026-06-09 13:33:19 +00:00
KS 0fe5dcf18a Bug 2014503 - Upgrade linux to use mitmproxy 12.2.1 r=perftest-reviewers,taskgraph-reviewers,sparky,bhearsum
This patch enables mitmproxy 12 on the Linux platform. Following up on
the work of Bug 1983694. Previously linux was hardcoded to mitmproxy 8
due to compatibility issues on ubuntu 18

Additionally linux 18 platform restriction for browsertime is removed
(browsertime raptor chrome/car/wasm). Also tp6-bench is disabled as the
stale recordings mixed in there were failing.

Additionally Bug 2031677 is also fulfilled

Differential Revision: https://phabricator.services.mozilla.com/D299175
2026-06-03 15:47:38 +00:00
Abhishek Nimalan d57d470633 Bug 2036105 - Update outdated ./mach try perf --help documentation. r=perftest-reviewers,fbilt
Differential Revision: https://phabricator.services.mozilla.com/D301567
2026-06-02 21:31:03 +00:00
florin.bilt dd8d75883d Bug 2040768 - Enable sp3 on autoland for windows ref-hw r=perftest-reviewers,kshampur
Differential Revision: https://phabricator.services.mozilla.com/D303095
2026-05-31 23:27:05 +00:00
florin.bilt 359a5ad6fd Bug 1934169 - Disable browsertime youtube-playback power tests on android-hw-a55 r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D303282
2026-05-29 19:03:36 +00:00
acreskeyMoz 31ee9765c7 Bug 2034480 - Add a browsertime navigation test that records speculation rules prefetch behaviour - Chrome and Firefox r=sunil,perftest-reviewers,fbilt
A local-server browsertime test to measure navigation time when the
Speculation Rules API prefetches a link, so we can track the performance
of the upcoming prefetch feature.

Differential Revision: https://phabricator.services.mozilla.com/D296731
2026-05-25 16:06:33 +00:00
KS 8850c231e2 Bug 2017152 - Move sp3 tests to LT r=perftest-reviewers,sparky,mozperftest-reviewers
Route SP3+A55 tests to run on both Lambdatest and BitBar temporarily, to
get some longitudinal data comparison.
Additionally, when running SP3 on LT, disable accessibility services,
scrcpy, and WebRTC packages in an attempt to reduce variance.

Differential Revision: https://phabricator.services.mozilla.com/D291794
2026-05-12 21:10:41 +00:00
acreskeyMoz 4345b449ee Bug 2025501 - Add "Adding Performance Tests" guide to perfdocs r=perftest-reviewers,sparky
Make it easier to write a new performance test by adding documention on how to select a test framework as well as starter code.

Differential Revision: https://phabricator.services.mozilla.com/D289304
2026-05-12 21:10:07 +00:00
Sylvestre Ledru 62433837c3 no bug - doc/telemetry alert: defines what recently means r=sparky,perftest-reviewers DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D299687
2026-05-11 16:01:38 +00:00
KS 8fd01b1989 Bug 2038340 - Temporarily reduce Windows perf test load during windows PSU replacement r=perftest-reviewers,sparky
This patch temporarily disables and changes scheduling of some perftest
tasks on Windows NUC13 hardware while we are replacing some hardware
components. Here we will prioritize important tests and adjust
accordingly over the next few weeks.

Differential Revision: https://phabricator.services.mozilla.com/D299474
2026-05-11 11:46:43 +00:00
Abhishek Nimalan 853c59f511 Bug 2033158 - Add documentation for generating Simpleperf profiles for Speedometer 3 tests on Android. r=perftest-reviewers,kshampur
Add documentation about using --native-profiling and adding Simpleperf
profiling to Raptor-Browsertime tests.

Differential Revision: https://phabricator.services.mozilla.com/D298352
2026-05-07 23:35:33 +00:00
Morgan Rae Reschenberg cfd02a235a Bug 1893707: Introduce perftest to track cost of adding ComputedRole call in GetARIAState r=Jamie,mozperftest-reviewers,sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D289670
2026-05-06 20:13:34 +00:00
Jonathan Moss 2cdd8205ba Bug 2037141 - Remove xperf-talos tasks from win11 24h2 in Azure r=perftest-reviewers,kshampur
xperf-talos has been running on win11 25h2 in parallel with 24h2 since
Bug 2032529 landed on 2026-04-17. Drop the 24h2 xperf-talos tasks now
that 25h2 results are stable.

Differential Revision: https://phabricator.services.mozilla.com/D298580
2026-05-06 20:04:02 +00:00
Markus Stange 185b666595 Bug 2035897 - Don't profile sp3 with 'ipcmessages', in order to reduce profile sizes. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D297386
2026-05-05 23:53:29 +00:00
Markus Stange 3def341a84 Bug 2035608 - Always run speedometer3 at the same port (I picked 62763), to ease before/after comparisons. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D297385
2026-05-05 23:53:26 +00:00
Gregory Mierzwinski df61e1661d Bug 1868773 - Update docs to use new perfdocs comand. r=fbilt,perftest-reviewers,mozperftest-reviewers,dom-storage-reviewers,dom-worker-reviewers,ai-platform-reviewers,kshampur,jesup,asuth
This patch takes care of updating all usages of the old perfdocs command to use `./mach perfdocs` instead.

Differential Revision: https://phabricator.services.mozilla.com/D297131
2026-05-05 21:42:48 +00:00
Gregory Mierzwinski 2d979acb38 Bug 1868773 - Add ./mach perfdocs command for generating performance docs. r=kshampur,perftest-reviewers,mozperftest-reviewers
This patch adds the `./mach perfdocs` command to mozperftest. It also sets up the logger required by perfdocs for producing reviewbot-compatible lint errors, and output these into a JSON file. A `--generate` option is added to enable re-generation of the documentation. At the same time, the existing lint task is changed to use this new command.

Because of a slight change in how perfdocs works, this patch also fixes a bug with the talos gatherer that had caused an existing failure to slip through.

Differential Revision: https://phabricator.services.mozilla.com/D297130
2026-05-05 21:42:45 +00:00
agoloman 4856722c71 Revert "Bug 2035897, Bug 2035608 - Don't profile sp3 with 'ipcmessages', in order to reduce profile sizes. r=perftest-reviewers,sparky" for causing sp3 failures.
This reverts commit 867f4d29c8.

Revert "Bug 2035608 - Always run speedometer3 at the same port (I picked 62763), to ease before/after comparisons. r=perftest-reviewers,sparky"

This reverts commit 34f9ef67a6.
2026-05-05 19:57:12 +00:00
Markus Stange 867f4d29c8 Bug 2035897 - Don't profile sp3 with 'ipcmessages', in order to reduce profile sizes. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D297386
2026-05-05 17:09:47 +00:00
Markus Stange 34f9ef67a6 Bug 2035608 - Always run speedometer3 at the same port (I picked 62763), to ease before/after comparisons. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D297385
2026-05-05 17:09:44 +00:00
Sylvestre Ledru 37caf1497a Bug 2036171 - Re-generate perfdocs to fix lint drift. r=perftest-reviewers,sparky DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D298088
2026-05-04 15:13:26 +00:00
Chun-Min Chang 5b427df527 Bug 2028273 - Add camera source test entries for WebCodecs encoder benchmarks r=perftest-reviewers,afinder
Add raptor test definitions for all codec/latency-mode combinations
using camera as the frame source with Firefox's fake camera device
(media.getusermedia.camera.fake.force). Linux skips H264 camera tests
since x264 is not available; Chrome and custom-car also omit full-res
H264, matching existing canvas test patterns.

Differential Revision: https://phabricator.services.mozilla.com/D291336
2026-05-01 23:26:45 +00:00
Chun-Min Chang 6b08da8885 Bug 2027465 - Refactor WebCodecs encoder benchmarks and add I420 pixel format tests r=perftest-reviewers,afinder
Pre-generate all VideoFrames before encoding tests begin so that frame
creation overhead does not affect benchmark measurements. Add I420 as a
selectable input pixel format alongside RGBX. Add raptor test entries
for I420 variants across all existing codec and latency-mode combinations.

Differential Revision: https://phabricator.services.mozilla.com/D290726
2026-05-01 23:26:42 +00:00
Gregory Mierzwinski c1f215a640 Bug 2036171 - Re-generate perfdocs on autoland to fix failure. r?#perftest,kshampur
Differential Revision: https://phabricator.services.mozilla.com/D297743
2026-04-30 21:28:29 +00:00
Sylvestre Ledru a2ce5437ce Bug 2024589 - doc: use the :searchfox: macro r=asuth,perftest-reviewers,necko-reviewers,mozperftest-reviewers,geckoview-reviewers,extension-reviewers,credential-management-reviewers,search-reviewers,releng-reviewers,places-reviewers,profiler-reviewers,win-reviewers,omc-reviewers,urlbar-reviewers,permissions-reviewers,core-sessionstore-reviewers,browser-installer-reviewers,layout-reviewers,dom-worker-reviewers,ai-platform-reviewers,niklas,sthompson,janerik,bhearsum,valentin,dshin,sparky,scunnane,canaltinova,hanna_a,handyman,ahal,farre,jteow,emz,nrishel,ohall,dimi,robwu,emilio
Differential Revision: https://phabricator.services.mozilla.com/D288640
2026-04-30 13:28:53 +00:00
Sylvestre Ledru 62b1ca8d05 Bug 2024589 - adjust the code: searchfox.org/mozilla-central is now redirecting to searchfox.org/firefox-main/ r=asuth,perftest-reviewers,necko-reviewers,jgraham,webcompat-reviewers,mozperftest-reviewers,geckoview-reviewers,extension-reviewers,credential-management-reviewers,devtools-reviewers,taskgraph-reviewers,releng-reviewers,desktop-theme-reviewers,win-reviewers,translations-reviewers,omc-reviewers,firefox-desktop-core-reviewers ,home-newtab-reviewers,core-sessionstore-reviewers,browser-installer-reviewers,profiles-reviewers,dom-worker-reviewers,geckodriver-reviewers,ai-platform-reviewers,Sasha,niklas,manuel,janerik,bhearsum,valentin,twisniewski,nchevobbe,emcminn,webrtc-reviewers,mjf,handyman,mconley,mossop,ahal,sparky,nrishel,robwu,ohall,dimi,hjones
Differential Revision: https://phabricator.services.mozilla.com/D288623
2026-04-30 13:28:49 +00:00
florin.bilt c443c9a735 Bug 1682027 - Disable twitch on Windows 11 24H2 and facebook cristiano on android due to high failure rate r=perftest-reviewers,kshampur
Differential Revision: https://phabricator.services.mozilla.com/D297036
2026-04-29 08:19:37 +00:00
KS 927a4dcf53 Bug 2032654 - Run macOS arm64 pageload tests on autoland r=perftest-reviewers,fbilt
Previously tp6 essential tests were enabled on apple silicon machines
and are running on mozilla-central. This patch updates it to include
autoland now. This will also ensure it appears on AWFY in the same
consistent way as other platforms.

Differential Revision: https://phabricator.services.mozilla.com/D295191
2026-04-21 15:59:14 +00:00
Jonathan Moss 8a7795f884 Bug 2032529 - Migrate xperf-talos tasks from win11 24h2 to win11 25h2 in Azure r=taskgraph-reviewers,perftest-reviewers,ahal,kshampur
Differential Revision: https://phabricator.services.mozilla.com/D294714
2026-04-17 02:11:26 +00:00
Gregory Mierzwinski 518be1e089 Bug 1942862 - Update telemetry alerting docs with latest information. r=aglavic,perftest-reviewers,bas DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D293516
2026-04-17 00:41:05 +00:00
Jonathan Moss 4e2229e696 Bug 2022544 - Add 25h2 test platforms and split test-sets for migration r=taskgraph-reviewers,perftest-reviewers,releng-reviewers,ahal,kshampur
Add windows11-*-25h2 entries to worker.py so the taskgraph can resolve
worker pools for 25h2 test platforms. Split windows11-24h2-tests into
two test-sets: windows11-24h2-tests retains suites still on 24h2 cloud
pools (reftest, crashtest, jsreftest, firefox-ui-functional) while
windows11-25h2-tests contains suites already migrated to 25h2 pools.
Create new 25h2 platform entries in test-platforms.yml for the migrated
suites and slim down 24h2 entries to the remaining suites plus perf.

Differential Revision: https://phabricator.services.mozilla.com/D287593
2026-04-14 23:45:05 +00:00
Jan de Mooij a8fe84dc75 Bug 2030907 - Update JetStream 3 to the latest version. r=kshampur,perftest-reviewers
JetStream 3 has been officially released. This patch updates our version in CI
to the latest commit of this branch:

https://github.com/WebKit/JetStream/commits/JetStream3.0/

Differential Revision: https://phabricator.services.mozilla.com/D293464
2026-04-10 12:34:37 +00:00
KS ee2b0507d3 Bug 2021939 - Disable most perf tests from running on ubuntu 18.04 r=taskgraph-reviewers,perftest-reviewers,mozperftest-reviewers,aglavic,ahal
Part of the ubuntu 18.04 -> 24.04 migration. (Bug 1983694) Add a couple
restriction transforms as some tests still need to remain on 18.04 for
the time being, but a majority of tests can be removed.

Additionally, a minor fix is added to the browsertime network-bench
tests as the *-qr suffix in the config was preventing 24.04 tasks from
being picked up.

Differential Revision: https://phabricator.services.mozilla.com/D289425
2026-04-10 00:13:25 +00:00
KS 0c6b96da7a Bug 1974848 - Update a few recordings with mitmproxy 12. r=perftest-reviewers,aglavic
Some tests were either perma failing or highly intermittent when
replayed with mitmproxy 12. This patch updates `amazon`, `google-docs`,
and `cnn` with new recordings

Additionally, `wikia` and `google-search` are pinned to mitmproxy 11 for
the time being.

Differential Revision: https://phabricator.services.mozilla.com/D288319
2026-04-08 14:38:33 +00:00
KS 9f9489743c Bug 2014800 - Enable some tp6 tests on apple silicon r=perftest-reviewers,fbilt
Previously we did not run pageload tests on Apple silicon as we had
limited capacity and visual metrics did not work. We have much more
capacity now and the visual metrics problem doesn't occur anymore.

For starters we can just enable tp6-essential and slowly add more.

This patch also builds on the mitmproxy 12 upgrade (and more recent
versions of mitmproxy have an arm64 mitmdump binary so we don't need to
use rosetta)

Differential Revision: https://phabricator.services.mozilla.com/D282075
2026-04-08 14:38:30 +00:00
KS decf3e1ad7 Bug 1974848 - Upgrade mitmproxy version to 12.2.1 r#perftest r=perftest-reviewers,sparky
This patch enables performance pageload tests to now use mitmproxy
12.2.1, only on the Mac/Windows/Android platform.
This will run on a subset of tests as the binary doesn't properly run on
all of the old recordings.

Differential Revision: https://phabricator.services.mozilla.com/D282044
2026-04-08 14:38:24 +00:00
Lars Eggert 5b8119be17 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 12:33:46 +00:00
Silaghi 38ab85b9f6 Revert "Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky" for causing build bustages at dns/nsHostResolver.cpp
This reverts commit b1cf0a3ab6.
2026-03-20 10:03:47 +00:00
Lars Eggert b1cf0a3ab6 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 09:34:38 +00:00
Silaghi f117cb70b5 Revert "Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky" for causing build bustages.
This reverts commit f8b8fa5d20.
2026-03-20 06:22:02 +00:00
Lars Eggert f8b8fa5d20 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 05:28:17 +00:00
acreskeyMoz 176e1ea5d3 Bug 2024205 - Disable usatoday.com live-site tests due to failure rate and lack of value r=perftest-reviewers,sparky
This live site test is failing and has provided limited value, so removing.

Differential Revision: https://phabricator.services.mozilla.com/D288431
2026-03-18 19:31:22 +00:00
Sylvestre Ledru befc8b47bc Bug 2023377 - doc: refresh the perfdocs files r=sparky,perftest-reviewers DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D287972
2026-03-16 15:29:21 +00:00
Carla Severe de8da1a9df Bug 2022708 - Format links and spacing in Perfcompare docs. r=sparky,perftest-reviewers DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D287252
2026-03-13 16:28:43 +00:00
KS 1e7b92120e Bug 2014270 - Rename speedometer to speedometer2 and disable on production branches. r=perftest-reviewers,sparky
Speedometer 2 currently runs as "speedometer" in CI. Couple of issues

- can cause false regression alerts
- naming confusion with speedometer3

this patch renames the test from speedometer to speedometer2 and
disables it on all production branches while keeping it available for
Try pushes as the spidermonkey team still finds it useful for JS
sensitive changes

Differential Revision: https://phabricator.services.mozilla.com/D286273
2026-03-13 01:23:27 +00:00
Valentin Gosu 64b0d74d1d Bug 2009407 - Make trr_bench run as a perftest r=perftest-reviewers,mozperftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D283121
2026-03-12 23:46:58 +00:00
Gregory Mierzwinski 82152a1620 Bug 2022585 - Regenerate perfdocs to resolve expiration issues. r=perftest-reviewers,kshampur DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D287151
2026-03-11 16:48:52 +00:00