Commit Graph
83 Commits
Author SHA1 Message Date
Morgan Rae Reschenberg cfd02a235a Bug 1893707: Introduce perftest to track cost of adding ComputedRole call in GetARIAState r=Jamie,mozperftest-reviewers,sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D289670
2026-05-06 20:13:34 +00:00
Sylvestre Ledru a2ce5437ce Bug 2024589 - doc: use the :searchfox: macro r=asuth,perftest-reviewers,necko-reviewers,mozperftest-reviewers,geckoview-reviewers,extension-reviewers,credential-management-reviewers,search-reviewers,releng-reviewers,places-reviewers,profiler-reviewers,win-reviewers,omc-reviewers,urlbar-reviewers,permissions-reviewers,core-sessionstore-reviewers,browser-installer-reviewers,layout-reviewers,dom-worker-reviewers,ai-platform-reviewers,niklas,sthompson,janerik,bhearsum,valentin,dshin,sparky,scunnane,canaltinova,hanna_a,handyman,ahal,farre,jteow,emz,nrishel,ohall,dimi,robwu,emilio
Differential Revision: https://phabricator.services.mozilla.com/D288640
2026-04-30 13:28:53 +00:00
Sylvestre Ledru 62b1ca8d05 Bug 2024589 - adjust the code: searchfox.org/mozilla-central is now redirecting to searchfox.org/firefox-main/ r=asuth,perftest-reviewers,necko-reviewers,jgraham,webcompat-reviewers,mozperftest-reviewers,geckoview-reviewers,extension-reviewers,credential-management-reviewers,devtools-reviewers,taskgraph-reviewers,releng-reviewers,desktop-theme-reviewers,win-reviewers,translations-reviewers,omc-reviewers,firefox-desktop-core-reviewers ,home-newtab-reviewers,core-sessionstore-reviewers,browser-installer-reviewers,profiles-reviewers,dom-worker-reviewers,geckodriver-reviewers,ai-platform-reviewers,Sasha,niklas,manuel,janerik,bhearsum,valentin,twisniewski,nchevobbe,emcminn,webrtc-reviewers,mjf,handyman,mconley,mossop,ahal,sparky,nrishel,robwu,ohall,dimi,hjones
Differential Revision: https://phabricator.services.mozilla.com/D288623
2026-04-30 13:28:49 +00:00
Lars Eggert 5b8119be17 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 12:33:46 +00:00
Silaghi 38ab85b9f6 Revert "Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky" for causing build bustages at dns/nsHostResolver.cpp
This reverts commit b1cf0a3ab6.
2026-03-20 10:03:47 +00:00
Lars Eggert b1cf0a3ab6 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 09:34:38 +00:00
Silaghi f117cb70b5 Revert "Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky" for causing build bustages.
This reverts commit f8b8fa5d20.
2026-03-20 06:22:02 +00:00
Lars Eggert f8b8fa5d20 Bug 2024108 - Split nsHostResolver::mLock into mDBLock (RWLock) and mQueueLock r=valentin,necko-reviewers,perftest-reviewers,mozperftest-reviewers,sparky
Split the coarse-grained mLock into two fine-grained locks to reduce contention:
- mDBLock (RWLock): Protects the DNS cache (mRecordDB) with read-heavy optimizations
- mQueueLock (Mutex): Protects work queues and thread coordination

This reduces lock hold times by decoupling cache lookups from queue operations,
allowing concurrent cache reads while queue work proceeds independently.

Stress test confirms 89% contention reduction at real scale (166.27x → 17.62x ratio).

Differential Revision: https://phabricator.services.mozilla.com/D288329
2026-03-20 05:28:17 +00:00
Valentin Gosu 64b0d74d1d Bug 2009407 - Make trr_bench run as a perftest r=perftest-reviewers,mozperftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D283121
2026-03-12 23:46:58 +00:00
Aristide Tossou a0b482362d Bug 2015040 - Add Performance tests for security layer. r=rconcepcion,perftest-reviewers,mozperftest-reviewers,ai-ondevice-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D282177
2026-02-11 12:22:41 +00:00
James Teow a3a5cac5a0 Bug 1986066 - Add a performance test for calculate_frecency - r=perftest-reviewers,mozperftest-reviewers,places-reviewers,sparky,Standard8
calculate_frecency determines frecency values for moz_places rows
in Places. We should add performance tests to understand the impact
of changes to the function, especially as we continue to evolve
the algorithm.

Differential Revision: https://phabricator.services.mozilla.com/D267276
2025-10-28 14:37:28 +00:00
serge-sans-paille 57a1df1538 Bug 1986311 - Use zst instead of gz to store test_archive r=jmaher,webdriver-reviewers,jgraham,glandium,whimboo
zst is faster, can run in parallel, and has better compression ratio.
With this change target.perftests.tests.tar.gz's size does down from 92M
to 83M, and the package_test step goes from 1m25s down to 37s

Differential Revision: https://phabricator.services.mozilla.com/D263314
2025-10-13 05:37:26 +00:00
pstanciu 7ae0d244b8 Revert "Bug 1986311 - Use zst instead of gz to store test_archive r=jmaher,webdriver-reviewers,jgraham,glandium,whimboo" for causing build bustages
This reverts commit 47eea177c6.
2025-10-08 14:48:20 +00:00
serge-sans-paille 47eea177c6 Bug 1986311 - Use zst instead of gz to store test_archive r=jmaher,webdriver-reviewers,jgraham,glandium,whimboo
zst is faster, can run in parallel, and has better compression ratio.
With this change target.perftests.tests.tar.gz's size does down from 92M
to 83M, and the package_test step goes from 1m25s down to 37s

Differential Revision: https://phabricator.services.mozilla.com/D263314
2025-10-08 13:08:16 +00:00
Cristian Tuns ba17dce2c2 Revert "Bug 1986311 - Use zst instead of gz to store test_archive r=jmaher,webdriver-reviewers,jgraham,glandium,whimboo" for causing artifact bustages
This reverts commit 2b10a74305.
2025-10-07 09:58:11 +00:00
serge-sans-paille 2b10a74305 Bug 1986311 - Use zst instead of gz to store test_archive r=jmaher,webdriver-reviewers,jgraham,glandium,whimboo
zst is faster, can run in parallel, and has better compression ratio.
With this change target.perftests.tests.tar.gz's size does down from 92M
to 83M, and the package_test step goes from 1m25s down to 37s

Differential Revision: https://phabricator.services.mozilla.com/D263314
2025-10-07 08:46:01 +00:00
Erik Nordin 3bdfb97243 Bug 1991761 - Test all architectures in Translations perftests r=perftest-reviewers,mozperftest-reviewers,translations-reviewers,gregtatum,sparky
This patch updates all of the Translations perftest infrastructure
to test each Translations model architecture kind: tiny, base-memory,
and base.

Differential Revision: https://phabricator.services.mozilla.com/D266895
2025-10-03 19:40:22 +00:00
Alexandru Marc 5edb65b5ea Revert "Bug 1991761 - Test all architectures in Translations perftests r=perftest-reviewers,mozperftest-reviewers,translations-reviewers,gregtatum,sparky" for causing mochitest failures @ browser_translations_e2e_full_page_translate_with_lexical_shortlist.js
This reverts commit 177e948254.

Revert "Bug 1991761 - Remove Spanish benchmark page r=translations-reviewers,gregtatum"

This reverts commit 09273d5eb3.

Revert "Bug 1991761 - Add English Translations benchmark page r=translations-reviewers,gregtatum"

This reverts commit bb53c04117.

Revert "Bug 1991761 - Pass architecture arg to Translations e2e tests r=translations-reviewers,gregtatum"

This reverts commit 82d9e5ab82.
2025-10-02 22:26:01 +00:00
Erik Nordin 177e948254 Bug 1991761 - Test all architectures in Translations perftests r=perftest-reviewers,mozperftest-reviewers,translations-reviewers,gregtatum,sparky
This patch updates all of the Translations perftest infrastructure
to test each Translations model architecture kind: tiny, base-memory,
and base.

Differential Revision: https://phabricator.services.mozilla.com/D266895
2025-10-02 20:35:02 +00:00
Eitan Isaacson e82bb3b883 Bug 1982212 - Use RelatedAccIterator for aria-activedescendant instead of QuerySelector. r=Jamie,perftest-reviewers,mozperftest-reviewers,sparky
Caching the active descendant "relation" allows us to not do slow
queries with selectors.

With the added perftest I see a local improvement in A11Y_TotalTime from
852ms to 44ms.

Differential Revision: https://phabricator.services.mozilla.com/D262616
2025-08-29 15:42:49 +00:00
Morgan Rae Reschenberg 850b3ef3eb Bug 1963174: Add browser_reflowPseudoelements.js a11y perftest to local suite and CI. r=Jamie,perftest-reviewers,mozperftest-reviewers,sparky
This patch serves as documentation for adding a single brower-based perftest to the accessibility perftesting suite.

Some things to note:
- Your additional test should be disabled in the `perftest.toml` file to avoid it running by any framework that slurps up `*.toml` files from `/accessible/browser/` subdirectories. It will still run under the `./mach perftest` command and in the associated `./mach try perf` job, if added to CI.
- Please verify your test runs via `./mach test` or `./mach mochitest` without errors before running with `./mach perftest`.
- You'll need to copy the `perfMetadata` object from an existing test, please modify only the test description and name.
- You'll need to add your test to `config.yml`
- Generate `mozperftest.rst` via `./mach lint -l perfdocs --outgoing --fix`, CI will warn you about this if you fail to do it.
- We cannot currently run perftest manifests in CI, each test needs to be added individually. Keep in mind that the firefox binary file location is different per platform; you can copy/paste from the existing test configs to set up your new test, but do not copy (for example) from `linux.yml` to `macos.yml`.
- Our timer function (`timeThis`) can only be called once per test. Also, we can only have one test per file.

Differential Revision: https://phabricator.services.mozilla.com/D258639
2025-08-05 17:48:19 +00:00
Morgan Rae Reschenberg ca738dd2af Bug 1963174: Translate initial perf framework to perftests r=Jamie,perftest-reviewers,sparky,mozperftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D253901
2025-08-04 19:57:20 +00:00
Tom Zhang ed3a91e4fa Bug 1964665 - Add a perftest for speecht5-tts r=firefox-ai-ml-reviewers,sparky,perftest-reviewers,tarek
This patch adds a perftest for the OONX speecht5-tts q8 quantized model as part of our ongoing exploration and benchmarking of TTS tasks for transform media type project. The goals are 1) add the first perftest for speech-to-text task as reference for future tests; 2) benchmark core performance metrics like latency and memory usage to assess realistic inference conditions (note that streaming audio output is not yet tested. This helps establish a baseline for comparing candidate TTS models (as well as different quantization levels) for future integration decisions. The test runs directly in transformers.js without any modification to the pipeline.

Differential Revision: https://phabricator.services.mozilla.com/D248133
2025-05-13 18:35:43 +00:00
Greg Mierzwinski c2ea258df2 Bug 1963180 - Update mentions about PERFTESTS_MANIFESTS in perfdocs. r=perftest-reviewers,fbilt DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D248237
2025-05-13 14:56:22 +00:00
Emma Zuehlcke 6ffe780cd1 Bug 1965038 - Add performance test for nsIUrlClassifierExceptionList. r=anti-tracking-reviewers,timhuang,perftest-reviewers,frontend-codestyle-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D247791
2025-05-08 12:01:06 +00:00
Greg Mierzwinski 75364ccec8 Bug 1944559 - Enable mochitest android tests in CI for mozperftest. r=perftest-reviewers,kshampur
This patch adds some changes needed to run mochitest android tests in CI for mozperftest. The main change is that we use `runtestsremote.run_test_harness` instead of `runtests.run_test_harness` for running android tests.

Additionally, the `LogProcessor` is modified to use the `re.search` method for finding the `perfMetrics` output and remove the requirement for there to be a space after `perfMetrics`. This is done because the output received from mochitest android is always prefixed with something which broke `re.match`. The removal of the space requirement was done to remove a common pitfall that was seen with others writing mozperftest mochitest tests.

Differential Revision: https://phabricator.services.mozilla.com/D245766
2025-05-07 11:51:24 +00:00
Greg Mierzwinski ad486bbcc5 Bug 1944559 - Enable local mochitest android performance testing. r=perftest-reviewers,afinder
This patch enables local mochitest android performance testing by passing the correct arguments to mochitest. It is enabled when the `--android` option is passed in a `mach perftest` mochitest test run. A mobile `--app` setting is also needed to have mochitest use the correct binary/activity.

Differential Revision: https://phabricator.services.mozilla.com/D245116
2025-05-07 11:51:17 +00:00
Chidam Gopal d435a0ff37 Bug 1958328 - Add performance test for history semantic search r=perftest-reviewers,mak,places-reviewers,tarek,sparky
This patch introduces a performance test targeting the history using semantic search functionality. The test is designed to benchmark the efficiency and responsiveness of the history semantic search operations under various conditions. Shorter vs Longer search queries and Concurrent vs Non-concurrent inference when vector DB load happens as deferred task in the background. This captures latency, of the ML engine, end to end inference and also the semantic search for shorter and longer queries.
In addition to that it captures how much time does it take for the vector DB update process to complete for the 10000 history entries.

Differential Revision: https://phabricator.services.mozilla.com/D245087
2025-04-23 21:34:29 +00:00
Erich Gubler 1781f0662d Bug 1960670 - refactor(webgpu): move dom/webgpu/mochitest/ to dom/webgpu/tests/mochitest/ r=webgpu-reviewers,frontend-codestyle-reviewers,perftest-reviewers,nical,sparky
Differential Revision: https://phabricator.services.mozilla.com/D245592
2025-04-23 03:47:17 +00:00
Andy Leiserson 5209057988 Bug 1956004 - Part 2: Reduce the amount of data copied by writeTexture r=webgpu-reviewers,perftest-reviewers,nical,sparky
Differential Revision: https://phabricator.services.mozilla.com/D244449
2025-04-11 21:54:24 +00:00
myeongjun e8fc554759 Bug 1950414 - Change Mochitest names to match filename in metadata r=sparky,perftest-reviewers DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D240638
2025-03-24 17:23:22 +00:00
Butkovits Atila 0cd706c403 Backed out changeset 9c7d3cc6180e (bug 1950414) for causing Bugzilla bustages. CLOSED TREE 2025-03-21 15:00:43 +02:00
myeongjun 0aee275e4c Bug 1950414 - Change Mochitest names to match filename in metadata r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D240638
2025-03-21 12:02:55 +00:00
Vasish Baungally 3860c6675c Bug 1953537 - Separate Smart Tab Grouping Perftests r=sparky,tarek,perftest-reviewers
These tests were timing out, so we're running them separately.
Re-added the peak-memory metric.

Differential Revision: https://phabricator.services.mozilla.com/D241295
2025-03-14 22:07:28 +00:00
Ted Campbell 4d2fb64ac2 Bug 1872614 - Remove mozperftest push-to-try behaviour. r=sparky,perftest-reviewers
Running `./mach perftest` gives errors or surprising behaviour, and is generally
unmaintained. Remove the no-arguments behaviour and leave specific test runner
scenarios. The `./mach try perf` tools is the recommended way to run perf tests
on CI these days.

Differential Revision: https://phabricator.services.mozilla.com/D239266
2025-03-13 14:20:30 +00:00
Aristide Tossou e7814df469 Bug 1942518 - Add Wllama engine - r=tarek,perftest-reviewers,afinder
Differential Revision: https://phabricator.services.mozilla.com/D234800
2025-03-06 22:54:36 +00:00
Chun-Min Chang 278c575269 Bug 1932528 - Remove mozperftest from WebCodecs VideoEncoder r=perftest-reviewers,afinder
This patch reverts "Bug 1920813 - Add performance test for WebCodecs
video encoding
r=perftest-reviewers,media-playback-reviewers,aosmond,padenot,sparky" by
running `git revert` with modification needed.

Differential Revision: https://phabricator.services.mozilla.com/D234114
2025-01-31 18:09:34 +00:00
Vasish Baungally f99e0b94d4 Bug 1944617 - Add Perftests for Smart Tab Grouping Models. r=sparky,tarek,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D236009
2025-01-31 16:55:44 +00:00
aglavic a3d0bbbf35 Bug 1940279 - Remove legacy android startup tests running in parallel. r=perftest-reviewers,sparky
The android startup tests were not implemented correctly when they were first added.
To properly reformat the tests we needed to run the correct method in parallel with the incorrect method to ensure we missed no alerts for a few weeks
Now that we have those few weeks, we are removing the old incorrectly formatted tests

Differential Revision: https://phabricator.services.mozilla.com/D234909
2025-01-24 15:23:00 +00:00
Erik Nordin 0efcaa9f10 Bug 1940142 - Add Translations Perf Test (es-en) r=perftest-reviewers,translations-reviewers,sparky,gregtatum
Adds infrastructure to run perf tests for Translations,
as well as a perftest file for measuring the es-en
Translations model.

Depends on D233318

Differential Revision: https://phabricator.services.mozilla.com/D233301
2025-01-14 23:09:11 +00:00
Greg Mierzwinski 3679bb1e85 Bug 1940442 - Add documentation about _TRY_MAPPING variable for mozperftest. r=perftest-reviewers,kshampur DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D233493
2025-01-08 17:58:04 +00:00
aglavic 11654a9807 Bug 1908984 - Fix typos found on perfdocs with chat GPT. r=perftest-reviewers,necko-reviewers,devtools-reviewers,dom-storage-reviewers,ochameau,kershaw,janv,sparky,jari
Differential Revision: https://phabricator.services.mozilla.com/D232547
2024-12-20 15:48:18 +00:00
Chidam Gopal c21cc8f457 Bug 1932696 - create MLSuggest perf test on feature r=vazish,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D231096
2024-12-04 17:10:41 +00:00
Aristide Tossou c5cdfb84e5 Bug 1931470 - Summarizer Perf test - r=tarek,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D229210
2024-11-27 21:36:20 +00:00
Vasish Baungally 2a6b0151af Bug 1931883 - Add credentials management model perftest - r=perftest-reviewers,sparky,tarek,cgopal
Differential Revision: https://phabricator.services.mozilla.com/D229508
2024-11-25 16:30:27 +00:00
Chidam Gopal d05e7c561f Bug 1929596 - Add MLSuggest inference as under ml tests and make it run inference?tarek,adw,sparky r=urlbar-reviewers,perftest-reviewers,sparky,adw,tarek
Differential Revision: https://phabricator.services.mozilla.com/D228192
2024-11-18 21:26:39 +00:00
Sandor Molnar 19d1ce1fe0 Backed out changeset 6d7a02956bac (bug 1929596) for not being properly reviewed. 2024-11-16 06:41:17 +02:00
Chidam Gopal 3646662b50 Bug 1929596 - Add MLSuggest inference as under ml tests and make it run inference?tarek,adw,sparky r=urlbar-reviewers,adw
Differential Revision: https://phabricator.services.mozilla.com/D228192
2024-11-16 03:57:15 +00:00
Tarek Ziadé 5f170bd957 Bug 1930097 - Add a concurrent workers perftest r=sparky,cgopal,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D228813
2024-11-15 07:46:40 +00:00
Chidam Gopal 1c3139c502 Bug 1928224 - Add intent and NER performance test in local r=sparky,tarek,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D227416
2024-11-07 14:45:12 +00:00