Currently lacking ARM coverage for the jetstream2 test, so this patch
enables it on the apple silicon and android A55 device.
Differential Revision: https://phabricator.services.mozilla.com/D228239
This patch changes p6/s24 platform naming convention to remove the
`-qr` and duplicate `android`. We recently did the same for the A55
Differential Revision: https://phabricator.services.mozilla.com/D228247
This patch fixes an issue where the suite-level description error wasn't being output. Instead of using the manifest from the yaml for this error, we'll output the failure to all changed files. Some additional changes are made for mozperftest to handle tests with periods in their names.
Differential Revision: https://phabricator.services.mozilla.com/D227378
Add an update to the perftest in a nutshell section of the documentation
with some additional information on how engineers can get profiles of
performance tests.
Differential Revision: https://phabricator.services.mozilla.com/D226402
This patch introduces performance tests to evaluate the video encoding
performance in two usage scenarios: *Realtime* and *Record*. Each
scenario assesses the encoding using two key metrics:
1. Frame Encoding Latency: The time from encoding a single frame to
receiving its encoded result
2. Total Encoding Time: The duration from the first encoding request to
the reception of the last encoded result
In the *Realtime* scenario, minimizing the latency for each frame is
crucial. This metric is essential for applications like live streaming
and video conferencing, where timely delivery of each frame impacts user
experience.
In contrast, the *Record* scenarios prioritizes the total encoding time.
Here, the focus is on processing the entire sequence efficiently to
produce the final output.
By adding these tests, we aim to thoroughly assess and optimize the
encoder's performance under both scenarios, ensuring Gecko provides the
experience users expect.
Differential Revision: https://phabricator.services.mozilla.com/D224999
In bug 1922360 we temporarily "duplicated" the a55 tasks for about 2
weeks to account for new time series signatures. Now we can remove the
old, incorrect name, and move forward with the better naming convention.
Differential Revision: https://phabricator.services.mozilla.com/D226570
This patch enables performance pageload tests to now use mitmproxy
11.0.0, only on the Mac/Windows platform.
This will run on a subset of tests as the binary doesn't properly run on
old recordings (e.g. mitm 6) but seems to run fine on recordings mitm7
and greater.
Additionally, the mitmproxy version for android is bumped from 10 -> 11.
Although 10.x.x was only recently landed, 11 was released shortly after
so we might as well keep all platforms on the same version where
possible.
Differential Revision: https://phabricator.services.mozilla.com/D224383
This patch adds some documentation about the mach perftest alert layer, and how to use it. This includes the additional options that it has.
Differential Revision: https://phabricator.services.mozilla.com/D224006
We currently have duplicate mentions of "android" in a few device
configurations. This patch temporarily duplicates the platform with the
fix, so that we can run it for ~2 weeks before removing the old
"incorrect" config. This is to ensure a smooth "migration" and to avoid
abruptly reseting the time series data for A55
Additionally, we remove the '-qr' suffix from the platform name as it is
outdated.
A55 is prioritized first as we are in the process of removing the A51's
and we have more capacity on the A55's at the moment.
After about 2 weeks this will be de-duplicated in bug 1922362
Differential Revision: https://phabricator.services.mozilla.com/D224373
Update the test-platforms config to make available A55 opt builds for
browsertime tests. We had this for for A51's and as those are being
phased out we should have the same ability on A55's
Differential Revision: https://phabricator.services.mozilla.com/D224258
This patch makes available the mitm 10 binary for android, and at the
moment only runs it on recordings using version 8 as there are errors on
older versions so we might as well wait until we record those.
These subset of sites are bild-de, allrecipes, instagram, and sina
Differential Revision: https://phabricator.services.mozilla.com/D223829
In bug 1914816 I was tasked with diabling and removing all chrome test for osx 1015, but I accidently disabled and removed all chrome tests, this patch fixes this and re-enables/re-adds all chrome tests other than the 1015 ones
Differential Revision: https://phabricator.services.mozilla.com/D223626
the `tp6-bench` works for the most part on windows and linux, so this
patch enables it to run on autoland so that data can start getting
collected. Additionally, keep this on tier 3 for now until we know more
about the data, and ignore osx 1015 & 1400 for now.
Differential Revision: https://phabricator.services.mozilla.com/D222685
We have motionmark 1.3 tests running already and we are no longer
interested in motionmark 1.0 so this patch removes it from our testing.
Differential Revision: https://phabricator.services.mozilla.com/D221533
As part of out expanding performance metrics for resource usage we are adding the cpuTime metric to track CPU time in various performance tests on mobile and desktop tests for firefox browsers only
Differential Revision: https://phabricator.services.mozilla.com/D217146
As part of out expanding performance metrics for resource usage we are adding the cpuTime metric to track CPU time in various performance tests on mobile and desktop tests for firefox browsers only
Differential Revision: https://phabricator.services.mozilla.com/D217146
This patch changes the external storage to accomodate condprof creation
and subsequently performance testing tasks are enabled on the A55.
Differential Revision: https://phabricator.services.mozilla.com/D220067
