Commit Graph

199 Commits

Author SHA1 Message Date
Alex Lopez
77ce415604 Bug 1696251 - Replace self with command_context where possible in existing mach commands. r=mhentges,webdriver-reviewers,perftest-reviewers,whimboo
This step removes all the dependencies of mach commands to
having a MachCommandBase as the `self` by using the `command_context`
argument instead. This also removes any remaining statefulness from those
classes that implement mach commands, ultimately making it easier to move
existing commands out of classes in a follow-up.

Differential Revision: https://phabricator.services.mozilla.com/D118058
2021-07-19 16:04:25 +00:00
Butkovits Atila
28088b069e Backed out changeset b533ae02d367 (bug 1705420) as requested by Kimberly. CLOSED TREE 2021-07-16 23:22:23 +03:00
Butkovits Atila
a07f790e42 Backed out changeset e1921c5112d8 (bug 1696251) for causing bustages complaining about 'CommandContext'. CLOSED TREE 2021-07-16 20:35:55 +03:00
Alex Lopez
190e03aaab Bug 1696251 - Replace self with command_context where possible in existing mach commands. r=mhentges,webdriver-reviewers,perftest-reviewers,whimboo
This step removes all the dependencies of mach commands to
having a MachCommandBase as the `self` by using the `command_context`
argument instead. This also removes any remaining statefulness from those
classes that implement mach commands, ultimately making it easier to move
existing commands out of classes in a follow-up.

Differential Revision: https://phabricator.services.mozilla.com/D118058
2021-07-16 15:51:29 +00:00
surajeet310
1903d302ab Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozperftest r=mhentges
Since Python 2 is no longer used in python/mozperftest, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119898
2021-07-14 16:33:46 +00:00
Kimberly Sereduck
210d1cc333 Bug 1705420: Report the version of the application being tested in our perfherder data r=perftest-reviewers,sparky
implementing get_browser_meta for mozperftest

Differential Revision: https://phabricator.services.mozilla.com/D113861
2021-07-13 12:13:38 +00:00
Florin Strugariu
2b3375937c Bug 1715478 - Automated recording for desktop with a list sites r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D117298
2021-07-09 07:12:27 +00:00
Mitchell Hentges
b7dde05a8d Bug 1717786: Update mozperfest runner's list of in-tree Python packages r=kimberlythegeek
After replacing a bunch of vendored source packages with wheels, the
paths to the raw source changed.

Differential Revision: https://phabricator.services.mozilla.com/D118723
2021-06-24 18:02:53 +00:00
Tarik Eshaq
453be8c6fd Bug 1716450 - Removes fxa-client rust code from Desktop. r=rfkelly
Differential Revision: https://phabricator.services.mozilla.com/D118238
2021-06-22 17:04:35 +00:00
Gregory Mierzwinski
a5873d50c0 Bug 1716378 - Use correct test modules path in xpcshell layer. r=perftest-reviewers,kimberlythegeek
Differential Revision: https://phabricator.services.mozilla.com/D117690
2021-06-15 17:01:58 +00:00
Mitchell Hentges
b685c830d4 Bug 1714684: Resolve assert_has_calls() usage error r=ahal
The `calls` parameter is expected to be an iterable
container of calls, not a singular call.

This was working in `mock-1.0.0` because `calls`
was (confusingly) allowed to be a single item
if `any_order==False`. This behaviour isn't
the same in the standard library.

Differential Revision: https://phabricator.services.mozilla.com/D117074
2021-06-14 15:34:47 +00:00
Mitchell Hentges
e389cc4cc4 Bug 1714684: Remove usages of vendored "mock" library r=perftest-reviewers,ahal,sparky
Python 3 has access to `unittest.mock` in the standard library.

Differential Revision: https://phabricator.services.mozilla.com/D117073
2021-06-14 15:34:46 +00:00
Greg Tatum
1a7c5a8df1 Bug 1714099 - Locally enable the console layer by default in perftest; r=sparky
This will only turn it on locally, but not when run in CI.

Differential Revision: https://phabricator.services.mozilla.com/D116655
2021-06-08 20:27:15 +00:00
Greg Tatum
e2b8e6c87b Bug 1713384 - Raise an exception when no perftest results are found; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D116654
2021-06-08 20:27:15 +00:00
Florin Strugariu
39b334597c Bug 1702659 - Update mozperftest proxy service r=sparky,perftest-reviewers
Make mozperftest work with the new mozproxy command line
Add ability to run proxy on mobile browser
Add ability to use record and playback modes
Add unit tests

Differential Revision: https://phabricator.services.mozilla.com/D115544
2021-06-08 18:00:12 +00:00
Agi Sferro
65b64cb3e0 Bug 1709640 - Rename android-api-16 to android-arm. r=marionette-reviewers,firefox-build-system-reviewers,nalexander,whimboo,aklotz,releng-reviewers,mhentges,glandium,mtabara
We don't offer API splits any more, and with the separation of GeckoView with
the rest of the front-end it's increasingly unlikely that we will in the
future.

This change makes it so that the build name doesn't contain the API version so
that we can update it without breaking all the automation that relies on the
build name.

Differential Revision: https://phabricator.services.mozilla.com/D114369
2021-06-04 22:31:14 +00:00
Sandor Molnar
2a126fe036 Backed out changeset 453cb34e4a4a (bug 1709640) for causing linting failures in perfdocs/config. CLOSED TREE 2021-06-05 01:00:19 +03:00
Agi Sferro
ecf4f5f0ad Bug 1709640 - Rename android-api-16 to android-arm. r=marionette-reviewers,firefox-build-system-reviewers,nalexander,whimboo,aklotz,releng-reviewers,mhentges,glandium,mtabara
We don't offer API splits any more, and with the separation of GeckoView with
the rest of the front-end it's increasingly unlikely that we will in the
future.

This change makes it so that the build name doesn't contain the API version so
that we can update it without breaking all the automation that relies on the
build name.

Differential Revision: https://phabricator.services.mozilla.com/D114369
2021-06-04 21:20:56 +00:00
Henrik Skupin
fa4fbb78b4 Bug 1695031 - Combine build flags --disable-marionette and --enable-cdp as --disable-webdriver. r=firefox-build-system-reviewers,Gijs,smaug,keeler,jdescottes,glandium
Differential Revision: https://phabricator.services.mozilla.com/D115583
2021-05-25 09:13:28 +00:00
Alex Lopez
455d9a088b Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-05-17 16:15:58 +00:00
Gregory Mierzwinski
e8e2ef66d3 Bug 1710578 - Add missing python packages to search paths for mozperftest. r=perftest-reviewers,Bebe
This patch fixes a regression caused by bug 1698616 which made modifications to third-party/python packages.

Differential Revision: https://phabricator.services.mozilla.com/D114869
2021-05-12 14:22:28 +00:00
Butkovits Atila
2e34e363b9 Backed out 2 changesets (bug 1696251) for causing js-bench-sm failures. CLOSED TREE
Backed out changeset 1c84c9a34575 (bug 1696251)
Backed out changeset e169193b7423 (bug 1696251)
2021-04-23 02:53:36 +03:00
Alex Lopez
d1a82b8092 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-22 18:56:15 +00:00
Cosmin Sabou
785f9b8a87 Backed out changeset d4a5d8567977 (bug 1696251) for non-unified build bustages. CLOSED TREE 2021-04-19 19:43:31 +03:00
Alex Lopez
75dfe35468 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-19 16:15:11 +00:00
Steve Fink
b5836beb66 Bug 1702763 - Fix check for verbose flag in mozperftest r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D110677
2021-04-06 19:46:00 +00:00
Chris H-C
ea2a18d757 Bug 1697555 - Remove Telemetry portions of Accounts Ecosystem Telemetry r=Dexter
Differential Revision: https://phabricator.services.mozilla.com/D110091
2021-03-29 20:03:38 +00:00
Agi Sferro
674d630320 Bug 1697844 - Remove unused FENNEC_NIGHTLY. r=esawin
Differential Revision: https://phabricator.services.mozilla.com/D108049
2021-03-24 20:06:24 +00:00
Alexandru Michis
ced948f22d Backed out 10 changesets (bug 1697844) for causing mpu failures in test_visualmetrics.py
CLOSED TREE

Backed out changeset 63b3268b0d2d (bug 1697844)
Backed out changeset 875b2aa342d9 (bug 1697844)
Backed out changeset 4fb528aaf7d5 (bug 1697844)
Backed out changeset 6ef5e1c9ca21 (bug 1697844)
Backed out changeset 430d6c940eb9 (bug 1697844)
Backed out changeset 7a306f28dc64 (bug 1697844)
Backed out changeset 871a40e2fc00 (bug 1697844)
Backed out changeset 083e9ce71d14 (bug 1697844)
Backed out changeset b53930a3f065 (bug 1697844)
Backed out changeset 24326d04dd37 (bug 1697844)
2021-03-24 21:59:28 +02:00
Agi Sferro
a6f7203643 Bug 1697844 - Remove unused FENNEC_NIGHTLY. r=esawin
Differential Revision: https://phabricator.services.mozilla.com/D108049
2021-03-24 18:54:45 +00:00
Andrew Creskey
b70829a366 Bug 1695252 - Add a pageload test that reports PerfStats r=sparky,perftest-reviewers
This commit adds a simple pageload test, a warm pageload of https://www.google.com.
Low-level perfstats are collected.

All platforms were included. Not running as a cron job.

The motivation is that we can now collect low-level perfStats timings and determine how useful they will be for performance work.

Differential Revision: https://phabricator.services.mozilla.com/D109072
2021-03-22 13:50:32 +00:00
Andrew Creskey
e439b1e266 Bug 1698620 - Update perftest browsertime r=sparky,perftest-reviewers
Update to the latest browsertime so we can collect PerfStats

Differential Revision: https://phabricator.services.mozilla.com/D108499
2021-03-18 13:26:34 +00:00
Dave Hunt
0795acbc2a Bug 1672422 - Default to mozperftest as the framework instead of browsertime r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D104731
2021-03-01 15:32:10 +00:00
Tarek Ziadé
31380bc0c1 Bug 1681669 - Add vision document for mozperftest. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D99318
2021-02-16 18:37:23 +00:00
Sean Feng
2502c7c5dd Bug 1688995 - Fall back to default PATH if fzf doesn't exist in mozbuild r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D103115
2021-02-16 18:11:38 +00:00
Dana Keeler
b20d3edb85 Bug 1682989 - remove CertBlocklist implementation and MOZ_NEW_CERT_STORAGE build variable r=rmf
Differential Revision: https://phabricator.services.mozilla.com/D100034
2021-01-19 22:11:25 +00:00
Gregory Mierzwinski
50dfc2cb3a Bug 1672142 - Update mozperftest perfdocs to include new test. r=tarek,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D98773
2020-12-04 15:47:22 +00:00
Tarek Ziadé
0269049986 Bug 1672142 - Add perf test for the controlled website r=sparky,dragana
Differential Revision: https://phabricator.services.mozilla.com/D94089
2020-12-04 14:56:43 +00:00
Andrew Creskey
888400592c Bug 1675863 - mozperftest uses a fixed build of geckoview_example from 05/21/2020 r=sparky
Updated the url used by perftest from 'nightly' to 'shippable'

Differential Revision: https://phabricator.services.mozilla.com/D96463
2020-11-10 14:07:43 +00:00
Tarek Ziadé
7c132a5e1b Bug 1668494 - add an influxdb layer r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D92480
2020-11-10 08:36:44 +00:00
Tarek Ziadé
83a9dd6f9f Bug 1667151 - add support for pre-compiled scipy/numpy r=sparky
This patch will make sure that we select the right
wheels for numpy and scipy when `--visualmetrics` is used,
so we don't need to compile them.

It also make sure we don't install all those packages
unless the environment wants to use visual metrics.

Differential Revision: https://phabricator.services.mozilla.com/D91740
2020-11-05 17:16:34 +00:00
Tarek Ziadé
6bc860d7cd Bug 1671330 - create a telemetry layer r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D94809
2020-11-03 14:32:33 +00:00
Gregory Mierzwinski
9ed7a7b8be Bug 1674243 - Check for colon when deciding between old/new metric format. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D95218
2020-10-29 23:39:08 +00:00
Myeongjun Go
27e4a2b691 Bug 1672207 - [perfdocs] Remove legacy code on build_test_description r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D94127
2020-10-23 13:04:19 +00:00
Myeongjun Go
10359c348a Bug 1663708 - [perfdocs] Find tests to add to documentation using manifests instead of path searching r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D91703
2020-10-19 15:17:04 +00:00
Tarek Ziadé
f3c2b155b5 Bug 1670631 - browsertime keeps on reinstalling itself r=sparky
Let's use `_from` instead of `_resolved`

Differential Revision: https://phabricator.services.mozilla.com/D93629
2020-10-15 14:07:09 +00:00
Tarek Ziadé
616eb184b2 Bug 1670216 - Speed up tests. r=sparky
Shaved off 15 seconds (and fixed small code issues in the proxy layer)

Differential Revision: https://phabricator.services.mozilla.com/D93080
2020-10-14 19:31:51 +00:00
Florin Strugariu
c6a83dc1a4 Bug 1666264 - [Mozproxy] Implement a recording .zip file manager r=tarek,perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D90954
2020-10-09 12:32:26 +00:00
Sylvestre Ledru
cad53f4804 Bug 1588458 - Replace dxr links by searchfox in the code/test r=kats,sparky
Differential Revision: https://phabricator.services.mozilla.com/D92792
2020-10-08 14:02:40 +00:00
Gregory Mierzwinski
96be950645 Bug 1667180 - Reinstall existing browsertime package if its outdated. r=tarek
This patch changes how/when we decide to (re-)install browsertime. We do this by checking the package.json entries to see if they match or not.

Differential Revision: https://phabricator.services.mozilla.com/D91329
2020-10-01 07:14:37 +00:00