This patch adds a warning output for when disable-pgo is set to true, and artifact mode is being disabled for Android selection. This is done because the PGO builds on android often fail.
Differential Revision: https://phabricator.services.mozilla.com/D222006
This enables a user to select the A55 devices when using `mach try perf`
with the `--android` flag.
The old a51 device is removed.
Differential Revision: https://phabricator.services.mozilla.com/D220068
We have motionmark 1.3 tests running already and we are no longer
interested in motionmark 1.0 so this patch removes it from our testing.
Differential Revision: https://phabricator.services.mozilla.com/D221533
This patch changes the link to search for in mach-try-perf base/new revisions to the treeherder one instead of the hgmo link. This resolves an issue where the hg links would come in different styles depending on the number of commits made locally. This patch keeps the original hg matcher though as a fallback-method in case a treeherder link is unavailable. By default, we'll always use the treeherder revision even if an hg revision is found.
Differential Revision: https://phabricator.services.mozilla.com/D219770
This patch adds the ability to auto-detect the framework that is used by the majority of the tasks selected and adds this information to the perfcompare URLs. It also does a refactor on how the perf try push info is passed around to simplify the process.
Differential Revision: https://phabricator.services.mozilla.com/D219219
This patch prevents users from selecting tests available on Win 10. It
is temporarily enabled (Bug 1906951) for running sp3, but we only want
that to run in CI for data and not for users to run it.
Differential Revision: https://phabricator.services.mozilla.com/D218670
This patch adds some documentation about the --tests option, and also updates a bit of the other documentation for mach-try-perf.
Differential Revision: https://phabricator.services.mozilla.com/D216934
This patch adds the abiltiy to run specific tests through mach try perf using the `--tests` option. When a test is specified, we search through the full-task-graph to find all tasks that run the test based on the command that is running in the task. Test finders are implemented on a per-suite basis to determine if the task contains the requested test. These are then used to (1) create new categories that only run this specific test, and (2) find all tasks that run the requested test. The query for the category is based on the longest common substring between all the tasks that were found, and some heuristics modifying the task label are needed within the test-finders to ensure that we find unique strings that only run the requested tasks/test. These tasks, and categories are then used within the other standard options like the category fuzzy view, the show-all view, and when running specific tests in an alert.
Differential Revision: https://phabricator.services.mozilla.com/D216932
This sets up a route on Pernosco tasks such that they will emit pulse messages
over the notify service's exchange with a dedicated routing key. This will allow
the Pernosco pulse consumer to receive only tasks that should be recorded.
Differential Revision: https://phabricator.services.mozilla.com/D215967
Before bug 1500188, push_to_try would normalize the file contents given
in `files_to_change`, but that doesn't happen anymore. While the new API
could be relaxed to alloy `bytes` in, `try scriptworker` is the only
script currently feeding `bytes` into `files_to_change`, and doesn't
actually require the contents to be `bytes`, as the files it pulls in
the first place are text.
Differential Revision: https://phabricator.services.mozilla.com/D215160
Currently, the caller potentially prepares files, add them to the VCS,
and then calls the function to create the commit, does whatever it wants
to do with it, then undoes it.
With the ultimate goal of not doing local changes to the work tree to
act on that try commit (for a push), this change in API makes it so
that everything except what do do with the commit is handled by one
function, that now takes paths and file contents for the files that were
previously created by the caller.
Differential Revision: https://phabricator.services.mozilla.com/D214214
I only changed the query to exclude `android` for `xpcshell` because the `xpcshell` query was the only one picking up `android` tests (for `xpcshell`).
Differential Revision: https://phabricator.services.mozilla.com/D211112
This patch enables a user to select safari technology preview with the
try perf selector by specifying `--safari-tp` flag.
Differential Revision: https://phabricator.services.mozilla.com/D209879
As chromium is no longer used and chromium as release is replacing it, we are removing all references to it to not confuse people
Differential Revision: https://phabricator.services.mozilla.com/D204821
This patch adds a new category for the tp6-bench test called `Pageload Lite` that will provie a minimum set of tests that should be run for checking pageload performance.
Differential Revision: https://phabricator.services.mozilla.com/D203820
This patch undoes the changes required for the `--fenix` flag. This will enable fenix tests to be scheduled without supplying an additional flag, and will be visible/schedule-able when only `--android` is supplied.
Differential Revision: https://phabricator.services.mozilla.com/D203649
Adds a new chooser section for firefox-android builds and tests. This was easier than trying to add to the existing Build and Test sections ... and might be more convenient for users?
Because some of the test labels depend on the build-type, and that attribute was not being used consistently, I needed to define that attribute for several tasks; I don't think that will affect anything else.
Differential Revision: https://phabricator.services.mozilla.com/D204205
This patch adds a mention of the perf selector to the selectors documentation. It also adds a warning to the top of the Performance panel in the try chooser to warn users not to use it, and use the `./mach try perf` tool instead.
Differential Revision: https://phabricator.services.mozilla.com/D203800
