Commit Graph

2845 Commits

Author SHA1 Message Date
Nick Alexander
c5f931e3b5 Bug 1512487 - Part 3: Convert Android-specific code analyses into mozlints. r=ahal,agi
API lint is arguably the most valuable lint of all, but it's also hard
to fit into the Phab ecosystem, since there's no place to hang the
"API hash not correct" message in the case when the hash hasn't been
updated at all.  Therefore, this commit doesn't convert it.  See also
https://github.com/mozilla-mobile/gradle-apilint/issues/61 for adding
file/line information to API lint.

Differential Revision: https://phabricator.services.mozilla.com/D35277

--HG--
rename : mobile/android/config/mozconfigs/android-api-16-frontend/nightly => mobile/android/config/mozconfigs/android-api-16/nightly-android-lints
extra : moz-landing-system : lando
2019-08-02 20:34:23 +00:00
Alexandru Irimovici
cb092c29dc Bug 1558456 - stop tracking >1080p youtube-playback-test on motoG5 r=sparky,perftest-reviewers,davehunt
Add functionality for being able to send extra parameters for the test_url query of a test, directly from a taskcluster config.

Also, the PR adds logic in the `setup-raptor` taskgraph transform for dynamically changing the subset of youtube-playback tests based on the platform and project

Differential Revision: https://phabricator.services.mozilla.com/D39006

--HG--
extra : moz-landing-system : lando
2019-07-31 16:36:21 +00:00
Mike Hommey
c0004287b9 Bug 1569817 - Set tooltool servers for wrench tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com//D39826

--HG--
extra : amend_source : 16ef289624f4d999fbb9751a5fbd33b31e121d14
2019-07-30 05:55:03 +03:00
Cosmin Sabou
e939c1d994 Backed out changeset 2a0f5a0e0e38 (bug 1569817) for landing without a reviewer in the commit message. 2019-07-30 06:05:06 +03:00
Mike Hommey
029f4071bb Bug 1569817 - Set tooltool servers for wrench tasks.
Differential Revision: https://phabricator.services.mozilla.com//D39826
2019-07-30 05:55:03 +03:00
Nick Alexander
8306db5c30 Bug 1566171 - Part 3: Add browsertime executable arguments to Raptor command line. r=rwood
The goal is to configure browsertime in Raptor in two ways:

1) locally, just like `mach browsertime` does;

2) in automation, at taskgraph creation time, using fetches and
mozharness suite artifacts (for geckodriver).

It's possible for this to be done using mozharness config settings but
using command line options is more explicit and more likely to be easy
to remove later if and when we transition to a browsertime-specific
mozharness script.

Differential Revision: https://phabricator.services.mozilla.com/D38776

--HG--
extra : moz-landing-system : lando
2019-07-26 21:30:03 +00:00
Nick Alexander
bc05d7913c Bug 1566171 - Part 2: Allow argument names with 'chrome' in them. r=rwood
The existing code parses an argument with 'chrome' in its name
incorrectly.  That is, `--arg-with-chrome value` will make the old
code think the `--app` is 'chrome', which is not correct.

Argument parsing is subtle enough that we rely on `argparse` (which is
already imported and thus known to be available).

Differential Revision: https://phabricator.services.mozilla.com/D39415

--HG--
extra : moz-landing-system : lando
2019-07-26 21:29:58 +00:00
Nick Alexander
49296e786e Bug 1566171 - Pre: Allow to not re-install Android app in Raptor locally. r=perftest-reviewers,rwood
This is better than `yes n | mach raptor-test ...`.

Differential Revision: https://phabricator.services.mozilla.com/D38774

--HG--
extra : moz-landing-system : lando
2019-07-26 21:29:57 +00:00
Bob Clary
0e4603dbfd Bug 1568623 - [test isolation] Add web-platform-tests support, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D39242

--HG--
extra : moz-landing-system : lando
2019-07-25 01:23:45 +00:00
Mike Hommey
05ba1d00a3 Bug 1568349 - Remove FetchesMixin. r=nalexander
With all mozharness-based jobs now using run-task (except aarch64
windows, see bug 1557614), and thus fetch-content, the FetchesMixin
mixin should not be required anymore.

Differential Revision: https://phabricator.services.mozilla.com/D39108

--HG--
extra : moz-landing-system : lando
2019-07-24 22:41:59 +00:00
Nick Thomas
258bfc9b9f Bug 1553076 - Checksums for releases don't contain msi, stub installer, or pkg files, r=Callek DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D38580

--HG--
extra : moz-landing-system : lando
2019-07-22 00:00:42 +00:00
Aki Sasaki
b9041f813d Bug 1562902 - fennec l10n bumping on esr68. r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D38782

--HG--
extra : moz-landing-system : lando
2019-07-20 01:10:56 +00:00
Tom Prince
8da108c6aa Bug 1567011: [update-verify] Use version number to determine branch, rather than product-details category; r=mhentges,rail
For esr versions, the category switches from "esr" to "stability" when the next esr branch is started. This breaks
the logic for determining which repository a release was made from. Since we also have code for determining the
type of release from the version number, we can just use that directly instead.

(Note that the logic will not work for Fennec as all releases have transitioned to mozilla-esr68, but Fennec does not
use update-verify.

Differential Revision: https://phabricator.services.mozilla.com/D38437

--HG--
extra : moz-landing-system : lando
2019-07-18 15:11:19 +00:00
Geoff Brown
a0158936ae Bug 1566957 - Ensure robocop runs with --disable-e10s; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D38395

--HG--
extra : moz-landing-system : lando
2019-07-17 20:32:17 +00:00
Andrew Halberstadt
3336efcb3f Bug 1473498 - Fixing Py3 compatibility errors reachable from testing/mach_commands.py r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D37762

--HG--
extra : moz-landing-system : lando
2019-07-16 01:21:55 +00:00
Byron Campen [:bwc]
5fe8caac32 Bug 1555792: Add --setpref option to many test types r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D37503

--HG--
extra : moz-landing-system : lando
2019-07-11 15:06:38 +00:00
Tom Prince
15fe3c2e5a Bug 1458385: Repackage windows builds on linux. r=glandium,Callek
This only uses cross-platform tools, so switch to running these on linux, which
cuts the runtime down from ~20m to ~3m.

Differential Revision: https://phabricator.services.mozilla.com/D1080

--HG--
extra : moz-landing-system : lando
2019-07-11 16:40:25 +00:00
Tom Prince
c390584851 Bug 1458385: Set mar-channel-id from taskcluster rather than based on update-channel; r=glandium
Taskgraph needs to know the correct mar-channel, so allow it to pass it into the build,
rather than keying off the update-channel in configure. This will allow using a `mar`
binary that doesn't have the mar-channel configured in.

Differential Revision: https://phabricator.services.mozilla.com/D37480

--HG--
extra : moz-landing-system : lando
2019-07-11 16:40:00 +00:00
Mike Shal
7d02c70f7b Bug 1563053 - Wildcard profraw files for Android PGO; r=firefox-build-system-reviewers,chmanchester
This adds support for the Android process writing out multiple profraw
files and pulling them all from the device. We currently only generate a
single profraw file, but if that changes in the future we should be able
to get a PGO build using the full set of files now.

Depends on D36840

Differential Revision: https://phabricator.services.mozilla.com/D36841

--HG--
extra : moz-landing-system : lando
2019-07-09 19:56:45 +00:00
Mike Shal
285be9abcc Bug 1563053 - Put all Android PGO outputs in a separate directory; r=firefox-build-system-reviewers,chmanchester
If we end up generating multiple profraw files in the future, it will
help to have them all in a separate directory so that we can just 'adb
pull' the whole directory at once.

Depends on D36839

Differential Revision: https://phabricator.services.mozilla.com/D36840

--HG--
extra : moz-landing-system : lando
2019-07-09 20:13:35 +00:00
Mike Shal
d77d483c53 Bug 1563053 - Poll Android PGO based on process existence, not file existence; r=snorp
After execute_script() returns, the Android process may not be fully
shutdown, so the profile data may not exist yet. The initial
implementation waited for this by checking if the profraw file existed
and was non-zero length, but this may be contributing to issues with
getting partial profraw files.

Instead we can wait for the whole process to exit by using
process_exist(), so the profraw file should be completely written out
by then. In the event that the profraw file is truncated for some
reason, the merge step will fail and the process will be retried (per
bug 1560755).

Differential Revision: https://phabricator.services.mozilla.com/D36839

--HG--
extra : moz-landing-system : lando
2019-07-08 20:53:25 +00:00
Maja Frydrychowicz
b867fd4d06 Bug 1560023 - Rename wpt product fennec to firefox_android; r=jgraham,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D36630

--HG--
rename : testing/web-platform/tests/tools/wptrunner/wptrunner/browsers/fennec.py => testing/web-platform/tests/tools/wptrunner/wptrunner/browsers/firefox_android.py
extra : moz-landing-system : lando
2019-07-09 18:10:03 +00:00
Bob Clary
e734f03390 Bug 1563957 - mozharness android.py's install_apk should distinguish ADBTimeoutError and ADBError, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D37176

--HG--
extra : moz-landing-system : lando
2019-07-08 12:44:11 +00:00
Bob Clary
5f1e5060e1 Bug 1516985 - Uninstall Firefox Android app prior to installation to prevent INSTALL_FAILED_UPDATE_INCOMPATIBLE errors, r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D36936

--HG--
extra : moz-landing-system : lando
2019-07-05 18:40:39 +00:00
Bob Clary
df7634e648 Bug 1561309 - add --repeat command line argument for mozharness reftest and mochitest categories, r=ahal.
Differential Revision: https://phabricator.services.mozilla.com/D36011

--HG--
extra : moz-landing-system : lando
2019-07-05 18:39:30 +00:00
Gregory Mierzwinski
c5fd4c93ff Bug 1549033 - Only dump PERFHERDER_DATA when scenario tests are run with a resource usage flag. r=perftest-reviewers,stephendonner,rwood
For the Raptor 'scenario' test type, this patch prevents PERFHERDER_DATA from being output when `--power-test`, `--cpu-test`, or `--memory-test` are not used.

Differential Revision: https://phabricator.services.mozilla.com/D31665

--HG--
extra : moz-landing-system : lando
2019-07-04 15:36:40 +00:00
Mike Shal
5974699942 Bug 1560755 - Merge Android PGO profile data in run task; r=firefox-build-system-reviewers,chmanchester
Android profile runs don't always fully write out the profile data. In
this case, the corrupted profile data is successfully uploaded, but
future profile-use PGO builds try to merge the data and fail. Retrying
the profile-use builds doesn't help, since they all pull from the same
job that published the corrupt data.

We can detect this in the run task by using llvm-profdata merge, and if
the merge fails the task can automatically be retried. Note that the
data gets redundantly merged in the profile-use build, but it may not be
possible to run the merge in the run task on all platforms (eg: OSX), so
we have to keep the merge there as well.

Differential Revision: https://phabricator.services.mozilla.com/D36294

--HG--
extra : moz-landing-system : lando
2019-07-02 21:51:23 +00:00
Tom Prince
50c9843007 Bug 1557190: Update esr migration script for esr68; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D36368

--HG--
extra : moz-landing-system : lando
2019-06-30 20:57:00 +00:00
Kartikaya Gupta
276b570b4d Bug 1558598 - Add the --enable-webrender option to android HW unittests. r=ahal
This is not used yet but will be eventually so I'm just going to
add it now.

As of this patch, all the tests that we currently run on android HW do
accept the --enable-webrender flag and explicitly disable WR if it is
not provided.

Differential Revision: https://phabricator.services.mozilla.com/D35868

--HG--
extra : moz-landing-system : lando
2019-06-29 09:51:05 +00:00
Kartikaya Gupta
513bb04fa4 Bug 1558598 - Simplify the webrender flags in android_emulator_unittest.py. r=ahal
Instead of using --setenv to control WebRender being on or off, just propagate
the --enable-webrender flag to the downstream "remote" test harness. This
is more reliable than passing --setenv because not all harnesses support
the setenv flag, and it's easier to explicitly add support for --enable-webrender
to the harnesses that need it (i.e. the ones we want to run with WR enabled in
automation).

This also drops the --disable-webrender flag and asserts that lack of
enable-webrender implies WR will be disabled.

Differential Revision: https://phabricator.services.mozilla.com/D35867

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:56 +00:00
Kartikaya Gupta
286b1f72fd Bug 1558598 - Fix up webrender flag in desktop_unittest.py. r=ahal
Now that all the downstream test harnesses take the --enable-webrender
option and propagate it correctly, the desktop_unittest.py wrapper can
just pass it along to those harnesses.

Differential Revision: https://phabricator.services.mozilla.com/D35866

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:47 +00:00
Kartikaya Gupta
b7f611ea16 Bug 1558598 - Fix up webrender options for the firefox-ui harness. r=ato,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D35864

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:34 +00:00
Kartikaya Gupta
7cac45c075 Bug 1558598 - Fix up webrender options for the AWSY harness. r=ato
AWSY is built on marionette, so it inherits the option by default, we mostly
just need to propagate it properly. This also drops the --disable-webrender
option as it is now implied if --enable-webrender is not provided.

Differential Revision: https://phabricator.services.mozilla.com/D35863

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:30 +00:00
Kartikaya Gupta
00ecade299 Bug 1558598 - Fix the enable-webrender option for the telemetry Marionette tests. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D35862

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:27 +00:00
Kartikaya Gupta
90eea8e8e5 Bug 1558598 - Force WebRender on or off in the marionette harness. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D35861

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:23 +00:00
Kartikaya Gupta
ebe5ebc203 Bug 1558598 - Force WebRender on or off in the talos harness. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D35858

--HG--
extra : moz-landing-system : lando
2019-06-29 09:49:14 +00:00
Kartikaya Gupta
c3de0e7d73 Bug 1558598 - Force WebRender on or off in the raptor harness. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D35857

--HG--
extra : moz-landing-system : lando
2019-06-29 09:49:00 +00:00
Kartikaya Gupta
14cf3a5147 Bug 1558598 - Force WebRender on or off in the WPT harness. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D35856

--HG--
extra : moz-landing-system : lando
2019-06-29 09:48:53 +00:00
Geoff Brown
7a298cda7f Bug 1556058 - Upgrade the emulator used for most Android 7.0 tests; r=aerickson
Upgrade to version 29.0.11 of the emulator and use '-gpu on' rather than
swiftshader_indirect, for most Android 7.0 tests. The upgrade appears to
finally resolve bug 1534732, improves reftest performance dramatically, and
allows us to reduce reftest "fuzz" for many tests.
marionette tests are excluded because they intermittently fail with network
errors (address in use); these tests are near end-of-life, so I don't think
this issue is worth investigating, but I'll file a follow-up bug to record
the issue.
web-platform tests are excluded because they are not very stable on the
existing emulator, making it difficult to compare results. I will file a
follow-up and work with :maja_zf to see if they can be upgraded soon.

Differential Revision: https://phabricator.services.mozilla.com/D36256

--HG--
extra : moz-landing-system : lando
2019-06-28 17:30:15 +00:00
Rok Garbas
d8e57f535e Bug 1561582 - tooltool.py now supports python 3 and 2 r=rail CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D36010

--HG--
extra : source : 7e05642566d001eb7b6900e80788212310243c3c
extra : histedit_source : 361d6b5974f9a4708f12f2c747645df6c7d706ee
2019-06-27 12:54:07 +00:00
Dorel Luca
66a6c7cb6f Backed out changeset 7e05642566d0 (bug 1561582) for Toolchain failures. CLOSED TREE 2019-06-27 19:36:32 +03:00
Rok Garbas
e09d6e060e Bug 1561582 - tooltool.py now supports python 3 and 2 r=rail
Differential Revision: https://phabricator.services.mozilla.com/D36010

--HG--
extra : moz-landing-system : lando
2019-06-27 12:54:07 +00:00
Alexandre Poirot
9e581c4dbe Bug 1560127 - Fix test-verify against mochitest-remote. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D35415

--HG--
extra : moz-landing-system : lando
2019-06-21 10:34:15 +00:00
James Graham
3dbbd8c724 Bug 1559902 - Make wpt more forgiving of crashes on treeherder, r=ahal
This is required so that crashes on import don't block updating tests.
It makes that change from 1539449 only apply to non-wpt suites, which is
not ideal but no worse than the previous setup.

Differential Revision: https://phabricator.services.mozilla.com/D35218
2019-06-19 11:07:03 -07:00
Alexandre Poirot
d73b8a9739 Bug 1545147 - Run remote agent's mochitests in a distinct "remote" job. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D32028

--HG--
extra : moz-landing-system : lando
2019-06-17 13:57:03 +00:00
Rok Garbas
bb7bcf38e3 Bug 1557255 - switch from relengapi-proxy to taskcluster-proxy in taskgraph r=rail
Bug 1557255 - use taskcluster proxy when running tooltool.py

Bug 1557255 - fixing tooltool url

Differential Revision: https://phabricator.services.mozilla.com/D34472

--HG--
extra : moz-landing-system : lando
2019-06-12 14:43:14 +00:00
Dorel Luca
cb53554453 Backed out 3 changesets (bug 1558598) for Geckoview failures
Backed out changeset d9c42c5f4850 (bug 1558598)
Backed out changeset d2f0c18e82de (bug 1558598)
Backed out changeset f24e407e9a6d (bug 1558598)
2019-06-12 18:19:07 +03:00
Kartikaya Gupta
faedf6bd33 Bug 1558598 - Add the --enable-webrender option to android HW unittests. r=ahal
This is not used yet but will be eventually so I'm just going to
add it now.

Depends on D34623

Differential Revision: https://phabricator.services.mozilla.com/D34624

--HG--
extra : moz-landing-system : lando
2019-06-12 13:12:30 +00:00
Kartikaya Gupta
dac61ec776 Bug 1558598 - Force-disable webrender unless it is enabled. r=ahal
Ensure we force-disable webrender unless it is explicitly enabled
via the --enable-webrender flag. Also add missing env variables for
the telemetry_client.py case which appears to be a copy/paste error
that was not caught because we never run that test with WR enabled.

Depends on D34622

Differential Revision: https://phabricator.services.mozilla.com/D34623

--HG--
extra : moz-landing-system : lando
2019-06-12 13:13:35 +00:00
Kartikaya Gupta
f6b29b417f Bug 1558598 - Remove --disable-webrender options from a couple of places. r=ahal
This drops the --disable-webrender option (which force-disables WR)
and treats the lack of an --enable-webrender as if --disable-webrender
was provided.

Differential Revision: https://phabricator.services.mozilla.com/D34622

--HG--
extra : moz-landing-system : lando
2019-06-12 13:08:43 +00:00