Commit Graph

1630 Commits

Author SHA1 Message Date
Ciure Andrei
8a1785a6cc Backed out 11 changesets (bug 1540655) for test_resolve.py perma failures CLOSED TREE
Backed out changeset 1a23d770d8a1 (bug 1540655)
Backed out changeset 641a7cb25298 (bug 1540655)
Backed out changeset 73236f81da44 (bug 1540655)
Backed out changeset 8d7bad30be46 (bug 1540655)
Backed out changeset bb012df3018b (bug 1540655)
Backed out changeset 8c67b494e207 (bug 1540655)
Backed out changeset c0a80d37576d (bug 1540655)
Backed out changeset 939ce2afcf0b (bug 1540655)
Backed out changeset 3b3a2a9fbc8b (bug 1540655)
Backed out changeset b96dede008ad (bug 1540655)
Backed out changeset 997d1568d944 (bug 1540655)
2019-08-14 18:53:36 +03:00
Andreas Tolfsen
5f375cf773 bug 1540655: moztest: add test path resolution for Puppeteer tests; r=ahal
Makes it possible for mach to resolve test paths for Puppeteer,
so that individual tests can be run from the command line using
"./mach test", as such:

	% ./mach test remote/test/puppeteer/test/screenshot.spec.js

As the Puppeteer test suite is imported from upstream and we cannot
change this directory at will (i.e. to add test manifest files),
we take the same approach as for WPT and populate the manifest by
recursively walking the remote/test/puppeteer/test/**/*.spec.js file tree.

Differential Revision: https://phabricator.services.mozilla.com/D37013

--HG--
extra : moz-landing-system : lando
2019-08-14 14:58:05 +00:00
Florin Strugariu
a9dde2d93d Bug 1539983 [mozproxy] Move alternate-server-replay script into mozproxy r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D41540

--HG--
rename : testing/mozbase/mozproxy/mozproxy/backends/mitm.py => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitm.py
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-4.0.4-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-4.0.4-linux64.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-4.0.4-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-4.0.4-osx.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-4.0.4-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-4.0.4-win.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-linux64.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-osx.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy-rel-bin-win.manifest
rename : testing/mozbase/mozproxy/mozproxy/backends/mitmproxy_requirements.txt => testing/mozbase/mozproxy/mozproxy/backends/mitm/mitmproxy_requirements.txt
rename : testing/raptor/raptor/playback/alternate-server-replay-2.0.2.py => testing/mozbase/mozproxy/mozproxy/backends/mitm/scripts/alternate-server-replay-2.0.2.py
rename : testing/raptor/raptor/playback/alternate-server-replay-4.0.4.py => testing/mozbase/mozproxy/mozproxy/backends/mitm/scripts/alternate-server-replay-4.0.4.py
rename : testing/raptor/raptor/playback/scripts/catapult/LICENSE => testing/mozbase/mozproxy/mozproxy/backends/mitm/scripts/catapult/LICENSE
rename : testing/raptor/raptor/playback/scripts/catapult/deterministic.js => testing/mozbase/mozproxy/mozproxy/backends/mitm/scripts/catapult/deterministic.js
rename : testing/raptor/raptor/playback/scripts/inject-deterministic.py => testing/mozbase/mozproxy/mozproxy/backends/mitm/scripts/inject-deterministic.py
extra : moz-landing-system : lando
2019-08-14 11:49:35 +00:00
James Graham
d289d43116 Bug 1573414 - Make geckodriver, webdriver and mozbase #![forbid(unsafe_code)], r=ato
We don't expect to use any unsafe and doing this helps static analysis tools
determine that the library is low risk from the point of view of memory unsafety,
and makes it less likely someone will add in some unsafe code in the future without
appropriate care.

Differential Revision: https://phabricator.services.mozilla.com/D41730

--HG--
extra : moz-landing-system : lando
2019-08-13 13:27:51 +00:00
Bob Clary
084747dfb5 Bug 1572563 - [mozdevice 3.0.5] - sync file system after modifications, r=jmaher.
Depends on D41570

Differential Revision: https://phabricator.services.mozilla.com/D41571

--HG--
extra : moz-landing-system : lando
2019-08-12 19:57:01 +00:00
Bob Clary
6f8bdebafe Bug 1572563 - [mozdevice 3.0.5] - Continue to use echo adb_returncode=0 hack for emulators regardless of Android version, r=jmaher.
Depends on D41395

Differential Revision: https://phabricator.services.mozilla.com/D41570

--HG--
extra : moz-landing-system : lando
2019-08-12 15:38:43 +00:00
Bob Clary
a2f6a21c82 Bug 1572563 - [mozdevice 3.0.5] - repeatedly attempt to detect ls through execution to determine which instance is available, r=gbrown,jmaher.
***

Differential Revision: https://phabricator.services.mozilla.com/D41395

--HG--
extra : moz-landing-system : lando
2019-08-12 15:32:45 +00:00
Bob Clary
88ded63ad8 Bug 1572563 - [mozdevice 3.0.5] - work around intermittent test path failures on emulators, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D41394

--HG--
extra : moz-landing-system : lando
2019-08-12 20:06:19 +00:00
Ciure Andrei
226bfc7c40 Backed out changeset 46206b874a55 (bug 1572448) for causing test_preferences.py to perma fail CLOSED TREE 2019-08-09 12:48:06 +03:00
Henrik Skupin
4d29daa6fb Bug 1572448 - [mozprofile] Cast boolean preference values case-insensitive. r=jgraham
Depends on D41282

Differential Revision: https://phabricator.services.mozilla.com/D41347

--HG--
extra : moz-landing-system : lando
2019-08-09 09:10:54 +00:00
James Graham
e6b3c4085c Bug 1572383 - Bump version numbers for mozprofile and mozrunner, r=gbrown
Bug 1539437 indtroduced a new ChromiumProfile class in mozprofile
that's imported into mozrunner. This means that the 7.5.0 release of
mozrunner should have been accompanied by a corresponding mozprofile
release and requirements version bump.

Differential Revision: https://phabricator.services.mozilla.com/D41167

--HG--
extra : moz-landing-system : lando
2019-08-08 13:35:06 +00:00
Gregory Mierzwinski
83697159ec Bug 1567954 - Part 4: Implement MozPower class in the Mozpower module. r=perftest-reviewers,rwood
This patch implements the MozPower class in the Mozpower module which is the interface for the user to use the power measurement tooling. It primarily detects the user's OS and CPU combination and provides the appropriate methods for them.

Differential Revision: https://phabricator.services.mozilla.com/D39194

--HG--
extra : moz-landing-system : lando
2019-08-07 20:55:27 +00:00
Gregory Mierzwinski
e382e45e4c Bug 1567954 - Part 3: Implement MacIntelPower class in the Mozpower module. r=perftest-reviewers,rwood,alexandru.irimovici
This patch implements the MacIntelPower class in the Mozpower module. It is used for power measurement testing on Mac Intel-based machines using Intel Power Gadget.

Differential Revision: https://phabricator.services.mozilla.com/D39193

--HG--
extra : moz-landing-system : lando
2019-08-01 20:38:23 +00:00
Gregory Mierzwinski
accc36a617 Bug 1567954 - Part 2: Implement IntelPowerGadget and IPGResultsHandler classes in the Mozpower module. r=perftest-reviewers,rwood
This patch implements IntelPowerGadget and IPGResultsHandler for the Mozpower module. These classes handle data generation with Intel Power Gadget as well as cleaning the data and formatting it into the PERFHERDER_DATA format.

Differential Revision: https://phabricator.services.mozilla.com/D39192

--HG--
extra : moz-landing-system : lando
2019-08-07 17:50:26 +00:00
Gregory Mierzwinski
92d5021daf Bug 1567954 - Part 1: Initialize Mozpower module and implement PowerBase class. r=perftest-reviewers,ahal,rwood
This patch initializes the Mozpower module and implements the PowerBase class. This class is used as a base for subclasses that implement power measurement tooling for various OS and CPU combinations.

Differential Revision: https://phabricator.services.mozilla.com/D39191

--HG--
extra : moz-landing-system : lando
2019-08-01 20:36:00 +00:00
Florin Strugariu
c99ea2e1ba Bug 1553932 Update mozproxy certutil usage r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D39200

--HG--
extra : moz-landing-system : lando
2019-08-07 08:22:55 +00:00
Bob Clary
d2ff3d2ad4 Bug 1571501 - [mozdevice 3.0.4] Use exitcode of adb process as exitcode of Android command for Android 7/24 and later, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D40668

--HG--
extra : moz-landing-system : lando
2019-08-06 14:35:52 +00:00
Geoff Brown
f7b0420fd4 Bug 1570051 - Minor updates to android mach commands; r=bc
Various cleanup:
 - remove extraneous calls to grant_runtime_permissions
 - remove unused legacy jimdb support code
 - remove "This may take a while" logging
 - emphasize x86/x86_64 capabilities of emulator

Differential Revision: https://phabricator.services.mozilla.com/D40302

--HG--
extra : moz-landing-system : lando
2019-08-03 01:52:39 +00:00
James Graham
226d6ca0b2 Bug 1571019 - Update mozrunner version to 7.5.0, r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D40443

--HG--
extra : moz-landing-system : lando
2019-08-02 15:44:31 +00:00
Maja Frydrychowicz
8e15c4ae87 Bug 1569440 - [mozrunner] Empty the minidump directory instead of deleting it; r=gbrown
Other harness code intermittently complains if the directory is absent. Maybe this will help.

Differential Revision: https://phabricator.services.mozilla.com/D39621

--HG--
extra : moz-landing-system : lando
2019-07-30 16:55:19 +00:00
Maja Frydrychowicz
96e61238be Bug 1569440 - [mozrunner] Clean up stray temp directory; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D39620

--HG--
extra : moz-landing-system : lando
2019-07-30 01:27:03 +00:00
Maja Frydrychowicz
b368ec56ba Bug 1569440 - [mozdevice] Remove redundant except clause; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D39619

--HG--
extra : moz-landing-system : lando
2019-07-30 01:59:45 +00:00
Maja Frydrychowicz
14e9dd3c9e Bug 1569440 - [mozrunner] Set MOZ_IN_AUTOMATION when running on Android; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D39616

--HG--
extra : moz-landing-system : lando
2019-07-30 01:59:45 +00:00
Maja Frydrychowicz
2b9bdaaf17 Bug 1569440 - [mozrunner] Log when minidumps directory does not exist on device; r=gbrown
The missing directory seems to happens ~20 or so times per test run. I hope this
can help with investigations.

Differential Revision: https://phabricator.services.mozilla.com/D39613

--HG--
extra : moz-landing-system : lando
2019-07-30 16:19:03 +00:00
Bob Clary
da772c8074 Bug 1569707 - [mozdevice 3.0.3] - Improve boot complete detection and ensure that the device state is reset after rebooting, r=gbrown.
Add internal method _wait_for_bootcompleted to wait until sys.boot_completed and dev.bootcomplate are set.
Add internal method _initialize_boot_state to encapsulate the steps required to initialize device state.
Make sure to set device state after rebooting.
Normalize optional arguments for _test_path calls.
Add verbose logging for shell_bool.

Differential Revision: https://phabricator.services.mozilla.com/D39876

--HG--
extra : moz-landing-system : lando
2019-07-30 18:03:27 +00:00
Andrew Halberstadt
e3e6ea6d8e Bug 1567264 - [mozlog] Support log errors in the errorsummary and mach formatter r=jgraham
Differential Revision: https://phabricator.services.mozilla.com/D39547

--HG--
extra : moz-landing-system : lando
2019-07-29 15:16:22 +00:00
Andreas Tolfsen
2ce9924f6c bug 1569143: mozrunner: lint; r=webdriver-reviewers,automatedtester
Differential Revision: https://phabricator.services.mozilla.com/D39487

--HG--
extra : moz-landing-system : lando
2019-07-26 12:03:22 +00:00
Andreas Tolfsen
ac034168fc bug 1569143: mozprofile: lint; r=webdriver-reviewers,automatedtester
Differential Revision: https://phabricator.services.mozilla.com/D39486

--HG--
extra : moz-landing-system : lando
2019-07-26 12:01:09 +00:00
Edwin Gao
a1cc4534a7 Bug 1519369 - support 'debugger' parser argument for mach test command r=ahal,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D39229

--HG--
extra : moz-landing-system : lando
2019-07-26 15:18:18 +00:00
Andreea Pavel
e4263c00eb Merge mozilla-inbound to mozilla-central. a=merge 2019-07-25 08:59:39 +03:00
Andreas Tolfsen
bb030bafa9 bug 1566778: mozrunner: search system path on assorted Unices; r=webdriver-reviewers,jgraham
Makes the Linux platform implementation of firefox_default_path()
apply to all flavours of Unix.

It was reported in https://github.com/mozilla/geckodriver/issues/1585
that geckodriver does not search the system path for the Firefox
binary on FreeBSD.

Differential Revision: https://phabricator.services.mozilla.com/D39196

--HG--
extra : moz-landing-system : lando
2019-07-24 14:45:27 +00:00
Marian Raiciof
914b7530c9 Bug 1560339 - Extra incoherent logging when running android mochitest r=gbrown
Do not decode data returned by get_file() in adb.py

Differential Revision: https://phabricator.services.mozilla.com/D38844

--HG--
extra : moz-landing-system : lando
2019-07-22 14:19:03 +00:00
Kris Maglione
73e321aadc Bug 1566952: Part 0 - Fix comment processing in multi-line directives. r=ahal
The current comment processing code strips whitespace from a line, calculates
comment offsets based on the unstripped version, and then strips those offsets
from the stripped version. That means that, for multi-line directives, which
typically have two spaces at the front, the offsets are wrong and lines with
comments end up with a trailing "# " that the expression parser doesn't
understand.

This patch fixes the comment parser to correctly use the stripped line for
offset calculations instead.

Differential Revision: https://phabricator.services.mozilla.com/D38724

--HG--
extra : rebase_source : 9f19314ccab3fb2fa68642ff0aef978cb5c3e13c
2019-07-17 14:19:59 -07:00
Andrew McCreight
d78c44314a Bug 1567541 - Fix typo "Minidump anaylsed". r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D38688

--HG--
extra : moz-landing-system : lando
2019-07-19 17:05:47 +00:00
Andrew Halberstadt
3336efcb3f Bug 1473498 - Fixing Py3 compatibility errors reachable from testing/mach_commands.py r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D37762

--HG--
extra : moz-landing-system : lando
2019-07-16 01:21:55 +00:00
Tom Prince
d644374710 Bug 1565725: Make tests of mozfile.which insensitive to the case of the cwd on windows; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D37949

--HG--
extra : moz-landing-system : lando
2019-07-15 17:31:04 +00:00
Eric Rahm
7432760a32 Bug 1565359 - Fix trait objects without an explicit dyn are deprecated error. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D37771

--HG--
extra : moz-landing-system : lando
2019-07-12 00:25:21 +00:00
Mike Shal
d877ac79c4 Bug 1565314 - use is_tarfile() check before is_zipfile() in mozinstall; r=ahal
Similar to bug 1552672, very rarely is_zipfile() can return True on a
tarfile if the tarfile happens to contain a magic four byte sequence at
the right location in the file. By checking for is_zipfile() first, we
try to unzip the tar file and then fail. Instead we can call
is_tarfile() first, which is more robust, and call is_zipfile() last.

Differential Revision: https://phabricator.services.mozilla.com/D37765

--HG--
extra : moz-landing-system : lando
2019-07-11 19:49:03 +00:00
Andrew Halberstadt
9a1ff6557d Bug 1563797 - [mozfile] Add a 'which' function to make 'shutil.which' consistent on Windows r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D37621

--HG--
extra : moz-landing-system : lando
2019-07-11 14:13:47 +00:00
Geoff Brown
911570de65 Bug 1562938 - Update 'mach android-emulator' for emulator 29.0.11; r=aerickson
Use the same options for x86-7.0 emulator via mach as in CI.

Differential Revision: https://phabricator.services.mozilla.com/D36631

--HG--
extra : moz-landing-system : lando
2019-07-10 13:09:26 +00:00
Victor Porof
2b036e45c5 Bug 1561435 - Format testing/, a=automatic-formatting
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D35962

--HG--
extra : source : c0948f31e520ca087279cf429ca5f1db5a8341b8
2019-07-05 11:01:24 +02:00
Edwin Gao
4760b99320 Bug 1562083 - explicitly insert sys.path to env for use in subprocess for python3 mozprocess unit tests r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D36681

--HG--
extra : moz-landing-system : lando
2019-07-03 17:52:19 +00:00
Cosmin Sabou
e869758aa5 Backed out changeset da3af6a077fc (bug 1562083) for busting gecko decision task. CLOSED TREE 2019-07-03 19:48:58 +03:00
Edwin Gao
4a65facb18 Bug 1562083 - explicitly insert sys.path to env for use in subprocess for python3 mozprocess unit tests r=jmaher
Changes:
- for macosx1014, in the tests where `subprocess` is called and the process relies on `six` being present, ensure that `six` is available in the PYTHONPATH by explicitly inserting the contents of `sys.path` to the modified environment variable dict
- change how the command line call to run the suite is being built in `taskcluster/taskgraph/transforms/job/mach.py`
- migrate source-tests from macosx1010 to macosx1014

Differential Revision: https://phabricator.services.mozilla.com/D36681

--HG--
extra : moz-landing-system : lando
2019-07-03 01:04:24 +00:00
Kartikaya Gupta
721a5dbcf4 Bug 1558598 - Ensure mozinfo correctly detects WebRender. r=ahal
I don't know if this covers all the things that use mozinfo (probably not)
but it covers all the suites that use mozinfo and have webrender conditions
in the test manifests (i.e. mochitest and wpt variants).

Differential Revision: https://phabricator.services.mozilla.com/D35869

--HG--
extra : moz-landing-system : lando
2019-06-29 09:51:14 +00:00
Nikki Sharpley
cd5919d8dd Bug 1561421 - [mozlog] Update mozlog docs and version to 4.2.0 r=ahal
The mozlog documents have been updated to reflect the addition of a `known_intermittent`
parameter in `test_status` and `test_end` included in the `StructuredLogger`, and across
multiple mozlog handlers and formatters.

As this was a major change, the version has been bumped to 4.2 for the next pypi release.

Web-platform-tests will eventually require this update in order for future patches related
to `known_intermittent` statuses to merge upstream.

Differential Revision: https://phabricator.services.mozilla.com/D36029

--HG--
extra : moz-landing-system : lando
2019-06-28 19:35:55 +00:00
Geoff Brown
95706218a2 Bug 1557152 - [mozdevice] Retry mkdir check for directory existence; r=bc
This effectively avoids the mkdir failures I see with the 29.0.11 emulator
on packet.net with Android 7.0 x86_64. I hate to add this sort of complication
but it really helps clear the way for an otherwise useful upgrade.

Differential Revision: https://phabricator.services.mozilla.com/D34740

--HG--
extra : moz-landing-system : lando
2019-06-26 22:45:11 +00:00
Geoff Brown
00c7fc4efb Bug 1560073 - Change default android package name for most mach test commands; r=snorp,nalexander,maja_zf
Use the geckoview TestRunnerActivity, org.mozilla.geckoview.test, by default
for all types of mochitests, reftests, and web-platform tests. TRA is already
the default for gtest and geckoview-junit. Fennec, based on ANDROID_PACKAGE_NAME,
remains the default for robocop and marionette-test and I have no plans to
change those. There is a related issue for xpcshell-test -- not the package
name, but the default apk -- but I am reluctant to handle that until bug 1553225
is resolved.

Differential Revision: https://phabricator.services.mozilla.com/D35479

--HG--
extra : moz-landing-system : lando
2019-06-26 02:34:49 +00:00
Geoff Brown
46ae70c525 Bug 1560162 - Handle psutil exception in 'mach android-emulator'; r=denschub
I haven't reproduced this failure myself, but this change *should* help.

Differential Revision: https://phabricator.services.mozilla.com/D35561

--HG--
extra : moz-landing-system : lando
2019-06-21 20:07:20 +00:00
Emilio Cobos Álvarez
3a16c93150 Bug 1556602 - Fix various warnings with rust 1.37 nightly. r=froydnj
In particular:

 * trait objects without an explicit `dyn` are deprecated
 * `...` range patterns are deprecated

I think these shouldn't really warn by default and should be clippy / opt-in
lints, but anyway, doesn't hurt.

Differential Revision: https://phabricator.services.mozilla.com/D35135

--HG--
extra : moz-landing-system : lando
2019-06-18 21:32:16 +00:00