Commit Graph

815 Commits

Author SHA1 Message Date
Andrew Halberstadt
0d41359cf5 Bug 1300163 - Add a --adbpath argument to mochitest Android to allow explicitly setting the adb binary, r=gbrown
In mozdevice, it's possible to pass in the path to the adb binary (rather than requiring it to be on the path). The
mochitest android options don't provide any means to set this however (even though the b2g options do). This patch
adds that option in.

This will be used by the mach environment on interactive loaners.

MozReview-Commit-ID: 4lsKGpizfH7

--HG--
extra : rebase_source : 07ad43c8fff3eb83a1eaab9ad0532cd85c4532c7
2016-09-02 14:26:16 -04:00
Maja Frydrychowicz
eba70f25fe Bug 1284874 - Represent am command as one string in FennecRunner; r=ahal
When running the command for starting Fennec, quotation marks aren't
processed properly when the 'am' portion of the command is represented
with one string token per argument; the args must be joined into one string
instead.

Also add log message about command being run in BaseRunner.

MozReview-Commit-ID: KZLnOdu9UGq

--HG--
extra : rebase_source : c8072c003afec3aba18f307b8cc64332736e55fc
2016-07-25 20:40:36 -04:00
Geoff Brown
7f2f8dacb4 Bug 1294878 - Support 'mach android-emulator --version 6.0'; r=jmaher 2016-08-23 09:02:35 -06:00
Andrew Halberstadt
c5c5ece520 Bug 1296735 - [manifestparser] pathprefix filter should use absolute paths if the filter is also absolute, r=jmaher
This fixes an error when attempting to run xpcshell-test with a test path from an interactive loaner.

MozReview-Commit-ID: 20kg5zKplhT

--HG--
extra : rebase_source : cda8e17dd6ad7b606711630e90df8d5e65c8bda3
2016-08-22 13:31:56 -04:00
Towkir Ahmed
63867da04a Bug 1284887 - Replaced references to mxr.mozilla.org in the codebase with dxr.mozilla.org r=dolske
a=release to get around a hook that's catching these comment-only idl changes

--HG--
extra : rebase_source : a7353680777fd2eeea24c9993f9937bbbcfb9e4f
2016-08-15 17:28:05 -07:00
James Graham
8bdb6331c6 Bug 1293250 - Make reftest log generation less magical, r=ahal
Ensure that the first line of the log for failing tests is identical to
one that would be produced by the tbplformatter from mozlog. This means
that treeherder will be able to sucessfully cross-match error lines.

Also make the data structures used for storing screenshots identical
between reftests and web-platform-tests so that we can start to move
toward removing the reftest-specific codepath here.

MozReview-Commit-ID: FZQXLjj9Ejv

--HG--
extra : rebase_source : 3e9bf70ff7915817b8c02032c8da0d0a659e4661
2016-08-08 17:48:39 +01:00
Andrew Halberstadt
16c7acfe05 Bug 1292660 - Fix |mach mochitest| kwargs['app'] is None error on android, r=gbrown
This fixes a regression from bug 1288827. It happened because I moved the logic that finds
the application path a little later on in the test harness. But there was an instance where
it was being used in the android mach command before that point.

As it turned out, we don't really *need* that value there. This patch grabs the same value
from build_obj.substs which is already an argument to the function.

MozReview-Commit-ID: 3IsI4VzEIIF

--HG--
extra : rebase_source : ceb718b265c7886b831e0378436baebf2b4e7598
2016-08-05 16:40:08 -04:00
Geoff Brown
b43e83e646 Bug 1289226 - Update Android 4.3 and x86 AVDs for sdk 24+ emulator compat; r=jmaher 2016-08-04 07:14:24 -06:00
Andrew McCreight
bbdc92f231 Bug 1195777 - When LSan detects leaks, tell the user about the report_objects option. r=chmanchester
MozReview-Commit-ID: KWNye8GdEKv
2016-07-29 16:08:06 -07:00
Tom Tromey
5538d692d3 Bug 1286877 - do not set c-basic-offset for python-mode; r=gps
This removes the unnecessary setting of c-basic-offset from all
python-mode files.

This was automatically generated using

    perl -pi -e 's/; *c-basic-offset: *[0-9]+//'

... on the affected files.

The bulk of these files are moz.build files but there a few others as
well.

MozReview-Commit-ID: 2pPf3DEiZqx

--HG--
extra : rebase_source : 0a7dcac80b924174a2c429b093791148ea6ac204
2016-07-14 10:16:42 -06:00
Rob Thijssen
18da8e2f82 Bug 1287496 - Increment sleep timespan by (attempts * delay) seconds. r=ted
MozReview-Commit-ID: Gx9fxp3xfZA

--HG--
extra : rebase_source : b2bbfb62a257a7d538b19ed522e24378fda2098d
2016-07-18 18:12:01 +01:00
Jeremy Chen
77cad258aa Bug 1287480 - Release mozlog 3.3. r=jmaher
MozReview-Commit-ID: D6UsFueHmPB

--HG--
extra : rebase_source : 8a667495b5efbe9849e8b64dccc3ac76fa257954
2016-07-19 09:50:09 +08:00
Henrik Skupin
3caa86c072 Bug 1255986 - [moztest] Safe-guard structured logging for exceptions from bad handlers. r=jgraham
Any exception which gets thrown by a log handler while test results are getting generated, should
not cause test harnesses to stop immediately. To achive that the exception details are written to
stderr and not propagated up the stack.

MozReview-Commit-ID: ChyYxApYSGx

--HG--
extra : rebase_source : 9fc3fe597061bedb1df2f5b8de1daa4bd127ea1e
2016-06-03 22:20:59 +02:00
Jeremy Chen
f0831c1624 Bug 1287019 - part2: prevent saving redundant screenshots in mozlog's HTML format result. r=jmaher
There are two identical pairs of screenshots (test/reference pair) which are
png/base64 raw files generated from mozlog's HTML formatter. One pair is stored
in the img element to present the visual result; the other pair is stored as a
hyperlink source in the visual result's title.

After part1 patch, we may have one more pair. It appears that the hyperlinks of
the visual result's titles could be eliminated since they are visually closed to
the visual results, and clicking the visual results provides the exact same
function.

DONTBUILD (NPOTB)

MozReview-Commit-ID: 4CLfYXX8g69

--HG--
extra : rebase_source : d4d3b4e08b66e737d75a2ca21b6e84b344a29fc8
2016-07-18 13:53:58 +08:00
Jeremy Chen
824b568df5 Bug 1287019 - part1: make mozlog's HTML format support wptrunner screenshot. r=jmaher
Current mozlog (v3.2) doesn't support screenshot logs exported from wptrunner.
Add this support so we could run css test with --log-html to see more detail
information, such as screenshots of test/reference pages.

DONTBUILD (NPOTB)

MozReview-Commit-ID: AUJwYfvNfda

--HG--
extra : rebase_source : 1d3d1fcdc396638d256336d3dfaf5ba5bad35168
2016-07-18 13:53:58 +08:00
Geoff Brown
058d5be563 Bug 1285663 - Optimize profile pushes and do not chmod files on /sdcard; r=bc 2016-07-14 10:36:31 -06:00
Geoff Brown
6c9e1864c5 Bug 1285675 - Grant READ_EXTERNAL_STORAGE to fennec during tests; r=me 2016-07-08 17:02:51 -06:00
Geoff Brown
94e2b5ece5 Bug 1285040 - Adapt device manager pushDir to latest adb; r=bc 2016-07-08 09:20:03 -06:00
Henrik Skupin
4a66067bde Bug 1176758 - Release mozprocess 0.23 and mozrunner 6.12. r=ahal
MozReview-Commit-ID: JeQhPhZHbUX

--HG--
extra : rebase_source : 729a8393b18ce7b75d3e615d5010cd32744cc16f
2016-06-30 16:45:21 +02:00
Henrik Skupin
c0ae4f73e9 Bug 1176758 - Allow mozprocess to detect and kill detached child processes. r=ahal
MozReview-Commit-ID: B9yfLYUZw76

--HG--
extra : rebase_source : dcf4d1a7b58b2045cf058247f3d6ffc753b398b1
2016-06-30 16:44:56 +02:00
Maja Frydrychowicz
bc77cad106 Bug 787203 - [mozdevice] Add remove_forward method to DeviceManagerADB; r=ahal
For adb forward --remove|remove-all

MozReview-Commit-ID: FrfFOCSQl6q

--HG--
extra : rebase_source : c3a9bd1224b5defa2bd50404a2e7eecf78997873
2016-06-28 23:41:30 -04:00
Maja Frydrychowicz
e3d59c813d Bug 787203 - [mozrunner] Pass application arguments to FennecRunner; r=ahal
MozReview-Commit-ID: KGPOL2P94ED

--HG--
extra : rebase_source : 9d7aaf4fd3f67429d54b664e5243026790a7cf2c
2016-06-30 17:20:54 -04:00
Maja Frydrychowicz
f5a12ff0d3 Bug 787203 - [mozrunner] Expose a start_logcat method in Device; r=ahal
This is a refactor. |start_logcat| allows filtering by tag and is used for
recording gecko.log for Marionette tests on Fennec.

MozReview-Commit-ID: 9NO6jQDMQ9E

--HG--
extra : rebase_source : e4f60b5d1c9c4ed6bb6dd237d9c1433b5f04a8d6
2016-06-30 17:41:17 -04:00
Maja Frydrychowicz
1b153a70e1 Bug 787203 - [mozrunner] Update disconnected when cleaning up after emulator shutdown; r=ahal
Allows Marionette client's FennecInstance to clean up properly

MozReview-Commit-ID: BWuNh5cq3ZD

--HG--
extra : rebase_source : d270b2a7e503658f69b2e5ce3a972d8cc9f1b13d
2016-06-29 00:44:34 -04:00
Geoff Brown
f437f61b75 Bug 1283584 - Disable android emulator authentication; r=jmaher 2016-07-04 08:06:55 -06:00
Eric Rahm
75eb6669f0 Bug 1282184 - Use lldb from Xcode install rather than system install if possible. r=ted
This works around issues with System Integrity Protection kicking in on OSX when
trying to run /usr/bin/lldb by attempting to using the version installed with
XCode's command line utilities.

In particular SIP prevents us from setting DYLD_LIBRARY_PATH which is needed
to run DMD.
2016-06-28 11:50:16 -07:00
Maja Frydrychowicz
a2e846edaf Bug 1278590 - Create a FennecRunner; r=ahal,gbrown
Add FennecEmulatorRunner (for convenience), FennecRunner, FennecContext
and EmulatorAVD.

Common behaviour is defined in BaseEmulator and RemoteContext to distinguish
from B2G and Fennec specifics. I've tried to decouple ArchContext from
B2GContext, as well.

The emulator/adb commands in FennecRunner and EmulatorAVD are intended to
match the behaviour seen in current Android automation (e.g. mochitest).

MozReview-Commit-ID: 1tqD0DStdHR

--HG--
extra : rebase_source : 1450f3b03f82a0f9d33e43d19632a06a51ef7253
2016-06-07 11:45:08 -04:00
Eric Rahm
cffa865b22 Bug 1278399 - Use MOZ_LOG in automation. r=ted
NSPR_LOG_MODULES is deprecated in favor of MOZ_LOG, this cleans up warning
spam during testing.
2016-06-10 10:05:57 -07:00
Henrik Skupin
be1e7aaec0 Bug 1276886 - [mozprocess] Fix hang in output readers when process is in a new process group. r=ahal
MozReview-Commit-ID: 9e6HNAaF0Yo

In case of in-process restarts it can happen that the new process gets forked into a new process group.
When that happens we loose the capability to kill the process. To prevent a hang when joining the output
reader threads in wait(), we simply skip that call by passing-through the IO error.

--HG--
extra : rebase_source : 702dfec407ed13114f59fa6ccb0d82c5b0790550
2016-06-02 20:19:34 +02:00
Andrew Halberstadt
95882ef0e4 Bug 1274584 - [mozprocess] Fix IO Completion Port failed to signal process shutdown, r=jgriffin
Sometimes the IO completion port doesn't shutdown child processes. When this happens,
mozprocess will attempt to force kill the child processes manually. However, there is
a bug here which causes the OSError to get raised.

Although this fixes that bug, the original issue(s) which prevented the IOC port
from signaling shutdown remain and are still undiagnosed.

MozReview-Commit-ID: L3DQPW0Is5v

--HG--
extra : rebase_source : cf6320cffea5a4c8fb5d62861c41065d9dcefa52
2016-05-30 11:02:13 -04:00
Andrew Halberstadt
7746cfd17f Bug 1274584 - [mozprocess] Improve debugging messages on windows, r=jgriffin
We can set MOZPROCESS_DEBUG to help debug windows process code. However on try
it is unreadable as there are multiple things using mozprocess, and each process
has multiple threads. It's impossible to tell which log message comes from where.
This improves the debug logs a bit by always specifying the PID and thread name.

There are a few other drive-by cleanups in this thread. The only one of note is
removing a python 2.5 only code path.

MozReview-Commit-ID: L3DQPW0Is5v

--HG--
extra : rebase_source : f07c07f53b06b1160cd3e70cb06b8dc12a89c3ab
2016-05-30 11:00:59 -04:00
Nicolas B. Pierron
b2b9651d11 Bug 1270082 - mozinfo: Use the kernel version if the distribution is not supported by python platform function. r=gps 2016-05-27 14:50:03 +00:00
Geoff Brown
dd65ba7f12 Bug 1274395 - Delete pending crash reports before running tests; r=jmaher 2016-05-25 14:48:42 -06:00
Maja Frydrychowicz
cada490dd5 Bug 1275608 - [mozrunner] Remove wait_for_system_message from Emulator; r=ahal
This code is no longer used by Marionette client or elsewhere.

MozReview-Commit-ID: 4lx9CN7XIeH

--HG--
extra : rebase_source : e0a895c02939c51ee40be5be5f999cc41420a2a7
2016-05-25 11:53:25 -04:00
Gregory Szorc
d575271cc0 Bug 1272782 - Bump mozsystemmonitor version to 0.3; r=ahal
So we can release the bug fixes we just made.

MozReview-Commit-ID: HgfPQkkwd6r

--HG--
extra : rebase_source : 62a85de968b26230721939838ca4d29d6600b186
2016-05-13 14:11:40 -07:00
Gregory Szorc
e16f5d1baa Bug 1272782 - Don't wait forever for child process to exit; r=ahal
I believe this is the source of hangs/timeouts in automation.
join() waits forever. We add code to wait at most N seconds before
force terminating the process. The timeout is a bit high. But it is
better than infinite.

MozReview-Commit-ID: KwyO4RZ9OqL

--HG--
extra : rebase_source : 767d8ff5b48d7e75ab8fe72b18145446a38d439a
2016-05-13 14:10:39 -07:00
Gregory Szorc
49e64768b0 Bug 1272782 - Wait longer and stop after "done" message; r=ahal
Before, we kept waiting for data in the pipe after receiving the
"done" message. This didn't really make much sense because the
"done" message should be the final thing sent over the pipe!

e9113fd6cdb8 (bug 1239939) recently dropped the poll interval
of the pipe from 1.0 to 0.1s. This appears to have introduced
an intermittent failure in a test. The race condition was
between the child process sending data and the parent process
timing out (after only 0.1s) waiting for that data. Increasing
the timeout makes the failure reproduce less often. Although
technically the race condition is still present! I'm not
inclined to fix it at this time, however.

The rationale for dropping the pipe timeout was that it was
causing lag when terminating short-lived processes. Now that
we abort the pipe reading/polling loop as soon as the "done"
message is received, we no longer poll the pipe after receiving
"done" and no longer have to worry about its timeout impacting
shutdown time.

MozReview-Commit-ID: EeENQ95RAs1

--HG--
extra : rebase_source : ce2502f32841a55f912aafdba7cc81e3a58e3ff5
2016-05-13 14:05:17 -07:00
Gregory Szorc
4b05251aa6 Bug 1272782 - Send tuple properly; r=ahal
Found this bug when auditing the code for issues. We are attempting
to send a tuple but were forgetting the trailing comma on a single
element tuple.

Fortunately, this doesn't appear to impact anything because
the receiving end of the pipe doesn't care what data it receives.

MozReview-Commit-ID: E34fBqxgUSq

--HG--
extra : rebase_source : 3701a28979a8b53d40ea68acef3ee2cb6d8a50f2
2016-05-13 13:57:59 -07:00
Gregory Szorc
f03abf7727 Bug 1272541 - Bump mozsystemmonitor to version 0.2; r=ahal
So we can release the new as_dict() goodies.

MozReview-Commit-ID: JNQ3jA2U450

--HG--
extra : rebase_source : 6f17ed7395033d75e28f1ed4db468b2865da739a
2016-05-12 18:48:32 -07:00
Gregory Szorc
3dd91a28c7 Bug 1272541 - Expose more data from SystemResourceMonitor.as_dict; r=ahal
We add some system information including processor count
and memory sizes. We also add an "overall" section describing
total resource usage. This (surprisingly) wasn't defined.

This commit is the first in a series to reconcile the differences
between the JSON format in mozsystemmonitor and what
`mach build` writes so we can write a single tool to visualize
the data.

MozReview-Commit-ID: 9mdbKxeV9Ta

--HG--
extra : rebase_source : 3aadf5e83c91ba9553595f3da77ed7ca0e4d5541
2016-05-12 18:03:16 -07:00
Gregory Szorc
17d5d5efa5 Bug 1272202 - Bump version of mozsystemmonitor to 0.1; r=jlund
We're currently running version 0.0 in automation. This version
doesn't have as_dict(), which means we can't easily save data
to JSON.

Bump the version to 0.1 in preparation of releasing a new
version.

MozReview-Commit-ID: Kr3JqyRXk5j

--HG--
extra : rebase_source : 89f763acaa12e4357f4a23f8772f99c1a0fdb56f
2016-05-12 15:42:07 -07:00
Gregory Szorc
d25774bf41 Bug 1272202 - Require psutil >= 3.1.1 in mozsystemmonitor; r=jlund
We have packages for 3.1.1 uploaded to our PyPI server used
for automation. There have been a number of bug fixes since the
version of psutil currently listed. Let's ensure we're running
a modern psutil to minimize our exposure to bugs on older
versions.

MozReview-Commit-ID: 6rDapZ8miFD

--HG--
extra : rebase_source : c66295828e0c95c4ffe57e579df41af508875027
2016-05-12 15:40:39 -07:00
Xidorn Quan
39fe310971 Bug 1271884 - Use the current python executable to run tooltool fetch rather than hard-coded python. r=jmaher
MozReview-Commit-ID: NEtTg3tih8

--HG--
extra : transplant_source : %60%A1%F4%29%F22%EFJ%D0%1D%BC%7B%1F%99%E9%95%E5_%3D%5C
2016-05-11 15:01:16 +10:00
Henrik Skupin
37ac3002c3 Bug 1271612 - Release mozlog 3.2. r=jmaher
MozReview-Commit-ID: I8JcpkeLzkv

--HG--
extra : rebase_source : 79bcb3512ba9b55c1c925287052beaf6ed084a81
2016-05-11 10:17:45 +02:00
Henrik Skupin
ce5263701a Bug 1258343 - [mozlog] Fix HTML report generation for unicode characters. r=jmaher
MozReview-Commit-ID: 79l2BuNRIxq

--HG--
extra : rebase_source : 7d31e35abcb6f9b6dc44a19c07b4e5393e31e16d
2016-05-09 23:14:05 +02:00
James Graham
ea86fedb84 Bug 1270507 - Elide subtest results from web-platform-tests on treeherder when they match expectations, r=ahal
MozReview-Commit-ID: DyatYcpdjvQ

--HG--
extra : rebase_source : 8947cfc0084a2523c570ff2f832a7ce79852ba1d
2016-05-03 23:21:07 +01:00
James Willcox
502a4ed174 Bug 1264154 - Fix Fennec debugging on Mac r=ted 2016-04-29 10:56:20 -05:00
Andrew McCreight
3347e025c4 Bug 1227347, part 3 - Remove object-count leak suppression infrastructure. r=erahm 2016-04-26 11:46:28 -07:00
Andrew McCreight
db70afedca Bug 1227347, part 2 - Remove leak suppressions for content processes. r=erahm 2016-04-26 11:46:28 -07:00
Geoff Brown
1819bf24b7 Bug 1264656 - Avoid file exists error in |mach android-emulator --force-update|; r=jmaher 2016-04-14 13:35:05 -06:00