Commit Graph

64 Commits

Author SHA1 Message Date
Bob Clary
0bffbb3592 Bug 1544089 - [mochitest] - Configure ssltunnel to listen on loopback address for Desktop and any public address for Remote tests, r=gbrown.
Depends on D27722

Differential Revision: https://phabricator.services.mozilla.com/D27723

--HG--
extra : moz-landing-system : lando
2019-04-23 00:36:52 +00:00
Jan Henning
50c69a3713 Bug 1529863 - Remove remnants of unused browser.firstrun and browser.snippets prefs. r=geckoview-reviewers,whimboo,esawin
"browser.firstrun.*" seems to have been unused since the end of XUL-based
Fennec, whereas the code referencing the "browser.snippets.*" prefs was removed
in bug 1482836.

Differential Revision: https://phabricator.services.mozilla.com/D20862

--HG--
extra : moz-landing-system : lando
2019-03-06 14:59:46 +00:00
Geoff Brown
a908bb5504 Bug 1531611 - Check for ANR and tombstone files in all android tests; r=bc
The existing ANR and tombstone checks in remoteautomation are used
by mochitests and reftests but are awkward for other harnesses like cppunit
that do not use remoteautomation...and easily missed. This patch moves that
code to the mozharness AndroidMixin, treating ANRs and tombstones like the
logcat: Make sure any old logs are deleted when the mozharness script starts,
then move any logs found at the end of the run to the upload directory.
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=f3de1e9836da2b0c9232f5d92c751b979459e19b
demonstrates tombstone artifacts for the Android 7.0 cppunit tests.

Differential Revision: https://phabricator.services.mozilla.com/D21774

--HG--
extra : moz-landing-system : lando
2019-03-05 14:22:45 +00:00
Geoff Brown
310d40b967 Bug 1111188 - Remove temporary workaround for ssltunnel in mochitest; r=emk 2019-01-04 09:21:49 -07:00
Geoff Brown
e5e351a5a2 Bug 1515189 - Consolidate ADBDevice and ADBAndroid classes; r=bc 2018-12-19 14:04:02 -07:00
Andrew Halberstadt
4157983d1f Bug 1460914 - [xpcshell] Add --setpref to the command line, r=ted
Depends on D9796

Differential Revision: https://phabricator.services.mozilla.com/D9797

--HG--
extra : moz-landing-system : lando
2018-11-08 14:50:32 +00:00
Andrew Halberstadt
ecadfa3e3d Bug 1460914 - [mozprofile] Move mochitest's 'parseKeyValue' function into mozprofile.cli, r=ted
Parsing prefs and env on the command line is a common task performed by our harnesses, let's
move it into mozbase.

Depends on D9717

Differential Revision: https://phabricator.services.mozilla.com/D9796

--HG--
extra : moz-landing-system : lando
2018-11-08 14:51:26 +00:00
Jan Henning
ae407ebe3b Bug 1502135 - Make resource://testing-common available for Robocop JS tests. r=gbrown
The code is simply a copy of the corresponding code in runtestsremote.py.

Differential Revision: https://phabricator.services.mozilla.com/D10279

--HG--
extra : moz-landing-system : lando
2018-11-01 17:45:07 +00:00
Andrew Halberstadt
26da3328fb Bug 1470266 - [ci] Schedule serviceworker-e10s mochitest tasks with linux64/debug on mozilla-central, r=jmaher
This duplicates all the mochitest, based tests except with
dom.serviceWorkers.parent_intercept set to true. For now they are only run on
mozilla-central with linux64/debug.

Differential Revision: https://phabricator.services.mozilla.com/D7641

--HG--
extra : moz-landing-system : lando
2018-10-05 19:12:27 +00:00
Cosmin Sabou
8bc1a4e74e Backed out changeset bf17ad5b022f (bug 1470266) for breaking test-verify. 2018-10-05 18:30:29 +03:00
Andrew Halberstadt
5fef7a02a1 Bug 1470266 - [ci] Schedule serviceworker-e10s mochitest tasks with linux64/debug on mozilla-central, r=jmaher
This duplicates all the mochitest, based tests except with
dom.serviceWorkers.parent_intercept set to true. For now they are only run on
mozilla-central with linux64/debug.

Differential Revision: https://phabricator.services.mozilla.com/D7641

--HG--
extra : moz-landing-system : lando
2018-10-05 14:55:09 +00:00
Tudor-Gabriel Vîjială
844b806b0a Bug 1475256 - Add code coverage for android robocop UI tests. r=gbrown
Depends on D4219

Differential Revision: https://phabricator.services.mozilla.com/D4144

--HG--
extra : moz-landing-system : lando
2018-09-06 17:51:08 +00:00
Bob Clary
745c5ff6c2 Bug 1477807 - Distinguish ADBTimeoutErrors from other exceptions in Android remote tests, r=gbrown. 2018-07-27 08:27:16 -07:00
Kris Maglione
e6d77f8270 Bug 1460610: Fix content process whitelist for profile extensions when none are present at startup. r=aswan
Also removes the stub workerbootstrap extensions, which previously allowed
this to work for Mochitest extensions.

MozReview-Commit-ID: LPlk8qIgJmr

--HG--
extra : rebase_source : 329f7fe11dde7a2713652591ac735b0d745070c8
extra : amend_source : 125481f030980c610217a9a1f6e51d592bda3c65
2018-05-19 17:23:01 -07:00
Kris Maglione
f8aeb3dbfc Bug 1462223: Remove unnecessary/unused bootstrap scope setup code. r=aswan
This also removes the workerbootstrap test extension, which is no longer used,
and contains the last references to the Worker and ChromeWorker bootstrap
globals.

MozReview-Commit-ID: 8YWReXMqX5W

--HG--
extra : rebase_source : b0aa59b2b5e6a08f4be803e828bd507f894e4a19
2018-05-19 14:03:50 -07:00
Geoff Brown
ca43a015dc Bug 1454404 - Pass adb path from Android mach commands to test harnesses; r=jmaher 2018-04-16 14:05:32 -06:00
Geoff Brown
e947c0c1e9 Bug 1452956 - Use newlines when dumping Android logcat to test log; r=jmaher 2018-04-10 13:26:08 -06:00
Geoff Brown
d3d676106c Bug 1449767 - Avoid error after robocop tests when no screenshots produced; r=bc
Screenshots are usually only taken when a test fails.
2018-03-29 07:33:40 -06:00
Geoff Brown
26b5113ed2 Bug 1449762 - Fix argument to get_logcat() in robocop and android mochitest harnesses; r=bc 2018-03-29 07:33:38 -06:00
Geoff Brown
cf1401dff9 Bug 1448697 - Try to use force-stop instead of kill to end remote applications; r=bc
This is important for running browser tests on some non-privileged devices, where
kill may not be permitted.
2018-03-26 12:21:46 -06:00
Geoff Brown
6083932cff Bug 1440714 - Convert Android browser test harnesses to adb.py; r=bc
This affects Android robocop, mochitest (all flavors) and reftests (all flavors).
2018-03-23 18:06:27 -06:00
Kris Maglione
5f432476e0 Bug 1446676: Part 3 - Remove non-bootstrapped worker test add-on. r=aswan
Non-restartless extensions are no longer supported in the wild, and none of
the remaining automation extension rely on Workers in their components.

MozReview-Commit-ID: bh3nwwfM1g

--HG--
extra : rebase_source : db16e8bfdc8148310675b1c8641f4321b2a89702
extra : source : d6bda91c66d6625fb98c427ad62b337696df5acf
2018-03-16 22:31:05 -07:00
Sebastian Hengst
65d6e8f735 Backed out 5 changesets (bug 1446676) for timeouts in talos-chrome-profiling on OS X. a=backout
Backed out changeset 5d3eb0526d8b (bug 1446676)
Backed out changeset d6bda91c66d6 (bug 1446676)
Backed out changeset 71d65d6b6499 (bug 1446676)
Backed out changeset aabfc0197692 (bug 1446676)
Backed out changeset ad8214a6cf04 (bug 1446676)

--HG--
rename : services/sync/tps/extensions/tps/bootstrap.js => services/sync/tps/extensions/tps/components/tps-cmdline.js
rename : testing/talos/talos/pageloader/bootstrap.js => testing/talos/talos/pageloader/components/tp-cmdline.js
rename : testing/talos/talos/startup_test/sessionrestore/addon/bootstrap.js => testing/talos/talos/startup_test/sessionrestore/addon/SessionRestoreTalosTest.js
rename : testing/talos/talos/talos-powers/bootstrap.js => testing/talos/talos/talos-powers/components/TalosPowersService.js
rename : tools/quitter/bootstrap.js => tools/quitter/QuitterObserver.js
2018-03-21 20:51:03 +02:00
Kris Maglione
6b484d848d Bug 1446676: Part 3 - Remove non-bootstrapped worker test add-on. r=aswan
Non-restartless extensions are no longer supported in the wild, and none of
the remaining automation extension rely on Workers in their components.

MozReview-Commit-ID: bh3nwwfM1g

--HG--
extra : rebase_source : ad3d131d6db984f4171c5f79b86de094d2cca1bf
2018-03-16 22:31:05 -07:00
Geoff Brown
385ab244a3 Bug 1440674 - Simplify some code in remoteautomation.py; r=jmaher
remove RemoteAutomation._product and product options;
remove some unused code paths;
remove "blobber" references;
remove incorrect and/or unhelpful comments;
s/_devicemanager/_dm/ (shorter, improve readability)
2018-02-23 09:47:57 -07:00
Andrew Halberstadt
f354075c7a Bug 1434430 - [flake8] Fix blank 'except' statements r=rwood
This is a new issue that gets linted with flake8 3.5.0. Basically you should
never use a blank except: statement.

This will catch all exceptions, including KeyboardInterrupt and SystemExit
(which is likely not intended). If a catch all is needed, use
`except: Exception`.  If you *really* mean to also catch KeyboardInterrupt et
al, use `except: BaseException`.

Of course, being specific is often better than a catch all.

MozReview-Commit-ID: FKx80MLO4RN

--HG--
extra : rebase_source : 7c74a7d0d81f2c984b47aff3a0ee3448b791177b
2018-01-31 14:32:08 -05:00
Andrew Halberstadt
3e46924759 Bug 1209463 - [test] Use a common logger across suites from |mach test| and other test commands, r=gbrown
In order for |mach test| and |mach mochitest| to log an overall summary,
every test harness invocation they make needs to use the same structured
logger (otherwise the affected suite will be missing from the summary).

MozReview-Commit-ID: 8LJw7r8SItk

--HG--
extra : rebase_source : 1417dce3817bae94ad61a5250065c6cbc35857e4
2017-11-23 13:04:19 -05:00
Sebastian Hengst
73fac0091d Backed out changeset dbe60b600dc0 (bug 1397853) for failining linter py-compat at testing/mochitest/runtests.py:2236. r=backout 2017-09-28 14:58:36 +02:00
Steve Armand
f8318d16e8 Bug 1397853 - Enable py2 and py3 linter on testing/mochitest. r=ahal
MozReview-Commit-ID: EhkNhyFHDox

--HG--
extra : rebase_source : 5200a985034c7ca0a494bc7d02a4c842e85dec3a
2017-09-24 21:28:25 -04:00
Perry Jiang
491c7f5d8c Bug 1393582 - Remove CastingApps support for Firefox desktop. r=felipe
MozReview-Commit-ID: B2bqiNXibPP
2017-08-25 14:03:47 -07:00
Geoff Brown
0c1b12715e Bug 1386816 - Kill any xpcshell or ssltunnel already running at start of tests; r=jmaher
This renames killNamedOrphans to killNamedProc and removes the check for
parent proc id, so that any xpcshell or ssltunnel process is killed before
starting a mochitest or reftest run. For reftests, this is moved out of
the desktop harness and into the remote/android harness, since desktop
reftests do not use xpcshell or ssltunnel.
2017-08-29 15:44:18 -06:00
Andrew Halberstadt
c9beaa56b4 Bug 1373294 - Fix E305 (two blank lines after method or class) in files enabled by flake8 linter, r=jmaher
This is needed before we can upgrade to flake8 3.3.0, as that version starts flagging these errors.

These files were modified by running:
autopep8 --select E305 --in-place -r <dir>

on the affected directories. I did it one dir at a time and verified the result after each.

MozReview-Commit-ID: FmlsfiKIbtr

--HG--
extra : rebase_source : 9df32258cadff5d27a0e72113c57f782756c0b18
2017-06-15 12:10:59 -04:00
Shing Lyu
65cb773340 Bug 1359288 - Enable Android reftest to resume from crashes. r=jmaher
MozReview-Commit-ID: EqTOdEwfTWi

--HG--
extra : rebase_source : 36837b43159f484f911cf5183d81c3440d59736a
2017-05-10 10:38:48 +08:00
Geoff Brown
f8160809a8 Bug 1340233 - Take more care when killing browser before starting Android tests; r=jmaher
The devicemanager killProcess() is updated to use force-stop first, then
use kill if force-stop does not work.

Browser test harnesses are updated to check if killProcess() worked, and
warn if it failed.
2017-04-12 09:15:53 -06:00
Geoff Brown
df122d5bfa Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Andrew Halberstadt
ee0c886766 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK

--HG--
extra : rebase_source : c9038ff87843b1cb46de506e245715f24a60ed63
2017-03-03 16:28:22 -05:00
Iris Hsiao
effe8f959a Backed out 3 changesets (bug 1344346) for mochitest shutdownleaks
Backed out changeset 71e3443cdc43 (bug 1344346)
Backed out changeset cd8993e4d0dd (bug 1344346)
Backed out changeset 8e03e57d44aa (bug 1344346)
2017-03-10 10:44:13 +08:00
Andrew Halberstadt
3aa28948a9 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK

--HG--
extra : rebase_source : 52f2f048aee5bd40cde29030e7668b321366e9ec
2017-03-03 16:28:22 -05:00
Andrew Halberstadt
b638ed69e1 Bug 1340551 - Log tests by manifest from suite_start in mochitest harness, r=jgraham
MozReview-Commit-ID: 1lcw62fmofa

--HG--
extra : rebase_source : 930dd542be6fdace8c6bec916d2246329afffad6
2017-02-22 14:36:31 -05:00
Chris Peterson
cab8e99bea Bug 1330496 - Part 2: Remove mochitest use of MOZ_WIN_INHERIT_STD_HANDLES_PRE_VISTA. r=jmaher
MozReview-Commit-ID: LX8F53hVySp

--HG--
extra : rebase_source : 6bb8d549e3d90c210b0a1895ccbfe9a24e5345bf
extra : histedit_source : 494c4537776bb1f79c6a7654a48ab901a78ee1f8
2017-01-10 23:47:32 -08:00
Ehsan Akhgari
6b394f0382 Bug 1318879 - Remove the app related code from mozprofile; r=ahal 2016-11-21 18:56:08 -05:00
Andrew Halberstadt
761071a431 Bug 1308202 - Merge MochitestBase and MochitestDesktop into a single class, r=jmaher
MozReview-Commit-ID: 737L08LhLDp

--HG--
extra : rebase_source : 7fb4db544e04c87a9b729bd34b4e00e5e393cc52
2016-10-06 10:16:06 -04:00
Prabhjyot Singh Sodhi
ebb9f983f1 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
MozReview-Commit-ID: INBZaZzcPmF

--HG--
extra : rebase_source : c0ba416f110b2768fc744de0fbee21c765081400
2016-09-28 08:28:04 -04:00
Wes Kocher
765926408d Backed out changeset e1d144423657 (bug 1280571) for making leaks hard to diagnose a=backout CLOSED TREE 2016-09-21 16:56:50 -07:00
Prabhjyot Singh Sodhi
58b6130e52 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
This also adds E402 (no imports at top of file) to the global ignore list. The
other error codes added were previously ignored by default, but now that we
have started a custom ignore list, need to be listed explicitly.

MozReview-Commit-ID: RtMuVEX6i5

--HG--
extra : rebase_source : 939bc9354f5891c680513d7e9068d0438e169132
2016-09-21 08:49:46 -04:00
Andrew Halberstadt
e920337e70 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : 3a94debda3dbed839074094707cadf32e7f7337c
2016-07-20 11:13:30 -04:00
Michael Comella
39ed656f3a Bug 1261494 - Reduce telemetry init delay to 1 second for integration testing. r=gbrown
My one concern is that this change could increase the amount of processing
time spent on telemetry initialization, causing the runtime of the robocop
test suite to increase. Checking my try push [1] against other try pushes,
it doesn't seem to have made a significant difference, but the change
in runtime between pushes can be large (e.g. > 5min) so it's hard to
tell.

[1]: https://treeherder.mozilla.org/#/jobs?repo=try&revision=2017843315fe&selectedJob=24641374

MozReview-Commit-ID: LeeGgNEp74h

--HG--
extra : rebase_source : 21b01fa8a5357de19046fc946b4098cfd0f7b823
extra : amend_source : 457f229e6b92b8834ddd6dfef5837753f47d570b
2016-07-27 08:05:12 -07:00
Nathan Froyd
bb3fb2eca6 Bug 1269349 - make robocop honor --timeout; r=gbrown
Our testsuites normally disable timeouts when --debugger or similar
options are specified.  Robocop doesn't do this, because apparently the
best way to debug Robocop tests is to |mach robocop [TEST-NAMES...]|,
wait for the browser window to show, and then connect a debugger.  This
setup seems suboptimal.

The setup being what it is, though, implies that runrobocop.py has no
knowledge of a debugger being connected, and therefore no idea that the
test really shouldn't time out.  Which then leads to the test going away
at that crucial moment when you are this > < close to figuring out the
bug.  Let's make runrobocop.py understand that --timeout means something
useful for such a context.
2016-05-05 11:25:54 -04:00
Nathan Froyd
8ac1e51406 Bug 1266198 - support --setenv options for robocop tests; r=gbrown 2016-04-21 11:13:14 -04:00
Honza Bambas
3d5960cd1f Bug 1248565 - Make test infra use MOZ_LOG_FILE and MOZ_LOG_MODULES. r=jmaher 2016-03-11 08:27:00 -05:00