Commit Graph

100 Commits

Author SHA1 Message Date
Dorel Luca
979ac450c8 Backed out changeset 67d2aa892562 (bug 1237182) for breaking Decision task. CLOSED TREE 2018-05-10 21:20:39 +03:00
Chris AtLee
714c7498fd Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 18ceefd30a5e5df3be7dc4152256b4407f61e8eb
2018-05-04 13:51:35 -04:00
Geoff Brown
63dec26887 Bug 1460399 - Android mozharness refactoring: remove libGL link, re-order code, add kvm diagnostics; r=me,a=test-only 2018-05-09 16:33:27 -06:00
Geoff Brown
67eec7103f Bug 1460399 - Refactor emulator installation in android_emulator_unittest.py; r=me,a=test-only
Remove EmulatorMixin, folding it in to android_emulator_unittest. Simplify
installation options based on current needs.
2018-05-09 13:34:06 -06:00
Geoff Brown
56396c3a4d Bug 1459732 - Do not kill compiz before running android emulator tests; r=jmaher 2018-05-08 07:38:52 -06:00
Joel Maher
fa141745dd Bug 1392106 - split reftest fonts into seperate suite. r=gbrown 2018-04-12 13:58:54 -04:00
Joel Maher
91721cfdc5 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 14:04:24 -04:00
Andreea Pavel
959a710440 Backed out changeset afbec9a6802c (bug 1455316) for breaking sy jobs 2018-05-02 23:46:23 +03:00
Joel Maher
08e964fd73 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 14:04:24 -04:00
Noemi Erli
583038f191 Backed out changeset 5cdb10268f47 (bug 1455316) for breaking Users/cltbld/tasks/task_1525191282/mozharness/mozharness/base/script.py on a CLOSED TREE 2018-05-01 20:17:08 +03:00
Joel Maher
3e9caea623 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 11:50:46 -04:00
Joel Maher
9077c8cf36 Bug 1453056 - test-verify should have the ability to run in chunks depending on the incoming tests. r=gbrown 2018-04-24 10:20:11 -04:00
Marco Castelluccio
3988db8b4e Bug 1431753 - Fix condition when verification and per-test coverage are not enabled. r=me 2018-04-19 23:56:50 +02:00
Marco Castelluccio
7e52f8d35c Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 1dcbefe05533b1295761a966484b2b250c3a6fa5
2018-04-19 19:19:31 +02:00
Brindusan Cristian
e15ae260fc Backed out changeset e8df07cc7125 (bug 1431753) as requested. 2018-04-19 22:41:27 +03:00
Marco Castelluccio
b119a517b0 Bug 1431753 - Make AndroidEmulatorTest extend CodeCoverageMixin. r=me CLOSED TREE
--HG--
extra : rebase_source : 48cefc7887943392fb30ce307fea6a5496c3c74e
2018-04-19 21:35:40 +02:00
Brindusan Cristian
de7724a73a Backed out 3 changesets (bug 1431753) for android mochitest failures on mozharness/base/script.py CLOSED TREE
Backed out changeset bc062fa71ca7 (bug 1431753)
Backed out changeset df038cacff14 (bug 1431753)
Backed out changeset 381cc9c492f3 (bug 1431753)

--HG--
rename : testing/mozharness/mozharness/mozilla/testing/per_test_base.py => testing/mozharness/mozharness/mozilla/testing/verify_tools.py
2018-04-19 22:31:24 +03:00
Marco Castelluccio
3b40dbed3e Bug 1431753 - Don't check per_test_coverage on Android, where we don't have a coverage build. r=me CLOSED TREE
--HG--
extra : rebase_source : ddf6f6a0e1a5449cf146282b8c38296e15187b57
2018-04-19 20:49:28 +02:00
Marco Castelluccio
ac95649c98 Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 8e151ddc81d528f85e2a4acbd7623935d4246b4f
2018-04-19 19:19:31 +02:00
Henrik Skupin
70287b8bfb Bug 1454671 - Combine default log and gecko.log in automation on Android. r=ato
To ease investigation of failures the gecko log should be streamed
to stdout so it will be part of the default log. It helps with
correlating tracing output with the appropriate test.

MozReview-Commit-ID: JnH64bhhtgk

--HG--
extra : rebase_source : b50707189c181a865ab66dac8b3cb4e258a8e427
2018-04-17 16:53:24 +02:00
Geoff Brown
3680684f70 Bug 1452694 - Use TestRunnerActivity for geckoview mochitest/reftest; r=bc
This makes the changes necessary to use TestRunnerActivity when geckoview
is installed and requested, but we do not yet attempt to run any such
test tasks in automation.
2018-04-10 13:26:11 -06:00
Geoff Brown
88e7b137f4 Bug 1451077 - Do not dump android emulator log in successful runs; r=me,a=test-only
_dump_emulator_log will still be called when the emulator fails to start.
2018-04-05 12:50:27 -06:00
Geoff Brown
feca6aae6f Bug 1098508 - Add support for scheduling Android jit tests, but don't run them yet; r=me,a=test-only
Android jit tests are not ready to run yet: They may not run green, there are concerns about
capacity, etc. I am adding this support now to make it more convenient to debug on try.

--HG--
extra : rebase_source : 00bc5bf21fec3c130133b0de322b1f37250893c3
2018-03-22 16:33:15 -06:00
Andrew Halberstadt
f354075c7a Bug 1434430 - [flake8] Fix blank 'except' statements r=rwood
This is a new issue that gets linted with flake8 3.5.0. Basically you should
never use a blank except: statement.

This will catch all exceptions, including KeyboardInterrupt and SystemExit
(which is likely not intended). If a catch all is needed, use
`except: Exception`.  If you *really* mean to also catch KeyboardInterrupt et
al, use `except: BaseException`.

Of course, being specific is often better than a catch all.

MozReview-Commit-ID: FKx80MLO4RN

--HG--
extra : rebase_source : 7c74a7d0d81f2c984b47aff3a0ee3448b791177b
2018-01-31 14:32:08 -05:00
Geoff Brown
b83a0a1401 Bug 1435031 - Make it easier to use geckoview_example from android_emulator_unittest.py; r=jmaher
In general, there is no simple mapping between apk name (geckoview_example.apk) and
package name (org.mozilla.geckoview_example). With bug 1434411, it will be relatively
easy to add or modify tasks to use a geckoview apk in taskcluster tests. At the
mozharness level, scripts are expected to expand mozharness configurations containing
"%(app)" into package names. For Firefox, android_emulator_unittest extracts and
reads package_name.txt, but there is no such file in the geckoview apk. In future
we might add package_name.txt to the geckoview apk, or possibly use a tool like aapt,
but for our immediate needs this simple hack does the job: If "geckoview" is in
the apk name, assume we are installing org.mozilla.geckoview_example.
2018-02-01 14:26:52 -07:00
Geoff Brown
8992f95ae8 Bug 1402358 - In Android emulator tests, shutdown faster; r=jmaher
When the emulator is in good shape, emulator verification on shutdown
only takes a few seconds. However, if the emulator is hung or otherwise
unresponsive, emulator verification can take several minutes. In the
pathological worst case, verification slows down the task enough to
exceed the task timeout, resulting in a failure that would otherwise
have been handled as a task retry. Emulator verification on shutdown
provides little value, so it is simply eliminated.
2018-01-30 08:47:16 -07:00
Geoff Brown
7280e78955 Bug 1433294 - Cleanup blobber upload support in android_emulator_unittest.py; r=jmaher 2018-01-25 13:04:37 -07:00
Geoff Brown
2d91a596e6 Bug 1432848 - Use /usr/local/bin/linux64-minidump_stackwalk in Android tests; r=jmaher
It is included in the docker image, so there is no need to download it every time.
2018-01-24 13:59:41 -07:00
Geoff Brown
ea394843a4 Bug 1431433 - Miscellaneous simplifications to android_emulator_unittest.py; r=jmaher 2018-01-20 07:41:53 -07:00
Geoff Brown
29f6aea60a Bug 1431433 - Remove ssl_port/http_port from Android mozharness configs; r=jmaher 2018-01-20 07:41:53 -07:00
Geoff Brown
687a96341c Bug 1431433 - Cleanup support for obsolete -debug Android test suites; r=jmaher 2018-01-20 07:41:53 -07:00
Geoff Brown
e2ffb68892 Bug 1431433 - Tidy and reorganize mozharness configuration for Android emulator tests; r=jmaher 2018-01-18 11:25:45 -07:00
Andrew Halberstadt
811da0a366 Bug 1413928 - [mozharness] Accept extra test harness args via environment variable r=maja_zf
When MOZHARNESS_TEST_PATHS is set, the test suite mozharness scripts
will run the paths specified there instead of the normal chunking
and/or default manifest. Paths should be separated by a ':' character.

In the case of web_platform_tests.py, we have to make the test paths
relative to 'testing/web-platform'.

MozReview-Commit-ID: IHRXXi5mB4G

--HG--
extra : rebase_source : 17b31ec19a64ab16918d0bd80d19d9bb496cbe37
2017-11-02 15:53:39 -04:00
Geoff Brown
d1e788a7b6 Bug 1321605 - Follow-up to dump Android bogomips in main test log; r=me, a=test-only
We use bogomips as a convenient indicator or emulator performance/health and
make that available in the android-performance.log artifact. When the task
times out, that artifact is not uploaded, leaving me curious about what the
bogomips were; let's dump it to the test log.
2018-01-15 15:51:13 -07:00
Geoff Brown
0901958dcd Bug 1321605 - Retry android emulator test tasks when the emulator has insufficient bogomips; r=jmaher
Check /proc/cpuinfo on android and extract the "bogomips" reading: If it is < 250, retry
the task, since there appears to be a higher probability of tests running too slowly
in such environments.
2018-01-03 15:50:54 -07:00
Geoff Brown
cf1c0cd9a1 Bug 1425334 - In android emulator tests, restart adbd after emulator has started; r=jmaher 2017-12-18 15:45:12 -07:00
Geoff Brown
182e07d640 Bug 1285678 - Try to use adb root for emulator unit tests; r=jmaher 2017-11-27 11:26:10 -07:00
Geoff Brown
496421c17a Bug 1285678 - Remove auth file before launching emulator; r=jmaher
Newer versions of the Android emulator check an 'auth' file on startup;
deleting the file avoids a user prompt to authorize use of the emulator.
2017-11-27 11:26:10 -07:00
Geoff Brown
b15575b735 Bug 1285678 - Check stderr when running adb commands from android mozharness script; r=jmaher
Curiously, when using the latest adb + emulator, some commands -- notably 'adb install' --
report 'Success' to stderr rather than stdout.
2017-11-27 11:26:10 -07:00
Steve Armand
df510b4622 Bug 1403131 - Run linters against mozharness scripts and configs. r=rail
MozReview-Commit-ID: 3dkx1SQiIns

--HG--
extra : rebase_source : 45f049032243b8bbae7d052a89cefcdb2b7e1f60
2017-10-24 20:21:41 -04:00
Sebastian Hengst
a79a507dc2 Backed out changeset 6fa6cfe0199c (bug 1403131) for mass reftest failures. r=backout on a CLOSED TREE
--HG--
extra : amend_source : 4d399778793d9239e5c441fe237a15d12c4f1360
2017-10-23 16:39:24 +02:00
Steve Armand
3be377b84e Bug 1403131 - Run linters against mozharness scripts and configs. r=rail
--HG--
extra : rebase_source : 4d9458f1819de0a73af9191d560557ab01ffa32e
extra : histedit_source : 1a3c743a9a1c6a3304e4a924be90164fcf882e1f%2C440a79ff12f256a2a79aff6b592fe838c1c9e6e3
2017-10-23 09:46:15 -04:00
Geoff Brown
b778b0197c Bug 1409875 - Make Android apk installation less chatty; r=me,test-only 2017-10-18 15:30:52 -06:00
Geoff Brown
0f14d33483 Bug 1409562 - Avoid intermittent UnboundLocalError in Android test-verify; r=me,test-only 2017-10-17 16:19:52 -06:00
Geoff Brown
4978bd8219 Bug 1404525 - Add test-verify support to Android mozharness script; r=jmaher 2017-10-17 14:45:07 -06:00
Kartikaya Gupta
8b8a999a38 Bug 1388423 - Get full rust backtraces everywhere. r=jmaher
MozReview-Commit-ID: 2Mfrpupz7As

--HG--
extra : rebase_source : 9b612430360fe46162f433f13667664188ceac55
2017-08-08 12:34:55 -04:00
Geoff Brown
1bf9cf462c Bug 1371805 - Eliminate android emulator telnet verification; r=jmaher 2017-06-19 15:32:43 -06:00
Geoff Brown
5f20a273d5 Bug 1336541 - Suppress DDMS prompt when starting android emulator; r=jmaher 2017-03-21 16:11:39 -06:00
Geoff Brown
df122d5bfa Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Kartikaya Gupta
b7d49477f1 Bug 1339458 - Set RUST_BACKTRACE=1 when running automated tests. r=jmaher
MozReview-Commit-ID: I3c56ava41B

--HG--
extra : rebase_source : e739d1d30a137371685f39a49bfe516f7093a545
2017-02-14 11:32:45 -05:00