Commit Graph

205 Commits

Author SHA1 Message Date
Tom Prince
a45ea20b93 Bug 1413575: Adjust in-tree references to mozbase documentation to point in-tree. r=ahal
MozReview-Commit-ID: rctbByyjTA

--HG--
extra : rebase_source : a682eb6d77b79640ac9ec20e9d64340613bcfed7
2017-11-20 11:43:13 -07:00
Ryan VanderMeulen
b16410f51c Merge inbound to m-c. a=merge 2017-11-10 16:13:15 -05:00
Geoff Brown
bb5c47c068 Bug 1416006 - Offer to update host-utils from mach; r=jmaher 2017-11-10 07:03:40 -07:00
Henrik Skupin
de0aa97084 Bug 1414882 - Remove unused Device.wait_for_port() in mozrunner. r=ahal
This method has not a single caller and as such doesn't seem to
be necessary anymore.

MozReview-Commit-ID: qhNK3EBc6Q

--HG--
extra : rebase_source : 2978829739f0bc465f98b8f6b727c27a03a42b11
2017-11-09 20:46:54 +01:00
Attila Craciun
7bcf901c3b Merge inbound to mozilla-central r=merge a=merge 2017-10-25 12:30:28 +03:00
Geoff Brown
5facbdc255 Bug 1410714 - Help mach tests find adb when running Android tests; r=jmaher 2017-10-24 15:17:25 -06:00
Steve Armand
fa0b6e7c7e Bug 1397849 - Enable py2 and py3 linter on testing/mozbase. r=ahal
MozReview-Commit-ID: GnaVLhtO4un

--HG--
extra : rebase_source : 8839a423c5db505469b813957649b1605ed5737f
2017-09-25 22:57:18 -04:00
Geoff Brown
cec74e4961 Bug 1390606 - (follow-up) Remove extra diagnostics; r=me,test-only 2017-10-20 15:30:59 -06:00
Geoff Brown
c4c7c9357a Bug 1390606 - Check <sdk>/emulator for emulator exe; r=nalexander 2017-10-18 15:30:48 -06:00
Mike Hommey
37d01456dc Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.

--HG--
extra : rebase_source : e0b1dcdabe798af478e054cde0df65facf25ea21
2017-09-28 11:00:09 +09:00
Sebastian Hengst
59aaffbcda Backed out changeset 9264d5789f76 (bug 1397849) for import failures, e.g. in mochitests and xpcshell tests. r=backout 2017-10-04 15:25:07 +02:00
Steve Armand
50c9b712c0 Bug 1397849 - Enable py2 and py3 linter on testing/mozbase. r=ahal
MozReview-Commit-ID: GnaVLhtO4un

--HG--
extra : rebase_source : 19f47b7f5854b7ee25d9779622ce4cd734ac15e5
2017-09-25 22:57:18 -04:00
Sebastian Hengst
2e58d81866 Backed out changeset ff0705eda4bd (bug 1403366) 2017-10-04 01:26:56 +02:00
Mike Hommey
5f2f5b4e64 Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.

--HG--
extra : rebase_source : e0b1dcdabe798af478e054cde0df65facf25ea21
2017-09-28 11:00:09 +09:00
Sebastian Hengst
6a0c7a5682 Backed out changeset 28b00bdf83a3 (bug 1403366) 2017-09-29 17:19:35 +02:00
Mike Hommey
8142d74974 Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.

--HG--
extra : rebase_source : 59ba89dbd8de9c0b9361872f3f45504a46f454a2
2017-09-28 11:00:09 +09:00
Myk Melez
87ae2b846a Bug 1398345 - find llvm-symbolizer, get memory size on Mac; r=ahal 2017-09-11 09:04:57 -07:00
Eric Rahm
0938982c90 Bug 1389598 - Part 4: Remove remaining gonk refs. r=froydnj
--HG--
extra : rebase_source : 063c7f95dda063eafabfa1921366bd1957b8fe73
2017-08-11 17:45:18 -07:00
William Lachance
b16d5c2ff2 Bug 1390208 - Remove metro-specific code from testing/mozbase r=ahal
MozReview-Commit-ID: 5SPYXXTlFFt

--HG--
extra : rebase_source : 59d06862b4ff2408da69ac595511fdfff3cfdc0e
2017-08-14 13:12:07 -04:00
Christian Holler
b8ee76ebd8 Bug 1373256 - Changes to support -fsanitize=integer in the codebase. r=froydnj
The -fsanitize=integer analysis from UBSan can be helpful to detect signed and unsigned integer overflows in the codebase. Unfortunately, those occur very frequently, making it impossible to test anything with it without the use of a huge blacklist. This patch includes a blacklist that is broad enough to silence everything that would drain performance too much. But even with this blacklist, neither tests nor fuzzing is "clean". We can however in the future combine this with static analysis to limit ourselves to interesting places to look at, or improve the dynamic analysis to omit typical benign overflows.

It also adds another attribute that can be used on functions. It is not used right now because it was initially easier to add things to the compile-time blacklist to get started.

Finally, it includes a runtime suppression list and patches various parts in the test harnesses to support that. It is currently empty and it should not be used on frequent overflows because it is expensive. However, it has the advantage that it can be used to differentiate between signed and unsigned overflows while the compile-time blacklist cannot do that. So it can be used to e.g. silence unsigned integer overflows on a file or function while still reporting signed issues. We can also use this suppression list for any other UBSan related suppressions, should we ever want to use other features from that sanitizer.

MozReview-Commit-ID: C5ofhfJdpCS

--HG--
extra : rebase_source : 952043a441b41b2f58ec4abc51ac15fa71fc142f
2017-04-09 12:59:26 +02:00
Carsten "Tomcat" Book
d8e080c10c Backed out changeset 07e0c4e4ae85 (bug 1373256) for breaking android tests 2017-06-28 14:47:55 +02:00
Christian Holler
9924ab3046 Bug 1373256 - Changes to support -fsanitize=integer in the codebase. r=froydnj
The -fsanitize=integer analysis from UBSan can be helpful to detect signed and unsigned integer overflows in the codebase. Unfortunately, those occur very frequently, making it impossible to test anything with it without the use of a huge blacklist. This patch includes a blacklist that is broad enough to silence everything that would drain performance too much. But even with this blacklist, neither tests nor fuzzing is "clean". We can however in the future combine this with static analysis to limit ourselves to interesting places to look at, or improve the dynamic analysis to omit typical benign overflows.

It also adds another attribute that can be used on functions. It is not used right now because it was initially easier to add things to the compile-time blacklist to get started.

Finally, it includes a runtime suppression list and patches various parts in the test harnesses to support that. It is currently empty and it should not be used on frequent overflows because it is expensive. However, it has the advantage that it can be used to differentiate between signed and unsigned overflows while the compile-time blacklist cannot do that. So it can be used to e.g. silence unsigned integer overflows on a file or function while still reporting signed issues. We can also use this suppression list for any other UBSan related suppressions, should we ever want to use other features from that sanitizer.

MozReview-Commit-ID: C5ofhfJdpCS

--HG--
extra : rebase_source : 64aa804965d24bb90b103c00c692a2ac6859e408
2017-04-09 12:59:26 +02:00
Andrew Halberstadt
c9beaa56b4 Bug 1373294 - Fix E305 (two blank lines after method or class) in files enabled by flake8 linter, r=jmaher
This is needed before we can upgrade to flake8 3.3.0, as that version starts flagging these errors.

These files were modified by running:
autopep8 --select E305 --in-place -r <dir>

on the affected directories. I did it one dir at a time and verified the result after each.

MozReview-Commit-ID: FmlsfiKIbtr

--HG--
extra : rebase_source : 9df32258cadff5d27a0e72113c57f782756c0b18
2017-06-15 12:10:59 -04:00
Ting-Yu Chou
5dd0d99f75 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y

--HG--
extra : rebase_source : c618544db62381087f4190d3b12c57c340606b15
2017-03-10 12:08:34 +08:00
Geoff Brown
7cc08b99a6 Bug 1352084 - Improve debug logging for 'mach android-emulator'; r=jmaher
Various minor improvements to aid debugging:
 - recommend --verbose on most common failure
 - in verbose mode, display platform
 - in verbose mode, display file creation date of binaries
 - in verbose mode, display sdk binary versions
 - remind of x86 vs arm emulator and need for corresponding apk
2017-04-04 09:45:19 -06:00
Maja Frydrychowicz
4c76df2d97 Bug 1349786 - Fix typo introduced in Bug 1322993; r=chmanchester
MozReview-Commit-ID: 2OB3yu4BBTs

--HG--
extra : rebase_source : 8cb0ce579255cd22c0522510fd1bfaf7251b1ac8
2017-03-24 10:16:48 -04:00
Wes Kocher
93d11e3441 Backed out 7 changesets (bug 1333003) for windows asan failures a=backout
Backed out changeset 3d2b2eeda8d3 (bug 1333003)
Backed out changeset 400d409ba4ca (bug 1333003)
Backed out changeset 1ba027abdfc9 (bug 1333003)
Backed out changeset 70114135bd8c (bug 1333003)
Backed out changeset 5715b15e33c0 (bug 1333003)
Backed out changeset 375e952bd738 (bug 1333003)
Backed out changeset d5d4112599f2 (bug 1333003)

MozReview-Commit-ID: DZUHJTdjX7V
2017-03-23 11:01:44 -07:00
Ting-Yu Chou
e8fe1839b7 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y

--HG--
extra : rebase_source : c618544db62381087f4190d3b12c57c340606b15
2017-03-10 12:08:34 +08:00
Carsten "Tomcat" Book
d40c4b5e91 Backed out changeset 18fd8676751a (bug 1333003) 2017-03-23 10:38:04 +01:00
Ting-Yu Chou
9c1ec9c16c Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y

--HG--
extra : rebase_source : ae28acf8b01688ca73b09b08769e35261c9365bd
2017-03-10 12:08:34 +08:00
Maja Frydrychowicz
63a91ec1cf Bug 1322993 - Guard against deleting nonexistent directory during emulator cleanup; r=whimboo
MozReview-Commit-ID: 7hopCdbHhj1

--HG--
extra : rebase_source : 64fcb946246aa89a00d2039f3cfbf6cdf24c62fc
2017-03-15 15:10:58 -04:00
Geoff Brown
7e2388e217 Bug 1347407 - Add an Android 7.0 AVD for mach android-emulator; r=me,test-only
Add support for 'mach android-emulator --version 7.0'. This AVD is somewhat
experimental but has worked well in my initial testing.
2017-03-16 10:44:42 -06:00
Geoff Brown
834f5465ad Bug 1346423 - Add manifest for Android x86 6.0 AVD; r=me,test-only
This adds support for 'mach android-emulator --version x86-6.0', a fast,
modern Android emulation environment for testing x86 builds of Firefox.
2017-03-14 08:08:45 -06:00
Geoff Brown
7a0127e2d0 Bug 1326492 - Update avd manifests for 'mach android-emulator', r=jmaher
I created a new Android 4.3 AVD and uploaded it to tooltool. This new
AVD is compatible with the "new" emulator included in recent versions
of the Android SDK (circa Android SDK Tools 25). To avoid destabilizing
the emulator automated tests run via taskcluster and mozharness, I'm
creating a new tooltool manifest for the new AVD and using it only from
mach android-emulator.

For consistency, I'm creating separate but identical manifests for x86,
renaming the mach-only 6.0 manifest, and deleting the old 2.3 manifest.

--HG--
rename : testing/config/tooltool-manifests/androidarm_6_0/releng.manifest => testing/config/tooltool-manifests/androidarm_6_0/mach-emulator.manifest
2017-03-10 12:34:55 -07:00
Wes Kocher
adaec16e2b Merge m-c to inbound, a=merge
MozReview-Commit-ID: HtopB4vot9e
2017-02-16 17:23:00 -08:00
Geoff Brown
cf5c7a3dc7 Bug 1340175 - Remove WRITE_CONTACTS permission from Android mozrunner; r=sebastian 2017-02-16 15:31:22 -07:00
Andrew Halberstadt
8415b25e37 Bug 1003417 - Add a 'mozbase' subsuite to python unittests on linux, r=ted
The subsuite is added conditionally because we only have the capability of
running source-check tasks on linux at the moment. Once taskcluster support
for windows and mac has matured a bit and the taskcluster configs support
source-check there, we should apply the subuite unconditionally.

MozReview-Commit-ID: Kk9Irz3fn14

--HG--
extra : rebase_source : b9266a06583083c36477d4e93f5462ee614cdb71
2016-11-16 16:43:42 -05:00
Brad Lassey
bbb965d132 bug 1295699 - TypeError: environment can only contain strings, convert environment from unicode before passing to popen r=gps 2017-01-23 18:53:58 -05:00
Carsten "Tomcat" Book
e992f5d4fe Backed out changeset 35ee729f6f1e (bug 1295699) for flake8 test failure 2017-01-23 15:09:57 +01:00
Brad Lassey
5da33996e2 bug 1295699 - TypeError: environment can only contain strings, convert environment from unicode before passing to popen r=gps 2017-01-19 11:41:23 -05:00
Andreas Tolfsen
c67b15da93 Bug 1320643 - Remove Device.setup_port_forward from mozrunner; r=jmaher,whimboo
The only consumer of `mozrunner.devices.base.Device.setup_port_forward`
was Marionette, which now uses `mozdevice.DeviceManagerADB.forward`
directly.

MozReview-Commit-ID: 72ROrOixKvM

--HG--
extra : rebase_source : f998e6c37161f851da450bd98ee27ba04a50f16f
2016-12-02 19:49:37 +00:00
Andrew Halberstadt
2d76b4f70d Bug 1317970 - Make mozbase tests use mozunit for consistent formatting, r=chmanchester
The mozbase unittests don't use mozunit, so their output is confusing in the log.
This makes mozbase output consistent with the rest of the python unittests.

MozReview-Commit-ID: AIs5mza8Rn6

--HG--
extra : rebase_source : 10f65e612f5b3cebb921c47699f5a8be7cd2ba5a
2016-11-17 16:36:18 -05:00
Henrik Skupin
89b4515176 Bug 1299216 - Bump mozrunner version to 6.13. r=ahal
MozReview-Commit-ID: 2hCytAyqfsp

--HG--
extra : rebase_source : 8b9b647fcf305aa47521073947ef446ba4cb7b5a
2016-09-28 23:29:40 +02:00
Henrik Skupin
c2cf729145 Bug 1299216 - [mozrunner] check_for_crashes() has to return the crash count since its last invocation. r=ahal
Adapt check_for_crashes() for latest mozcrash changes, which returns the number of crashes for both log_crashes()
and check_for_crashes() now. Also the runner should accumulate the number of crashes so it will be known at any
time how many times the process has been crashed.

MozReview-Commit-ID: Dl9FlH1TalH

--HG--
extra : rebase_source : b27895482fcad099cf4fcfc01a65fe0fbc5243e3
2016-09-21 12:57:50 +02:00
Randell Jesup
35232de3ba Bug 1311397: fix DataChannel logging for mochitests/etc r=erahm 2016-10-28 03:25:10 -04:00
Geoff Brown
08bbef87dc Bug 1311412 - Try restarting emulator without -gpu if first attempt fails; r=jmaher 2016-10-25 08:53:34 -06:00
Kartikaya Gupta
f6d49dac63 Bug 1310215 - Add a verbose argument to mach install which provides useful information in case the android emulator startup fails. r=ahal
MozReview-Commit-ID: EhuBgeewqtb
2016-10-14 11:15:10 -04:00
Francesco Pischedda
f45ed99748 Bug 1280573 - Add testing/mozbase to flake8 linter: r=ahal
added testing/mozbase to tools/lint/flake8.lint
fixed a first batch of PEP8 errors/warnings

at first the commad autopep8 -i --max-line-length 99 -r -j 8 .
has been used to fix simpler problems, run from testing/mozbase

some of the issues can not easily fixed :
- undefined 'names' in code for example isLinux - isLinux and isBsd "fixed" with # noqa
- undefined 'message' resolved with return fmt.format(...
- undefined 'structured' resolved replacing those with mozlog
- long comments - some remaining - addressed with # noqa
- package level import everything - addressed with # flake8: noqa

restored testing/mozbase/mozdevice/mozdevice/Zeroconf.py
fixed issues reported on mozreview
fixed ')' in testing/mozbase/mozprocess/mozprocess/qijo.py imports
finally fixed multiline string at testing/mozbase/manifestparser/tests/test_manifestparser.py:114
^^^ and again, but now with ./mach python-test --path-only testing/mozbase/manifestparser/tests/test_manifestparser.py passing
fixed testing/mozbase/manifestparser/tests/test_convert_directory.py assert

fixed this error:
10:15:21     INFO -      return lambda line: stack_fixer_module.fixSymbols(line)
10:15:21     INFO -  TypeError: fixSymbols() takes exactly 2 arguments (1 given)

fixed two spaces lint error even of #  noqa comments
restored assignement to lambda with #  noqa to silence the lint error
global noqa for testing/mozbase/manifestparser/tests/test_filters.py
stupid is/is not error...

MozReview-Commit-ID: 1FpJF54GqIi

--HG--
extra : rebase_source : 3cf0277fb36a296e3506aeacc2ff05e1b03f9eac
2016-09-30 16:08:37 +02:00
Geoff Brown
59d81d8be3 Bug 1306490 - Use '-gpu swiftshader' when starting android emulator from mach; r=jmaher 2016-10-11 13:48:37 -06:00
Maja Frydrychowicz
eba70f25fe Bug 1284874 - Represent am command as one string in FennecRunner; r=ahal
When running the command for starting Fennec, quotation marks aren't
processed properly when the 'am' portion of the command is represented
with one string token per argument; the args must be joined into one string
instead.

Also add log message about command being run in BaseRunner.

MozReview-Commit-ID: KZLnOdu9UGq

--HG--
extra : rebase_source : c8072c003afec3aba18f307b8cc64332736e55fc
2016-07-25 20:40:36 -04:00