Commit Graph

54 Commits

Author SHA1 Message Date
Geoff Brown
df122d5bfa Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Andrew Halberstadt
dc228ea415 Bug 1340551 - [mozlog] Change 'tests' field in suite_start action to a dict of tests keyed by group name, r=jgraham
In suite_start, tests is currently a list of test ids. But to support a new 'test-centric' treeherder view, we need to
be able to map tests to their manifests somewhere in the structured log, and the suite_start tests field seemed like a
good spot.

Because not all test suites use manifests, this is being called a "group" so it could potentially be re-used with
directories, tags or subsuites.

MozReview-Commit-ID: 2Sc7nqJrWts

--HG--
extra : rebase_source : d999df4c137b4752f118017a5db337e2ba6b467d
2017-02-22 11:46:09 -05:00
Andrew Halberstadt
44a16cbe8a Bug 1333564 - [manifestparser] Add support for inline comments, r=jmaher
Previously manifestparser only supported inline comments on conditional keys, such as
skip-if, fails-if, subsuite-if, etc. But on any other key name, inline comments weren't
supported. This was a bad situation because people saw these skip-if comments, and
naturally assumed inline comments worked everywhere. Then they were surprised when things
broke in mysterious ways.

This patch removes the special-casing for skip-if and friends and allows inline comments
everywhere. A caveat to this, is that ' #' is no longer a valid substring in a value.

MozReview-Commit-ID: Hr0BIwzTgaJ

--HG--
extra : rebase_source : f9a042da2137f200434140a7e472df0799f6606d
2017-01-25 12:21:31 -05:00
Andrew Halberstadt
30e80e125a Bug 1333564 - [manifestparser] Stop supporting ';' as a valid comment character, r=jmaher
It turns out there are shockingly few cases of manifestparser manifests that actually use the ';'
character as a comment. Because we will soon allow inline comments, deprecating the use of ';' will
ensure that values are allowed to have semicolons in them.

Even without inline comments, might as well enforce consistency across manifests.

MozReview-Commit-ID: AEPPQFdNXG0

--HG--
extra : rebase_source : 3540fa385f328bffb020c0a6debc4d2b3a90ed39
2017-01-25 14:38:37 -05:00
Andrew Halberstadt
6adcf5b456 Bug 1317970 - Use manifestparser manifests for python unit tests, r=chmanchester
This deprecates PYTHON_UNIT_TESTS and replaces it with PYTHON_UNITTEST_MANIFESTS.
In the build system, this means python unittests will be treated the same as all
other test suites that use manifestparser. New manifests called 'python.ini' have
been created for all test directories containing python unittests.

MozReview-Commit-ID: IBHG7Thif2D

--HG--
extra : rebase_source : 11a92a2bc544d067946bbd774975140147458caa
2016-11-16 09:59:22 -05:00
Francesco Pischedda
f45ed99748 Bug 1280573 - Add testing/mozbase to flake8 linter: r=ahal
added testing/mozbase to tools/lint/flake8.lint
fixed a first batch of PEP8 errors/warnings

at first the commad autopep8 -i --max-line-length 99 -r -j 8 .
has been used to fix simpler problems, run from testing/mozbase

some of the issues can not easily fixed :
- undefined 'names' in code for example isLinux - isLinux and isBsd "fixed" with # noqa
- undefined 'message' resolved with return fmt.format(...
- undefined 'structured' resolved replacing those with mozlog
- long comments - some remaining - addressed with # noqa
- package level import everything - addressed with # flake8: noqa

restored testing/mozbase/mozdevice/mozdevice/Zeroconf.py
fixed issues reported on mozreview
fixed ')' in testing/mozbase/mozprocess/mozprocess/qijo.py imports
finally fixed multiline string at testing/mozbase/manifestparser/tests/test_manifestparser.py:114
^^^ and again, but now with ./mach python-test --path-only testing/mozbase/manifestparser/tests/test_manifestparser.py passing
fixed testing/mozbase/manifestparser/tests/test_convert_directory.py assert

fixed this error:
10:15:21     INFO -      return lambda line: stack_fixer_module.fixSymbols(line)
10:15:21     INFO -  TypeError: fixSymbols() takes exactly 2 arguments (1 given)

fixed two spaces lint error even of #  noqa comments
restored assignement to lambda with #  noqa to silence the lint error
global noqa for testing/mozbase/manifestparser/tests/test_filters.py
stupid is/is not error...

MozReview-Commit-ID: 1FpJF54GqIi

--HG--
extra : rebase_source : 3cf0277fb36a296e3506aeacc2ff05e1b03f9eac
2016-09-30 16:08:37 +02:00
Carsten "Tomcat" Book
6244cfb10e Backed out changeset 200da85932e9 (bug 1230862) for valgrind perma failures 2016-02-10 11:04:50 +01:00
Julien Pagès
cb348f4346 Bug 1230862 - Remove mozhttpd. r=wlach
--HG--
extra : commitid : HRDp24nhYo8
extra : rebase_source : 76443fa9938e488fcd06af7ba0676d491c9da36e
2016-02-09 03:26:43 +01:00
William Lachance
99f1f9471e Bug 1230622 - Docs: Suggest people use wptserve instead of mozhttpd. r=jgraham 2015-12-04 13:18:40 -05:00
Julien Pagès
dfdc7dc7de Bug 1226554 - [mozlog] add a ProxyLogger concept. r=jgraham
--HG--
extra : commitid : Ez3CFCMZVYb
extra : rebase_source : f2515b3bf0fc813a3f10613fb8d1bc94878a6e60
2015-11-20 12:42:51 +01:00
Dave Hunt
cf61aea229 Bug 1145680 - [mozdevice] Add reboot, move, copy, and info methods to adb.py. r=bc 2015-10-27 02:30:00 +01:00
Julien Pagès
079030035a Bug 1189847 - [mozversion] mozversion requires mozdevice, it shoudn't. r=dhunt
This make the mozdevice dependency of mozversion optional.

--HG--
extra : rebase_source : 40be17f1b8a36055b01b93c3f8087e8f9fa23fbb
2015-08-03 06:32:00 +02:00
Julien Pagès
cd63971121 Bug 1185971 - mozfile: add a mozfile.move function, and bump release 1.2. r=ahal
--HG--
rename : testing/mozbase/mozfile/tests/test_remove.py => testing/mozbase/mozfile/tests/test_move_remove.py
extra : commitid : 9JROGo4tYHS
extra : rebase_source : f19d3b4eaf2e181f35f0bdbdb74e009246d8d1ce
extra : amend_source : 388c870bdf7aa06956b8d8641fdf55303453835e
2015-07-23 19:11:16 +02:00
Andrew Halberstadt
2be5ff0c10 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.

--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
Julien Pagès
a9ef479407 Bug 1112516 - [mozrunner] Update documentation for correctly using a Firefox profile. r=whimboo 2015-05-15 06:22:00 -04:00
Dave Hunt
5a597a5e84 Bug 1156812 - [mozdevice] Support specifying alternate log buffers when retrieving or clearing the logcat. r=bclary 2015-04-23 16:42:11 -07:00
Wes Kocher
84a6b2c6d2 Backed out changeset 619f030b0d23 (bug 1156812) for android m7 orange 2015-04-23 16:26:38 -07:00
Dave Hunt
1c0acb181c Bug 1156812 - [mozdevice] Support specifying alternate log buffers when retrieving or clearing the logcat. r=bclary
--HG--
extra : rebase_source : daf38979980ab04f207953dbd682a1b7639f8842
2015-04-22 11:02:00 -04:00
Julien Pages
258af81ab8 Bug 1147614 - [mozdevice] The property ADBDevice.test_root does not appear in documentation. r=bclary 2015-03-31 03:17:00 -07:00
Andrew Halberstadt
c6d32a2950 Bug 1134395 - mozbuild should pass in rootdir to manifestparser to properly calculate test relpaths, r=gps
--HG--
extra : rebase_source : 0d77784a6e7eea31be009f3f475861cf57caeeb3
2015-02-18 17:07:55 -05:00
Anish
4063a569ed Bug 958147 - Choose one of run-if or skip-if and get rid of the other.r=jmaher, mwargers 2015-03-03 08:46:37 -05:00
William Lachance
f243dc7e3e Bug 1133076 - Add documentation for mozinstall. r=ahal 2015-02-17 13:48:17 -05:00
Andrew Halberstadt
bc64a1699e Bug 1129495 - [mozlog] Add optional 'path' attribute to test_start, r=jgraham
--HG--
extra : rebase_source : d26387e9674a97c4571d29ee80e0e00609ed2a72
2015-02-10 17:11:35 -05:00
Andrew Halberstadt
f02004a920 Bug 1123763 - [manifestparser] Implement filter system for manifest.active_tests(), r=ted
A filter is a callable that accepts an iterable of tests and a dictionary of values (e.g mozinfo.info) and returns an iterable of tests. Note filtering can mean modifying tests in addition to removing them. For example, this implements a "timeout-if" tag in the manifest:

    from manifestparser import expression
    import mozinfo

    def timeout_if(tests, values):
        for test in tests:
            if 'timeout-if' in test:
                timeout, condition = test['timeout-if'].split(',', 1)
                if expression.parse(condition, **values):
                    test['timeout'] = timeout
        yield test

    tests = mp.active_tests(filters=[timeout_if], **mozinfo.info)

--HG--
extra : rebase_source : adead90910811e71e8ea2bb862f2b8e92f2c1bee
2015-02-10 09:38:29 -05:00
Chris Manchester
11a1ff5261 Bug 1055765 - Implement log buffering as a handler in mozlog.;r=jgraham 2014-12-12 12:08:31 -05:00
William Lachance
807b164e44 Bug 1097901 - Improve structured log example + docs;r=jgraham DONTBUILD 2014-11-13 16:45:43 -05:00
Julien Pagès
6aecdbd83c Bug 859422 - update sphinx documentation for mozfile. r=wlach 2014-10-13 08:37:00 +02:00
Andrei Eftimie
5d5579816a Bug 1023790 - [manifestparser] Add support for parent link. r=hskupin, r=jmaher 2014-10-02 14:23:21 +02:00
Alessio Placitelli
ad39e7f09c Bug 928397 - Add the documentation for mozdebug. r=ted 2014-09-09 11:53:00 +02:00
Chris Manchester
650a0fbdc5 Bug 1047429 - Remove unstructured mozlog docs to reduce risk of use in new code. r=ahal
--HG--
extra : rebase_source : 8ad569f3898f4d3758f99d50528a8c4c5ac13320
2014-08-25 11:29:43 -04:00
Chris Manchester
d9f51c6e27 Bug 1054375 - Fix reference to tbplformatter in mozlog docs. r=wlach 2014-08-15 14:30:38 -04:00
William Lachance
28be0fa930 Bug 1051895 - Make mozdevice docs a bit easier to navigate;r=bc DONTBUILD NPOTB 2014-08-15 12:59:02 -04:00
James Graham
4dbda546cc Bug 1026181 - Make mach terminal formatter work outside mach context, r=chmanchester 2014-07-31 14:54:05 +01:00
Arnav Sharma
3db8eb771f Bug 1037532 - "mozversion should have documentation on how to use its API". r=wlachance 2014-07-16 12:56:00 +02:00
William Lachance
ba2b4b855e Bug 1036530 - Instantiate / initialize device root only when needed in mozdevice. r=bc 2014-07-11 15:29:30 -04:00
Bob Clary
daf23b9853 Bug 1035254 - [mozdevice] - Add ADBAndroid.get_battery_percentage(), r=wlach, DONTBUILD. 2014-07-10 06:46:23 -07:00
Bob Clary
18eb5ebd1e Bug 1034406 - [mozdevice] Do not allow ADBCommand to be instantiated, r=wlach, DONTBUILD. 2014-07-07 08:19:35 -07:00
Bob Clary
30a84d98fd Bug 1012711 - Add adb.py to devicemanager package, -correcting bugnumber- r=wlach. DONTBUILD a=sheriffduty 2014-06-26 16:20:12 +02:00
Carsten "Tomcat" Book
952ae2f289 Backed out changeset 1fd65e3c2f4a (bug 1012712) 2014-06-26 16:18:34 +02:00
Bob Clary
2d0815dc05 Bug 1012712 - Add adb.py to devicemanager package, r=wlach. DONTBUILD 2014-06-25 21:08:41 -07:00
Andrew Halberstadt
e60605718c Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Ryan VanderMeulen
0645a74aa3 Merge m-c to inbound on a CLOSED TREE. a=merge 2014-06-12 17:32:33 -04:00
William Lachance
3559093118 Bug 1023883 - Update doc reference to manifestparser from manifestdestiny. r=ahal 2014-06-11 10:27:20 -04:00
William Lachance
c6f074b1e3 Bug 1021943 - Add some additional features to mozlog.structured to help with informational level logging;r=jgraham 2014-06-12 11:28:19 -04:00
William Lachance
543aa429dc Bug 984528 - Rename manifestdestiny -> manifestparser. r=ahal
--HG--
rename : testing/mozbase/docs/manifestdestiny.rst => testing/mozbase/docs/manifestparser.rst
rename : testing/mozbase/manifestdestiny/manifestparser/__init__.py => testing/mozbase/manifestparser/manifestparser/__init__.py
rename : testing/mozbase/manifestdestiny/manifestparser/manifestparser.py => testing/mozbase/manifestparser/manifestparser/manifestparser.py
rename : testing/mozbase/manifestdestiny/setup.py => testing/mozbase/manifestparser/setup.py
rename : testing/mozbase/manifestdestiny/tests/comment-example.ini => testing/mozbase/manifestparser/tests/comment-example.ini
rename : testing/mozbase/manifestdestiny/tests/default-skipif.ini => testing/mozbase/manifestparser/tests/default-skipif.ini
rename : testing/mozbase/manifestdestiny/tests/filter-example.ini => testing/mozbase/manifestparser/tests/filter-example.ini
rename : testing/mozbase/manifestdestiny/tests/fleem => testing/mozbase/manifestparser/tests/fleem
rename : testing/mozbase/manifestdestiny/tests/include-example.ini => testing/mozbase/manifestparser/tests/include-example.ini
rename : testing/mozbase/manifestdestiny/tests/include/bar.ini => testing/mozbase/manifestparser/tests/include/bar.ini
rename : testing/mozbase/manifestdestiny/tests/include/crash-handling => testing/mozbase/manifestparser/tests/include/crash-handling
rename : testing/mozbase/manifestdestiny/tests/include/flowers => testing/mozbase/manifestparser/tests/include/flowers
rename : testing/mozbase/manifestdestiny/tests/include/foo.ini => testing/mozbase/manifestparser/tests/include/foo.ini
rename : testing/mozbase/manifestdestiny/tests/just-defaults.ini => testing/mozbase/manifestparser/tests/just-defaults.ini
rename : testing/mozbase/manifestdestiny/tests/manifest.ini => testing/mozbase/manifestparser/tests/manifest.ini
rename : testing/mozbase/manifestdestiny/tests/mozmill-example.ini => testing/mozbase/manifestparser/tests/mozmill-example.ini
rename : testing/mozbase/manifestdestiny/tests/mozmill-restart-example.ini => testing/mozbase/manifestparser/tests/mozmill-restart-example.ini
rename : testing/mozbase/manifestdestiny/tests/no-tests.ini => testing/mozbase/manifestparser/tests/no-tests.ini
rename : testing/mozbase/manifestdestiny/tests/path-example.ini => testing/mozbase/manifestparser/tests/path-example.ini
rename : testing/mozbase/manifestdestiny/tests/relative-path.ini => testing/mozbase/manifestparser/tests/relative-path.ini
rename : testing/mozbase/manifestdestiny/tests/test_convert_directory.py => testing/mozbase/manifestparser/tests/test_convert_directory.py
rename : testing/mozbase/manifestdestiny/tests/test_convert_symlinks.py => testing/mozbase/manifestparser/tests/test_convert_symlinks.py
rename : testing/mozbase/manifestdestiny/tests/test_default_skipif.py => testing/mozbase/manifestparser/tests/test_default_skipif.py
rename : testing/mozbase/manifestdestiny/tests/test_expressionparser.py => testing/mozbase/manifestparser/tests/test_expressionparser.py
rename : testing/mozbase/manifestdestiny/tests/test_manifestparser.py => testing/mozbase/manifestparser/tests/test_manifestparser.py
rename : testing/mozbase/manifestdestiny/tests/test_read_ini.py => testing/mozbase/manifestparser/tests/test_read_ini.py
rename : testing/mozbase/manifestdestiny/tests/test_testmanifest.py => testing/mozbase/manifestparser/tests/test_testmanifest.py
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/subdir/manifest.ini => testing/mozbase/manifestparser/tests/verifyDirectory/subdir/manifest.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/subdir/test_sub.js => testing/mozbase/manifestparser/tests/verifyDirectory/subdir/test_sub.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_1.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_1.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_2.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_2.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_3.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_3.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory_incomplete.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory_incomplete.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory_toocomplete.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory_toocomplete.ini
2014-06-10 13:20:23 -04:00
James Graham
250d54d299 Bug 1015287 - Add complete example to mozlog.structured documentation, r=wlach 2014-05-30 17:10:26 +01:00
William Lachance
4e494d0b99 Bug 1016467 - Allow mozversion to support getting version info out of a fennec .apk. r=davehunt 2014-05-29 14:57:52 -04:00
James Graham
fd7d29db1c Bug 985606 - Improve API for reading structured logs, r=ahal 2014-04-02 14:32:41 +01:00
dadadel
4489adec63 Bug 907433 - Improve the mozprocess documentation with description and examplesi;r=wlach
DONTBUILD

--HG--
extra : amend_source : 99b1ef66ea65a1bf59ba01c98ad89cdb12fbf2ad
2014-03-10 12:15:35 -04:00
James Graham
8e6f253886 Bug 978108 - Update documentation for strucured logging. r=wlach 2014-02-27 19:04:45 +00:00