Commit Graph

137 Commits

Author SHA1 Message Date
Shing Lyu
dc62409f53 Bug 1253219 - Add reftest screenshots to html report for easier debugging. r=jmaher
--HG--
extra : rebase_source : d9d03001e3b597908b0f241db2cfda02afc51072
2016-03-14 05:16:00 +01:00
Shing Lyu
2507afb6b9 Bug 1253209 - Fixed reftest html report generation failure. r=jmaher 2016-03-06 20:09:00 +01:00
Julian Seward
9c5cac6016 Bug 1245566 - Enable taskcluster scheduling for valgrind-mochitest runs: mochitest_valgrind_mods. r=jgraham. 2016-02-18 11:34:40 +01:00
Andrew Halberstadt
f94d7e71d8 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 77ed0ba842cc8e557141fb3494212b06868c728a
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
extra : source : d1779fe421c3c7cd8e3d191816776390dc104f37
2016-02-05 15:44:20 -05:00
Phil Ringnalda
66e6da78e6 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
8a462fd84b Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 6bae978126dbd5beddc39332c7cbce0c1354cd87
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
2015-10-29 15:01:44 -04:00
Julien Pagès
88a3456247 Bug 1226554 - [mozlog] bump version to 3.1. r=jgraham
--HG--
extra : commitid : IxovQzi5gyE
extra : rebase_source : ae3cf006bba8676cf66edaecd01b30de03bd3c0a
2015-11-20 13:40:24 +01:00
Julien Pagès
dfdc7dc7de Bug 1226554 - [mozlog] add a ProxyLogger concept. r=jgraham
--HG--
extra : commitid : Ez3CFCMZVYb
extra : rebase_source : f2515b3bf0fc813a3f10613fb8d1bc94878a6e60
2015-11-20 12:42:51 +01:00
Andrew Halberstadt
e7029d44aa Bug 1219870 - [mozlog] ensure correct suite state when logging suite_start/suite_end via StructuredLogger.log_raw, r=chmanchester
--HG--
extra : commitid : L5aVgE5euqR
extra : rebase_source : 3b7f3b105503a7cc3e0ba8d8c15a85b18a06ce30
2015-10-29 15:11:25 -04:00
Julian Seward
0ce48c0f5e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
d4897fa1ef Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
b3bc139b1e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
Andrew Halberstadt
20cae47299 Bug 1193522 - [mozlog] Use ultrajson instead of stdlib json if available for performance, r=jgraham
--HG--
extra : commitid : IQGf0ENQujg
extra : rebase_source : 1d29af9a7871d595952b776998f66bc7c9b41735
2015-08-13 13:37:07 -04:00
Julien Pagès
6ad9fb9172 Bug 1192024 - Remove the word status from the human readable string of a process exit code in mozlog on Windows. r=jgraham 2015-08-12 00:43:00 -04:00
James Graham
3cc0515703 Bug 1191267 - Fix mozlog log buffering command line option, r=chmanchester 2015-08-06 11:52:20 +01:00
Julien Pagès
78ef1c279b Bug 1186551 - [mozlog] add structured action process_start/process_exit. r=jgraham
--HG--
extra : transplant_source : %23%B9%0D%23%93Kf%8F%3F%1A%F5%8DP%97%AA%81%8D%1C%8D%7E
2015-07-22 21:00:25 +02:00
Andrew Halberstadt
2b977b797d Bug 1186888 - [mozlog] Ability to use a pre-existing logger with commandline.setup_logging(), r=jgraham
--HG--
extra : commitid : 786tOojSwTl
extra : rebase_source : 3df091de3afee6838a40c0c858da97fd04b32739
extra : amend_source : 5a5ea71fd9a8ede744d281cb0b2dae190575230d
2015-07-22 15:27:31 -04:00
Andrew Halberstadt
2be5ff0c10 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.

--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
James Graham
0b0e2d0aaf Bug 1177630 - Add formatter to mozlog for producing a machine readable error summary, r=chmanchester
--HG--
extra : commitid : FeIqwyCNz06
extra : rebase_source : 32141de7decef684b241e674d02a709b5f87f09f
2015-07-08 11:32:57 +01:00
James Graham
43a3f73c63 Bug 1171849 Let consumers override mozlog default formatter options, r=chmanchester 2015-06-05 17:48:06 +01:00
James Graham
e07b9de9bf Bug 1171032 - Log raw messages at debug level by default, r=chmanchester
Also add --log-raw-level option to control this.

--HG--
extra : rebase_source : 9cb319c94b3f6b5e88bdc514dd0e22dc56277d85
2015-06-03 15:55:00 +01:00
Manish Goregaokar
f10df76074 Bug 1170591 - Remove trailing whitespace in mozlog. r=jdm 2015-06-02 11:30:00 -04:00
Nick Alexander
c1f14290e2 Bug 1160324 - Handle missing robocopApk files in runtestsremote.py. r=gbrown
--HG--
extra : source : 7d8043298e133ab903b55ba9c8530b2ea28a3180
2015-04-30 14:28:14 -07:00
Hiroyuki Ikezoe
66b928b10a Bug 1154111 - Colorize SKIP in test logs. r=jgraham
--HG--
extra : rebase_source : ca0862950be526bda05711c369cef38b0d2a516c
2015-04-13 23:18:00 +02:00
Dave Hunt
729813836c Bug 1146292 - [mozlog] Bump version to 2.11. r=jgraham 2015-03-23 11:00:58 +00:00
Julien Pagès
5bf31af53c Bug 1132409 - [mozlog] Create directories for log specified on the command line if not present. r=jgraham
--HG--
extra : rebase_source : f895f820c97796573a665ecc28358931700b0c43
2015-03-06 06:17:00 -05:00
Julien Pagès
2756b8c420 Bug 1066643 - [mozlog] Allow users of mozlog's command line options to exclude inappropriate log types. r=jgraham 2015-02-24 14:01:00 -05:00
Julien Pagès
ecf2ab744f Bug 1132076 - [mozlog] Incorrect skip count in HTML log summary. r=davehunt 2015-02-11 09:19:00 -05:00
Andrew Halberstadt
bc64a1699e Bug 1129495 - [mozlog] Add optional 'path' attribute to test_start, r=jgraham
--HG--
extra : rebase_source : d26387e9674a97c4571d29ee80e0e00609ed2a72
2015-02-10 17:11:35 -05:00
Dave Hunt
9cb2cd3d6f Bug 1130358 - [mozlog] Bump version to 2.10. r=jgraham 2015-02-06 04:47:00 -05:00
Julien Pagès
337d9012ea Bug 1016929 - [mozlog] html formatter imports py.xml, doesn't declare it as a dependency. r=jgraham
--HG--
extra : rebase_source : 249b6ee7f576ce466f77fc063fef4c7fddffa9ec
2015-02-04 09:54:00 +01:00
Maciek
2d6f742885 Bug 1103945 - Add command line tool to merge multiple raw structured logs, r=jgraham
--HG--
extra : rebase_source : e2e07270a584c61bc01d6e68d7bf4e3ff9a451e2
2015-02-02 20:13:50 +01:00
Dave Hunt
7c60600fd9 Bug 1118738 - Fix HTML report colours for expected skips and unexpected errors. r=jgraham 2015-01-07 06:36:00 -05:00
Julien Pagès
ae85f164f2 Bug 1065406 - [mozlog] Split test class and name for XUnit formatter. r=jgraham 2014-12-16 16:02:00 +01:00
Ms2ger
f2b16bc10f No bug - Bump the mozlog package version; rs=jgraham 2014-12-19 11:27:28 +01:00
Ms2ger
de702b2126 Bug 1113095 - Handle failing reftests in machformatter's summarizing code; r=jgraham 2014-12-19 11:25:51 +01:00
Chris Manchester
11a1ff5261 Bug 1055765 - Implement log buffering as a handler in mozlog.;r=jgraham 2014-12-12 12:08:31 -05:00
Julien Pagès
e93266931a Bug 1065390 - [mozlog] various minor improvements of XUnit structured formatter; r=jgraham 2014-10-20 14:35:00 +02:00
James Graham
26505efb5a Bug 1103905 - Bump version number of mozlog, r=davehunt 2014-11-24 12:56:32 +00:00
James Graham
9526da9ec9 Bug 1098404 - Implement per-component filters for mozlog, r=chmanchester
This allows individual component loggers to e.g. discard all messages below a
set level, or rewrite messages from one level to another.

--HG--
extra : rebase_source : 9b37981368edb099ac555a2dacfafd486f8fcd2d
extra : histedit_source : 144d17f582944703b07529e31bf13b845d5f9695%2C706e2b7db06a1217d0e956614f0232c153a6a3d0
2014-11-21 11:43:54 +00:00
Andrew Halberstadt
6ae8df7d8d Bug 1073093 - [mozlog] make sure formatter wasn't removed from defaults before adding commandline option for it, r=chmanchester
--HG--
extra : rebase_source : 3357bbf0ea607a07111b6aa5258d0476c782f824
2014-11-14 09:23:22 -05:00
William Lachance
807b164e44 Bug 1097901 - Improve structured log example + docs;r=jgraham DONTBUILD 2014-11-13 16:45:43 -05:00
Chris Manchester
bbdbda2391 Bug 1090485 - Fix mozlog's commandline to accept file arguments for a formatter that is also the stdout default.;r=jgraham 2014-10-28 17:03:20 -04:00
Dave Hunt
cbf6fb7b78 Bug 1087250 - [mozlog] Bump version number to 0.27. r=wlachance 2014-11-06 08:57:26 +00:00
Dave Hunt
ac79da7488 Bug 1090148 - [mozlog] Remove test class from HTML formatter. r=cmanchester 2014-11-05 10:44:19 +00:00
William Lachance
1438f1530b Bug 945706 - [mozlog] logger.exception() calls do not add exception information to the output; r=wlach 2014-11-03 11:26:11 -05:00
Chris Manchester
f361b4e1ec Bug 1091413 - Refrain from printing the command args with each call to process_output in mozlog's machformatter;r=jgraham 2014-10-30 11:37:22 -04:00
Mark Hammond
52453853a0 Bug 1090733 - xpcshell tests fail if no terminal configured. r=chmanchester 2014-10-30 12:13:34 +11:00
Dave Hunt
706c1d8dec Bug 1087248 - [mozlog] Fix encoding for debug in HTML formatter such as page source. r=jgraham 2014-10-27 05:55:00 +01:00
Dave Hunt
4baf8b2325 Bug 1087244 - [mozlog] Fix screenshot links in the HTML formatter. r=jgraham 2014-10-22 07:02:00 +02:00