Commit Graph

346 Commits

Author SHA1 Message Date
Andrew Halberstadt
f94d7e71d8 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 77ed0ba842cc8e557141fb3494212b06868c728a
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
extra : source : d1779fe421c3c7cd8e3d191816776390dc104f37
2016-02-05 15:44:20 -05:00
Phil Ringnalda
66e6da78e6 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
8a462fd84b Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 6bae978126dbd5beddc39332c7cbce0c1354cd87
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
2015-10-29 15:01:44 -04:00
Julian Seward
0ce48c0f5e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
d4897fa1ef Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
b3bc139b1e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
Julien Pagès
23e4c1d4a3 Bug 1091285 - move dumpScreen in a new mozscreenshot package. r=jgriffin
This also completely remove build/automationutils.py.

--HG--
extra : commitid : 50v6EAQNEHV
extra : rebase_source : 4ac1347d73498f068979514c6afb16ac50ab4033
2015-07-29 17:50:16 +02:00
Julien Pagès
c1802eb571 Bug 1177780 - remove useless stuff in automation.py. r=jgriffin
--HG--
extra : commitid : 3mgWZQdnDa4
extra : rebase_source : f8b91fff719dbeda7923a7e8c2c3e01a856d9b14
2015-06-26 22:45:18 +02:00
Eric Rahm
c8cabc45e1 Bug 1165515 - Part 15: Reduce log level of WebRTC during testing. r=jesup 2015-06-03 15:26:07 -07:00
Kartikaya Gupta
cd5b55f8d6 Bug 1039866 - Rip out a bunch of metro-only code. r=jimm,gavin,rstrong 2015-04-23 15:10:30 -04:00
Nicholas Nethercote
97b5d348cc Bug 1014341 (part 1) - Remove trace-malloc. r=dbaron,glandium.
--HG--
extra : rebase_source : 771710c5427141d738eef112fab00951eb8e20e3
2015-01-07 16:13:03 -08:00
Prashant Baisla
a44cc8c44c Bug 1091269 - Removed ZipFileReader class from automationutils.py and changed automation.py.in to use zipfile.extractall. r=jgriffin 2014-12-20 14:45:48 +01:00
Nicholas Nethercote
98688c1a41 Bug 1100851 - Tweak DMD to account for the fact that $DMD can now be undefined. r=glandium.
Now that defining $DMD is no longer necessary to run DMD, this patch does the
following.
- Removes all the places where we set DMD=1 (test harnesses, etc.)
- Still handles DMD=1, for backwards compatibility.
- Prints "$DMD is undefined" at DMD start-up if appropriate.
- Writes a |null| value for |dmdEnvVar| in the JSON if $DMD is undefined. Bumps
  the DMD output version number accordingly.
- Changes a bunch of the test files accordingly, including changing the mode of
  script-ignore-alloc-fns.json in order to test a case where $DMD is undefined.

--HG--
extra : rebase_source : eb1ef5722410734ce6d7658465ff6f442ee4ed49
2014-11-27 21:04:46 -08:00
Byron Campen [:bwc]
3af28ea884 Bug 1091242 - Part 6: Wiring the new JSEP handler code in. See https://github.com/unicorn-wg/gecko-dev/tree/multistream_rebase for more history. r=jesup, r=smaug 2014-11-19 16:16:29 -08:00
Phil Ringnalda
5fe54ea0fd Backed out 10 changesets (bug 1091242) for Android/b2g non-unified build bustage
CLOSED TREE

Backed out changeset 7f72b55c5de7 (bug 1091242)
Backed out changeset f1501aa24397 (bug 1091242)
Backed out changeset 7fde5994aee5 (bug 1091242)
Backed out changeset 59b415714087 (bug 1091242)
Backed out changeset dadb65fedc08 (bug 1091242)
Backed out changeset 21be81424e4e (bug 1091242)
Backed out changeset 498fb1dafba5 (bug 1091242)
Backed out changeset 8d0653eb85ab (bug 1091242)
Backed out changeset c82d484e135a (bug 1091242)
Backed out changeset 3e0c8932f1b1 (bug 1091242)
2014-12-08 20:53:07 -08:00
Byron Campen [:bwc]
bb404e8254 Bug 1091242 - Part 6: Wiring the new JSEP handler code in. See https://github.com/unicorn-wg/gecko-dev/tree/multistream_rebase for more history. r=jesup, r=smaug 2014-11-19 16:16:29 -08:00
Nazma Panjwani
9bd7bfc683 Bug 1091280 - moved options from AutomationUtils.addCommonOptions to runreftest.py, mochitest_options.py, runxpcshelltests.py and removed the addCommonOptions from automationUtils and automation.py.in, r=ahal 2014-11-19 12:31:45 -08:00
Sebastian Hengst
1e915ce56f Bug 1078033 - Remove remaining Camino code. r=ted 2014-10-10 17:00:29 +02:00
Nils Ohlmeier [:drno]
7204b2e48f Bug 1049688 - Allow override of MOZ_DISABLE_NONLOCAL_CONNECTIONS. r=froydnj 2014-09-22 09:48:00 -04:00
Aaron Klotz
70797271f3 Bug 1070042: Fix --debugger parameter in reftest/crashtest; r=ted 2014-09-19 14:49:34 -06:00
Mark Hammond
3cd7c18fda Bug 1058433 - nsPermissionManager now records the mod-time of a permission and allows removal of ones modified since a specified time. r=ehsan 2014-09-15 11:33:12 +10:00
Nicholas Nethercote
2a6091aa99 Bug 1062689 - Run local mochitest and reftest output through fix_macosx_stack.py on Mac. r=ted. 2014-09-04 22:19:42 -07:00
Nicholas Nethercote
ab2d367e37 Bug 1050601 - Remove fix-linux-stack.pl. r=ted.
--HG--
extra : rebase_source : f344aa5db9e16575835a7de3df34c311635c128b
2014-09-03 09:24:38 -07:00
Ralph Giles
ebddba08ca Bug 1054043 - Remove wrapcommand. r=ted
This code was only needed on osx 10.5, and the version string compare
fails on osx 10.10.
2014-08-14 15:35:00 -07:00
Tim Taubert
d6fbf13d57 Bug 1052371 - Fix m-bc shutdown leak detector r=akachkach 2014-08-12 21:23:29 +02:00
Tim Taubert
8d37c3208a Backed out changeset 9b26ce378971 (bug 1052371) 2014-08-12 21:11:16 +02:00
Tim Taubert
1b4bd31f32 Bug 1052371 - Bustage fix for android mochitests on a CLOSED TREE r=bustage 2014-08-12 20:40:43 +02:00
Vaibhav Agrawal
be65f1bbce Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Andrew McCreight
a7fbd0d3c2 Bug 988041 - Enable LeakSanitizer for Mochitests. r=jmaher 2014-06-20 09:08:30 -07:00
Nathan Froyd
b6301f2928 Bug 995417 - part 2 - testing infrastructure changes to set MOZ_DISABLE_NONLOCAL_CONNECTIONS; r=jmaher 2014-06-17 10:49:57 -04:00
Byron Campen [:bwc]
6facfa747f Bug 1017332 - Part 2: Make loglevels consistent (in a useful way). r=drno 2014-06-13 11:45:42 -07:00
Andrew McCreight
8f67db8df7 Bug 1023368 - ASan tests should show an error when the symbolizer isn't found. r=jmaher 2014-06-14 16:43:46 -07:00
Joel Maher
08a5fa35e7 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Andrew Halberstadt
c2b2c17ee5 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Manish Goregaokar
17f55bc6ed Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Vaibhav Agrawal
710c031709 Bug 908945 - Fix automation.py's exit code handling; r=jmaher 2014-03-26 06:14:51 -04:00
Jan de Mooij
5ae1515090 Bug 977921 - Override ASan malloc_context_size to save memory. r=decoder
--HG--
extra : rebase_source : 500882c214de079c1d493e21a9ee91c3da743226
2014-02-28 16:33:25 +01:00
Mihai Tabara
1ea10a6b41 Bug 961108 - make dumpScreen always write to a file in MOZ_UPLOAD_DIR. r=ted,jmaher 2014-01-17 12:04:02 -05:00
Andrew Halberstadt
9d5486288c Bug 957768 - Add hide_subtests argument to automation.py to appease Android on a CLOSED TREE, r=bustage 2014-01-09 16:55:26 -05:00
Nils Ohlmeier [:drno]
18d3e0bd88 Bug 951314 - Only set WebRTC debug variables if not present. r=ted 2013-12-19 11:42:19 -05:00
Ryan VanderMeulen
f5d9af358e Backed out changeset 08009e8417e9 (bug 951314) for Windows bustage. 2013-12-19 11:58:24 -05:00
Nils Ohlmeier [:drno]
370726bf59 Bug 951314 - Only set WebRTC debug variables if not present. r=ted 2013-12-19 11:42:19 -05:00
Nathan Froyd
0f8ca584d8 Bug 938289 - part 1 - add automation support for adding DMD environment variables; r=jmaher 2013-11-13 14:47:41 -05:00
Tim Taubert
eee5c89ff7 Bug 932898 - Bring back the shutdown leak detector r=ted
From 246109686e62e3231ccba74a84adaa0774f2a1af Mon Sep 17 00:00:00 2001
2013-11-20 21:53:08 +01:00
Ryan VanderMeulen
e1f22e4fdc Backed out changeset 53627e59f761 (bug 932898) for mochitest-mc timeouts. 2013-11-20 14:30:30 -05:00
Tim Taubert
c8b9db8497 Bug 932898 - Bring back the shutdown leak detector r=ted 2013-11-01 11:25:17 +01:00
Ted Mielczarek
0cf4101913 bug 914925 - fix --debugger for mochitest on OS X. r=jmaher 2013-09-16 14:44:25 -04:00
Christian Holler
1c2bc77c17 Bug 934641 - Switch ASan tests to using the low-memory config instead of the mid-memory config, to work around intermittent OOM failures, r=philor 2013-11-14 01:44:41 +01:00
Christian Holler
01aa013cea Bug 917242 - Symbolize ASan traces in automation. r=ted 2013-09-20 13:37:53 +02:00
Ted Mielczarek
d085cd7987 bug 717758 - kill hung processes with SIGABRT on OS X in automation.py. r=jmaher 2013-09-16 14:44:25 -04:00