Commit Graph

263 Commits

Author SHA1 Message Date
Joel Maher
1297551e8b Bug 1057512 - enable --run-by-dir for devtools* jobs. r=dminor 2014-11-20 07:49:04 -05:00
Joel Maher
b807dc3eb5 Bug 1057512 - enable --run-by-dir for browser-chrome e10s. r=dminor 2014-11-19 12:36:34 -05:00
Joel Maher
7f1ef4eab3 Bug 1057512 - --run-by-dir enabled for browser-chrome on trunk. r=RyanVM 2014-11-17 11:01:23 -05:00
Vaibhav Agrawal
a1f9ec83ea Bug 1089037 - Removing invalid mochitests and moving webapprt-content tests to a seperate "webapprtContent" folder in object directory. r=jmaher, marco 2014-11-13 12:30:00 +01:00
Pankaj Malhotra(:bitgeeky)
ff6b9df484 Bug 1091267 - Move automationutils:parseKeyValue to mochitest's runtests.py. r=ahal 2014-11-06 03:34:00 +01:00
Pankaj Malhotra(:bitgeeky)
4351fe04c1 Bug 1091270 - Move isURL out of automationutils; r=jgriffin 2014-11-04 16:59:40 -08:00
Joel Maher
f70fad68df Bug 987849 - Add fail-if support to Mochitest manifests. r=ahal. 2014-10-17 10:01:15 -04:00
Bob Owen
b5478fbccd Bug 1037445: When pre-Vista, for testing purposes allow std handles to be inherited by child process when an env var is set. r=jmaher,dvander 2014-10-15 08:26:39 +01:00
Chris Manchester
d2ce264928 Bug 1075240 - Log disabled tests as skips in mochitests. r=ahal 2014-10-02 11:08:41 -04:00
Andrew McCreight
f3d650b7c0 Bug 1076969 - processLeakLog should come up with reasonable defaults itself. r=jmaher
Instead of grabbing attributes off options at every call site, pass
in the options object to processLeakLog, and attempt to get the attributes
there. If not present, use a restrictive default value.

This will prevent silent harness failures if one of the many ways to invoke
processLeakLog fails to set up these options, and makes it so they
don't have to set it up if they don't care.
2014-10-06 14:23:17 -07:00
Mark Hammond
286ada94c3 Bug 1075324 - mochitest logs only report output was truncated when it actually was. r=ahal 2014-10-03 16:15:06 +10:00
Andrew McCreight
b71a75b37a Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-30 14:17:27 -07:00
Andrew McCreight
3a5312793b Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-30 09:54:25 -07:00
Jim Mathies
af9be8e2a8 Bug 1072417 - Remove the browser.tabs.remote pref and turn everything it controls on by default. r=felipe 2014-09-29 16:11:08 -05:00
Ryan VanderMeulen
8bcef57acc Backed out 4 changesets (bug 1068276, bug 1067664) for Android leaktest complaints.
Backed out changeset 846faaa68219 (bug 1068276)
Backed out changeset 35e71ffcf8e1 (bug 1068276)
Backed out changeset 605f59a806fd (bug 1067664)
Backed out changeset 2d5b7ea96b70 (bug 1067664)

--HG--
extra : rebase_source : 7a90c78ba35f31acce7609d5d8375a593cb9825d
2014-09-26 16:02:12 -04:00
Andrew McCreight
7630b62a5b Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-26 10:34:09 -07:00
Andrew McCreight
ddb5b793b3 Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-26 10:34:08 -07:00
Bob Owen
e688081dc5 Bug 1067301 - Add mach / mochitest option to run tests with Windows content sandbox. r=jmaher 2014-09-16 08:20:07 +01:00
Vaibhav Agrawal
f8994bd2a3 Bug 987849 - Temporary solution to raise an Exception if 'fail-if' encountered. r=ahal 2014-09-24 14:12:00 -04:00
Chris Manchester
7a035febd4 Bug 1068429 - Log crashes with structured logging for those using structured logging.;r=ahal 2014-09-23 20:33:31 -04:00
Edwin Flores
8bbbd93848 Bug 1044742 - Make ClearKey CDM accessible to mochitests - r=ted 2014-09-24 10:04:49 +12:00
Dave Townsend
f485086973 Bug 1035512: Add a new common JS testing harness based on the mochitest test runner. r=gps, ted, erikvold, jmaher 2014-09-22 11:08:06 -07:00
Chris Manchester
6a79dce6d7 Bug 1061670 - Log failures in automationutils.py at the warning level for visibility when running locally. r=ahal 2014-09-16 22:32:13 -04:00
Alexandre Lissy
e5a303a93b Bug 1066044 - Make Mochitest pass on Mulet r=jmaher,ochameau
To get Mochitest green with Mulet, we need to disable a couple more of
tests. We also need to disable the crash on non local connections, as it
is being done for runtestsb2g.
2014-09-11 22:59:00 +02:00
Alessio Placitelli
a7b1ef77b3 Bug 928397 - Enable xpcshell-test debugging on Windows platforms and default debugger detection. r=ted.mielczarek 2014-07-02 13:52:00 +02:00
Ryan VanderMeulen
283ce21d17 Backed out changeset 3afb6445a73c (bug 1066044) for B2G desktop mochitest perma-fail. 2014-09-11 20:38:06 -04:00
Alexandre Lissy
d72a0e1df7 Bug 1066044 - Make Mochitest pass on Mulet. r=jmaher, r=ochameau
To get Mochitest green with Mulet, we need to disable a couple more of
tests. We also need to disable the crash on non local connections, as it
is being done for runtestsb2g.
2014-09-11 07:37:00 -04:00
Ryan VanderMeulen
2363a05381 Backed out changeset 7b0ae11d2441 (bug 1057512) for introducing various new intermittent failures and making an existing one perma-fail. 2014-09-09 15:02:27 -04:00
Joel Maher
010164839f Bug 1057512 - --run-by-dir enabled for browser-chrome on trunk. r=ted 2014-09-09 12:01:54 -04:00
Nicholas Nethercote
2a6091aa99 Bug 1062689 - Run local mochitest and reftest output through fix_macosx_stack.py on Mac. r=ted. 2014-09-04 22:19:42 -07:00
Nicholas Nethercote
ab2d367e37 Bug 1050601 - Remove fix-linux-stack.pl. r=ted.
--HG--
extra : rebase_source : f344aa5db9e16575835a7de3df34c311635c128b
2014-09-03 09:24:38 -07:00
Chris Manchester
7f6a9e49b0 Bug 1045525 - Convert automationutils python logging to log through mozlog.structured.;r=ahal 2014-08-29 10:37:17 -04:00
Ahmed Kachkach
9bd3b0b779 Bug 1056329 - Activate structured logging command line args for other mochitest suites. r=ahal 2014-08-25 12:32:00 -04:00
Bill McCloskey
ff1f803447 Bug 1058300 - Fix Linux stack walking code in mochitest testrunner (r=akachkach) 2014-08-26 11:43:36 -07:00
Qeole
158c324a97 Bug 1045209 - Updating tests for new OpenH264 plugin path handling. r=unfocused,ted,jmaher 2014-08-25 17:23:34 +02:00
Gijs Kruitbosch
860badb714 Bug 1057328 - get gmp path for app-override tests, r=ted
--HG--
extra : rebase_source : 19485859be5c0660d36242e2920fa3d4ca662666
2014-08-22 16:28:04 +02:00
Ahmed Kachkach
59d9c8247c Bug 1050855 - Remove --log-file and --file-level options. r=ahal 2014-08-15 15:42:00 -04:00
Ahmed Kachkach
b47d5e54c3 Bug 1050251 - Use the correct message/name for chrome mochitest asserts. r=chmanchester 2014-08-15 14:42:00 -04:00
Ahmed Kachkach
0fe8812f69 Bug 1051024 - Remove unstructured logs parsing in mochitest handlers. r=ahal 2014-08-08 14:15:00 -04:00
Ahmed Kachkach
1b49fb456b Bug 1039833 - Add structured logging command line arguments for mochitest/mach. r=chmanchester, r=ahal 2014-08-13 12:03:00 -04:00
Tim Taubert
d6fbf13d57 Bug 1052371 - Fix m-bc shutdown leak detector r=akachkach 2014-08-12 21:23:29 +02:00
Tim Taubert
6d259c19e1 Backed out changeset d04a9bf0df24 (bug 1052371) 2014-08-12 21:11:17 +02:00
Tim Taubert
db8ba6ec31 Bug 1052371 - Fix m-bc shutdown leak detector r=akachkach 2014-08-12 13:25:23 +02:00
Ahmed Kachkach
25383a3e1f Bug 1050148 - Dump the log buffer after each run (with run-by-dir). r=jmaher
--HG--
extra : rebase_source : 8dd613dad733c63dd84981fc582149a85cd45c31
2014-08-07 10:58:00 -04:00
Kyle Huey
66021be422 Bug 1038943: Turn on leak checking on B2G with an initial threshold of 400000 bytes. r=ahal,dbaron 2014-08-05 14:11:53 -07:00
Ryan VanderMeulen
6253da7301 Merge inbound to m-c on a CLOSED TREE. a=merge 2014-08-04 16:06:19 -04:00
Ahmed Kachkach
cc40166c9e Bug 1046566 - Avoid instantiating multiple structured loggers. r=ahal 2014-08-01 11:46:00 -04:00
James Graham
0da7281b20 Bug 1042921 - Explicitly type-convert all input to mozlog.structured.;r=ahal 2014-08-04 10:29:58 +01:00
Chris Manchester
757d8862c6 Bug 1044206 - Revert the global logger in mochitest's runtests to use python stdlib logging for compatibility with mozharness regex.;r=ahal 2014-07-30 09:55:45 -04:00
Ahmed Kachkach
af98d35b3f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
f9a5d00145 Bug 1042963 - Only execute the first_error handler on test_status messages. r=Vaibhav 2014-07-28 11:44:00 +02:00
Chris Manchester
39f2cb9cf8 Bug 1045255 - Add back global logging setup removed in bug 886570 needed for leak logging on a CLOSED TREE.;r=gps 2014-07-28 19:51:55 -04:00
Ahmed Kachkach
f83941296e Bug 1043485 - Save last Android robocop test name when logs are unstructured. r=edmorley 2014-07-25 11:26:00 +02:00
Ahmed Kachkach
2a45093863 Bug 1043420 - Use actual log level in mochitest logs instead of always INFO. r=ted 2014-07-24 08:49:00 +02:00
Vaibhav Agrawal
895e36f0c0 Bug 1038813 - Make the job bisection bleedthrough log output parsable by TBPL & Treeherder. r=edmorley 2014-07-23 10:23:00 +02:00
Ted Mielczarek
6344615ad6 bug 1041347 - Package and provide path to fake GMP plugin for Mochitests. r=jmaher 2014-07-25 07:01:13 -04:00
Ahmed Kachkach
634b6a5ff0 Bug 1042979 - Clean up unused imports, variables, and dead code in mochitest. r=ahal 2014-07-24 06:23:00 +02:00
Carsten "Tomcat" Book
77246bd1b5 Backed out changeset 0356454faea3 (bug 1041347) for mochitest 1 test failures on B2G Desktop Linux on a CLOSED TREE 2014-07-25 07:57:57 +02:00
Ted Mielczarek
1f87e19110 bug 1041347 - Package and provide path to fake GMP plugin for Mochitests r=jmaher 2014-07-24 11:31:43 -04:00
Ahmed Kachkach
68cf6227fd Bug 1043015 - running mochitest-remote without ssltunnel gives bizarre errors. r=jgraham 2014-07-23 16:32:00 +02:00
Ahmed Kachkach
087859b18f Bug 1041706 - Mochitests prints raw JSON logs when running with a debugger. r=ahal 2014-07-23 15:31:00 +02:00
Ahmed Kachkach
53fb82ea68 Bug 1041944 - Printing mochitest failures at the end of the execution (with mach). r=ahal 2014-07-22 11:56:00 +02:00
Ted Mielczarek
154fe53541 Bug 1040966 - Fix unicode encoding when passing bad unicode to stack fixer. r=ahal 2014-07-22 15:45:54 -04:00
Randell Jesup
b68cb4d134 Bug 1037125: Make fake GMP plugin accessible in mochitests r=khuey 2014-07-20 17:39:19 -04:00
Vaibhav Agrawal
bbe56494c5 Bug 1039172 - Warnings are printed twice and "TEST-SKIPPED" are no longer printed in logs. r=jmaher 2014-07-18 07:20:00 -04:00
Ahmed Kachkach
4b03d2c025 Bug 886570 - Initial integration of structured logs in mochitest; r=ahal,Ms2ger 2014-07-17 09:02:00 +02:00
Vaibhav Agrawal
616e4c5a42 Bug 1028226 - Clean up the code for manifest parsing. r=jmaher 2014-07-10 09:38:00 +02:00
Carsten "Tomcat" Book
ce57787693 Backed out changeset cf85693280c7 (bug 886570) frequent mochitest-3 errors on windows 2014-07-11 14:15:29 +02:00
Ahmed Kachkach
50db9012f6 Bug 886570 - Initial integration of structured logs in mochitest. r=ahal,Ms2ger 2014-07-10 13:33:00 +02:00
Vaibhav Agrawal
70313384a4 Bug 1036374 - Adding a binary search algorithm for bisection of failing tests. r=jmaher 2014-07-09 13:20:00 +02:00
Vaibhav Agrawal
be65f1bbce Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Vaibhav Agrawal
b057114758 Bug 925699 - pymake/mach mochitest-plain don't delete the temporary profile. r=jmaher 2014-06-23 11:24:00 +02:00
Andrew McCreight
a7fbd0d3c2 Bug 988041 - Enable LeakSanitizer for Mochitests. r=jmaher 2014-06-20 09:08:30 -07:00
Andrew Halberstadt
e60605718c Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Geoff Brown
bb55ebe718 Bug 1026830 - Add LD_LIBRARY_PATH=xrePath when launching utilities; r=jmaher 2014-06-18 20:39:34 -06:00
Wes Kocher
e34177291e Backed out changeset 81a51de30a2a (bug 997244) for breaking b2g emulator mochitests on an otherwise CLOSED TREE 2014-06-18 14:15:48 -07:00
Andrew Halberstadt
7704c45325 Bug 997244 - Pull emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-18 13:30:12 -04:00
Armen Zambrano Gasparnian
da2589be17 Bug 989583 - Set self.testRoot and self.testRootAbs in only one place (runtests.py). r=jmaher 2014-06-17 09:50:16 -04:00
Armen Zambrano Gasparnian
93d68b29e0 Bug 989583 - Install all tests (even disabled) from manifests. r=jmaher 2014-06-16 14:51:22 -04:00
William Lachance
543aa429dc Bug 984528 - Rename manifestdestiny -> manifestparser. r=ahal
--HG--
rename : testing/mozbase/docs/manifestdestiny.rst => testing/mozbase/docs/manifestparser.rst
rename : testing/mozbase/manifestdestiny/manifestparser/__init__.py => testing/mozbase/manifestparser/manifestparser/__init__.py
rename : testing/mozbase/manifestdestiny/manifestparser/manifestparser.py => testing/mozbase/manifestparser/manifestparser/manifestparser.py
rename : testing/mozbase/manifestdestiny/setup.py => testing/mozbase/manifestparser/setup.py
rename : testing/mozbase/manifestdestiny/tests/comment-example.ini => testing/mozbase/manifestparser/tests/comment-example.ini
rename : testing/mozbase/manifestdestiny/tests/default-skipif.ini => testing/mozbase/manifestparser/tests/default-skipif.ini
rename : testing/mozbase/manifestdestiny/tests/filter-example.ini => testing/mozbase/manifestparser/tests/filter-example.ini
rename : testing/mozbase/manifestdestiny/tests/fleem => testing/mozbase/manifestparser/tests/fleem
rename : testing/mozbase/manifestdestiny/tests/include-example.ini => testing/mozbase/manifestparser/tests/include-example.ini
rename : testing/mozbase/manifestdestiny/tests/include/bar.ini => testing/mozbase/manifestparser/tests/include/bar.ini
rename : testing/mozbase/manifestdestiny/tests/include/crash-handling => testing/mozbase/manifestparser/tests/include/crash-handling
rename : testing/mozbase/manifestdestiny/tests/include/flowers => testing/mozbase/manifestparser/tests/include/flowers
rename : testing/mozbase/manifestdestiny/tests/include/foo.ini => testing/mozbase/manifestparser/tests/include/foo.ini
rename : testing/mozbase/manifestdestiny/tests/just-defaults.ini => testing/mozbase/manifestparser/tests/just-defaults.ini
rename : testing/mozbase/manifestdestiny/tests/manifest.ini => testing/mozbase/manifestparser/tests/manifest.ini
rename : testing/mozbase/manifestdestiny/tests/mozmill-example.ini => testing/mozbase/manifestparser/tests/mozmill-example.ini
rename : testing/mozbase/manifestdestiny/tests/mozmill-restart-example.ini => testing/mozbase/manifestparser/tests/mozmill-restart-example.ini
rename : testing/mozbase/manifestdestiny/tests/no-tests.ini => testing/mozbase/manifestparser/tests/no-tests.ini
rename : testing/mozbase/manifestdestiny/tests/path-example.ini => testing/mozbase/manifestparser/tests/path-example.ini
rename : testing/mozbase/manifestdestiny/tests/relative-path.ini => testing/mozbase/manifestparser/tests/relative-path.ini
rename : testing/mozbase/manifestdestiny/tests/test_convert_directory.py => testing/mozbase/manifestparser/tests/test_convert_directory.py
rename : testing/mozbase/manifestdestiny/tests/test_convert_symlinks.py => testing/mozbase/manifestparser/tests/test_convert_symlinks.py
rename : testing/mozbase/manifestdestiny/tests/test_default_skipif.py => testing/mozbase/manifestparser/tests/test_default_skipif.py
rename : testing/mozbase/manifestdestiny/tests/test_expressionparser.py => testing/mozbase/manifestparser/tests/test_expressionparser.py
rename : testing/mozbase/manifestdestiny/tests/test_manifestparser.py => testing/mozbase/manifestparser/tests/test_manifestparser.py
rename : testing/mozbase/manifestdestiny/tests/test_read_ini.py => testing/mozbase/manifestparser/tests/test_read_ini.py
rename : testing/mozbase/manifestdestiny/tests/test_testmanifest.py => testing/mozbase/manifestparser/tests/test_testmanifest.py
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/subdir/manifest.ini => testing/mozbase/manifestparser/tests/verifyDirectory/subdir/manifest.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/subdir/test_sub.js => testing/mozbase/manifestparser/tests/verifyDirectory/subdir/test_sub.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_1.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_1.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_2.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_2.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/test_3.js => testing/mozbase/manifestparser/tests/verifyDirectory/test_3.js
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory_incomplete.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory_incomplete.ini
rename : testing/mozbase/manifestdestiny/tests/verifyDirectory/verifyDirectory_toocomplete.ini => testing/mozbase/manifestparser/tests/verifyDirectory/verifyDirectory_toocomplete.ini
2014-06-10 13:20:23 -04:00
Joel Maher
08a5fa35e7 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Carsten "Tomcat" Book
78c2dc6adc Backed out changeset 86d0bd2a0233 (bug 992911) for android 2.3 bustage 2014-06-02 13:36:51 +02:00
Joel Maher
49f419b353 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-02 06:54:23 -04:00
Joel Maher
01f11e2fad Bug 1014503 - running devtools tests via mochitest-browser gives unhelpful error message. r=ted 2014-05-30 08:17:05 -04:00
Andrew Halberstadt
c2b2c17ee5 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Ted Mielczarek
59841f10b0 bug 815002 - allow using loopback devices in WebRTC mochitests on Linux when available. r=jsmith,jmaher 2014-05-01 07:18:00 -04:00
Martin Thomson
2739930979 Bug 907770 - Part 1: Making ssltunnel run for android and b2g mochitests. r=jmaher 2014-03-14 11:25:41 -07:00
Cameron McCormack
b22f8622e0 Bug 997598 - Don't strip leading white space from mochitest output lines when stack fixer is in use. r=wlach 2014-04-18 11:34:47 +10:00
Vaibhav Agrawal
532956cd3e Bug 912243 - Mochitest shouldnt chdir in __init__. r=jmaher 2014-04-16 10:29:39 -04:00
Manish Goregaokar
17f55bc6ed Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Ms2ger
161b37e9c0 Backed out changeset c63d8f19a893 for failures in Android mochitests. 2014-04-12 12:00:37 +02:00
Manish Goregaokar
91a087f85c Bug 991348 - Support taking screenshots on all test failures in mochitests; r=jmaher 2014-04-12 11:08:34 +02:00
Ryan VanderMeulen
2cb4e7bc1d Backed out changeset df3c1971ecdc (bug 984930) 2014-04-11 12:54:56 -04:00
Joel Maher
97f8165ef6 Bug 984930 - Create mochitest-dt [temporarily turn off --subsuite]. r=mratcliffe 2014-04-10 15:00:56 -04:00
Michael Ratcliffe
d0f5dae6ab Bug 983948 - Add mach mochitest-devtools r=jmaher 2014-03-25 16:52:53 +00:00
Joel Maher
a14d21f5df backout d459cc1b5a94 for robocop failures (bug 912243) 2014-04-07 08:45:15 -04:00
Vaibhav Agrawal
4846815c8e Bug 912243 - Mochitest shouldnt chdir in __init__; r=jmaher 2014-04-07 06:46:29 -04:00
Bill McCloskey
8fecb12663 Bug 986163 - Fix webapprt tests (r=ted) 2014-03-28 15:50:28 -07:00
Nathan Froyd
65f2050ac7 Bug 969437 - part 1 - introduce a --quiet option for mochitests; r=jmaher 2014-03-07 11:42:07 -05:00
Ryan VanderMeulen
a14baa39be Merge inbound to m-c. 2014-03-26 20:58:31 -04:00