Commit Graph

105 Commits

Author SHA1 Message Date
Stephen Pohl
8ad576d66a Bug 1091109: Don't sign webapprt-stub on OSX because webapps fail to launch due to quarantine bit. r=smichaud,myk 2014-11-03 17:13:16 -05:00
Ryan VanderMeulen
b1e25526d8 Backed out changeset 5eebce6c8845 (bug 1091109) for webapp test failures. 2014-11-01 00:15:44 -04:00
Stephen Pohl
5070442475 Bug 1091109: Don't sign webapprt-stub on OSX because webapps fail to launch due to quarantine bit. r=smichaud,myk 2014-10-31 20:39:07 -04:00
Gijs Kruitbosch
5b24249161 Bug 1052211 - fix default closure behaviour for mochitests and add --auto-close option to force closing the browser, r=ted 2014-09-11 15:29:57 +01:00
Bob Owen
e688081dc5 Bug 1067301 - Add mach / mochitest option to run tests with Windows content sandbox. r=jmaher 2014-09-16 08:20:07 +01:00
Edwin Flores
8bbbd93848 Bug 1044742 - Make ClearKey CDM accessible to mochitests - r=ted 2014-09-24 10:04:49 +12:00
Dave Townsend
f485086973 Bug 1035512: Add a new common JS testing harness based on the mochitest test runner. r=gps, ted, erikvold, jmaher 2014-09-22 11:08:06 -07:00
Nick Alexander
d4924c9fdf Bug 874729 - Part 4: Add |mach robocop|. r=gps 2014-09-08 16:23:12 -07:00
Tomasz Kołodziejski
41c67f83a4 Bug 1057453 - 'mach test filename' should test a single file. r=gps 2014-09-03 13:06:00 +02:00
Ahmed Kachkach
9bd3b0b779 Bug 1056329 - Activate structured logging command line args for other mochitest suites. r=ahal 2014-08-25 12:32:00 -04:00
Qeole
158c324a97 Bug 1045209 - Updating tests for new OpenH264 plugin path handling. r=unfocused,ted,jmaher 2014-08-25 17:23:34 +02:00
Gijs Kruitbosch
860badb714 Bug 1057328 - get gmp path for app-override tests, r=ted
--HG--
extra : rebase_source : 19485859be5c0660d36242e2920fa3d4ca662666
2014-08-22 16:28:04 +02:00
Ahmed Kachkach
1b49fb456b Bug 1039833 - Add structured logging command line arguments for mochitest/mach. r=chmanchester, r=ahal 2014-08-13 12:03:00 -04:00
Ryan VanderMeulen
0e89667592 Merge inbound to m-c. a=merge 2014-08-09 11:19:46 -04:00
Sylvestre Ledru
2e0c1ce1ec Bug 1050715 - Update the description of the various tests targed proposed by './mach help' r=jmaher
--HG--
extra : rebase_source : 29019a02711ffce5c148787517051855259b6446
2014-08-09 15:37:29 +02:00
Gijs Kruitbosch
5b42ea6c7f Bug 1051066 - fix mochitest-chrome for single test runs, r=ted
--HG--
extra : rebase_source : 85ddaf183d33014d86b5659db10871b9ae2abc94
2014-08-09 09:26:53 +01:00
Ryan VanderMeulen
a3bcb78c14 Merge fx-team to m-c. a=merge 2014-08-07 17:24:52 -04:00
Steven Lee
54cb6b62ce Bug 1046515 - Add support for the "repeat" and "run-until-failure" mach commands on B2G. r=ahal 2014-08-04 23:29:00 -04:00
Ahmed Kachkach
af98d35b3f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
634b6a5ff0 Bug 1042979 - Clean up unused imports, variables, and dead code in mochitest. r=ahal 2014-07-24 06:23:00 +02:00
Jonathan Griffin
987efb80fa Bug 1042270 - Add is_mulet condition to mach, r=ahal 2014-07-22 14:41:09 -07:00
Ahmed Kachkach
53fb82ea68 Bug 1041944 - Printing mochitest failures at the end of the execution (with mach). r=ahal 2014-07-22 11:56:00 +02:00
Gijs Kruitbosch
1547c6dfb4 Bug 1014062 - expose harness parameters via SimpleTest, always use the harness, pass keep-open for single test runs with mach, r=ted,f=bz
--HG--
extra : rebase_source : 494615dbe437053ea65079a2c5016782a7bee0a2
2014-05-22 20:09:21 +01:00
Andrew Halberstadt
8c7e960ba4 Bug 1037858 - B2G mochitest mach command should fail early if running with PRODUCTION=1 or VARIANT=user, r=jgriffin, DONTBUILD, a=NPOTB 2014-07-17 13:38:20 -04:00
Giovanni Sferro
357bf55627 Bug 1032530 - mach mochitest takes --setpref argument. r=gps 2014-07-13 10:04:00 +02:00
Ting-Yu Lin
dea8ddcd04 Bug 982560 - Fix mach fails to find tests in subdirectory. r=gps
Make the test paths relative to topsrcdir before passing them to
TestResolver. Also do not passing cwd to TestResolver since it will
filter out tests that do not live under the directory where the mach
command is executed.

Verification steps:
Execute a mach test command from any subdirectory. For example:
$ cd testing/tps/
$ ../../mach xpcshell-test ../../services/fxaccounts/tests/xpcshell/
$ ../../mach test ../../services/fxaccounts/tests/xpcshell/
2014-07-01 23:21:00 +02:00
Vaibhav Agrawal
be65f1bbce Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Andrew Halberstadt
b11804bb36 Bug 1028746 - Running mach mochitest-remote from gecko srcdir raises AttributeError instead of being helpful, r=gps, DONTBUILD, a=NPOTB 2014-06-24 13:47:19 -04:00
Wes Kocher
387f8bb39f Merge m-c to fx-team 2014-06-19 18:33:19 -07:00
Gregory Szorc
f94d9adf59 Bug 920193 - mach mochitest can now receive test objects; r=AutomatedTester
Similar to the previous patch, we now teach `mach mochitest` how to
execute test objects directly.

--HG--
extra : rebase_source : b69b5b74bcf6c81cff5deb28a1156ab2fcc691f7
2014-06-18 11:19:45 -07:00
Gregory Szorc
f3a669b6b1 Bug 938712 - Add --flavor to mach mochitest; r=AutomatedTester
`mach mochitest` now accepts a --flavor argument to limit execution to
tests of a certain flavor. Executing `mach mochitest --flavor=X` should
be equivalent to executing `mach mochitest-X`.

This paves the road to deprecating the various `mach mochitest-X`
commands.

--HG--
extra : rebase_source : 0f8370425f54a4ec86e7f668bcbff69362e017f7
2014-06-17 15:49:41 -07:00
Gregory Szorc
257d7cb1f2 Bug 938712 - Implement mach mochitest; r=AutomatedTester
The `mach mochitest` command is now implemented. Given test path
arguments, it will identify mochitests of any flavor and run the
appropriate mochitest suite.

If tests from multiple suites are present, it will invoke each suite
separately. Although, the output in this mode isn't very friendly.

There are a number of enhancements that could be made to this command,
including the abilities to filter by flavor and sub-suite. These will
come in another patch.

--HG--
extra : rebase_source : 9be6000e6bb508ef0c980eda9f9ebe03a4c0f02a
2014-06-17 15:42:08 -07:00
Andrew Halberstadt
e60605718c Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Joel Maher
08a5fa35e7 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Carsten "Tomcat" Book
78c2dc6adc Backed out changeset 86d0bd2a0233 (bug 992911) for android 2.3 bustage 2014-06-02 13:36:51 +02:00
Joel Maher
49f419b353 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-02 06:54:23 -04:00
Andrew Halberstadt
c2b2c17ee5 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Boris Zbarsky
740465ec29 Bug 990289. Make running a single mochitest run it in a way where the subtest results can be accessed. r=ted 2014-05-08 22:20:54 -04:00
Ted Mielczarek
59841f10b0 bug 815002 - allow using loopback devices in WebRTC mochitests on Linux when available. r=jsmith,jmaher 2014-05-01 07:18:00 -04:00
Gijs Kruitbosch
0b34d934a0 Bug 1004410 - allow running mochitests against an arbitrary binary, r=jmaher
--HG--
extra : rebase_source : ba7e34aaffe2dd845b8717a34dc27c7f59983534
2014-05-01 11:05:36 +01:00
Vicamo Yang
d97ffaef80 Bug 996443: carry emulator arch automatically for mach commands. r=ahal 2014-05-01 00:57:39 +08:00
Nathan Froyd
497cdb9d36 Bug 999407 - add --setenv option for mochitests run through mach; r=jmaher
DONTBUILD because NPOTB
2014-04-22 09:09:47 -04:00
Manish Goregaokar
17f55bc6ed Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Ms2ger
161b37e9c0 Backed out changeset c63d8f19a893 for failures in Android mochitests. 2014-04-12 12:00:37 +02:00
Manish Goregaokar
91a087f85c Bug 991348 - Support taking screenshots on all test failures in mochitests; r=jmaher 2014-04-12 11:08:34 +02:00
Michael Ratcliffe
d0f5dae6ab Bug 983948 - Add mach mochitest-devtools r=jmaher 2014-03-25 16:52:53 +00:00
Vicamo Yang
e58c108d84 Bug 975442: recognize as emulator if device name begins with 'emulator'. r=jgriffin 2014-04-09 10:14:07 +08:00
Nathan Froyd
65f2050ac7 Bug 969437 - part 1 - introduce a --quiet option for mochitests; r=jmaher 2014-03-07 11:42:07 -05:00
Gregory Szorc
4ff214391e Bug 987414 - Pass multiple test arguments to mach testing commands; r=ahal
Previously, mach xpcshell-test and mochitest-* were limited to a single
test "path" argument. This patch enables multiple arguments to be passed
in.

TestResolver in the build system has gained the ability to process
multiple paths in a single invocation. The mach commands have been
modified to utilize this new feature.

Only mach code paths that pass manifestdestiny.TestManifest instances
into the test runner can accept multiple arguments. This is because
there is no other way to pass a custom set of tests into the test
runner. If multiple test arguments are used but not supported, a warning
is emitted.

--HG--
extra : rebase_source : 1ce1328a969f654e7b43a7a0bdd15ed86f5ceb21
2014-03-24 16:19:57 -07:00
Gregory Szorc
ad523f117c Bug 987398 - Part 1: Run mochitests from manifests with mach; r=ahal
The mochitest mach commands now consult the all-tests.json file for
resolving the test argument/path. The mochitest runner has been modified
to accept a manifestdestiny.TestManifest instance instead of a path to a
manifest file. The mach commands construct an in-memory TestManifest and
pass it to the mochitest runner.

While I was here, I cleaned up some old JSON serializing code.

--HG--
extra : rebase_source : 886b13d4cb35992c132bc3051925424609a5fdf8
2014-03-24 14:35:06 -07:00