Commit Graph

3205 Commits

Author SHA1 Message Date
Andrew Halberstadt
6b65448914 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc

--HG--
extra : rebase_source : b81ab806cd2455f4e4fc761863fe699feadd0bb5
2017-09-26 10:47:22 -04:00
Sebastian Hengst
b1575a7d2b Backed out changeset ddfc127526b2 (bug 1403222) for failing python/mozbuild/mozbuild/test/frontend/test_reader.py::TestBuildReader::test_schedules, at least for Linux asan opt builds. r=backout on a CLOSED TREE 2017-10-02 16:03:12 +02:00
Andrew Halberstadt
ef896de9c0 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc

--HG--
extra : rebase_source : 6c456c91985f2006910bda66fdbc5d18e066d020
2017-09-26 10:47:22 -04:00
Mark Banner
79b29f1549 Bug 1402248 - Disable idle-daily during mochitests to avoid possible background interactions that might cause intermittents. r=jmaher
Set the idle preference to be the current time, so that idle-daily won't kick in for 24 hours.

MozReview-Commit-ID: 6OJCSm8RaeZ

--HG--
extra : rebase_source : 71217263ddd5b9299e8463254f48ad2d9918b8a2
2017-10-02 11:10:15 +01:00
Geoff Brown
308a809310 Bug 1403501 - Do not kill non-orphan xpcshell/ssltunnel; r=bc 2017-09-29 10:40:24 -06:00
Geoff Brown
d054111cf9 Bug 1404012 - Break out of multi-flavor |mach mochitest| with one ctrl-c; r=jmaher 2017-09-29 10:40:21 -06:00
Sebastian Hengst
73fac0091d Backed out changeset dbe60b600dc0 (bug 1397853) for failining linter py-compat at testing/mochitest/runtests.py:2236. r=backout 2017-09-28 14:58:36 +02:00
Andrew Halberstadt
35b752c904 Bug 1403325 - Use a single --sandbox-read-whitelist argument in mochitest and reftest, r=Alex_Gaynor
The main bug this fixes is that on reftest, the objdir needs to be added to the
whitelist on Windows. However, this only happens when running on Linux for some
reason.

Changing the --work-path and --obj-path arguments to --sandbox-read-whitelist
was more of a drive-by cleanup than anything necessary.

MozReview-Commit-ID: Dq8ZLETMzeM

--HG--
extra : rebase_source : 3d2cdda125205e76f86235eb373074899fe0789a
2017-09-26 16:36:43 -04:00
Steve Armand
f8318d16e8 Bug 1397853 - Enable py2 and py3 linter on testing/mochitest. r=ahal
MozReview-Commit-ID: EhkNhyFHDox

--HG--
extra : rebase_source : 5200a985034c7ca0a494bc7d02a4c842e85dec3a
2017-09-24 21:28:25 -04:00
Henrik Skupin
abd06348eb Bug 1403616 - Defer logging of Marionette IOError to after post-test checks. r=gbrown
If Firefox crashes while mochitests or reftests are running, Marionette
will trigger an IOError exception which currently gets logged immediately,
and causes no post-test checks to be performed. This results in missing
crash and leak checks, and an unclear failure message on Treeherder.

With this change only the IOError from Marionette gets deferred until
all post-test checks are done. This fixes the failure messages, and will
put PROCESS_CRASH or leak log output first.

MozReview-Commit-ID: JCYP5LlPE1m

--HG--
extra : rebase_source : a4a9455402b01db8ef1dbafccc7a726d2927ec03
2017-09-27 21:07:44 +02:00
Geoff Brown
1e26b50be4 Bug 1390884 - Enable limited test chaos mode in test-verify; r=jmaher
This adds new test verification steps for mochitest/reftest/xpcshell tests
with MOZ_CHAOSMODE=3 (thread scheduling and network thread scheduling).
Enabling all chaos mode features seems to destabilize test verification
so I am only enabling these features for now.
2017-09-26 13:20:28 -06:00
Andrew Halberstadt
7527e600f0 Bug 1392787 - Disable manifestparser tests using 'disabled' key instead of comment, r=jmaher
MozReview-Commit-ID: IQL7hWxQX9F

--HG--
extra : rebase_source : b78cbf7913fc1b0a27dfa085c38957e2bc2467d0
2017-08-22 16:56:02 -04:00
Greg Mierzwinski
1c079bc66d Bug 1400683 - Add 'coverage' field to mozinfo to disable tests on linux64-jsdcov. r=jmaher
This patch makes it possible to disable mochitest-devtools tests on linux64-jsdcov through the 'coverage' flag.

MozReview-Commit-ID: 1gkgbFo19MZ

--HG--
extra : rebase_source : 9c6d311cb467e4424d42848e1caf024f9702b8cd
2017-09-17 16:00:07 -04:00
Ryan VanderMeulen
ecdacdf4a0 Merge m-c to autoland. a=merge 2017-09-15 14:20:34 -04:00
Henrik Skupin
03d4b0f51c Bug 1399592 - Increase Marionette startup timeout for mochitest/reftest. r=gbrown
Currently the mochitest and reftest runners are forcing a timeout of 60s
(or 900s for valgrind or debug builds) when calling `start_session` of
Marionette. While this method still offers a timeout parameter, the
timeout should be set via the `startup_timeout` argument for Marionette.

Reason is that Marionette doesn't control the browser instance and
is getting called right after the application gets launched. As such
slow running builds can cause timeouts once it takes longer than 60s
for the Marionette server to get started.

By using `startup_timeout` the timeout will even be configurable via
the command line and mozharness config files.

MozReview-Commit-ID: EV7GklBcJjU

--HG--
extra : rebase_source : 9d3c623c49deb92d68c40ba4410c812c864e06bd
2017-09-14 16:18:58 +02:00
Geoff Brown
d289ad01ba Bug 1391694 - Avoid false shutdown leaks in browser-chrome tests with --repeat; r=jmaher
This patch re-organizes control flow in the browser-chrome harness so that
extra memory cleanup only happens just before the browser is closed, even
when running with --repeat.
2017-09-15 07:29:44 -06:00
Geoff Brown
080cbb4052 Bug 1399769 - Do not modify runtests.py return code for failed tests; r=jmaher
Bug 1394910 modified the runtests.py return code when one or more tests
failed, but that causes mozharness to emit a starrable error. This patch
returns to the old behavior of normally returning 0 from runtests.py when
tests fail. To allow for test verification, verifyTests() is updated to
explicitly check for failed tests, instead of relying on the runTests()
return code.
2017-09-14 11:07:48 -06:00
Sebastian Hengst
006a58c35d merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: 2iVDKexRjxu
2017-09-13 23:58:43 +02:00
Geoff Brown
59295bdd27 Bug 1394910 - Return failed status from mochitest harness when one or more tests fail; r=jmaher 2017-09-13 08:27:18 -06:00
Andrew Halberstadt
9efc4d301f Bug 1392390 - Refactor common code out of mochitest selftests and into a new moztest.selftest module, r=jmaher
This includes code for downloading a Firefox binary, downloading + setting up a tests.zip and
running output through mozharness' output parsers. This is all stuff that will also be required
for the reftest selftests.

I couldn't think of a better location to put this stuff, suggestions welcome.

MozReview-Commit-ID: 59TSbsugT5T

--HG--
extra : rebase_source : a328f6bc90e73fe23f9054933cd01a30065419f6
2017-09-11 16:06:06 -04:00
Kris Maglione
e99cced382 Bug 1371065: Part 1 - Remove external references to the add-on SDK. r=Mossop,glandium
MozReview-Commit-ID: D5KyHcg8Ujk

--HG--
extra : rebase_source : 1a74ccb2963f2946a49c8bf720af595151b48fd1
2017-09-12 11:54:47 -07:00
Kris Maglione
f829523282 Bug 1371065: Part 0 - Fix unit tests that use the SDK loader :/ r=Mossop
MozReview-Commit-ID: 4ewrbY0FS09

--HG--
extra : rebase_source : 390256a9eb0d303d8582c24d69fff189b0e0ab4d
2017-09-08 18:16:50 -07:00
Geoff Brown
fcaf64fa27 Bug 1398953 - Set runUntilFailure in mochitest with --verify option; r=jmaher 2017-09-12 08:51:19 -06:00
Andrew McCreight
2b68b38709 Bug 1377587, part 1 - Always act like __exposedProps__ is missing. r=krizsa
This patch gently removes support for __exposedProps__ by changing
ExposedPropertiesOnly::check() to always return false, while still
failing silently in deny for some kinds of access.

The tests that I changed all involve testing the behavior with
__exposedProps__. I adjusted them to expect it to fail, or to adjust
the error message they get when they fail. That seemed better than
deleting them entirely.

Note that test_bug1065185.html had a bug, so that it never executed
the first case. I fixed that, and then fixed up the test to work when
__exposedProps__ is not supported.

This also removes various bits of the test framework that use
__exposedProps__, but don't actually need to.

MozReview-Commit-ID: 8fvkAmITmXY

--HG--
extra : rebase_source : ef7e2c55adc12511f17f3865ebb46c343875f0b3
2017-08-22 14:24:11 -07:00
Chris Manchester
c0a229d4c3 Bug 1386876 - Replace all uses of DISABLE_STL_WRAPPING with a template, remove DISABLE_STL_WRAPPING. r=glandium
MozReview-Commit-ID: FMEtb5PY7iP

--HG--
extra : rebase_source : 3cdee7528846462c758e623d6bcd2e6e17dbabff
2017-09-11 11:33:26 -07:00
Michael Layzell
63ecbc4c55 Bug 1199729 - Part 4: Update EventUtils to simulate drag events more accurately, r=baku 2017-09-08 11:05:08 -04:00
Perry Jiang
491c7f5d8c Bug 1393582 - Remove CastingApps support for Firefox desktop. r=felipe
MozReview-Commit-ID: B2bqiNXibPP
2017-08-25 14:03:47 -07:00
Andrew Halberstadt
f79b06a32a Bug 1339178 - Use pytest to run python-tests, r=davehunt
This switches most tests over to use pytest as the runner instead of unittest (taking
advantage of the fact that pytest can run unittest based tests).

There were a couple tests that had failures when swithing to pytest:
config/tests/unit-expandlibs.py
xpcom/idl-parser/xpidl/runtests.py

For these tests, I added a runwith='unittest' argument so that they still run the
same way as before. Once we fix them to use pytest, the unittest logic in mozunit.py
can be deleted.

MozReview-Commit-ID: Gcsz6z8MeOi

--HG--
extra : rebase_source : 3c762422ce0af54cbbe7d9fc20085a2d1ebe7057
2017-08-29 14:50:33 -04:00
Wes Kocher
a8e6d0bd2c Merge m-c to inbound, a=merge
MozReview-Commit-ID: 7XpmaFg1k8N
2017-08-29 16:17:13 -07:00
Geoff Brown
0c1b12715e Bug 1386816 - Kill any xpcshell or ssltunnel already running at start of tests; r=jmaher
This renames killNamedOrphans to killNamedProc and removes the check for
parent proc id, so that any xpcshell or ssltunnel process is killed before
starting a mochitest or reftest run. For reftests, this is moved out of
the desktop harness and into the remote/android harness, since desktop
reftests do not use xpcshell or ssltunnel.
2017-08-29 15:44:18 -06:00
Sebastian Hengst
ca3d97b658 merge mozilla-central to autoland. r=merge a=merge 2017-08-29 20:31:58 +02:00
Sebastian Hengst
2a9cc8e3be merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: BQuBmVtsdki
2017-08-29 20:30:41 +02:00
Kris Maglione
83ac7dd4fb Bug 1394479: Only override Services.scriptloader for XPCOMUtils. r=florian
Overriding Services.scriptloader has a lot of consequences in terms of path
name magling and choice of target global when no target object is passed.
Since this test code doesn't care about callers outside of XPCOMUtils, it
should only override the instance used by XPCOMUtils, and not the instance
used by other callers.

MozReview-Commit-ID: 2LEchjzn0U5

--HG--
extra : rebase_source : 739fe2b03adb0b4637056b25d6b747a4e1f5a4a9
2017-08-28 09:51:08 -07:00
Kris Maglione
c5a2868365 Bug 1394467: Remove unused procompileScript method. r=mccr8
MozReview-Commit-ID: 6s2Nqtcd9uS

--HG--
extra : rebase_source : ec4f96e7281e3f72be01aeb8faa1c9b34a61f534
2017-08-28 09:21:46 -07:00
Botond Ballo
dc075dbdbc Bug 1390964 - Do not clobber an existing LD_LIBRARY_PATH in the mochitest harness. r=ted
MozReview-Commit-ID: 7uQ71Jpq1lM

--HG--
extra : rebase_source : 2383db7abceea790dbb837ddfa501626492159b4
2017-08-16 13:25:01 -04:00
J. Ryan Stinnett
a3ff9bdc0e Bug 1393234 - Add --disable-stylo for desktop tests. r=jmaher
MozReview-Commit-ID: 3wBxpOjYqC1

--HG--
extra : rebase_source : 3fb96b85e743d74d22dd0c74473a66b7ef640809
2017-08-24 16:16:40 -05:00
Sebastian Hengst
85113c4391 Backed out changeset fa04de352d99 (bug 1390964) for linting failure at gecko/testing/mochitest/runtests.py:420: test for membership should be 'not in'. r=backout 2017-08-28 20:42:37 +02:00
Botond Ballo
0427d1e846 Bug 1390964 - Do not clobber an existing LD_LIBRARY_PATH in the mochitest harness. r=ted
MozReview-Commit-ID: 7uQ71Jpq1lM

--HG--
extra : rebase_source : 451b8117427609f9528ed6549937d5be817e6e53
2017-08-16 13:25:01 -04:00
Tooru Fujisawa
edfe01e5ed Bug 1393160 - Detect visibility of the drag event target and fail if hidden. r=smaug 2017-08-27 21:03:31 +09:00
Eric Rahm
0938982c90 Bug 1389598 - Part 4: Remove remaining gonk refs. r=froydnj
--HG--
extra : rebase_source : 063c7f95dda063eafabfa1921366bd1957b8fe73
2017-08-11 17:45:18 -07:00
Wes Kocher
1d9f00cb8d Merge inbound to m-c a=merge
MozReview-Commit-ID: CQeEqtGlaXh
2017-08-17 16:16:51 -07:00
Gian-Carlo Pascutto
f4a0bc4497 Bug 1386826 - Whitelist the objdir, so _tests gets covered. r=jmaher
MozReview-Commit-ID: 8SHk1Pfy37I

--HG--
extra : rebase_source : 3944e20e310dda395e67ba9b1e33747413dea84e
2017-08-16 19:03:09 +02:00
Wes Kocher
9e13a44b54 Merge inbound to central, a=merge
MozReview-Commit-ID: GEfEDRZk5bo
2017-08-16 16:59:26 -07:00
Geoff Brown
f735ed7396 Bug 1388883 - Ensure a fresh necko cache for each mochitest and reftest run; r=bc 2017-08-16 06:55:49 -06:00
Wes Kocher
cb3e58d017 Merge m-c to inbound, a=merge
MozReview-Commit-ID: ENNd2QVktmQ
2017-08-16 17:07:52 -07:00
Geoff Brown
86e38e0e40 Bug 1390884 - Do not use chaos mode for test verification; r=jmaher
Chaos mode for test verification doesn't quite work -- it is a bit flaky still.
I intend to come back to it at a later date.
2017-08-16 16:42:41 -06:00
Chung-Sheng Fu
f7ccc499ad Bug 1382499 - Fix typo in testing/mochitest/tests/SimpleTest/EventUtils.js r=smaug
MozReview-Commit-ID: B6wo6Px54jk

--HG--
extra : rebase_source : efbba991267c78caca0f5c224e59cafc5c0ecb02
2017-08-03 16:02:07 +08:00
Stone Shih
55c5359fa6 Bug 1351148 Part4: Revise those test cases that have some tasks have to be processed before or after the synthesized key events. r=smaug.
Make sure input events are processed before or after the dependent tasks.

MozReview-Commit-ID: 8KfZnT2wjJR
2017-06-07 14:28:16 +08:00
Sebastian Hengst
56c035fa36 merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: 4cZJ3qFjvPY
2017-08-12 23:49:21 +02:00
Geoff Brown
dad38365b5 Bug 1389500 - Fix |mochitest --verify| by not popping prefs; r=ahal 2017-08-11 14:30:25 -06:00