Commit Graph

694 Commits

Author SHA1 Message Date
Yaron Tausky
768366d7b8 Bug 1496997 - Remove dom.serviceWorkers.parent_intercept pref r=asuth,dom-workers-and-storage-reviewers,perftest-reviewers,jgraham,sparky,webdriver-reviewers,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D101788
2021-06-15 08:52:39 +00:00
Joel Maher
a297be1afe Bug 1699456 - fix message for normal crash path. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D113376
2021-04-26 19:07:46 +00:00
Florian Quèze
8579c53f5b Bug 1706432 - mochitest --profiler should open the captured profile at the end of accessibility tests, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D112800
2021-04-21 15:19:44 +00:00
Andrew Halberstadt
d0cd0fcc69 Bug 1705431 - [mochitest] Refactor MessageLogger.TEST_PATH_PREFIXES into regexes and catch https://mochi.test urls, r=marco
Using regexes will be a little less brittle in the event we change things like
ports or prefix paths.

Differential Revision: https://phabricator.services.mozilla.com/D112354
2021-04-19 12:57:12 +00:00
Joel Maher
224db8c460 Bug 1699456 - When browser-chrome tests have a single test and crash, failures in log processing as the crash is handled in python instead of javascript. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D108958
2021-03-31 22:09:29 +00:00
Geoff Brown
605df9dfee Bug 1698131 - Suppress websocket server errors in mochitests; r=jmaher
mod_pywebsocket3 inherits the stdout and stderr handles of its parent process
(the mochitest harness), so anything printed by the websocket server will appear
in the mochitest log. Most websocket server output is logged to a separate log
file, but exceptions are dumped to stderr.
test_worker_websocket2.html appropriately tests special unicode characters in
the reason code used when closing the websocket. On Windows, under python-3,
the special content of that reason code causes an exception in the mod_pywebsocket3
logging, which is reported to the mochitest log; the test still passes and the
websocket server continues to run correctly, but the exception is picked up by
the treeherder log parser as a "failure".
This patch suppresses the websocket server stderr so that any exception reported
by the websocket server will not affect test status directly.

Differential Revision: https://phabricator.services.mozilla.com/D108308
2021-03-15 13:53:10 +00:00
Geoff Brown
20efec2f73 Bug 1683177 - Improve mochitest web server shutdown and avoid exception under py3 on Windows; r=ahal
The exception seen in this bug can be avoided by simply replacing the terminate() call
with kill(). While we're here, I've tried to simplify the shutdown logic and improve
logging.

Differential Revision: https://phabricator.services.mozilla.com/D107528
2021-03-10 14:24:35 +00:00
Jonathan Kew
ceb44d34d6 Bug 1664730 - Disable async font fallback when running mochitests, to avoid unpredictable extra reflows that can disrupt event-/timing-sensitive tests. r=botond
Differential Revision: https://phabricator.services.mozilla.com/D107284
2021-03-10 12:26:52 +00:00
smolnar
7322fda0de Backed out changeset 1f4840599e64 (bug 1683177) for causing mochitest failures on windows in quota/QuotaManagerService. CLOSED TREE 2021-03-09 01:03:51 +02:00
Geoff Brown
56dac85cb7 Bug 1683177 - Improve mochitest web server shutdown and avoid exception under py3 on Windows; r=ahal
The exception seen in this bug can be avoided by simply replacing the terminate() call
with kill(). While we're here, I've tried to simplify the shutdown logic and improve
logging.

Differential Revision: https://phabricator.services.mozilla.com/D107528
2021-03-08 21:07:56 +00:00
James Graham
b9682a9785 Bug 1695263 - Import marionette from driver not harness, r=marionette-reviewers,whimboo
This avoids a lot of unnecessary extra work and dependencies.

Differential Revision: https://phabricator.services.mozilla.com/D106760
2021-03-03 10:03:03 +00:00
Geoff Brown
a8b25adc35 Bug 1695784 - py3 updates for mochitest with --use-test-media-devices; r=jmaher
Allow for clib text/binary conversions under py3.

Differential Revision: https://phabricator.services.mozilla.com/D106854
2021-03-02 00:16:43 +00:00
Andrew Osmond
49ab54fc3d Bug 1693383 - Part 2. Add 'swgl' for Software WebRender in mochitest manifest parsing. r=jgraham
This matches 'swgl' for reftests.

Differential Revision: https://phabricator.services.mozilla.com/D105663
2021-02-24 18:47:24 +00:00
Joel Maher
f5334a8b26 Bug 1692570 - Allow failure jobs to handle timeouts and crashes for browser-chrome, mochitest, xpcshell. r=releng-reviewers,bhearsum
Allow failure jobs to handle timeouts and crashes for browser-chrome, mochitest, xpcshell.

Differential Revision: https://phabricator.services.mozilla.com/D105057
2021-02-22 19:38:12 +00:00
Csoregi Natalia
fc82ffc2b0 Backed out changeset 7f3db661fd19 (bug 1692570) for mochitest failures on runtests.py. CLOSED TREE 2021-02-22 18:36:32 +02:00
Joel Maher
a9ba91f56d Bug 1692570 - Allow failure jobs to handle timeouts and crashes for browser-chrome, mochitest, xpcshell. r=releng-reviewers,bhearsum
Allow failure jobs to handle timeouts and crashes for browser-chrome, mochitest, xpcshell.

Differential Revision: https://phabricator.services.mozilla.com/D105057
2021-02-22 15:55:59 +00:00
Joel Maher
15c1170047 Bug 1682358 - add --run-failures support to mochitest. r=bhearsum
add --run-failures support to mochitest

Differential Revision: https://phabricator.services.mozilla.com/D102805
2021-01-26 14:41:46 +00:00
Geoff Brown
cc29a5d011 Bug 1688208 - Remove MochitestFormatter to align android and desktop log format; r=jmaher,aryx
The MochitestFormatter adds an additional count and log level, from the mochitest test
harness. As far as I can tell, the MochitestFormatter is not called during desktop tests
(only Android); this difference appears accidental. Removing this log formatter removes
the extra, undesired fields.

Differential Revision: https://phabricator.services.mozilla.com/D102873
2021-01-25 20:55:44 +00:00
Yura Zenevich
09a23bc0e6 Bug 1667998 - add AccessibilityUtils for testing accessibility related issues and use it to check accessibility when EventUtils.sendMouseEvent is used to make a click. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100839
2021-01-15 18:20:37 +00:00
Noemi Erli
8ad2a18a79 Backed out 5 changesets (bug 1667998) for breaking a11y checks CLOSED TREE
Backed out changeset 633dda979b22 (bug 1667998)
Backed out changeset c9838cdb1303 (bug 1667998)
Backed out changeset 501c54cf59be (bug 1667998)
Backed out changeset 615b74c822ec (bug 1667998)
Backed out changeset 6d187c01fcb3 (bug 1667998)
2021-01-15 20:16:06 +02:00
Yura Zenevich
ef01f4bcb9 Bug 1667998 - add AccessibilityUtils for testing accessibility related issues and use it to check accessibility when EventUtils.sendMouseEvent is used to make a click. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100839
2021-01-15 16:52:44 +00:00
Peter Van der Beken
519ec94d44 Bug 1668658 - Add sessionHistoryInParent value for test manifests. r=smaug,jgraham
Differential Revision: https://phabricator.services.mozilla.com/D99666
2020-12-15 15:21:33 +00:00
Bob Clary
1584100fb2 Bug 1681096 - python3 - pylint --py3k - W1618: from __future__ import absolute_import r=perftest-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D98939
2020-12-14 17:50:17 +00:00
Bob Clary
9e125ea710 Bug 1681096 - python3 - pylint --py3k - W1619: from __future__ import division r=marionette-reviewers,perftest-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D98938
2020-12-11 16:05:25 +00:00
Bob Clary
900a0163dc Bug 1681093 - python3 - from __future__ import print_function, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D98937
2020-12-07 19:43:57 +00:00
Mike Hommey
09ba90638d Bug 1679491 - Fail immediately on gst-launch crashes. r=releng-reviewers,aki
The failures in bug 1678451 are a timeout because gst-launch crashes and
makes itself wait indefinitely for $someone to possibly debug the issue,
which, on CI, is not useful. What happens then is that the task is
killed after a while. A more useful thing to do is just to let it crash
and not wait, turning timeouts into immediate task failures.

Differential Revision: https://phabricator.services.mozilla.com/D98040
2020-11-30 17:20:45 +00:00
Andrey Bienkowski
d7875803f2 Bug 1678282 - Redirect subprocess output to mozlog in testing/mochitest/runtests.py r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97559
2020-11-19 15:53:58 +00:00
smolnar
eb39765c34 Bug 1672162 - Fix lint failure in testing/mochitest/runtests. a=lint-fix CLOSED TREE 2020-11-16 17:07:45 +02:00
Christian Holler
44e019d016 Bug 1672162 - Increase mochitest-browser timeout for TSan. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D96981
2020-11-16 14:28:48 +00:00
Bryce Seager van Dyk
9a4fa928ac Bug 1674483 - Only use websocketprocessbridge when running tests tagged with 'webrtc'. r=bwc,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D95409
2020-11-06 22:47:42 +00:00
Cosmin Sabou
4dd521634d Backed out changeset 92fdfa32ce69 (bug 1674483) for gv-junit failures. 2020-11-05 17:28:05 +02:00
Bryce Seager van Dyk
a2128407ca Bug 1674483 - Only use websocketprocessbridge when running tests tagged with 'webrtc'. r=bwc,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D95409
2020-11-05 12:56:24 +00:00
Ricky Stewart
02a7b4ebdf Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Bogdan Tara
da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart
c0cea3b0fa Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Dorel Luca
1ff59cb7a3 Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart
50762dacab Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Paul Adenot
664e8f7256 Bug 1671612 - Fix runtest.py for python3. r=pehrsons
Differential Revision: https://phabricator.services.mozilla.com/D93758
2020-10-20 13:04:31 +00:00
Geoff Brown
b278eee381 Bug 1638974 - Convert mochitest runtests.py to run with Python 3; r=bc
Initial changes to allow mochitests to run in python 3. This works well on Linux,
and almost works on Android. A follow-up will complete the work on Android and
switch mach mochitest over to python 3.

Differential Revision: https://phabricator.services.mozilla.com/D91461
2020-09-28 16:34:53 +00:00
Geoff Brown
a2e1392505 Bug 1390884 - Enable all test-verify chaos modes except TimerScheduling; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D89214
2020-09-02 21:13:40 +00:00
Ricky Stewart
c1a7e97905 Bug 1660128 - Set PYTHONPATH appropriately in testing/mochitest/runtests.py r=ahal
This stamps out an unspoken dependency on `six` in the `mach` `virtualenv`; adding this fixes a bunch of broken tests, namely all those that depend on `pywebsocket_wrapper.py`.

Differential Revision: https://phabricator.services.mozilla.com/D87774
2020-08-20 17:12:04 +00:00
Julian Descottes
f619c49685 Bug 1657806 - Add --verify-fission to run tests once with fission and once without r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D87305
2020-08-17 17:08:54 +00:00
Kershaw Chang
cb8dd8e93e Bug 1640105 - Skip failed tests, r=dragana,remote-protocol-reviewers,necko-reviewers,maja_zf
Differential Revision: https://phabricator.services.mozilla.com/D86224
2020-08-10 09:20:35 +00:00
Mike Hommey
d3c3a026b3 Bug 1657768 - Set temp_file_paths earlier. r=ahal
The finally where it's used may be reached before it is set currently,
leading to more important error messages being hidden.

Differential Revision: https://phabricator.services.mozilla.com/D86281
2020-08-07 14:54:55 +00:00
Geoff Brown
8731a1e19e Bug 1638963 - Run 'mach geckoview-junit' with py3; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D84560
2020-07-22 18:08:02 +00:00
Sarah Bird
d1626da38c Bug 1647501 - Rename "test slave" -> "test machine", r=Gijs
Differential Revision: https://phabricator.services.mozilla.com/D81908
2020-07-02 01:06:01 +00:00
Makoto Kato
0f09630e38 Bug 1599340 - Remote mochitest should consider host's suffix for ssltunnel. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D80588
2020-06-24 04:46:38 +00:00
tkhan
b4821a1c8e Bug 1602668 - Enables xorigin iframe mode for mochitest-plain. r=kmag
Differential Revision: https://phabricator.services.mozilla.com/D70360
2020-06-22 19:10:30 +00:00
Greg Tatum
f2fbbef862 Bug 1644942 - Fix broken --tag command for mochitests; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D79305
2020-06-11 15:53:45 +00:00
Geoff Brown
21fcb0c7bd Bug 1644165 - [mochitest] Guard against missing 'message' in 'log' messages; r=bc
Avoids infrequent intermittent failure.

Differential Revision: https://phabricator.services.mozilla.com/D79168
2020-06-10 19:34:30 +00:00