gecko-dev/testing
James Graham c9e960f859 Bug 1363428 - Add reftest-specific endpoints to Marionette, r=ato
This adds commands to start a reftest session, run a test, and end the
session. It as assumed that after you start a reftest session you will
just run reftests until you end the session. When starting a session
the user provides a string indicating when screenshots should be
taken, and an object mapping urls to a count of the number of times
that url is expected to be used in the session, to help with
caching. Running the tests takes a url to a test, an expected status,
a timeout, and a nested list of possible references, in which each
entry at a specific level is combined by OR and nested references are
combined by AND.

The implementation is heavilly inspired by the existing reftest
harness, starting a minimal window with no tabs, and loading the urls
directly in there. In order to get a screenshot in the e10s case we
have to pass the DRAW_VIEW and USE_WIDGET_LAYERS flags when taking the
screenshot.

For performance we heavily cache canvases; for references that will be
repeated we cache the full canvas with image, and we also cache a
single canvas to use for all other screenshots to avoid the overhead
of repeatedly creating a new canvas element.

MozReview-Commit-ID: JOFvtmH7tg

--HG--
extra : rebase_source : ab5a2ef2e450b9bbdc6bc3c9487ed5dfda2c1d4b
2017-05-10 10:51:10 +01:00
..
awsy Bug 1372667 - Part 2: Clean up path_total. r=mccr8 2017-06-14 15:09:49 -07:00
config Bug 1372051 - Remove external media tests from /testing, /build, /python. r=maja_zf 2017-06-12 10:27:42 +12:00
crashtest Bug 1352333 - remove autophone webrtc test manifests, r=dminor. 2017-04-20 14:13:34 -07:00
firefox-ui Bug 1219725 - Add a button for session restore to the tab bar. r=dao,Gijs,mikedeboer,whimboo ui-r=shorlander 2017-06-20 11:33:55 -07:00
geckodriver Bug 1375425 - Remove deprecated commands; r=automatedtester 2017-06-22 10:42:55 +01:00
gtest
instrumentation
marionette Bug 1363428 - Add reftest-specific endpoints to Marionette, r=ato 2017-05-10 10:51:10 +01:00
mochitest Backed out changeset 25838d44520a (bug 1372567) for unexpected assertion counts in and between test_bug394239.html and test_bug402380.html 2017-06-23 08:28:05 -07:00
modules Bug 1374282 - script generated patch to remove Task.jsm calls, r=Mossop. 2017-06-22 12:51:42 +02:00
mozbase Backed out changeset ea9c2e2a07e5 (bug 1375145) for test failures in /mozlog/pytest_mozlog/plugin.py:10:1 2017-06-22 12:13:36 +02:00
mozharness Bug 1372051 - Remove external media tests from /testing, /build, /python. r=maja_zf 2017-06-12 10:27:42 +12:00
profiles Backed out 17 changesets (bug 1363428) for various testfailures 2017-06-21 15:16:00 +02:00
runtimes Bug 1363850 - Part I, Move new about:preferences from in-content/ to in-content-new/, r=jaws,mconley 2017-05-25 18:31:41 +08:00
specialpowers Bug 1375262 - Add the ability to pass sandbox options to SpecialPowers.loadChromeScript(). r=jmaher 2017-06-20 15:50:20 -07:00
talos Bug 1374282 - script generated patch to remove Task.jsm calls, r=Mossop. 2017-06-22 12:51:42 +02:00
tools Bug 1372051 - Remove external media tests from /testing, /build, /python. r=maja_zf 2017-06-12 10:27:42 +12:00
tps Bug 1367567 - Allow non-mpc extensions when running sync's TPS tests r=markh 2017-05-24 17:18:33 -04:00
web-platform Bug 1363428 - Add reftest-specific endpoints to Marionette, r=ato 2017-05-10 10:51:10 +01:00
xpcshell Backed out changeset a0f804d0b487 (bug 1375173) for failing Windows taskcluster builds in selftest.py | XPCShellTestsTests.testAddTaskRunNextTest. r=backout on a CLOSED TREE 2017-06-23 19:08:42 +02:00
cppunittest.ini
mach_commands.py Bug 1371833 - In 'mach test-info', use posix paths for queries; r=jmaher 2017-06-21 13:59:28 -06:00
moz.build Bug 1372051 - Remove external media tests from /testing, /build, /python. r=maja_zf 2017-06-12 10:27:42 +12:00
README.txt
remotecppunittests.py Bug 1355222 - When debug logging requested for android mach test commands, enable devicemanager logging; r=jmaher 2017-04-11 09:21:37 -06:00
runcppunittests.py
testsuite-targets.mk Bug 1359965 - Support and generate tar.gz WPT archive; r=glandium 2017-05-08 17:19:05 -07:00

Common testing tools for mozilla codebase projects, test suite definitions
for automated test runs, tests that don't fit anywhere else, and other fun
stuff