gecko-dev/dom/imptests
Gregory Szorc dd337c330c Bug 979640 - Make build system error on missing test files; r=ted
Previously, the build system may silently missing test files defined in
manifests. This patch makes missing test files a fatal error, detected
when reading test manifests.

The test_bug872273.html XBL test appeared to be orphaned in
content/xbl/test. It has been reunited with its family.

dom/tests/mochitest/notification referenced a single test file which was
recently deleted. That manifest has been removed.

Missing test files related to the Python unit tests for the build system
have been added. (They are a bunch of empty files.)

--HG--
extra : amend_source : cb6b9bf91e57569c8be312d3c16fef69b2b0b950
2014-03-04 17:48:50 -08:00
..
editing Bug 924160 - Part a: Use mochitest manifests for the tests in dom/imptests; p=gps+Ms2ger r=Ms2ger+gps 2013-10-07 20:56:52 +02:00
failures Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00
html Bug 979640 - Make build system error on missing test files; r=ted 2014-03-04 17:48:50 -08:00
webapps Bug 924160 - Part a: Use mochitest manifests for the tests in dom/imptests; p=gps+Ms2ger r=Ms2ger+gps 2013-10-07 20:56:52 +02:00
editing.txt Bug 866424 - Part c: Use git instead of hg-git to clone upstream test suites; r=jhammel 2013-05-10 09:11:35 +02:00
html.txt Bug 920043 - Update DOM tests from web-platform-tests; f=RyanVM rs=mounir 2013-09-25 19:27:28 +02:00
idlharness.js Bug 885878 - Update testharness.js; r=jgraham 2013-11-28 15:07:56 +01:00
importTestsuite.py Bug 924160 - Part a: Use mochitest manifests for the tests in dom/imptests; p=gps+Ms2ger r=Ms2ger+gps 2013-10-07 20:56:52 +02:00
Makefile.in Bug 943728 - Convert several resource install using double quotes to INSTALL_TARGETS and editor/libeditor/html/tests to mochitest manifest. r=gps,r=mshal 2013-12-03 06:34:21 +09:00
moz.build Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00
parseFailures.py Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00
parseManifest.py No bug - Update parseManifest.py. 2013-09-25 19:25:30 +02:00
README Bug 784841 - Part 15: Produce moz.build files for dom imported tests; r=Ms2ger 2013-02-25 12:46:50 -08:00
reftest.list Bug 859252 - Part c: Hook up the reftests in dom/imptests; r=jhammel 2013-05-10 09:13:19 +02:00
testharness.css Bug 774705 - Part a: Update /resources. 2012-08-04 09:43:59 +02:00
testharness.js Bug 885878 - Update testharness.js; r=jgraham 2013-11-28 15:07:56 +01:00
testharnessreport.js Bug 868426 - Display results table when running testharness.js tests by themselves; r=jhammel 2013-05-10 09:13:25 +02:00
updateTestharness.py Bug 885107 - Sync testharness with the latest upstream. r=Ms2ger 2013-10-01 00:35:32 +09:00
webapps.txt Bug 920043 - Update DOM tests from web-platform-tests; f=RyanVM rs=mounir 2013-09-25 19:27:28 +02:00
WebIDLParser.js Bug 885107 - Sync testharness with the latest upstream. r=Ms2ger 2013-10-01 00:35:32 +09:00
writeBuildFiles.py Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00

This directory contains tests imported from W3C test suites. In order to make it
as easy as possible to update these tests, no changes are made to the imported
files (names for scripted tests do get a test_ prefix to integrate with the test
runner, however). The scripts to update tests are provided.


=======================
Files in this directory
=======================

Source;  Usage and purpose;  License

* testharness.js / testharness.css
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Provide the test harness.
  W3C Test Suite License / W3C 3-clause BSD License

* idlharness.js
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Used to test WebIDL.
  W3C Test Suite License / W3C 3-clause BSD License

* WebIDLParser.js
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Used by idlharness.js to parse IDL blocks.
  MIT License

* updateTestharness.py
  Used to update the above files.
  MPL

* parseManifest.py
  Imported from <https://bitbucket.org/ms2ger/test-runner>. Parses MANIFEST
  files (provided in the W3C repository) as documented at
  <https://bitbucket.org/ms2ger/test-runner/raw/tip/manifests.txt>.
  MIT License

* testharnessreport.js
  Glue between testharness.js and our Mochitest runner.
  MPL

* importTestsuite.py
  Imports a test suite from a remote repository. Takes one argument, a file in
  the format described under webapps.txt.
  Note: removes both source and destination directory before starting. Do not
        use with outstanding changes in either directory.
  MPL

* parseFailures.py
  Parses failures out of a mochitest log and writes out JSON files and Makefiles
  into the correct failures/ folder.
  The mochitest log should be produced by setting the 'dumpFailures' flag in
  testharnessreport.js; this will print out the encountered failures, marked
  by @ signs.
  MPL

* writeBuildFiles.py
  Helper functions to write out automatically generated build files.
  MPL

* Makefile.in
  Integration with our build system. Installs support files into /resources and
  includes a .mk file for each repository.
  MPL

* failures/
  Expected failures for tests in each repository.  Each test's failures, if
  any, are in a file with the same path and name with .json appended.  New
  expected fail files currently needed to be added manually to makefiles.

* html.mk / webapps.mk / ...
  Generated by importTestsuite.py from webapps.txt.
  Contains a list of the directories with tests. To be included in Makefile.in.

* html.txt / webapps.txt / ...
  Input to importTestsuite.py.
  Lists the URL of the repository and the destination directory (separated by a
  vertical bar), followed by a list of directories within the repository
  (separated by line feeds).

* html / webapps / ...
  Actual tests.
  W3C Test Suite License / W3C 3-clause BSD License


=====================================================================
Importing an additional directory from an already-imported repository
=====================================================================

Add a line to the relevant data file (e.g. webapps.txt), with the path to the
additional directory relative to the root of the remote repository, and then run
the importTestsuite.py script, passing the data file as its argument.


==========================
Importing a new test suite
==========================

Create a data file in the format documented above, and run the
importTestsuite.py script, passing the data file as its argument.
This will create a foo.mk file; include this file in dom/imptests/Makefile.in.

Add any necessary files in failures/.