gecko-dev/dom/imptests
Hiroyuki Ikezoe 79959b004c Bug 1196691 - Update testharness.js in imptests. r=Ms2ger
--HG--
extra : rebase_source : a970bd4005e520771b277b58818f95590ebbaac1
2015-08-20 04:23:00 -04:00
..
editing Backed out changeset ecebeba2582c (bug 1008146) for making imptests on Android/B2G nearly permafail. 2015-08-11 14:48:24 -04:00
failures Backed out changeset ecebeba2582c (bug 1008146) for making imptests on Android/B2G nearly permafail. 2015-08-11 14:48:24 -04:00
html Bug 1173288 - Update testharness code in imptests; rs=jgraham 2015-06-20 09:16:51 +02:00
webapps Bug 970925 - convert testing/mochitest/android.json into skip-if statements in mochitest.ini files; r=jmaher 2014-03-12 06:16:12 -04:00
editing.txt
html.txt Bug 920043 - Update DOM tests from web-platform-tests; f=RyanVM rs=mounir 2013-09-25 19:27:28 +02:00
idlharness.js Bug 1173288 - Update testharness code in imptests; rs=jgraham 2015-06-20 09:16:51 +02:00
importTestsuite.py Bug 924160 - Part a: Use mochitest manifests for the tests in dom/imptests; p=gps+Ms2ger r=Ms2ger+gps 2013-10-07 20:56:52 +02:00
mochitest.ini Bug 883092 - Move mochitest support files from Makefile.in to a manifest; r=gps f=Ms2ger 2014-03-21 16:25:55 -07:00
moz.build Backed out changeset ecebeba2582c (bug 1008146) for making imptests on Android/B2G nearly permafail. 2015-08-11 14:48:24 -04:00
parseFailures.py Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00
parseManifest.py No bug - Update parseManifest.py. 2013-09-25 19:25:30 +02:00
README
reftest.list Bug 859252 - Part c: Hook up the reftests in dom/imptests; r=jhammel 2013-05-10 09:13:19 +02:00
testharness.css Bug 1173288 - Update testharness code in imptests; rs=jgraham 2015-06-20 09:16:51 +02:00
testharness.js Bug 1196691 - Update testharness.js in imptests. r=Ms2ger 2015-08-20 04:23:00 -04:00
testharnessreport.js Bug 1134791 - Show the testharness.js output when the browser remains open after running the test; r=bz 2015-03-11 15:43:28 +01:00
updateTestharness.py Bug 885107 - Sync testharness with the latest upstream. r=Ms2ger 2013-10-01 00:35:32 +09:00
webapps.txt Bug 920043 - Update DOM tests from web-platform-tests; f=RyanVM rs=mounir 2013-09-25 19:27:28 +02:00
WebIDLParser.js Bug 1173288 - Update testharness code in imptests; rs=jgraham 2015-06-20 09:16:51 +02:00
writeBuildFiles.py Bug 924160 - Part b: Use mochitest manifests for the expected failures in dom/imptests; r=gps 2014-01-20 08:58:24 +01:00

This directory contains tests imported from W3C test suites. In order to make it
as easy as possible to update these tests, no changes are made to the imported
files (names for scripted tests do get a test_ prefix to integrate with the test
runner, however). The scripts to update tests are provided.


=======================
Files in this directory
=======================

Source;  Usage and purpose;  License

* testharness.js / testharness.css
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Provide the test harness.
  W3C Test Suite License / W3C 3-clause BSD License

* idlharness.js
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Used to test WebIDL.
  W3C Test Suite License / W3C 3-clause BSD License

* WebIDLParser.js
  Directly imported from the W3C repository (<http://dvcs.w3.org/hg/resources>),
  with the updateTestharness.py script.
  Used by idlharness.js to parse IDL blocks.
  MIT License

* updateTestharness.py
  Used to update the above files.
  MPL

* parseManifest.py
  Imported from <https://bitbucket.org/ms2ger/test-runner>. Parses MANIFEST
  files (provided in the W3C repository) as documented at
  <https://bitbucket.org/ms2ger/test-runner/raw/tip/manifests.txt>.
  MIT License

* testharnessreport.js
  Glue between testharness.js and our Mochitest runner.
  MPL

* importTestsuite.py
  Imports a test suite from a remote repository. Takes one argument, a file in
  the format described under webapps.txt.
  Note: removes both source and destination directory before starting. Do not
        use with outstanding changes in either directory.
  MPL

* parseFailures.py
  Parses failures out of a mochitest log and writes out JSON files and Makefiles
  into the correct failures/ folder.
  The mochitest log should be produced by setting the 'dumpFailures' flag in
  testharnessreport.js; this will print out the encountered failures, marked
  by @ signs.
  MPL

* writeBuildFiles.py
  Helper functions to write out automatically generated build files.
  MPL

* Makefile.in
  Integration with our build system. Installs support files into /resources and
  includes a .mk file for each repository.
  MPL

* failures/
  Expected failures for tests in each repository.  Each test's failures, if
  any, are in a file with the same path and name with .json appended.  New
  expected fail files currently needed to be added manually to makefiles.

* html.mk / webapps.mk / ...
  Generated by importTestsuite.py from webapps.txt.
  Contains a list of the directories with tests. To be included in Makefile.in.

* html.txt / webapps.txt / ...
  Input to importTestsuite.py.
  Lists the URL of the repository and the destination directory (separated by a
  vertical bar), followed by a list of directories within the repository
  (separated by line feeds).

* html / webapps / ...
  Actual tests.
  W3C Test Suite License / W3C 3-clause BSD License


=====================================================================
Importing an additional directory from an already-imported repository
=====================================================================

Add a line to the relevant data file (e.g. webapps.txt), with the path to the
additional directory relative to the root of the remote repository, and then run
the importTestsuite.py script, passing the data file as its argument.


==========================
Importing a new test suite
==========================

Create a data file in the format documented above, and run the
importTestsuite.py script, passing the data file as its argument.
This will create a foo.mk file; include this file in dom/imptests/Makefile.in.

Add any necessary files in failures/.