gecko-dev/remote
Emilio Cobos Álvarez 7881b1d9c1 Bug 1917458 - Fix puppeteer/remote tests after D221995. r=webdriver-reviewers,webidl,smaug,jdescottes
Calling setViewport on a background tab would wait forever without this
tweak after D221995, because we won't resize it until it becomes active.

Some tests like the ones mentioned in comment 12 call newPage() multiple
times at once, and newPage() calls setViewport() if there is a default
viewport set, which triggered this bug.

Make this work by reusing the AppWindow logic for sizing popup windows,
with a tweak so that we also resize background tabs.

Differential Revision: https://phabricator.services.mozilla.com/D222227
2024-09-16 13:21:51 +00:00
..
cdp Bug 1917524 - [cdp] Disable network.cookie.useServerTime for CDP network mochitests r=webdriver-reviewers,whimboo 2024-09-10 07:50:58 +00:00
components Bug 1898719 - [remote] Use private properties and methods in Remote Agent and WebDriver BiDi classes. r=webdriver-reviewers,jdescottes 2024-06-06 07:37:25 +00:00
doc Bug 1882089 - [remote] Do not enable CDP protocol by default. r=webdriver-reviewers,jdescottes 2024-06-12 08:57:38 +00:00
marionette Backed out 6 changesets (bug 1915798, bug 1904665, bug 1918049) for causing wpt failures in input-events-get-target-ranges-joining-dl-elements.tentative.html CLOSED TREE 2024-09-13 05:13:41 -04:00
server
shared Backed out 6 changesets (bug 1915798, bug 1904665, bug 1918049) for causing wpt failures in input-events-get-target-ranges-joining-dl-elements.tentative.html CLOSED TREE 2024-09-13 05:13:41 -04:00
test/puppeteer Bug 1915798 - [remote] Add support for "Action queues" to sequencially perform actions without races. r=webdriver-reviewers,jdescottes 2024-09-13 07:32:20 +00:00
webdriver-bidi Bug 1917458 - Fix puppeteer/remote tests after D221995. r=webdriver-reviewers,webidl,smaug,jdescottes 2024-09-16 13:21:51 +00:00
.gitignore
jar.mn Backed out 6 changesets (bug 1915798, bug 1904665, bug 1918049) for causing wpt failures in input-events-get-target-ranges-joining-dl-elements.tentative.html CLOSED TREE 2024-09-13 05:13:41 -04:00
mach_commands.py Bug 1913832 - [puppeteer] Fix expectations filter for puppeteer-test command r=webdriver-reviewers,Sasha 2024-08-20 19:45:12 +00:00
moz.build
README.md

The Firefox remote agent is a low-level debugging interface based on the CDP protocol.

With it, you can inspect the state and control execution of documents running in web content, instrument Gecko in interesting ways, simulate user interaction for automation purposes, and debug JavaScript execution.

This component provides an experimental and partial implementation of a remote devtools interface using the CDP protocol and transport layer.

See https://firefox-source-docs.mozilla.org/remote/ for documentation.

It is available in Firefox and is started this way:

% ./mach run --remote-debugging-port

Puppeteer

Puppeteer is a Node library which provides a high-level API to control Chrome, Chromium, and Firefox over the Chrome DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) browsers.

To verify that our implementation of the CDP protocol is valid we do not only run xpcshell and browser-chrome mochitests in Firefox CI but also the Puppeteer unit tests.

Expectation Data

With the tests coming from upstream, it is not guaranteed that they all pass in Gecko-based browsers. For this reason it is necessary to provide metadata about the expected results of each test. This is provided in a manifest file under test/puppeteer-expected.json.

For each test of the Puppeteer unit test suite an equivalent entry will exist in this manifest file. By default tests are expected to PASS.

Tests that are intermittent may be marked with multiple statuses using a list of possibilities e.g. for a test that usually passes, but intermittently fails:

"Page.click should click the button (click.spec.ts)": [
  "PASS", "FAIL"
],

Disabling Tests

Tests are disabled by using the manifest file test/puppeteer-expected.json. For example, if a test is unstable, it can be disabled using SKIP:

"Workers Page.workers (worker.spec.ts)": [
  "SKIP"
],

For intermittents it's generally preferable to give the test multiple expectations rather than disable it.

Autogenerating Expectation Data

After changing some code it may be necessary to update the expectation data for the relevant tests. This can of course be done manually, but mach is able to automate the process:

mach puppeteer-test --write-results

By default it writes the output to test/puppeteer-expected.json.

Given that the unit tests run in Firefox CI only for Linux it is advised to download the expectation data (available as artifact) from the TaskCluster job.