Commit Graph

108 Commits

Author SHA1 Message Date
Cosmin Sabou
53c2d5ebb9 Backed out 2 changesets (bug 1628527) for causing wpt failures and a spike in bug 1622119. CLOSED TREE
Backed out changeset d9dfb6439761 (bug 1628527)
Backed out changeset 8235287622a8 (bug 1628527)
2020-04-21 23:12:09 +03:00
Tooru Fujisawa
2108f90fcf Bug 1623965 - Improve error message when binary not found while testing. r=glandium,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,Bebe,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D67726
2020-04-21 11:58:04 +00:00
Nicholas Nethercote
88cd51aa6d Bug 1628527 - Introduce explicit initialization and finalization of fix-stacks. r=erahm,perftest-reviewers,sparky,gbrown
Currently AWSY-with-DMD doesn't work on Windows. This is because `fix-stacks`
is initialized lazily, and by the time the initialization happens some file
descriptors for files are open, and that leads to some major Python2-on-Windows
sadness as described in the big comment in the commit.

To fix the problem, this commit adds an `init` function to `fix_stacks.py` so
that `fix-stacks` can be initialized eagerly, hopefully before any file
descriptors for files are open.

For `dmd.py`, other than fixing the AWSY problems, this has little effect,
because `fix-stacks` is always initialized.

For `utils.py`, which is used to process the output of most tests, this has a
more noticeable effect: the `fix-stacks` process is always spawned, rather than
being spawned only when needed. If no stack traces appear in the test output,
this means that `fix-stacks` is spawned unnecessarily. But it's cheap to spawn;
the expensive part only happens when stack traces start getting fixed. So I
think this change in behaviour is acceptable.

Furthermore, the commit adds a `finish` function to `fix_stacks.py`, so that
the `fix-stacks` process can be explicitly shut down. This has never been done
for processes spawned for any of the stack fixing scripts. It's never caused
problems on Linux/Mac, but it seems to be necessary on Windows to avoid
similar "this file is locked" problems with the test_dmd.js test.

The commit also renames some things to more standard Python style, e.g.
`json_mode` instead of `jsonMode`.

Finally, Android tests use `utils.py` from the repository but `fix_stacks.py`
from the Android host utils. Because the two scripts must be updated in tandem,
this commit also updates the Android host utils to a version that contains the
updated `fix_stacks.py`. Thanks to aerickson for packaging up the new Android
host utils and providing the change to the `hostutils.manifest` file.

Differential Revision: https://phabricator.services.mozilla.com/D69478
2020-04-20 22:43:25 +00:00
Nicholas Nethercote
8f6eed94e5 Bug 1626272 - Disable stack fixing on Windows awsy-dmd jobs. r=erahm,perftest-reviewers,sparky
Unfortunate, but it gets us back to where we were before `fix_stacks.py` came
along, and getting it working isn't worth the effort right now.

Differential Revision: https://phabricator.services.mozilla.com/D69928

--HG--
extra : moz-landing-system : lando
2020-04-07 21:19:52 +00:00
Bob Clary
48aea3100e Bug 1617656 - Use correct field names for suite.unit, suite.subtests.unit, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D64022

--HG--
extra : moz-landing-system : lando
2020-02-25 11:57:06 +00:00
Dão Gottwald
c5e3d9ecd6 Bug 1616568 - Stop trying to call gBrowser.removePreloadedBrowser from awsy. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D63330

--HG--
extra : moz-landing-system : lando
2020-02-20 16:23:54 +00:00
Stephen Donner
14559f8276 Fix Bug 1607344; remove legacy stylo-seq linux64 jobs. r=erahm,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59466

--HG--
extra : moz-landing-system : lando
2020-01-14 22:36:47 +00:00
Mihai Alexandru Michis
227405cbbd Backed out changeset fd1001cea260 (bug 1607344) for causing wpt failures regarding single_stylo_traversal.
CLOSED TREE
2020-01-11 09:55:56 +02:00
Stephen Donner
37fa3ade04 Fix Bug 1607344; remove legacy stylo-seq linux64 jobs. r=erahm,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59466

--HG--
extra : moz-landing-system : lando
2020-01-11 07:20:50 +00:00
Daniel Varga
5546045f1c Backed out changeset 05f81cc8b39c (bug 1607344) for causing multiple failures at builds/worker/workspace/mozharness/mozharness/base/script.py
CLOSED TREE
2020-01-11 01:33:35 +02:00
Stephen Donner
ace7e6d13b Fix Bug 1607344; remove legacy stylo-seq linux64 jobs. r=erahm,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59466

--HG--
extra : moz-landing-system : lando
2020-01-10 21:39:19 +00:00
Rob Wood
fba75b1823 Bug 1605880 - Use consistent fission perfherder data naming for talos/raptor/awsy r=sparky,Marian
Differential Revision: https://phabricator.services.mozilla.com/D58299

--HG--
extra : moz-landing-system : lando
2019-12-27 17:11:55 +00:00
Florin Strugariu
9696f02d54 Bug 1585456 - [mozproxy] Error out when mozproxy can't bind to port r=tarek,perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D50594

--HG--
extra : moz-landing-system : lando
2019-12-11 10:07:28 +00:00
Punam Dahiya
5448031408 Bug 1600332 - Fix awsy tests to measure common case non-triplets new tab page r=Mardak
Differential Revision: https://phabricator.services.mozilla.com/D55530

--HG--
extra : moz-landing-system : lando
2019-12-02 20:56:25 +00:00
Marian Raiciof
c85e0d2447 Bug 1599495 - Fission preferences have additional quotation marks r=perftest-reviewers,rwood,stephendonner
This was causing false results when using marionette.get_pref() method

Differential Revision: https://phabricator.services.mozilla.com/D54965

--HG--
extra : moz-landing-system : lando
2019-11-28 08:56:40 +00:00
Marian Raiciof
fd401a7368 Bug 1567122 - Enable Fission for AWSY r=perftest-reviewers,stephendonner,sparky,erahm
Differential Revision: https://phabricator.services.mozilla.com/D48660

--HG--
extra : moz-landing-system : lando
2019-11-26 08:46:24 +00:00
Andreea Pavel
03ff4d65f1 Backed out changeset 776dc76ec598 (bug 1567122) for landing without proper peer review on a CLOSED TREE 2019-11-12 18:46:03 +02:00
Marian Raiciof
548d1181f8 Bug 1567122 - Enable Fission for AWSY r=perftest-reviewers,stephendonner,sparky
Differential Revision: https://phabricator.services.mozilla.com/D48660

--HG--
extra : moz-landing-system : lando
2019-11-12 14:07:17 +00:00
Cosmin Sabou
ac32e977d8 Backed out changeset ea612d6aa75b (bug 1585456) for causing regressions (Bug 1593351,1587387,1583680). 2019-11-01 23:22:05 +02:00
Florin Strugariu
85629f9e1e Bug 1585456 - [mozproxy] Error out when mozproxy can't bind to port r=tarek,perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D50594

--HG--
extra : moz-landing-system : lando
2019-11-01 09:41:36 +00:00
Marco Bonardo
d973ff4e31 Bug 1525296 - Remove any remaining references to old search suggestions notifications. r=adw,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D50932

--HG--
extra : moz-landing-system : lando
2019-10-29 17:57:10 +00:00
Razvan Maries
ca0ef20231 Backed out changeset 843409fd89e6 (bug 1567122) ar per Marian's request for causing regressions. CLOSED TREE 2019-10-18 17:56:19 +03:00
Marian Raiciof
3825075bc6 Bug 1567122 - Enable Fission for AWSY. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D48660

--HG--
extra : moz-landing-system : lando
2019-10-16 21:14:33 +00:00
Rishi Gupta
e82a1cb23d bug 1354458 - Replacing self.wait_for_condition() with Wait().until() function r=whimboo
Differential Revision: https://phabricator.services.mozilla.com/D47666

--HG--
extra : moz-landing-system : lando
2019-10-02 14:04:33 +00:00
Florin Strugariu
37d17612f4 Bug 1563164 - Remove option to enable/disable upstream certs in raptor r=perftest-reviewers,tarek,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D44622

--HG--
extra : moz-landing-system : lando
2019-09-04 13:39:19 +00:00
Florin Strugariu
300a8a317b Bug 1563162 - remove mitmproxy 2.0.2 support in raptor r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D43748

--HG--
extra : moz-landing-system : lando
2019-09-03 10:38:10 +00:00
Florin Strugariu
b846cf6646 Bug 1567137 Update AWSY tp6 tests to mitmproxy 4 r=perftest-reviewers,erahm,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D41343

--HG--
extra : moz-landing-system : lando
2019-08-28 08:36:48 +00:00
Ed Lee
bd33349692 Bug 1571624 - Switch awsy tests to measure common case non-triplets new tab page r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D41752

--HG--
extra : moz-landing-system : lando
2019-08-13 18:15:04 +00:00
Edwin Gao
6ce175cc67 Bug 1559975 - fix python2 linter errors for testing/awsy r=ahal
Changes:
- change how the modules are imported with the `absolute_import` changes
- satisfy python2 linter

Differential Revision: https://phabricator.services.mozilla.com/D37525

--HG--
extra : moz-landing-system : lando
2019-07-19 14:37:10 +00:00
Edwin Gao
1fd0b4e594 Bug 1559975 - convert testing/awsy to python3 syntax r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D35327

--HG--
extra : moz-landing-system : lando
2019-07-02 17:26:13 +00:00
Henrik Skupin
3e75511189 Bug 1562036 - [awsy] Re-enable "browser.tabs.remote.separatePrivilegedContentProcess". r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D36298

--HG--
extra : moz-landing-system : lando
2019-06-29 15:55:38 +00:00
Kartikaya Gupta
7cac45c075 Bug 1558598 - Fix up webrender options for the AWSY harness. r=ato
AWSY is built on marionette, so it inherits the option by default, we mostly
just need to propagate it properly. This also drops the --disable-webrender
option as it is now implied if --enable-webrender is not provided.

Differential Revision: https://phabricator.services.mozilla.com/D35863

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:30 +00:00
Dorel Luca
cb53554453 Backed out 3 changesets (bug 1558598) for Geckoview failures
Backed out changeset d9c42c5f4850 (bug 1558598)
Backed out changeset d2f0c18e82de (bug 1558598)
Backed out changeset f24e407e9a6d (bug 1558598)
2019-06-12 18:19:07 +03:00
Kartikaya Gupta
dac61ec776 Bug 1558598 - Force-disable webrender unless it is enabled. r=ahal
Ensure we force-disable webrender unless it is explicitly enabled
via the --enable-webrender flag. Also add missing env variables for
the telemetry_client.py case which appears to be a copy/paste error
that was not caught because we never run that test with WR enabled.

Depends on D34622

Differential Revision: https://phabricator.services.mozilla.com/D34623

--HG--
extra : moz-landing-system : lando
2019-06-12 13:13:35 +00:00
Eric Rahm
8b801e06ee Bug 1532491 - Part 3: Enable running AWSY tp6 in automation. r=bc
An `sy-tp6` variant is added to the AWSY test suite that runs against the tp6 pageset.

Differential Revision: https://phabricator.services.mozilla.com/D24585

--HG--
extra : moz-landing-system : lando
2019-03-29 19:35:24 +00:00
Eric Rahm
82909640e2 Bug 1532491 - Part 2: Add a tp6 version of AWSY. r=bc,rwood
This adds a '--tp6' option to `mach awsy-test` which allows the running of the AWSY test against the tp6 pageset rather than the default tp5 pageset.

Differential Revision: https://phabricator.services.mozilla.com/D23606

--HG--
extra : moz-landing-system : lando
2019-04-01 19:21:54 +00:00
Eric Rahm
94b38b97d9 Bug 1532491 - Part 1: Always check for a new tab handle. r=bc
It's possible for the first tab handle to change as well. This removes the special case for when we only add a new tab and just checks all the time.

Differential Revision: https://phabricator.services.mozilla.com/D25327

--HG--
extra : moz-landing-system : lando
2019-03-29 20:12:17 +00:00
Gijs Kruitbosch
5e05f6c9c9 Bug 1353013 - move new tab preload browser tracking into a separate module, r=dthayer
Differential Revision: https://phabricator.services.mozilla.com/D21126

--HG--
extra : moz-landing-system : lando
2019-03-19 17:29:14 +00:00
shindli
a7af1edc71 Backed out 3 changesets (bug 1353013) for a11y failures in accessible/tests/mochitest/relations/test_tabbrowser.xul CLOSED TREE
Backed out changeset af8bce2330e9 (bug 1353013)
Backed out changeset a3d1302b06c0 (bug 1353013)
Backed out changeset 976afd1adf84 (bug 1353013)
2019-03-18 18:21:16 +02:00
Gijs Kruitbosch
b7a741e6cb Bug 1353013 - move new tab preload browser tracking into a separate module, r=dthayer
Differential Revision: https://phabricator.services.mozilla.com/D21126

--HG--
extra : moz-landing-system : lando
2019-03-12 14:34:04 +00:00
Henrik Skupin
4b889bad47 Bug 1533786 - [marionette] Add support for the WebDriver Actions API. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D22757

--HG--
extra : moz-landing-system : lando
2019-03-11 20:33:49 +00:00
Eric Rahm
557518ac40 Bug 1530869 - Add support for setting per-suite alert thresholds. r=igoldan
This adds support for specifying per-suite perfherder alert thresholds and
updates the base content JS measurement to specify a 0.25% threshold.

Differential Revision: https://phabricator.services.mozilla.com/D21292

--HG--
extra : moz-landing-system : lando
2019-02-27 14:24:48 +00:00
Mike Conley
260710ce45 Bug 1515201 - Avoid loading about:blank in the privileged content process during AWSY tests. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D14920

--HG--
extra : moz-landing-system : lando
2019-01-07 16:05:53 +00:00
Cameron McCormack
220a9b83b3 Bug 1516493 - Use process count for AWSY page load count and explicitly drop the preallocated process r=kmag
Differential Revision: https://phabricator.services.mozilla.com/D15397

--HG--
extra : moz-landing-system : lando
2018-12-28 03:41:05 +00:00
terrameijar
9f28cc669c Bug 1506611 - Fixed linter errors in testing/awsy and testing/geckodriver r=ahal
Before this change, testing/awsy had 94 errors and testing/geckodriver had 17. The errors have been resolved

Differential Revision: https://phabricator.services.mozilla.com/D14712

--HG--
extra : moz-landing-system : lando
2018-12-18 21:31:59 +00:00
Eric Rahm
0d6916073e Bug 1510829 - Upload AWSY artifacts even if processing fails. r=bc
It's useful to get DMD reports even if we end up with negative
heap-unclassified. This catches any assertions during processing and makes
sure we move the reports to the upload dir even if there's a failure.

--HG--
extra : rebase_source : 3268d7b8f7f33c36c9b59bfdd5f181d80a0c4201
2018-12-03 11:50:45 -08:00
Kartikaya Gupta
7334674134 Bug 1507914 - Report actual invalid value if heap-unclassified is negative. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D12169

--HG--
extra : moz-landing-system : lando
2018-11-26 17:49:03 +00:00
Eric Rahm
bbeb9c3ddb Bug 1508399 - Use dom.ipc.processCount to determine how many tabs to open. r=bc
--HG--
extra : rebase_source : e15beebace2b0bd4bd781d3fa21f57d1e19385d8
2018-11-19 15:24:20 -08:00
Henrik Skupin
f8c705f152 Bug 1507267 - [awsy] Re-enable "about:newtab" page after Bug 1507267. r=erahm
Bug 1506643 disabled the usage of "about:newtab". But it's
actually needed by awsy for testing the memory consumption
of Firefox.

Differential Revision: https://phabricator.services.mozilla.com/D11932

--HG--
extra : moz-landing-system : lando
2018-11-14 22:38:48 +00:00
Eric Rahm
f5ec738046 Bug 1500523 - Increase DMD timeout. r=njn
This bumps the timeout when waiting for reports to 180 seconds which seems to
be long enough for MacOS in automation.

--HG--
extra : rebase_source : 6eb396e53bd37f6640b7c5402fb997c73af40d99
2018-10-22 14:05:47 -07:00