Commit Graph

90 Commits

Author SHA1 Message Date
Cosmin Sabou
ac32e977d8 Backed out changeset ea612d6aa75b (bug 1585456) for causing regressions (Bug 1593351,1587387,1583680). 2019-11-01 23:22:05 +02:00
Florin Strugariu
85629f9e1e Bug 1585456 - [mozproxy] Error out when mozproxy can't bind to port r=tarek,perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D50594

--HG--
extra : moz-landing-system : lando
2019-11-01 09:41:36 +00:00
Marco Bonardo
d973ff4e31 Bug 1525296 - Remove any remaining references to old search suggestions notifications. r=adw,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D50932

--HG--
extra : moz-landing-system : lando
2019-10-29 17:57:10 +00:00
Razvan Maries
ca0ef20231 Backed out changeset 843409fd89e6 (bug 1567122) ar per Marian's request for causing regressions. CLOSED TREE 2019-10-18 17:56:19 +03:00
Marian Raiciof
3825075bc6 Bug 1567122 - Enable Fission for AWSY. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D48660

--HG--
extra : moz-landing-system : lando
2019-10-16 21:14:33 +00:00
Rishi Gupta
e82a1cb23d bug 1354458 - Replacing self.wait_for_condition() with Wait().until() function r=whimboo
Differential Revision: https://phabricator.services.mozilla.com/D47666

--HG--
extra : moz-landing-system : lando
2019-10-02 14:04:33 +00:00
Florin Strugariu
37d17612f4 Bug 1563164 - Remove option to enable/disable upstream certs in raptor r=perftest-reviewers,tarek,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D44622

--HG--
extra : moz-landing-system : lando
2019-09-04 13:39:19 +00:00
Florin Strugariu
300a8a317b Bug 1563162 - remove mitmproxy 2.0.2 support in raptor r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D43748

--HG--
extra : moz-landing-system : lando
2019-09-03 10:38:10 +00:00
Florin Strugariu
b846cf6646 Bug 1567137 Update AWSY tp6 tests to mitmproxy 4 r=perftest-reviewers,erahm,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D41343

--HG--
extra : moz-landing-system : lando
2019-08-28 08:36:48 +00:00
Ed Lee
bd33349692 Bug 1571624 - Switch awsy tests to measure common case non-triplets new tab page r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D41752

--HG--
extra : moz-landing-system : lando
2019-08-13 18:15:04 +00:00
Edwin Gao
6ce175cc67 Bug 1559975 - fix python2 linter errors for testing/awsy r=ahal
Changes:
- change how the modules are imported with the `absolute_import` changes
- satisfy python2 linter

Differential Revision: https://phabricator.services.mozilla.com/D37525

--HG--
extra : moz-landing-system : lando
2019-07-19 14:37:10 +00:00
Edwin Gao
1fd0b4e594 Bug 1559975 - convert testing/awsy to python3 syntax r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D35327

--HG--
extra : moz-landing-system : lando
2019-07-02 17:26:13 +00:00
Henrik Skupin
3e75511189 Bug 1562036 - [awsy] Re-enable "browser.tabs.remote.separatePrivilegedContentProcess". r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D36298

--HG--
extra : moz-landing-system : lando
2019-06-29 15:55:38 +00:00
Kartikaya Gupta
7cac45c075 Bug 1558598 - Fix up webrender options for the AWSY harness. r=ato
AWSY is built on marionette, so it inherits the option by default, we mostly
just need to propagate it properly. This also drops the --disable-webrender
option as it is now implied if --enable-webrender is not provided.

Differential Revision: https://phabricator.services.mozilla.com/D35863

--HG--
extra : moz-landing-system : lando
2019-06-29 09:50:30 +00:00
Dorel Luca
cb53554453 Backed out 3 changesets (bug 1558598) for Geckoview failures
Backed out changeset d9c42c5f4850 (bug 1558598)
Backed out changeset d2f0c18e82de (bug 1558598)
Backed out changeset f24e407e9a6d (bug 1558598)
2019-06-12 18:19:07 +03:00
Kartikaya Gupta
dac61ec776 Bug 1558598 - Force-disable webrender unless it is enabled. r=ahal
Ensure we force-disable webrender unless it is explicitly enabled
via the --enable-webrender flag. Also add missing env variables for
the telemetry_client.py case which appears to be a copy/paste error
that was not caught because we never run that test with WR enabled.

Depends on D34622

Differential Revision: https://phabricator.services.mozilla.com/D34623

--HG--
extra : moz-landing-system : lando
2019-06-12 13:13:35 +00:00
Eric Rahm
8b801e06ee Bug 1532491 - Part 3: Enable running AWSY tp6 in automation. r=bc
An `sy-tp6` variant is added to the AWSY test suite that runs against the tp6 pageset.

Differential Revision: https://phabricator.services.mozilla.com/D24585

--HG--
extra : moz-landing-system : lando
2019-03-29 19:35:24 +00:00
Eric Rahm
82909640e2 Bug 1532491 - Part 2: Add a tp6 version of AWSY. r=bc,rwood
This adds a '--tp6' option to `mach awsy-test` which allows the running of the AWSY test against the tp6 pageset rather than the default tp5 pageset.

Differential Revision: https://phabricator.services.mozilla.com/D23606

--HG--
extra : moz-landing-system : lando
2019-04-01 19:21:54 +00:00
Eric Rahm
94b38b97d9 Bug 1532491 - Part 1: Always check for a new tab handle. r=bc
It's possible for the first tab handle to change as well. This removes the special case for when we only add a new tab and just checks all the time.

Differential Revision: https://phabricator.services.mozilla.com/D25327

--HG--
extra : moz-landing-system : lando
2019-03-29 20:12:17 +00:00
Gijs Kruitbosch
5e05f6c9c9 Bug 1353013 - move new tab preload browser tracking into a separate module, r=dthayer
Differential Revision: https://phabricator.services.mozilla.com/D21126

--HG--
extra : moz-landing-system : lando
2019-03-19 17:29:14 +00:00
shindli
a7af1edc71 Backed out 3 changesets (bug 1353013) for a11y failures in accessible/tests/mochitest/relations/test_tabbrowser.xul CLOSED TREE
Backed out changeset af8bce2330e9 (bug 1353013)
Backed out changeset a3d1302b06c0 (bug 1353013)
Backed out changeset 976afd1adf84 (bug 1353013)
2019-03-18 18:21:16 +02:00
Gijs Kruitbosch
b7a741e6cb Bug 1353013 - move new tab preload browser tracking into a separate module, r=dthayer
Differential Revision: https://phabricator.services.mozilla.com/D21126

--HG--
extra : moz-landing-system : lando
2019-03-12 14:34:04 +00:00
Henrik Skupin
4b889bad47 Bug 1533786 - [marionette] Add support for the WebDriver Actions API. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D22757

--HG--
extra : moz-landing-system : lando
2019-03-11 20:33:49 +00:00
Eric Rahm
557518ac40 Bug 1530869 - Add support for setting per-suite alert thresholds. r=igoldan
This adds support for specifying per-suite perfherder alert thresholds and
updates the base content JS measurement to specify a 0.25% threshold.

Differential Revision: https://phabricator.services.mozilla.com/D21292

--HG--
extra : moz-landing-system : lando
2019-02-27 14:24:48 +00:00
Mike Conley
260710ce45 Bug 1515201 - Avoid loading about:blank in the privileged content process during AWSY tests. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D14920

--HG--
extra : moz-landing-system : lando
2019-01-07 16:05:53 +00:00
Cameron McCormack
220a9b83b3 Bug 1516493 - Use process count for AWSY page load count and explicitly drop the preallocated process r=kmag
Differential Revision: https://phabricator.services.mozilla.com/D15397

--HG--
extra : moz-landing-system : lando
2018-12-28 03:41:05 +00:00
terrameijar
9f28cc669c Bug 1506611 - Fixed linter errors in testing/awsy and testing/geckodriver r=ahal
Before this change, testing/awsy had 94 errors and testing/geckodriver had 17. The errors have been resolved

Differential Revision: https://phabricator.services.mozilla.com/D14712

--HG--
extra : moz-landing-system : lando
2018-12-18 21:31:59 +00:00
Eric Rahm
0d6916073e Bug 1510829 - Upload AWSY artifacts even if processing fails. r=bc
It's useful to get DMD reports even if we end up with negative
heap-unclassified. This catches any assertions during processing and makes
sure we move the reports to the upload dir even if there's a failure.

--HG--
extra : rebase_source : 3268d7b8f7f33c36c9b59bfdd5f181d80a0c4201
2018-12-03 11:50:45 -08:00
Kartikaya Gupta
7334674134 Bug 1507914 - Report actual invalid value if heap-unclassified is negative. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D12169

--HG--
extra : moz-landing-system : lando
2018-11-26 17:49:03 +00:00
Eric Rahm
bbeb9c3ddb Bug 1508399 - Use dom.ipc.processCount to determine how many tabs to open. r=bc
--HG--
extra : rebase_source : e15beebace2b0bd4bd781d3fa21f57d1e19385d8
2018-11-19 15:24:20 -08:00
Henrik Skupin
f8c705f152 Bug 1507267 - [awsy] Re-enable "about:newtab" page after Bug 1507267. r=erahm
Bug 1506643 disabled the usage of "about:newtab". But it's
actually needed by awsy for testing the memory consumption
of Firefox.

Differential Revision: https://phabricator.services.mozilla.com/D11932

--HG--
extra : moz-landing-system : lando
2018-11-14 22:38:48 +00:00
Eric Rahm
f5ec738046 Bug 1500523 - Increase DMD timeout. r=njn
This bumps the timeout when waiting for reports to 180 seconds which seems to
be long enough for MacOS in automation.

--HG--
extra : rebase_source : 6eb396e53bd37f6640b7c5402fb997c73af40d99
2018-10-22 14:05:47 -07:00
Eric Rahm
43aa0be082 Bug 1500176 - Annotate DMD perfherder results. r=bc
This will split out AWSY results with DMD enabled from standard results, thus
avoiding confusion due to a large discrepency in values due to DMD's overhead.

--HG--
extra : rebase_source : d301fbe0161914486d5269803b86d376627f8419
2018-10-18 10:49:27 -07:00
Kris Maglione
0820be3463 Bug 1474208: Use median of all process values for AWSY base content. r=erahm
MozReview-Commit-ID: DBiJjeTlyZE

--HG--
extra : rebase_source : deb1d6265e3d2d77a85e3c5f1b32f274c866a623
2018-07-08 11:50:46 -07:00
Venkatesh Pitta
514d9d09b5 Bug 1452490 - Remove marionetteScriptFinished. r=whimboo
MozReview-Commit-ID: CdQCmtaodww

--HG--
extra : rebase_source : a950bc89194a866c4fa27fded1d2aed707ee750f
2018-07-08 14:52:49 +10:00
Eric Rahm
d545dc0998 Bug 1470831 - Only disable sandboxing in dmd builds. r=bc
Disabling sandboxing seems to cause a memory regression for win32 builds which
affects our AWSY numbers. This switches over to only disabling sandboxing if
using a DMD build so that we can still run without crashing.

--HG--
extra : rebase_source : 9887c19cdd746aec9f6d9e64561f2226cd1ce443
2018-06-25 11:52:21 -07:00
Henrik Skupin
894f69b8b2 Bug 1470414 - Clean-up moz.build files for BUG_COMPONENT in testing/. r=ahal
MozReview-Commit-ID: F5vHc4G13v6

--HG--
extra : rebase_source : 1c6c8de55def6026da467d589ec3a8b511986125
2018-06-22 13:32:05 +02:00
Margareta Eliza Balazs
38873b16e7 Backed out changeset 52e86ed85e54 (bug 1470414) for bustage in ./config/tests/test_mozbuild_reading.py::TestMozbuildReading on a CLOSED TREE 2018-06-25 17:29:18 +03:00
Henrik Skupin
df65676052 Bug 1470414 - Clean-up moz.build files for BUG_COMPONENT in testing/. r=ahal
MozReview-Commit-ID: F5vHc4G13v6

--HG--
extra : rebase_source : c39293be7a60ecc22be2f385671769f371dca06b
2018-06-22 13:32:05 +02:00
Eric Rahm
e6892b931a Bug 1442361 - Track explicit memory usage in the base content memory test. r=mccr8
--HG--
extra : rebase_source : f6ef9d4f541c7df1dfbb0297613ec0c011688d29
2018-06-21 14:57:12 -07:00
Eric Rahm
5ab7117b5c Bug 1395540 - Part 5: Enable DMD in automation. r=bc
This adds support running AWSY with DMD in automation via mozharness. We use
existence of dmd.py to detect whether or not dmd should be enabled.
Additionally sandboxing has to be disabled in order to avoid crashes on Windows
and OSX.

--HG--
extra : rebase_source : 1576dbb98bc2cff565ea5055daaec5a44aed88a8
2018-06-15 09:59:18 -07:00
Ryan Hunt
b00603123d Bug 1426499 - Add an error message for unzipping tp5n on windows. r=erahm
--HG--
extra : rebase_source : e6999c6a418acc3ff616d4e79977d08fb0e49187
2018-05-16 13:55:37 -05:00
Ryan Hunt
4846d7b517 Bug 1426499 - Disable windows content process sandbox when using DMD with AWSY. r=erahm
--HG--
extra : rebase_source : 9af460b07207c8bd2b0187b41ba65fe00c03871a
2018-05-17 13:46:29 -05:00
Eric Rahm
1ff3563202 Bug 1457243 - Part 7: Followup - Setup base case testvars. r=me
We need testvars for the base case as well.

--HG--
extra : rebase_source : 0fbe7b3e206262d47f78e1289dceb02878ad987b
extra : histedit_source : fd1eabcc887e91dff8f4ec2e00b03fcd8bb68c9b
2018-05-11 14:33:12 -07:00
Eric Rahm
9b852df17e Bug 1457243 - Part 6: Hook in the about:blank awsy test to automation. r=bc
--HG--
extra : rebase_source : 9eb7f7bb6609c1aa20fdf1ef3395ce91e5b8afeb
2018-05-08 16:05:33 -07:00
Eric Rahm
72e5391ee5 Bug 1457243 - Part 5: Add base case AWSY test that just measures about:blank. r=bc
--HG--
extra : rebase_source : 7be4c67e6de6c482bbb7741c5a307d32246f177b
2018-05-09 16:48:49 -07:00
Eric Rahm
9370dfd92b Bug 1457243 - Part 4: Support filtering on process names and limit process count. r=bc
This adds support for only gathering data for a given process type. It also
allows you to limit the number of processes included in a measurement.

--HG--
extra : rebase_source : f4c172ff151f6739f0222f0e1c36bc299fe1d3d7
2018-05-09 16:33:42 -07:00
Eric Rahm
02116be10a Bug 1457243 - Part 3: Split out a base awsy test case. r=bc
--HG--
extra : rebase_source : b90844900688c78acc32cc337d7e78b022a2244f
2018-05-09 16:37:21 -07:00
Eric Rahm
f02182a347 Bug 1457243 - Part 2: Allow checkpoints and perf_suites to be passed in to process_perf_data. r=bc
--HG--
extra : rebase_source : 6079a2ed599647b1bb0631c3542f475c457d94d0
2018-05-09 16:42:32 -07:00
Eric Rahm
c8048bf57a Bug 1457243 - Part 1: Support zero values for awsy params in mach_commands. r=bc
--HG--
extra : rebase_source : cd9006c267e627ad4ab75eb997145cf4489dc21c
2018-05-09 16:31:52 -07:00