Commit Graph

319 Commits

Author SHA1 Message Date
Chris Hartjes
d03d62e5f9 Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27954

--HG--
extra : moz-landing-system : lando
2019-05-30 19:33:08 +00:00
Arnold Iakab
3a496ddefa Bug 1554681 Re-record youtube.com to reflect Polymer update Desktop r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32998

--HG--
extra : moz-landing-system : lando
2019-05-30 13:06:00 +00:00
Alexandru Irimovici
7b87be76cf Bug 1449572 - Bug 1449571 - raptor unit test for pageload timeouts r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32670

--HG--
extra : moz-landing-system : lando
2019-05-29 19:23:13 +00:00
Rob Wood
09454f678d Bug 1554311 - Start page timeout timer only after the test tab has actually been updated r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D32531

--HG--
extra : moz-landing-system : lando
2019-05-27 17:48:42 +00:00
alexandru.ionescu
a712b0f753 Bug 1546119 Raptor warm page-load tests on Firefox android fenix r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32101

--HG--
extra : moz-landing-system : lando
2019-05-27 17:56:14 +00:00
Henrik Skupin
6689e0a3a3 Bug 1554645 - [raptor] Use dedicated message type for shutting down the browser. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32683

--HG--
extra : moz-landing-system : lando
2019-05-27 18:48:44 +00:00
Ivan Yung
b4030f9fc6 Bug 1545117: added message which includes the local perf-automation github repo clone path r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D31177

--HG--
extra : moz-landing-system : lando
2019-05-15 14:27:57 +00:00
alexandru.ionescu
fa583b7a2f Bug 1545055 Run warm page load tests against Fennec v64 in CI r=Bebe,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D31770

--HG--
extra : moz-landing-system : lando
2019-05-24 11:19:07 +00:00
Henrik Skupin
59b691b66e Bug 1546880 - [raptor] Remove proxy workaround from raptor-youtube-playback tests. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D32378

--HG--
extra : moz-landing-system : lando
2019-05-24 05:36:42 +00:00
alexandru.ionescu
2f37f5f55a Bug 1546323 Run cold page load tests against Fennec v64 in CI r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31773

--HG--
extra : moz-landing-system : lando
2019-05-24 07:12:19 +00:00
Stephen Donner
168232fa40 Bug 1553623: Fix typos in Raptor's cmdline.py; r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D32215

--HG--
extra : moz-landing-system : lando
2019-05-22 21:12:28 +00:00
Henrik Skupin
a85b69685d Bug 1552484 - [raptor] Add geckoview support to raptor-youtube-playback test suite. r=perftest-reviewers,rwood
Adding those tests with the premise to run all the videos as muted,
at least as long as bug 1547717 hasn't been fixed.

Differential Revision: https://phabricator.services.mozilla.com/D32040

--HG--
extra : moz-landing-system : lando
2019-05-22 14:27:14 +00:00
Andrew Creskey
ad2afb1825 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 13:23:05 +00:00
Brindusan Cristian
5b1da8059b Backed out changeset 09df445cbdd9 (bug 1550075) for f8 linting failure at raptor.py:857:10. CLOSED TREE 2019-05-22 15:47:40 +03:00
Andrew Creskey
d3c69a3d77 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 12:13:47 +00:00
alexandru.ionescu
1a8f3c3864 Bug 1543369 Raptor cold page-load tests on Firefox android fennec r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31251

--HG--
extra : moz-landing-system : lando
2019-05-21 12:03:03 +00:00
Cosmin Sabou
17df5e7158 Backed out changeset 5862c607fcc2 (bug 1550075) for eslint failure on raptor-android/user.js. 2019-05-22 01:50:11 +03:00
Andrew Creskey
8cd21a5822 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-21 22:13:07 +00:00
Henrik Skupin
c69340b591 Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Gregory Mierzwinski
d36b68fefc Bug 1552548 - Set screen brightness to 50% on reference phones for power tests. r=perftest-reviewers,stephendonner
This patch sets the screen brightness on the reference Moto G5 and Pixel 2 phones to 50% before starting power tests and resets it to its original value once the test is complete.

Differential Revision: https://phabricator.services.mozilla.com/D31662

--HG--
extra : moz-landing-system : lando
2019-05-18 14:01:05 +00:00
Stephen Donner
6d86a346d7 Bug 1551324: Hook up remaining Fennec and Fenix jobs in CI for scn-power-idle tests. r=perftest-reviewers,rwood,sparky
Differential Revision: https://phabricator.services.mozilla.com/D31025

--HG--
extra : moz-landing-system : lando
2019-05-18 00:10:05 +00:00
Henrik Skupin
25e8969644 Bug 1548845 - [raptor] Don't filter-out tests which are white-listed for "use_live_sites". r=perftest-reviewers,stephendonner,rwood
Depends on D31681

Differential Revision: https://phabricator.services.mozilla.com/D31682

--HG--
extra : moz-landing-system : lando
2019-05-17 20:58:12 +00:00
Henrik Skupin
53ac5b9613 Bug 1548845 - [raptor] Log discarded tests in filter_live_sites. r=perftest-reviewers,rwood
Depends on D30532

Differential Revision: https://phabricator.services.mozilla.com/D31681

--HG--
extra : moz-landing-system : lando
2019-05-17 20:45:13 +00:00
Henrik Skupin
bc20797022 Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Henrik Skupin
4e8e65b9a9 Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:25 +00:00
Henrik Skupin
a092be21b1 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:23 +00:00
Rob Wood
8fdc5e82c4 Bug 1551972 - Fix Fenix cold page load by clearing app data before subsequent subtests; #perftest-reviewers r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D31632

--HG--
extra : moz-landing-system : lando
2019-05-17 16:55:05 +00:00
Mihai Alexandru Michis
724354e338 Backed out 5 changesets (bug 1548845) for failing new youtube playback raptor tests. CLOSED TREE
Backed out changeset 934d2f88195d (bug 1548845)
Backed out changeset 609f489bdc8c (bug 1548845)
Backed out changeset a2544ca8c593 (bug 1548845)
Backed out changeset 152615db9db6 (bug 1548845)
Backed out changeset 6b3a8394727f (bug 1548845)

--HG--
rename : testing/raptor/raptor/filters.py => testing/raptor/raptor/filter.py
2019-05-17 16:17:06 +03:00
Henrik Skupin
85b0987a4f Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:53 +00:00
Henrik Skupin
992c3cdb7d Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 11:12:40 +00:00
Henrik Skupin
11d84bf86a Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:20 +00:00
Henrik Skupin
9eeae6d8c8 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:02 +00:00
Edwin Gao
d05d708389 Bug 1552000 - move root-required tuning commands to its appropriate location for Raptor Android r=acreskey
Changes:

- move the I/O scheduler modification subroutine under the block that checks for `root` availability of device.

This change should not be visible on CI systems; all devices there are already rooted. Where this change makes an impact is for developers running Raptor Android tests on non-rooted devices.

Differential Revision: https://phabricator.services.mozilla.com/D31339

--HG--
extra : moz-landing-system : lando
2019-05-16 11:57:31 +00:00
shindli
d1ef75d446 Backed out changeset 90a51dbd6ee1 (bug 1528236) for causing permafailures in raptor tests CLOSED TREE 2019-05-15 00:48:21 +03:00
Henrik Skupin
dceb981485 Bug 1528236 - [raptor] Use opt-out mechanism for setting test specific preferences. r=perftest-reviewers,stephendonner
Due to missing class abstractions for Gecko- and non-Gecko based
browsers it's currently sub-optimal to define when preferences
as defined by tests will be set.

Given that by default we run Gecko-based applications other
browsers should opt-out from setting test preferences.

Differential Revision: https://phabricator.services.mozilla.com/D30923

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:27 +00:00
Henrik Skupin
22364e41eb Bug 1528236 - [raptor] Fix root permission failures for device tuning. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D30922

--HG--
extra : moz-landing-system : lando
2019-05-14 19:29:53 +00:00
Henrik Skupin
1fb0816fdd Bug 1528236 - [raptor] Environment variables should not be set via extra args. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29333

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:15 +00:00
Henrik Skupin
33461df3ea Bug 1528236 - [raptor] Update profile building code to align with mochitests. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29332

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:13 +00:00
Henrik Skupin
d93887ea36 Bug 1528236 - [raptor] Use constructor for initialization of raptor instances. r=perftest-reviewers,rwood
The patch tries to reduce the amount of initialization code
to call when creating a new Raptor class.

Initializing the ADBDevice already in the constructor of the
RaptorAndroid class is currently not possible because it would
mean that a device is immediately created but the "adb" binary
is not available for python test jobs. This has to be fixed later.

Differential Revision: https://phabricator.services.mozilla.com/D29331

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:11 +00:00
Henrik Skupin
c1ba84a470 Bug 1528236 - [raptor] Allow Raptor to run the tests all at once. r=perftest-reviewers,stephendonner,rwood
Differential Revision: https://phabricator.services.mozilla.com/D31047

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:01 +00:00
Henrik Skupin
d529cab0f1 Bug 1528236 - [raptor] Remove test root folder during clean-up. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29330

--HG--
extra : moz-landing-system : lando
2019-05-14 19:31:57 +00:00
Henrik Skupin
908e40dddf Bug 1528236 - [raptor] Refactor handling of remote profiles. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29329

--HG--
extra : moz-landing-system : lando
2019-05-14 19:30:11 +00:00
alexandru.ionescu
40ff099e27 Bug 1549669 - [raptor] Handle "--disable-e10s" argument to avoid causing fennec tests to fail r=perftest-reviewers,whimboo,ahal,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30171

--HG--
extra : moz-landing-system : lando
2019-05-14 11:50:00 +00:00
Stephen Donner
2c218a311e Bug 1548689: Hook idle-power-usage tests up to CI. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30456

--HG--
extra : moz-landing-system : lando
2019-05-13 20:33:15 +00:00
Stephen Donner
4a55597f03 Bug 1550828: String fixes and minor cleanup for power.py and Raptor's mach_commands.py. r=bc
Differential Revision: https://phabricator.services.mozilla.com/D30775

--HG--
extra : moz-landing-system : lando
2019-05-11 08:13:29 +00:00
Florin Strugariu
3dc303757f Bug 1549948 Fenix jobs are failing with "activity class does not exist" r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D30359

--HG--
extra : moz-landing-system : lando
2019-05-13 07:30:08 +00:00
Edwin Gao
1b56450c60 Bug 1549843 - implement jitter reduction for Motorola G5 r=jmaher,rwood
Changes:

- implement cpu, gpu, memory bus and other kernel tweaks for Motorola G5 to complement D30116

Differential Revision: https://phabricator.services.mozilla.com/D30715

--HG--
extra : moz-landing-system : lando
2019-05-10 21:15:20 +00:00
Andreea Pavel
e14f62f15c Merge mozilla-central to autoland on a CLOSED TREE 2019-05-10 13:01:38 +03:00
Florin Strugariu
9d23aa6093 Bug 1549949 Errors on launching activities are causing timeouts r=perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D30343

--HG--
extra : moz-landing-system : lando
2019-05-10 09:32:00 +00:00
Andreea Pavel
f5f94453ae Backed out changeset ba9d948d404c (bug 1544470) for breaking raptor-chromium a=backout 2019-05-10 11:35:42 +03:00