Commit Graph

423 Commits

Author SHA1 Message Date
Edwin Gao
1b56450c60 Bug 1549843 - implement jitter reduction for Motorola G5 r=jmaher,rwood
Changes:

- implement cpu, gpu, memory bus and other kernel tweaks for Motorola G5 to complement D30116

Differential Revision: https://phabricator.services.mozilla.com/D30715

--HG--
extra : moz-landing-system : lando
2019-05-10 21:15:20 +00:00
Andreea Pavel
e14f62f15c Merge mozilla-central to autoland on a CLOSED TREE 2019-05-10 13:01:38 +03:00
Florin Strugariu
9d23aa6093 Bug 1549949 Errors on launching activities are causing timeouts r=perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D30343

--HG--
extra : moz-landing-system : lando
2019-05-10 09:32:00 +00:00
Andreea Pavel
f5f94453ae Backed out changeset ba9d948d404c (bug 1544470) for breaking raptor-chromium a=backout 2019-05-10 11:35:42 +03:00
Chris Hartjes
80fbae9239 Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27954

--HG--
extra : moz-landing-system : lando
2019-05-09 20:39:43 +00:00
Edwin Gao
1298ea44c8 Bug 1547135 - reduce tp6m test result jitter for Android (Pixel 2) r=jmaher,acreskey,rwood
All changes are reversible upon reboot, with exception of the animation setting which is restored to default settings once Raptor concludes testing.

All values are for Pixel 2. Motorola G5 patch will be available separately.

Changes:
- set cpu/gpu to `performance` mode, and override minimum frequency with the maximum available frequency
- tweak msm-bus related kernel settings
- set display to be permanently on when connected over USB
- disable animation for duration of test
- turn off thermal throttling

Differential Revision: https://phabricator.services.mozilla.com/D30116

--HG--
extra : moz-landing-system : lando
2019-05-09 16:35:27 +00:00
Florin Strugariu
70d07476cb Bug 1541041 Page timeouts are ignored during cold page-load test suites r=rwood,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26309

--HG--
extra : moz-landing-system : lando
2019-05-08 18:29:56 +00:00
Ionut Goldan
ab23804ea9 Bug 1548577 - Add missing chromium counterparts r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30188

--HG--
extra : moz-landing-system : lando
2019-05-08 19:39:10 +00:00
Stephen Donner
d229732882 Bug 1548987: pypi.python.org should now just be pypi.org in mach_commands.py. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29985

--HG--
extra : moz-landing-system : lando
2019-05-08 17:50:21 +00:00
Stephen Donner
e52c3cef40 Bug 1546741. Land initial idle-power-usage-measurement test for Android. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29654

--HG--
extra : moz-landing-system : lando
2019-05-08 19:21:12 +00:00
Rob Wood
046bef30c3 Bug 1545186 - Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D29207

--HG--
extra : moz-landing-system : lando
2019-05-03 15:53:27 +00:00
Ivan Yung
9914e7d5ec Bug 1519884: Improve help text for --test argument r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29541

--HG--
extra : moz-landing-system : lando
2019-05-01 19:26:41 +00:00
Rob Wood
0678c2e034 Bug 1522972 - Raptor cold-load tests on Firefox and Chromium desktop; #perftest r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D29032

--HG--
extra : moz-landing-system : lando
2019-05-01 14:52:59 +00:00
Henrik Skupin
fc6a577886 Bug 1547069 - [raptor] Always take a screenshot on page load timeouts. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29178

--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:28 +00:00
Henrik Skupin
3b68194ffa Bug 1547069 - [raptor] Refactoring screen capturing code in web extension. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29177

--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:11 +00:00
Henrik Skupin
e1bb9a3e44 Bug 1547069 - [raptor] Reduce CPU overhead when waiting for results. r=perftest-reviewers,rwood
The method checkForResult is called each and every 5 milliseconds while the Raptor
tests are running. This actually consumes a lot of CPU which can decrease the
performance of the website under test.

It's totally enough to check for results 4 times in a minute.

Differential Revision: https://phabricator.services.mozilla.com/D29176

--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:56 +00:00
Henrik Skupin
f45dee943e Bug 1547069 - [raptor] Generalize code in waitForResult(). r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29175

--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:35 +00:00
Henrik Skupin
fdfa7dd694 Bug 1544686 - [raptor] Allow CLI arguments to override Gecko profiler settings from test manifest. r=perftest reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D28047

--HG--
extra : moz-landing-system : lando
2019-04-29 13:35:51 +00:00
Henrik Skupin
27e49c37df Bug 1544686 - [raptor] Make Gecko profiler threads customizable in the harness. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D28046

--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:30 +00:00
Henrik Skupin
f957b3ea28 Bug 1544686 - [raptor] Fix Gecko profiler settings. r=rwood
When the Gecko profiler is enabled the interval and entries as specified
in manifest files aren't correctly set. Instead the default values from
the extension are always used.

Also with WebRender enabled the threads are "WR", and "Renderer", but
not "WR,Renderer".

Differential Revision: https://phabricator.services.mozilla.com/D28045

--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:29 +00:00
Florin Strugariu
d3d1d11735 Bug 1544356 4 - 281% raptor-tp6 regression r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28598

--HG--
extra : moz-landing-system : lando
2019-04-26 12:49:09 +00:00
Cosmin Sabou
8f9aff6a55 Bug 1513467 - Disable raptor-tp6-amazon-firefox due to frequent failures. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D29090

--HG--
extra : moz-landing-system : lando
2019-04-27 02:06:28 +00:00
Henrik Skupin
b77e627ac4 Bug 1546611 - [raptor] Fix None checks when validating test manifests. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28642

--HG--
extra : moz-landing-system : lando
2019-04-26 12:48:02 +00:00
Henrik Skupin
bb1110b6b8 Bug 1547074 - [raptor] Rename measure.js and benchmark-relay.js. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D28896

--HG--
rename : testing/raptor/webext/raptor/benchmark-relay.js => testing/raptor/webext/raptor/benchmark.js
rename : testing/raptor/webext/raptor/measure.js => testing/raptor/webext/raptor/pageload.js
extra : moz-landing-system : lando
2019-04-26 05:13:42 +00:00
Rob Wood
ac0b8d3376 Bug 1546704 - Fix subtest names for cold page-load Fenix suites; r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D28708

--HG--
extra : moz-landing-system : lando
2019-04-25 11:13:34 +00:00
Henrik Skupin
e86db915f3 Bug 1506928 - [raptor] Use signal handler for safe shutdown. r=rwood,tarek
Differential Revision: https://phabricator.services.mozilla.com/D25752

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:06 +00:00
Henrik Skupin
317dd0b163 Bug 1506928 - [raptor] "get()" defaults to None by default if key isn't found. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27640

--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:52 +00:00
Henrik Skupin
dbdb18ef72 Bug 1506928 - [raptor] Fix inheritance of methods in raptor classes. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27639

--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:37 +00:00
Henrik Skupin
d8fa03fe11 Bug 1506928 - [raptor] Refactor arguments for constructors of Raptor classes. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25751

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:13 +00:00
Henrik Skupin
e748412851 Bug 1506928 - [raptor] Handle "MOZ_UPLOAD_DIR" as optional in Output class. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25750

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:16 +00:00
Rob Wood
f0ae2f4c0a Bug 1546178 - Fix live-sites support when running Raptor cold page-load on android; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28399

--HG--
extra : moz-landing-system : lando
2019-04-23 18:09:43 +00:00
Florin Strugariu
f74efede94 Bug 1518793 Add Microsoft Office to tp6 r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D27663

--HG--
extra : moz-landing-system : lando
2019-04-22 15:39:00 +00:00
Florin Strugariu
bb78bfab8c Bug 1545722 remove raptor-tp6-8-404 jobs r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D28180

--HG--
extra : moz-landing-system : lando
2019-04-19 08:51:28 +00:00
Florin Strugariu
2aab02dcd9 Bug 1533283 Intermittent timeouts running raptor-tp6m-google-restaurants-geckoview r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D28182

--HG--
extra : moz-landing-system : lando
2019-04-22 09:17:11 +00:00
Rob Wood
1105b8f744 Bug 1545175 - Raptor test definitions and taskcluster configs for cold page-load tests on Fenix; r=Bebe,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D27964

--HG--
extra : moz-landing-system : lando
2019-04-18 19:34:10 +00:00
Andrew Halberstadt
af84858720 Bug 1532747 - Create try-only raptor tp6m-1 fenix task, r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27948

--HG--
extra : moz-landing-system : lando
2019-04-17 19:49:52 +00:00
Florin Strugariu
ec6fa081bc Bug 1544702 Clear app data between tests when running mobile warm raptor tests r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27652

--HG--
extra : moz-landing-system : lando
2019-04-18 10:34:15 +00:00
Henrik Skupin
dafcfb1456 Bug 1544707 - [raptor] Use format strings instead of concatenating log messages. r=rwood
Depends on D27812

Differential Revision: https://phabricator.services.mozilla.com/D27813

--HG--
extra : moz-landing-system : lando
2019-04-18 06:42:00 +00:00
Henrik Skupin
647820f87f Bug 1544707 - [raptor] Move most of if/elif blocks for testType to switch statements. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27812

--HG--
extra : moz-landing-system : lando
2019-04-18 06:41:42 +00:00
Rob Wood
57bf658be0 Bug 1544516 - Add ability to specify intent when launching android app; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27570

--HG--
extra : moz-landing-system : lando
2019-04-18 12:46:13 +00:00
shindli
2554c77019 Backed out changeset 20bbaead9017 (bug 1519884) for causing mozlint failure in /builds/worker/checkouts/gecko/testing/raptor/raptor/cmdline.py CLOSED TREE 2019-04-17 19:44:49 +03:00
Ivan Yung
438d9c71b3 Bug 1519884: Improve help text for --test argument r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27608

--HG--
extra : moz-landing-system : lando
2019-04-17 14:17:35 +00:00
Florin Strugariu
987bd630c6 Bug 1543996 Add test configurations for reference browser r=davehunt,rwood
Differential Revision: https://phabricator.services.mozilla.com/D27284

--HG--
extra : moz-landing-system : lando
2019-04-17 13:34:23 +00:00
Bob Clary
752022eeda Bug 1533848 - Implement Android memory test using control server waits, r=rwood.
Depends on D26973

Differential Revision: https://phabricator.services.mozilla.com/D26974

--HG--
extra : moz-landing-system : lando
2019-04-16 18:55:34 +00:00
Bob Clary
5968316eb9 Bug 1533848 - Suppress HTTP 200 request log output, r=rwood.
Depends on D26972

Differential Revision: https://phabricator.services.mozilla.com/D26973

--HG--
extra : moz-landing-system : lando
2019-04-16 18:26:44 +00:00
Bob Clary
73d6f12ca4 Bug 1533848 - Make the control server multithreaded, r=rwood.
Differential Revision: https://phabricator.services.mozilla.com/D26972

--HG--
extra : moz-landing-system : lando
2019-04-16 19:26:26 +00:00
Florin Strugariu
ae84bf2e0a Bug 1518791 Add Microsoft Outlook to tp6 r=davehunt
Recording in bug comment.

https://drive.google.com/open?id=1p1hCJfW-d0gbEZNWHP3NMIr4sI3lPHEV

Differential Revision: https://phabricator.services.mozilla.com/D26143

--HG--
extra : moz-landing-system : lando
2019-04-15 07:50:35 +00:00
Florin Strugariu
debe0f9baf Bug 1513835 Add LinkedIn to tp6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26896

--HG--
extra : moz-landing-system : lando
2019-04-12 17:03:32 +00:00
Ionut Goldan
e0060de75c Bug 1539437 - Replace Chrome with Chromium mentionings where needed r=sparky,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25094

--HG--
rename : taskcluster/ci/test/raptor-chrome.yml => taskcluster/ci/test/raptor-chromium.yml
extra : moz-landing-system : lando
2019-04-12 10:33:24 +00:00
Florin Strugariu
4348f3974a Bug 1509835 Raptor test raptor-tp6-amazon-chrome is not rendering a completely loaded amazon site r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D25597

--HG--
extra : moz-landing-system : lando
2019-04-09 09:49:03 +00:00
Florin Strugariu
528fad068d Bug 1519827 Measure "loadtime" in all tp6 tests r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26674

--HG--
extra : moz-landing-system : lando
2019-04-11 07:22:17 +00:00
Marian Raiciof
e8b1485d83 Bug 1533304 - remove disabled attribute for raptor-tp6m-bbc-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26665

--HG--
extra : moz-landing-system : lando
2019-04-10 12:53:29 +00:00
Marian Raiciof
0870b461b1 Bug 1533666 - Remove disabled attribute for raptor-tp6m-cnn-ampstories-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26662

--HG--
extra : moz-landing-system : lando
2019-04-10 12:52:04 +00:00
Marian Raiciof
1ffc7bf45a Bug 1533306 - remove disabled attribute for raptor-tp6m-microsoft-support-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26670

--HG--
extra : moz-landing-system : lando
2019-04-10 12:57:25 +00:00
Florin Strugariu
c4d7037af0 Bug 1542757 - Investigate and fix TEST-UNEXPECTED-FAIL: test 'raptor-tp6-paypal-chrome' r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26524

--HG--
extra : moz-landing-system : lando
2019-04-08 17:20:16 +00:00
alexandru.ionescu
faeccf1361 Bug 1532545 Add support for running page load tests against Fennec r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25723

--HG--
extra : moz-landing-system : lando
2019-04-08 17:47:59 +00:00
Rob Wood
226e9fab72 Bug 1533008 - Fix Raptor Chromium OSX jobs by using mock-keychain; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25861

--HG--
extra : moz-landing-system : lando
2019-04-04 14:54:38 +00:00
Ionut Goldan
f1eb1ac35c Bug 1538201 - Correctly extract subtest_lower_is_better value r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25781

--HG--
extra : moz-landing-system : lando
2019-04-03 20:07:38 +00:00
Henrik Skupin
e539398061 Bug 1541215 - [raptor] Use proper timeout values for test_start_browser. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25859

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:45 +00:00
Henrik Skupin
e0b05f4996 Bug 1541215 - [raptor] Make post_startup_delay configurable. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25857

--HG--
extra : moz-landing-system : lando
2019-04-04 06:13:05 +00:00
Henrik Skupin
e282f9c968 Bug 1541215 - [raptor] Check for failures in spawned thread for test_start_browser. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25855

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:23 +00:00
Henrik Skupin
2bb8060847 Bug 1541215 - [raptor] Fall back to 1 browser_cycle / page_cycle if test doesn't specify a value. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25854

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:38 +00:00
Florin Strugariu
f0624a23a4 Bug 1540629 remove screenshots from tp6-8-404 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25563

--HG--
extra : moz-landing-system : lando
2019-04-01 15:00:50 +00:00
Stephen Donner
f9d59415ac Bug 1534778. Abstract and enable power tests for non-GeckoView browsers. r=rwood,bc
Differential Revision: https://phabricator.services.mozilla.com/D24971

--HG--
extra : moz-landing-system : lando
2019-03-29 18:47:35 +00:00
alexandru.ionescu
1902546a62 Bug 1534628 add benchmark measurement to raptor error handeling r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D23304

--HG--
extra : moz-landing-system : lando
2019-03-29 14:36:56 +00:00
Marian Raiciof
e2de20e8a8 Bug 1536095 - Add aframe.io Animation page to tp6-m r=davehunt,rwood
Bug 1536095 - Add aframe.io Animation page to tp6-m

Differential Revision: https://phabricator.services.mozilla.com/D23862

--HG--
extra : moz-landing-system : lando
2019-03-29 14:41:31 +00:00
alexandru.ionescu
548250ddec Bug 1536758 Switch to using event listener instead of overloading window.onload in runner/measure.js r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D24163

--HG--
extra : moz-landing-system : lando
2019-03-29 13:14:33 +00:00
Rob Wood
2efaefdfc3 Bug 1539438 - Expand tp6m-cold-1; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25060

--HG--
extra : moz-landing-system : lando
2019-03-29 13:28:06 +00:00
Florin Strugariu
5ef71add7a Bug 1457274 Upgrade mitmproxy in production r=rwood,tarek
Differential Revision: https://phabricator.services.mozilla.com/D21374

--HG--
rename : testing/raptor/raptor/playback/alternate-server-replay.py => testing/raptor/raptor/playback/alternate-server-replay-2.0.2.py
extra : moz-landing-system : lando
2019-03-29 09:54:53 +00:00
Rob Wood
a720305501 Bug 1536874 - Temporarily remove measuring TTFI and Hero elements in order to stabilize pageload tests; r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D25112

--HG--
extra : moz-landing-system : lando
2019-03-28 09:44:47 +00:00
Rob Wood
b309039307 Bug 1538786 - Fix 'KeyError: suites' when a tp6 page times out; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D24881

--HG--
extra : moz-landing-system : lando
2019-03-27 09:10:39 +00:00
shindli
8af903f814 Backed out changeset 030cb27161ee (bug 1538786) for raptor failures in testing/raptor/test/test_manifest.py::test_get_raptor_test_list_firefox CLOSED TREE 2019-03-26 04:52:51 +02:00
Rob Wood
b6d015016c Bug 1538786 - Fix 'KeyError suites' when a tp6 page times out; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D24746

--HG--
extra : moz-landing-system : lando
2019-03-25 19:30:38 +00:00
Rob Wood
17dec601e9 Bug 1533423 - Raptor cold page-load support for Firefox android geckoview; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D24464

--HG--
extra : moz-landing-system : lando
2019-03-22 15:27:27 +00:00
Henrik Skupin
6eea3b81dc Bug 1536112 - testing/raptor misses moz.build file. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D23936

--HG--
extra : moz-landing-system : lando
2019-03-19 03:45:24 +00:00
Nick Alexander
7a1c539e39 Bug 1521967 - Part 1: Use MOZ_HOST_BIN to find certutil in mach raptor-test for Android. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D17396

--HG--
extra : moz-landing-system : lando
2019-03-18 16:50:57 +00:00
Marian Raiciof
05db28a64b Bug 1534956 - Add Cristiano's facebook page to tp6-m r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D23317

--HG--
extra : moz-landing-system : lando
2019-03-15 11:46:22 +00:00
Tarek Ziadé
2f3c136a11 Bug 1534788 - add the playback_args option r=Bebe,rwood
This patch also removes custom_script and stops
executing start() in the constructor.

Differential Revision: https://phabricator.services.mozilla.com/D23288

--HG--
extra : moz-landing-system : lando
2019-03-13 14:50:03 +00:00
marian.raiciof
45cd40fa58 Bug 1527849 Add google search to tp6-m r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D19907

--HG--
extra : moz-landing-system : lando
2019-03-13 10:31:34 +00:00
Joel Maher
29cb950a1e Bug 1490048 - add cranelift to raptor wasm-misc and wasm-godot tests. r=bbouvier,rwood
add cranelift to raptor wasm-misc and wasm-godot tests.

Differential Revision: https://phabricator.services.mozilla.com/D23144

--HG--
extra : moz-landing-system : lando
2019-03-12 14:42:45 +00:00
Kartikaya Gupta
5486eb421d Bug 1533517 - [mozdevice] Remove FirefoxOS candidate test root paths. r=bc
Differential Revision: https://phabricator.services.mozilla.com/D22952

--HG--
extra : moz-landing-system : lando
2019-03-12 13:55:51 +00:00
Florin Strugariu
63eb0a0132 Bug 1532671 output what measurements are still pending though when there is a page timeout in raptor r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D22107

--HG--
extra : moz-landing-system : lando
2019-03-12 12:16:09 +00:00
marian.raiciof
899b667ee0 Bug 1529207 - Add new Raptor tests in tp6m-4 r=davehunt,rwood
Differential Revision: https://phabricator.services.mozilla.com/D20852

--HG--
extra : moz-landing-system : lando
2019-03-12 12:01:27 +00:00
alexandru.ionescu
78eb1bc26f Bug 1529212 Add new Raptor tests in tp6m-7 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D21000

--HG--
extra : moz-landing-system : lando
2019-03-11 14:30:12 +00:00
alexandru.ionescu
941c77dc3a Bug 1529211 Add new Raptor tests in tp6m-6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20820

--HG--
extra : moz-landing-system : lando
2019-03-07 16:37:30 +00:00
Tarek Ziadé
9ed1006ca9 Bug 1528992 - extract raptor mitmproxy integration - r=rwood,Bebe,gbrown
This patch moves testing/raptor/raptor/playback into its own testing package in testing/mozbase/mozproxy
so we can use the proxy in other places than Raptor.

Differential Revision: https://phabricator.services.mozilla.com/D21200

--HG--
rename : testing/raptor/raptor/playback/__init__.py => testing/mozbase/mozproxy/mozproxy/__init__.py
rename : testing/raptor/raptor/playback/base.py => testing/mozbase/mozproxy/mozproxy/backends/base.py
rename : testing/raptor/raptor/playback/mitmproxy.py => testing/mozbase/mozproxy/mozproxy/backends/mitm.py
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-linux64.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-osx.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-win.manifest
rename : testing/raptor/raptor/playback/mitmproxy_requirements.txt => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy_requirements.txt
extra : moz-landing-system : lando
2019-03-06 17:13:21 +00:00
alexandru.ionescu
1b4fb7feae Bug 1532542 raptor-tp6m-youtube-geckoview output problem r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D22061

--HG--
extra : moz-landing-system : lando
2019-03-05 11:04:30 +00:00
Rob Wood
18ad654c50 Bug 1530353 - Temporarily stop measuring hero element in tp6-1 to prevent intermittent failures; r=acreskey,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D21802

--HG--
extra : moz-landing-system : lando
2019-03-04 21:43:21 +00:00
Andrew Erickson
8253608b85 Bug 1530546: change hostutils version in raptor test r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D22009

--HG--
extra : moz-landing-system : lando
2019-03-04 21:08:33 +00:00
Rob Wood
28ef99fbcd Bug 1531169 - Add the ability to run Raptor page-load tests against live sites; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D21466

--HG--
extra : moz-landing-system : lando
2019-03-04 20:40:51 +00:00
Rob Wood
46accc2092 Bug 1531441 - Revert disabling of raptor-unity-webgl-geckoview; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D21751

--HG--
extra : moz-landing-system : lando
2019-03-01 21:56:40 +00:00
alexandru.ionescu
361d5151c4 Bug 1529210 Add new Raptor tests in tp6m-5 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20815

--HG--
extra : moz-landing-system : lando
2019-03-01 14:46:36 +00:00
Rob Wood
3042085516 Bug 1531079 - Stop capturing Firefox JS errors and warnings in the Raptor logs; r=stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D21399

--HG--
extra : moz-landing-system : lando
2019-02-27 19:38:46 +00:00
Florin Strugariu
7a132cc405 Bug 1523877 Add Instagram and bing to tp6-m r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18072

--HG--
extra : moz-landing-system : lando
2019-02-28 08:46:33 +00:00
Narcis Beleuzu
085345ac87 Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures. r=jmaher
Reviewers: jmaher, rwood

Reviewed By: jmaher

Subscribers: reviewbot, jmaher

Bug #: 1524495

Differential Revision: https://phabricator.services.mozilla.com/D20939

--HG--
extra : rebase_source : 0dfc90e334d0d51b135614d5b48d7d4eb24866dd
extra : histedit_source : 42e6fdea6fd0a8fe5eaac00f3acf8d72d082e58f
2019-02-26 17:20:58 +02:00
Narcis Beleuzu
c2918302b0 Backed out changeset e5fc352e6d65 (bug 1524495) for Raptor performance tests failures. 2019-02-26 17:19:43 +02:00
Narcis Beleuzu
b63f29553f Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20939

--HG--
extra : moz-landing-system : lando
2019-02-26 12:00:41 +00:00
Narcis Beleuzu
e489ab4f77 Backed out changeset 9b617c97285a (bug 1524495) for Py2 failure
--HG--
extra : rebase_source : 11dae674cfe6dfe1b9ac0c70ac463b64d148c48b
2019-02-26 11:36:11 +02:00
Narcis Beleuzu
243105ce4c Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20939

--HG--
extra : moz-landing-system : lando
2019-02-25 13:32:22 +00:00
Cosmin Sabou
6adb5274af Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail. r=jmaher,davehunt
--HG--
extra : amend_source : 7c550f19ee58925ef15fd14b44d680078bbe5d1b
2019-02-23 23:15:44 +02:00
Cosmin Sabou
3aeb6355e0 Backed out changeset 05dc22d0131b (bug 1506936) for causing raptor failures on test_manifest.py. 2019-02-23 22:53:29 +02:00
Rob Wood
59718a6d7c Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail; r=jmaher,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20911

--HG--
extra : moz-landing-system : lando
2019-02-23 20:00:21 +00:00
Rob Wood
1f2bb6f01b Bug 1529079 - Fix Raptor fennec shutdown failure; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D20829

--HG--
extra : moz-landing-system : lando
2019-02-22 21:40:05 +00:00
Rob Wood
2e13f2584d Bug 1520523 - Update Raptor Chromium rev; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20814

--HG--
extra : moz-landing-system : lando
2019-02-22 19:31:52 +00:00
Florin Strugariu
8367e1b8cd Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D19485

--HG--
extra : moz-landing-system : lando
2019-02-22 19:33:13 +00:00
Greg Tatum
39cd1d4845 Bug 1525358 - Rename perf.html to profiler.firefox.com; r=julienw
Differential Revision: https://phabricator.services.mozilla.com/D18728

--HG--
extra : moz-landing-system : lando
2019-02-21 23:16:40 +00:00
Brindusan Cristian
90f0dafc2a Backed out changeset ad3aad4f529e (bug 1527280) for ESlint and flake failures at deterministic.js. CLOSED TREE 2019-02-21 19:01:32 +02:00
Florin Strugariu
7d3ec27a10 Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D19485

--HG--
extra : moz-landing-system : lando
2019-02-21 16:31:39 +00:00
Junior Hsu
b7e28eddd2 Bug 1507110 - Allow hijacking localhost only if network.proxy.allow_hijacking_localhost is set r=Gijs,mayhemer,mkaply,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D19325

--HG--
extra : moz-landing-system : lando
2019-02-19 21:53:22 +00:00
Rob Wood
df7c74194f Bug 1528055 - Raptor's extension measure.js onload overrides onload in mitmproxy page recordings; r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D19961

--HG--
extra : moz-landing-system : lando
2019-02-20 21:06:15 +00:00
Rob Wood
47c7bf42ec Bug 1522100 - Add Raptor support for running tests locally on the android-components reference browser; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20414

--HG--
extra : moz-landing-system : lando
2019-02-21 14:14:05 +00:00
Florin Strugariu
9096d62bdf Bug 1523973 Review and update the raptor-tp6m-1 recordings r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20309

--HG--
extra : moz-landing-system : lando
2019-02-19 12:22:32 +00:00
Florin Strugariu
8584f3a17e Bug 1508379 Add BinAST version of Instagram to tp6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18824

--HG--
extra : moz-landing-system : lando
2019-02-15 15:41:53 +00:00
Rob Wood
e7157bdeaa Bug 1522972 - Make existing main Raptor code more modular; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18689

--HG--
extra : moz-landing-system : lando
2019-02-15 14:55:16 +00:00
marian.raiciof
2db0262d3b Bug 1515023 Abort page load test when mitmproxy recording can not be found r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D19649

--HG--
extra : moz-landing-system : lando
2019-02-15 10:48:25 +00:00
Florin Strugariu
b4402089b6 Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D16802

--HG--
extra : moz-landing-system : lando
2019-02-13 19:55:30 +00:00
Cosmin Sabou
75d8d540ab Backed out changeset a5ad662d5bbb (bug 1520447) for android build bustages. CLOSED TREE 2019-02-13 17:04:19 +02:00
Florin Strugariu
604b72af80 Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D16802

--HG--
extra : moz-landing-system : lando
2019-02-12 14:33:49 +00:00
Rob Wood
e9c99dfaf4 Bug 1520592 - Enable screen captures on pageload timeouts; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18878

--HG--
extra : moz-landing-system : lando
2019-02-08 21:33:35 +00:00
Florin Strugariu
92ed8bb564 Bug 1518776 Add Tumblr to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D16054

--HG--
extra : moz-landing-system : lando
2019-02-06 17:10:06 +00:00
Ionut Goldan
f53b36fd57 Bug 1520417 - Do not combine test name with measurement r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D18323

--HG--
extra : moz-landing-system : lando
2019-02-06 13:57:28 +00:00
Florin Strugariu
eb7e08c167 Bug 1525280 Raptor should clear app data before running tests on gecko view r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18686

--HG--
extra : moz-landing-system : lando
2019-02-06 12:01:03 +00:00
Andrew Halberstadt
8bc7850637 Bug 1483228 - [mozboot] Simplify get_state_dir()'s return value r=nalexander
mozboot.util.get_state_dir() returns a tuple of (<path>, <bool). The bool
denotes whether or not the state dir came from an environment variable.

But this value is only used in a single place, and is very easy to test for
anyway. It's not worth the added complexity it imposes on all other consumers
of this function. Let's just make this function return the path.

Differential Revision: https://phabricator.services.mozilla.com/D15723

--HG--
extra : moz-landing-system : lando
2019-02-04 20:52:31 +00:00
Bob Clary
a50cb45a62 Bug 1517178 - [raptor] disable adb verbose output during logcat collection, r=rwood. 2019-01-31 20:35:56 -08:00
Bob Clary
5ccc06113c Bug 1520130 - [raptor] Improve Raptor no raptor test results were found message, r=rwood. 2019-01-31 20:35:56 -08:00
Myk Melez
25349d2601 Bug 1518283 - prohibit blank lines at the beginning and end of blocks (eslint padded-blocks) r=mossop,Standard8
Differential Revision: https://phabricator.services.mozilla.com/D17526

--HG--
extra : moz-landing-system : lando
2019-01-30 17:26:25 +00:00
Dave Hunt
bff88648b3 Bug 1516015 - Fix proxy configuration for Raptor in Google Chrome; r=rwood
When investigating the timeouts for wikia.com on Google Chrome I discovered differences in the way proxy configuration is interpreted. It meant that insecure sites such as wikia were not using the proxy when launched via mach, and now that wikia.com redirects to a secure site we get redirected to a site that is not in the recordings. I have resolved this by fixing the command line argument for the proxy to include all protocols. It was also necesary to allow communication with the control server by adding localhost to the pass-through hosts.

I also removed the trailing disable-sync command line argument that was introduced recently in error.

Differential Revision: https://phabricator.services.mozilla.com/D17869

--HG--
extra : moz-landing-system : lando
2019-01-28 22:12:00 +00:00
Rob Wood
2863bd9494 Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
Depends on D17288

Differential Revision: https://phabricator.services.mozilla.com/D17289

--HG--
extra : moz-landing-system : lando
2019-01-25 18:01:45 +00:00
Rob Wood
d7bb330c5f Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D17288

--HG--
extra : moz-landing-system : lando
2019-01-24 19:06:49 +00:00
Rob Wood
aa7f384d91 Bug 1517738 - Have Raptor use the correct binary name when running on android in production; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D17251

--HG--
extra : moz-landing-system : lando
2019-01-22 19:56:58 +00:00
Rob Wood
0debaf69dc Bug 1520523 - Update Chromium version running with Raptor in production; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D16724

--HG--
extra : moz-landing-system : lando
2019-01-22 15:01:31 +00:00
Florin Strugariu
791aa236d2 Bug 1521459 Add the certutil path to 'LD_LIBRARY_PATH' variable when running a local android tp6 run r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D16970

--HG--
extra : moz-landing-system : lando
2019-01-21 14:58:30 +00:00
Rob Wood
ebffce4499 Bug 1521099 - Add FCP measurement to pageload on geckoview (tp6m-1); r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D17001

--HG--
extra : moz-landing-system : lando
2019-01-18 18:26:09 +00:00
Rob Wood
3226dda355 Bug 1518479 - Add Firefox FirstContentfulPaint measurement to raptor tests (on behalf of :jesup); r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D16599

--HG--
extra : moz-landing-system : lando
2019-01-17 20:00:07 +00:00
Rob Wood
fc98f89dd9 Bug 1506912 - Raptor tp6m-1 pageload test on android geckoview; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D15143

--HG--
extra : moz-landing-system : lando
2019-01-17 03:01:40 +00:00
Florin Strugariu
cd72b29090 Bug 1513365 Add Google Mail to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D15939

--HG--
extra : moz-landing-system : lando
2019-01-15 08:33:31 +00:00
Florin Strugariu
4aeedf5b2e Bug 1517800 Add Pinterest to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D16048

--HG--
extra : moz-landing-system : lando
2019-01-14 19:42:12 +00:00
Florin Strugariu
24d3ea5ce2 Bug 1518519 Add Paypal to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D16031

--HG--
extra : moz-landing-system : lando
2019-01-11 19:07:10 +00:00
Rob Wood
61b758639c Bug 1517738 - [raptor] Use the correct app name when running on fennec on beta; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D16209

--HG--
extra : moz-landing-system : lando
2019-01-11 19:25:22 +00:00
Florin Strugariu
daa7fbeb2e Bug 1513369 Add Yahoo Mail to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D14546

--HG--
extra : moz-landing-system : lando
2019-01-08 08:44:37 +00:00
Florin Strugariu
0654d55e71 Bug 1513367 Add Yahoo to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D14425

--HG--
extra : moz-landing-system : lando
2019-01-07 16:25:54 +00:00
Florin Strugariu
627ce82d7d Bug 1510404 Add Wikipedia to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D14134

--HG--
extra : moz-landing-system : lando
2019-01-07 16:11:25 +00:00
Dave Hunt
ba667e28c0 Bug 1517270 - Add pageload measurement types to --print-tests output; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D15642

--HG--
extra : moz-landing-system : lando
2019-01-04 17:04:27 +00:00
Rob Wood
e957682403 Bug 1517052 - [raptor] Do not report power usage when raptor fails to report results; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D15744

--HG--
extra : moz-landing-system : lando
2019-01-04 20:09:31 +00:00
Florin Strugariu
89ba457187 Bug 1512615 Support screenshots for tests r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D13972

--HG--
extra : moz-landing-system : lando
2019-01-04 13:02:44 +00:00
Rob Wood
d64a93fbd2 Bug 1511356 - Run speedometer on fennec via Raptor; r=jmaher,jlund
Differential Revision: https://phabricator.services.mozilla.com/D13946

--HG--
extra : moz-landing-system : lando
2019-01-02 20:43:21 +00:00
Geoff Brown
622b218aa2 Bug 1512983 - Add crash reporting for android raptor; r=rwood
Also fix the symbols path, so that desktop crash reports are symbolicated.
2018-12-31 09:18:00 -07:00
Rob Wood
0daee297ae Bug 1491097 - Add utils unit test; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D13153

--HG--
extra : moz-landing-system : lando
2018-11-28 18:44:02 +00:00
Rob Wood
a5e0666632 Bug 1491097 - Add manifest unit test; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D13139

--HG--
extra : moz-landing-system : lando
2018-12-28 20:01:10 +00:00
Rob Wood
ddd69f99e8 Bug 1504013 - Add the ability to measure loadtime in raptor, and use loadtime as the overall test result for tp6 suites; r=jmaher,acreskey
Differential Revision: https://phabricator.services.mozilla.com/D14306

--HG--
extra : moz-landing-system : lando
2018-12-27 21:35:13 +00:00
Bob Clary
9526040894 Bug 1512038 - Handle different batterystats output for Raptor power tests on Android 7, r=rwood. 2018-12-21 06:12:19 -08:00
Bob Clary
bea8a390ce Bug 1512038 - Enable raptor-speedometer-geckoview-power for android-hw-{p2,g5} on try, r=rwood.
Rap-P treeherder group for Raptor power tests.

Emit separate PERFHERDER_DATA for power in addition to the performance measurements.

Use magic --host HOST_IP value to have framework load host ip from environment
variable HOST_IP.
2018-12-21 06:12:18 -08:00
Rob Wood
bfc96ac22a Bug 1473997 - Add support to Raptor to receive/format/output power data; r=jmaher
Depends on D14997

Differential Revision: https://phabricator.services.mozilla.com/D14998

--HG--
extra : moz-landing-system : lando
2018-12-19 21:13:55 +00:00
Rob Wood
c2349ad0f8 Bug 1473997 - find a way to measure the battery usage of geckoview (:bc's initial patch); r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D14997

--HG--
extra : moz-landing-system : lando
2018-12-19 20:52:28 +00:00
Florin Strugariu
70f9100da6 Bug 1511029 Mitmproxy alternate-server-replay returns last found request ignoring match algorithm r=acreskey
Mitmproxy alternate-server-replay returns last found request ignoring match algorithm

Differential Revision: https://phabricator.services.mozilla.com/D13408

--HG--
extra : moz-landing-system : lando
2018-12-19 14:19:30 +00:00
Razvan Maries
f658ebcbab Merge mozilla-inbound to mozilla-central a=merge 2018-12-20 07:04:06 +02:00
Geoff Brown
e5e351a5a2 Bug 1515189 - Consolidate ADBDevice and ADBAndroid classes; r=bc 2018-12-19 14:04:02 -07:00
Florin Strugariu
1435da9871 Bug 1513837 Add ebay to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D14543

--HG--
extra : moz-landing-system : lando
2018-12-18 17:45:07 +00:00
Florin Strugariu
4508b0fd5b Bug 1513373 Add Twitter to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D14542

--HG--
extra : moz-landing-system : lando
2018-12-18 17:02:55 +00:00
Andrew Creskey
96ae71fa3f Bug 1514752 Define hero user timing before performance entry is created r=rwood
1-line fix to hero element timing: the performance entry would show up as 'undefined' in profiles because the variable was defined later.

Differential Revision: https://phabricator.services.mozilla.com/D14746

--HG--
extra : moz-landing-system : lando
2018-12-17 22:40:43 +00:00
Rob Wood
a63f5d5395 Bug 1506912 - Raptor support for tp6 pageload on android geckoview; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D14186

--HG--
extra : moz-landing-system : lando
2018-12-14 07:19:59 +00:00
Florin Strugariu
06b85a3fce Bug 1508375 Add Instagram to tp6 r=rwood,davehunt rwood
Differential Revision: https://phabricator.services.mozilla.com/D12520

--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-7.manifest
extra : moz-landing-system : lando
2018-12-12 21:23:34 +00:00
Gijs Kruitbosch
28ea3cc015 Bug 1509904 - always use backslashes on Windows, r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D12935

--HG--
extra : moz-landing-system : lando
2018-11-26 21:43:37 +00:00
Rob Wood
8a44f27935 Bug 1509381 - Fix debug-mode page-cycles value when page-cycles < 2; r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D12704

--HG--
extra : moz-landing-system : lando
2018-11-23 11:26:18 +00:00
Rob Wood
1e43108db5 Bug 1509009 - Fix proxy policy for raptor http pageload; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D12698

--HG--
extra : moz-landing-system : lando
2018-11-22 20:38:17 +00:00
Rob Wood
6822f625cb Bug 1508692 - Use Firefox policies instead of autoconfig for pageload tp6; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D12453

--HG--
extra : moz-landing-system : lando
2018-11-20 22:18:44 +00:00
Razvan Maries
208d16134b Merge mozilla-inbound to mozilla-central a=merge 2018-11-20 07:03:17 +02:00
florin.strugariu
8ef2b84cb6 Bug 1503990 add additional pages to tp6 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D11058

--HG--
extra : moz-landing-system : lando
2018-11-20 01:21:38 +00:00
Rob Wood
a269e5f630 Bug 1470450 - Add a debug mode to raptor; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D11937

--HG--
extra : moz-landing-system : lando
2018-11-16 19:30:55 +00:00
Rob Wood
78cd9dab3f Bug 1502036 - Subtest results for raptor speedometer have incorrect lower_is_better setting; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D12142

--HG--
extra : moz-landing-system : lando
2018-11-16 17:25:32 +00:00
arthur.iakab
c0b26c4076 Merge inbound to mozilla-central a=merge 2018-11-15 11:54:15 +02:00
Rob Wood
d40e331dae Bug 1499539 - Add a raptor command that will just list all available raptor tests; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D11379

--HG--
extra : moz-landing-system : lando
2018-11-14 22:12:03 +00:00
Bob Clary
dcc74f176f Bug 1499253 - fix setting chrome proxy arguments when using playback, r=rwood. 2018-11-13 19:02:40 -08:00
Robert Strong
ce780910f7 Bug 1506917 - Don't attempt to check for updates from Firefox's nsBrowserGlue.js when running tests. r=ted
This adds the app.update.checkInstallTime pref with a value of false in all tests that have the app.update.disabledForTesting pref except for geckodriver which is covered by bug 1508283.
2018-11-19 07:33:33 -08:00
Bob Clary
9c728df81e Bug 1506404 - [raptor] Convert dos line endings to unix, r=rwood. 2018-11-14 17:48:49 -08:00
Bob Clary
91a1fd6dbd Bug 1499352 - [raptor] Allow the use of wifi and adb over tcp to serve pages, r=rwood. 2018-11-10 03:10:08 -08:00
florin.strugariu
87801ab786 Bug 1505428 raptor --page-cycles only works at 'subtest' level r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D11455

--HG--
extra : moz-landing-system : lando
2018-11-09 13:48:19 +00:00
Rob Wood
34ed2a4281 Bug 1505526 - Rename existing raptor tp6 to tp6-1 and raptor gdocs to tp6-2; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D11234

--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-1.manifest
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-gdocs.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-2.manifest
rename : testing/raptor/raptor/tests/raptor-tp6.ini => testing/raptor/raptor/tests/raptor-tp6-1.ini
rename : testing/raptor/raptor/tests/raptor-gdocs.ini => testing/raptor/raptor/tests/raptor-tp6-2.ini
extra : moz-landing-system : lando
2018-11-07 21:33:21 +00:00
Rob Wood
3ff1ca5cb2 Bug 1505479 - Add raptor webext browser toolbar icon; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D11193

--HG--
extra : moz-landing-system : lando
2018-11-07 17:46:24 +00:00
Rob Wood
bbc7462eda Bug 1503398 - Increase page-cycle limit to 3 while gecko-profiling is on; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10756

--HG--
extra : moz-landing-system : lando
2018-11-02 19:58:00 +00:00
Ciure Andrei
194c521f36 Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE 2018-11-02 18:59:30 +02:00
Rob Wood
6133912e19 Bug 1503999 - Enable e10s on the geckoview example app when running raptor; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D10715

--HG--
extra : moz-landing-system : lando
2018-11-02 14:01:03 +00:00
Rob Wood
5b64e46782 Bug 1491114 - Add ability to specify page_cycles and page_timeout on the command line; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10599

--HG--
extra : moz-landing-system : lando
2018-11-01 19:54:37 +00:00
Rob Wood
e8ccc57b1e Bug 1501040 - Raptor fix so unsigned webext will load on mozilla-beta; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10453

--HG--
extra : moz-landing-system : lando
2018-11-01 08:43:49 +00:00
Rob Wood
f5b7112fd5 Bug 1502873 - More tweaks for raptor gecko profiling support; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10267

--HG--
extra : moz-landing-system : lando
2018-10-31 21:24:58 +00:00
Rob Wood
0f2e4886fa Bug 1492913 - When gecko profiling is enabled locally, have resulting gecko profiles open automatically in perf-html.io; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10300

--HG--
extra : moz-landing-system : lando
2018-10-30 23:23:39 +00:00
Rob Wood
1dfcab1a30 Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D10114

--HG--
rename : taskcluster/taskgraph/templates/talos-profile.yml => taskcluster/taskgraph/templates/gecko-profile.yml
extra : moz-landing-system : lando
2018-10-30 15:15:32 +00:00
florin.strugariu
2c1a3776aa Bug 1502483 raptor-test should test for presence of Git and emit an error message if it's not found r=rwood rwood
Differential Revision: https://phabricator.services.mozilla.com/D10054

--HG--
extra : moz-landing-system : lando
2018-10-29 16:43:22 +00:00
Rob Wood
d1b2d84bf4 Bug 1473079 - Add gecko profiling support to raptor (part 3: enable gecko profiling); r=jmaher
Depends on D6309

Differential Revision: https://phabricator.services.mozilla.com/D6918

--HG--
extra : moz-landing-system : lando
2018-10-29 13:35:21 +00:00
Rob Wood
e154044f63 Bug 1473079 - Add gecko profiling support to raptor (part 2: limit page cycles); r=jmaher
Depends on D6286

Differential Revision: https://phabricator.services.mozilla.com/D6309

--HG--
extra : moz-landing-system : lando
2018-10-29 13:33:13 +00:00
Rob Wood
6f148acd8e Bug 1473079 - Add gecko profiling support to raptor (part 1: cmd line args); r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D6286

--HG--
extra : moz-landing-system : lando
2018-10-29 13:32:25 +00:00
Bob Clary
a62c29cd3e Bug 1502190 - bump mozdevice requirements for raptor, marionette, mozrunner, r=gbrown. 2018-10-26 09:51:37 -07:00
Rob Wood
c5742407d9 Bug 1495903 - When running raptor on chromium, remove the webext from the cmd line after each test is finished; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9709

--HG--
extra : moz-landing-system : lando
2018-10-24 20:18:41 +00:00
Rob Wood
562d40574c Bug 1501809 - Fix Raptor tp6 'main application timed out'; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9714

--HG--
extra : moz-landing-system : lando
2018-10-24 22:30:50 +00:00
florin.strugariu
e6070d471c Bug 1501788 - godot tweaks r=jmaher jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9754

--HG--
extra : moz-landing-system : lando
2018-10-25 11:34:21 +00:00
florin.strugariu
c7398f447c Bug 1493648 - Can we run the Godot Engine wasm benchmark in automation? r=jmaher
Reviewers: jmaher

Tags: #secure-revision

Bug #: 1493648

Differential Revision: https://phabricator.services.mozilla.com/D8957
2018-10-17 10:40:57 +03:00
Raphael Pierzina
4409ba6681 Bug 1501224 - Update version requirement on mozprofile for raptor; r=davehunt
Depends on D9515

Differential Revision: https://phabricator.services.mozilla.com/D9516

--HG--
extra : moz-landing-system : lando
2018-10-23 16:40:31 +00:00
Rob Wood
48a9b391fa Bug 1500236 - Have Raptor use '127.0.0.1' instead of 'localhost' to fix timeouts on OSX; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9147

--HG--
extra : moz-landing-system : lando
2018-10-18 20:30:13 +00:00
florin.strugariu
56904c821f Bug 1487374 benchmark_score for Sunspider Chrome is unnecessary r=jmaher jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8838

--HG--
extra : moz-landing-system : lando
2018-10-16 12:48:19 +00:00
Rob Wood
21874f0702 Bug 1496544 - Don't timeout the pageload / fail raptor test when TTFI is not available; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8590

--HG--
extra : moz-landing-system : lando
2018-10-15 17:06:58 +00:00