Commit Graph

228 Commits

Author SHA1 Message Date
Bob Clary
73d6f12ca4 Bug 1533848 - Make the control server multithreaded, r=rwood.
Differential Revision: https://phabricator.services.mozilla.com/D26972

--HG--
extra : moz-landing-system : lando
2019-04-16 19:26:26 +00:00
Florin Strugariu
ae84bf2e0a Bug 1518791 Add Microsoft Outlook to tp6 r=davehunt
Recording in bug comment.

https://drive.google.com/open?id=1p1hCJfW-d0gbEZNWHP3NMIr4sI3lPHEV

Differential Revision: https://phabricator.services.mozilla.com/D26143

--HG--
extra : moz-landing-system : lando
2019-04-15 07:50:35 +00:00
Florin Strugariu
debe0f9baf Bug 1513835 Add LinkedIn to tp6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26896

--HG--
extra : moz-landing-system : lando
2019-04-12 17:03:32 +00:00
Ionut Goldan
e0060de75c Bug 1539437 - Replace Chrome with Chromium mentionings where needed r=sparky,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25094

--HG--
rename : taskcluster/ci/test/raptor-chrome.yml => taskcluster/ci/test/raptor-chromium.yml
extra : moz-landing-system : lando
2019-04-12 10:33:24 +00:00
Florin Strugariu
4348f3974a Bug 1509835 Raptor test raptor-tp6-amazon-chrome is not rendering a completely loaded amazon site r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D25597

--HG--
extra : moz-landing-system : lando
2019-04-09 09:49:03 +00:00
Florin Strugariu
528fad068d Bug 1519827 Measure "loadtime" in all tp6 tests r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26674

--HG--
extra : moz-landing-system : lando
2019-04-11 07:22:17 +00:00
Marian Raiciof
e8b1485d83 Bug 1533304 - remove disabled attribute for raptor-tp6m-bbc-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26665

--HG--
extra : moz-landing-system : lando
2019-04-10 12:53:29 +00:00
Marian Raiciof
0870b461b1 Bug 1533666 - Remove disabled attribute for raptor-tp6m-cnn-ampstories-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26662

--HG--
extra : moz-landing-system : lando
2019-04-10 12:52:04 +00:00
Marian Raiciof
1ffc7bf45a Bug 1533306 - remove disabled attribute for raptor-tp6m-microsoft-support-geckoview r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26670

--HG--
extra : moz-landing-system : lando
2019-04-10 12:57:25 +00:00
Florin Strugariu
c4d7037af0 Bug 1542757 - Investigate and fix TEST-UNEXPECTED-FAIL: test 'raptor-tp6-paypal-chrome' r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26524

--HG--
extra : moz-landing-system : lando
2019-04-08 17:20:16 +00:00
alexandru.ionescu
faeccf1361 Bug 1532545 Add support for running page load tests against Fennec r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25723

--HG--
extra : moz-landing-system : lando
2019-04-08 17:47:59 +00:00
Rob Wood
226e9fab72 Bug 1533008 - Fix Raptor Chromium OSX jobs by using mock-keychain; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25861

--HG--
extra : moz-landing-system : lando
2019-04-04 14:54:38 +00:00
Ionut Goldan
f1eb1ac35c Bug 1538201 - Correctly extract subtest_lower_is_better value r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25781

--HG--
extra : moz-landing-system : lando
2019-04-03 20:07:38 +00:00
Henrik Skupin
e539398061 Bug 1541215 - [raptor] Use proper timeout values for test_start_browser. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25859

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:45 +00:00
Henrik Skupin
e0b05f4996 Bug 1541215 - [raptor] Make post_startup_delay configurable. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25857

--HG--
extra : moz-landing-system : lando
2019-04-04 06:13:05 +00:00
Henrik Skupin
e282f9c968 Bug 1541215 - [raptor] Check for failures in spawned thread for test_start_browser. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25855

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:23 +00:00
Henrik Skupin
2bb8060847 Bug 1541215 - [raptor] Fall back to 1 browser_cycle / page_cycle if test doesn't specify a value. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25854

--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:38 +00:00
Florin Strugariu
f0624a23a4 Bug 1540629 remove screenshots from tp6-8-404 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25563

--HG--
extra : moz-landing-system : lando
2019-04-01 15:00:50 +00:00
Stephen Donner
f9d59415ac Bug 1534778. Abstract and enable power tests for non-GeckoView browsers. r=rwood,bc
Differential Revision: https://phabricator.services.mozilla.com/D24971

--HG--
extra : moz-landing-system : lando
2019-03-29 18:47:35 +00:00
alexandru.ionescu
1902546a62 Bug 1534628 add benchmark measurement to raptor error handeling r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D23304

--HG--
extra : moz-landing-system : lando
2019-03-29 14:36:56 +00:00
Marian Raiciof
e2de20e8a8 Bug 1536095 - Add aframe.io Animation page to tp6-m r=davehunt,rwood
Bug 1536095 - Add aframe.io Animation page to tp6-m

Differential Revision: https://phabricator.services.mozilla.com/D23862

--HG--
extra : moz-landing-system : lando
2019-03-29 14:41:31 +00:00
alexandru.ionescu
548250ddec Bug 1536758 Switch to using event listener instead of overloading window.onload in runner/measure.js r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D24163

--HG--
extra : moz-landing-system : lando
2019-03-29 13:14:33 +00:00
Rob Wood
2efaefdfc3 Bug 1539438 - Expand tp6m-cold-1; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25060

--HG--
extra : moz-landing-system : lando
2019-03-29 13:28:06 +00:00
Florin Strugariu
5ef71add7a Bug 1457274 Upgrade mitmproxy in production r=rwood,tarek
Differential Revision: https://phabricator.services.mozilla.com/D21374

--HG--
rename : testing/raptor/raptor/playback/alternate-server-replay.py => testing/raptor/raptor/playback/alternate-server-replay-2.0.2.py
extra : moz-landing-system : lando
2019-03-29 09:54:53 +00:00
Rob Wood
a720305501 Bug 1536874 - Temporarily remove measuring TTFI and Hero elements in order to stabilize pageload tests; r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D25112

--HG--
extra : moz-landing-system : lando
2019-03-28 09:44:47 +00:00
Rob Wood
b309039307 Bug 1538786 - Fix 'KeyError: suites' when a tp6 page times out; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D24881

--HG--
extra : moz-landing-system : lando
2019-03-27 09:10:39 +00:00
shindli
8af903f814 Backed out changeset 030cb27161ee (bug 1538786) for raptor failures in testing/raptor/test/test_manifest.py::test_get_raptor_test_list_firefox CLOSED TREE 2019-03-26 04:52:51 +02:00
Rob Wood
b6d015016c Bug 1538786 - Fix 'KeyError suites' when a tp6 page times out; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D24746

--HG--
extra : moz-landing-system : lando
2019-03-25 19:30:38 +00:00
Rob Wood
17dec601e9 Bug 1533423 - Raptor cold page-load support for Firefox android geckoview; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D24464

--HG--
extra : moz-landing-system : lando
2019-03-22 15:27:27 +00:00
Henrik Skupin
6eea3b81dc Bug 1536112 - testing/raptor misses moz.build file. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D23936

--HG--
extra : moz-landing-system : lando
2019-03-19 03:45:24 +00:00
Nick Alexander
7a1c539e39 Bug 1521967 - Part 1: Use MOZ_HOST_BIN to find certutil in mach raptor-test for Android. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D17396

--HG--
extra : moz-landing-system : lando
2019-03-18 16:50:57 +00:00
Marian Raiciof
05db28a64b Bug 1534956 - Add Cristiano's facebook page to tp6-m r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D23317

--HG--
extra : moz-landing-system : lando
2019-03-15 11:46:22 +00:00
Tarek Ziadé
2f3c136a11 Bug 1534788 - add the playback_args option r=Bebe,rwood
This patch also removes custom_script and stops
executing start() in the constructor.

Differential Revision: https://phabricator.services.mozilla.com/D23288

--HG--
extra : moz-landing-system : lando
2019-03-13 14:50:03 +00:00
marian.raiciof
45cd40fa58 Bug 1527849 Add google search to tp6-m r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D19907

--HG--
extra : moz-landing-system : lando
2019-03-13 10:31:34 +00:00
Joel Maher
29cb950a1e Bug 1490048 - add cranelift to raptor wasm-misc and wasm-godot tests. r=bbouvier,rwood
add cranelift to raptor wasm-misc and wasm-godot tests.

Differential Revision: https://phabricator.services.mozilla.com/D23144

--HG--
extra : moz-landing-system : lando
2019-03-12 14:42:45 +00:00
Kartikaya Gupta
5486eb421d Bug 1533517 - [mozdevice] Remove FirefoxOS candidate test root paths. r=bc
Differential Revision: https://phabricator.services.mozilla.com/D22952

--HG--
extra : moz-landing-system : lando
2019-03-12 13:55:51 +00:00
Florin Strugariu
63eb0a0132 Bug 1532671 output what measurements are still pending though when there is a page timeout in raptor r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D22107

--HG--
extra : moz-landing-system : lando
2019-03-12 12:16:09 +00:00
marian.raiciof
899b667ee0 Bug 1529207 - Add new Raptor tests in tp6m-4 r=davehunt,rwood
Differential Revision: https://phabricator.services.mozilla.com/D20852

--HG--
extra : moz-landing-system : lando
2019-03-12 12:01:27 +00:00
alexandru.ionescu
78eb1bc26f Bug 1529212 Add new Raptor tests in tp6m-7 r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D21000

--HG--
extra : moz-landing-system : lando
2019-03-11 14:30:12 +00:00
alexandru.ionescu
941c77dc3a Bug 1529211 Add new Raptor tests in tp6m-6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20820

--HG--
extra : moz-landing-system : lando
2019-03-07 16:37:30 +00:00
Tarek Ziadé
9ed1006ca9 Bug 1528992 - extract raptor mitmproxy integration - r=rwood,Bebe,gbrown
This patch moves testing/raptor/raptor/playback into its own testing package in testing/mozbase/mozproxy
so we can use the proxy in other places than Raptor.

Differential Revision: https://phabricator.services.mozilla.com/D21200

--HG--
rename : testing/raptor/raptor/playback/__init__.py => testing/mozbase/mozproxy/mozproxy/__init__.py
rename : testing/raptor/raptor/playback/base.py => testing/mozbase/mozproxy/mozproxy/backends/base.py
rename : testing/raptor/raptor/playback/mitmproxy.py => testing/mozbase/mozproxy/mozproxy/backends/mitm.py
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-linux64.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-osx.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-win.manifest
rename : testing/raptor/raptor/playback/mitmproxy_requirements.txt => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy_requirements.txt
extra : moz-landing-system : lando
2019-03-06 17:13:21 +00:00
alexandru.ionescu
1b4fb7feae Bug 1532542 raptor-tp6m-youtube-geckoview output problem r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D22061

--HG--
extra : moz-landing-system : lando
2019-03-05 11:04:30 +00:00
Rob Wood
18ad654c50 Bug 1530353 - Temporarily stop measuring hero element in tp6-1 to prevent intermittent failures; r=acreskey,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D21802

--HG--
extra : moz-landing-system : lando
2019-03-04 21:43:21 +00:00
Andrew Erickson
8253608b85 Bug 1530546: change hostutils version in raptor test r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D22009

--HG--
extra : moz-landing-system : lando
2019-03-04 21:08:33 +00:00
Rob Wood
28ef99fbcd Bug 1531169 - Add the ability to run Raptor page-load tests against live sites; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D21466

--HG--
extra : moz-landing-system : lando
2019-03-04 20:40:51 +00:00
Rob Wood
46accc2092 Bug 1531441 - Revert disabling of raptor-unity-webgl-geckoview; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D21751

--HG--
extra : moz-landing-system : lando
2019-03-01 21:56:40 +00:00
alexandru.ionescu
361d5151c4 Bug 1529210 Add new Raptor tests in tp6m-5 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D20815

--HG--
extra : moz-landing-system : lando
2019-03-01 14:46:36 +00:00
Rob Wood
3042085516 Bug 1531079 - Stop capturing Firefox JS errors and warnings in the Raptor logs; r=stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D21399

--HG--
extra : moz-landing-system : lando
2019-02-27 19:38:46 +00:00
Florin Strugariu
7a132cc405 Bug 1523877 Add Instagram and bing to tp6-m r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18072

--HG--
extra : moz-landing-system : lando
2019-02-28 08:46:33 +00:00
Narcis Beleuzu
085345ac87 Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures. r=jmaher
Reviewers: jmaher, rwood

Reviewed By: jmaher

Subscribers: reviewbot, jmaher

Bug #: 1524495

Differential Revision: https://phabricator.services.mozilla.com/D20939

--HG--
extra : rebase_source : 0dfc90e334d0d51b135614d5b48d7d4eb24866dd
extra : histedit_source : 42e6fdea6fd0a8fe5eaac00f3acf8d72d082e58f
2019-02-26 17:20:58 +02:00