Commit Graph

93 Commits

Author SHA1 Message Date
Ciure Andrei
194c521f36 Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE 2018-11-02 18:59:30 +02:00
Rob Wood
6133912e19 Bug 1503999 - Enable e10s on the geckoview example app when running raptor; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D10715

--HG--
extra : moz-landing-system : lando
2018-11-02 14:01:03 +00:00
Rob Wood
5b64e46782 Bug 1491114 - Add ability to specify page_cycles and page_timeout on the command line; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10599

--HG--
extra : moz-landing-system : lando
2018-11-01 19:54:37 +00:00
Rob Wood
e8ccc57b1e Bug 1501040 - Raptor fix so unsigned webext will load on mozilla-beta; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10453

--HG--
extra : moz-landing-system : lando
2018-11-01 08:43:49 +00:00
Rob Wood
f5b7112fd5 Bug 1502873 - More tweaks for raptor gecko profiling support; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10267

--HG--
extra : moz-landing-system : lando
2018-10-31 21:24:58 +00:00
Rob Wood
0f2e4886fa Bug 1492913 - When gecko profiling is enabled locally, have resulting gecko profiles open automatically in perf-html.io; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D10300

--HG--
extra : moz-landing-system : lando
2018-10-30 23:23:39 +00:00
Rob Wood
1dfcab1a30 Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D10114

--HG--
rename : taskcluster/taskgraph/templates/talos-profile.yml => taskcluster/taskgraph/templates/gecko-profile.yml
extra : moz-landing-system : lando
2018-10-30 15:15:32 +00:00
florin.strugariu
2c1a3776aa Bug 1502483 raptor-test should test for presence of Git and emit an error message if it's not found r=rwood rwood
Differential Revision: https://phabricator.services.mozilla.com/D10054

--HG--
extra : moz-landing-system : lando
2018-10-29 16:43:22 +00:00
Rob Wood
d1b2d84bf4 Bug 1473079 - Add gecko profiling support to raptor (part 3: enable gecko profiling); r=jmaher
Depends on D6309

Differential Revision: https://phabricator.services.mozilla.com/D6918

--HG--
extra : moz-landing-system : lando
2018-10-29 13:35:21 +00:00
Rob Wood
e154044f63 Bug 1473079 - Add gecko profiling support to raptor (part 2: limit page cycles); r=jmaher
Depends on D6286

Differential Revision: https://phabricator.services.mozilla.com/D6309

--HG--
extra : moz-landing-system : lando
2018-10-29 13:33:13 +00:00
Rob Wood
6f148acd8e Bug 1473079 - Add gecko profiling support to raptor (part 1: cmd line args); r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D6286

--HG--
extra : moz-landing-system : lando
2018-10-29 13:32:25 +00:00
Bob Clary
a62c29cd3e Bug 1502190 - bump mozdevice requirements for raptor, marionette, mozrunner, r=gbrown. 2018-10-26 09:51:37 -07:00
Rob Wood
c5742407d9 Bug 1495903 - When running raptor on chromium, remove the webext from the cmd line after each test is finished; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9709

--HG--
extra : moz-landing-system : lando
2018-10-24 20:18:41 +00:00
Rob Wood
562d40574c Bug 1501809 - Fix Raptor tp6 'main application timed out'; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9714

--HG--
extra : moz-landing-system : lando
2018-10-24 22:30:50 +00:00
florin.strugariu
e6070d471c Bug 1501788 - godot tweaks r=jmaher jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9754

--HG--
extra : moz-landing-system : lando
2018-10-25 11:34:21 +00:00
florin.strugariu
c7398f447c Bug 1493648 - Can we run the Godot Engine wasm benchmark in automation? r=jmaher
Reviewers: jmaher

Tags: #secure-revision

Bug #: 1493648

Differential Revision: https://phabricator.services.mozilla.com/D8957
2018-10-17 10:40:57 +03:00
Raphael Pierzina
4409ba6681 Bug 1501224 - Update version requirement on mozprofile for raptor; r=davehunt
Depends on D9515

Differential Revision: https://phabricator.services.mozilla.com/D9516

--HG--
extra : moz-landing-system : lando
2018-10-23 16:40:31 +00:00
Rob Wood
48a9b391fa Bug 1500236 - Have Raptor use '127.0.0.1' instead of 'localhost' to fix timeouts on OSX; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D9147

--HG--
extra : moz-landing-system : lando
2018-10-18 20:30:13 +00:00
florin.strugariu
56904c821f Bug 1487374 benchmark_score for Sunspider Chrome is unnecessary r=jmaher jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8838

--HG--
extra : moz-landing-system : lando
2018-10-16 12:48:19 +00:00
Rob Wood
21874f0702 Bug 1496544 - Don't timeout the pageload / fail raptor test when TTFI is not available; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8590

--HG--
extra : moz-landing-system : lando
2018-10-15 17:06:58 +00:00
Rob Wood
8bee4877e5 Bug 1496226 - Be sure raptor's capturing of first-contentful-paint in google chrome is the correct entry; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D8731

--HG--
extra : moz-landing-system : lando
2018-10-15 15:43:13 +00:00
Randell Jesup
1e918164f2 Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood 2018-10-11 13:23:38 -04:00
shindli
0f211616dc Backed out 3 changesets (bug 1299118) for ES lint failures
Backed out changeset 14451eb9a2b8 (bug 1299118)
Backed out changeset e5adc30bdf7f (bug 1299118)
Backed out changeset 8f7bb583fbb5 (bug 1299118)
2018-10-11 20:47:58 +03:00
Randell Jesup
94b05e1202 Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood 2018-10-11 13:23:38 -04:00
Rob Wood
e1c323b919 Bug 1460742 - Add raptor 'tp6' for google chrome; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D7524

--HG--
extra : moz-landing-system : lando
2018-10-02 22:15:15 +00:00
Rob Wood
24a553e036 Bug 1466648 - add unity3d benchmark to raptor/android; r=bc,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D7114

--HG--
extra : moz-landing-system : lando
2018-10-01 19:01:57 +00:00
Joel Maher
130b3341e6 Bug 1458242 - add DOMContentFlushed to tp6 as a measurement. r=rwood
add DOMContentFlushed to tp6, collect it and return the geometric mean of all measurements.

Differential Revision: https://phabricator.services.mozilla.com/D5797

--HG--
extra : moz-landing-system : lando
2018-09-14 13:51:05 +00:00
Rob Wood
c4f0d02624 Bug 1478775 - Mark raptor test failed if any one test page times out r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D5463

--HG--
extra : moz-landing-system : lando
2018-09-13 19:17:10 +00:00
Dave Hunt
36100c0619 Bug 1471888 - Update mozprofile version used by raptor; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D5594

--HG--
extra : moz-landing-system : lando
2018-09-11 21:09:23 +00:00
Edwin Gao
edc30e1b35 Bug 1488327 - Use new ADBDevice.reverse in Raptor r=rwood
Changed two occurrences of _cmd['reverse', port, port] to use the create_socket_connection method from 1484238.
Added code at end of clean_up() to remove opened socket connections.

Checked via manual execution of raptor-speedometer that opened reverse socket connections are removed at conclusion of test.

Differential Revision: https://phabricator.services.mozilla.com/D5286

--HG--
extra : moz-landing-system : lando
2018-09-07 20:11:55 +00:00
Rob Wood
d421d8b58f Bug 1478794 - Raptor should turn off the browser proxy after pageload tests are finished r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D5202

--HG--
extra : moz-landing-system : lando
2018-09-07 08:29:07 +00:00
Rob Wood
67f06625a7 Bug 1461422 - Remove raptor/setup.py r=egao
Differential Revision: https://phabricator.services.mozilla.com/D5076

--HG--
extra : moz-landing-system : lando
2018-09-05 20:19:43 +00:00
Margareta Eliza Balazs
b5430ee4da Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-09-05 15:42:52 +03:00
Ionut Goldan
03af62563c Bug 1488422 - Use boolean literal instead of string r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D5012

--HG--
extra : moz-landing-system : lando
2018-09-05 09:45:50 +00:00
Bob Clary
1155dedeb1 Bug 1487244 - Remove mach's --debug-command argument before starting Raptor, r=gbrown. 2018-08-30 19:04:46 -07:00
Bob Clary
7aed758f49 Bug 1487229 - Raptor should make sure app isn't already running before starting app, r=jmaher. 2018-08-30 19:04:46 -07:00
Bob Clary
df0e8c3957 Bug 1486908 - ./mach raptor-test should prompt to install geckoview_example if needed, r=gbrown. 2018-08-30 19:04:46 -07:00
Bob Clary
488c0b8b66 Bug 1486908 - Raptor should terminate with an exception if the app isn't installed during run_test, r=jmaher.
Otherwise the resourcemonitor will hang and it will wait 1800 seconds to timeout.
2018-08-30 19:04:46 -07:00
Bob Clary
a09d9d7eaf Bug 1486892 - Do not check for binary path when calling raptor via mach, r=jmaher. 2018-08-30 19:04:45 -07:00
Geoff Brown
111bbc5fbe Bug 1488544 - Do not check for android device when running desktop raptor-test; r=rwood 2018-09-04 15:16:18 -06:00
Joel Maher
49ed6e30bf Bug 1486789 - support subtest units independent of benchmark units, set values for speedometer. r=ahal
allow support in .ini files for subtest units and lower_is_better values; implement this for speedometer.

Differential Revision: https://phabricator.services.mozilla.com/D4465

--HG--
extra : moz-landing-system : lando
2018-08-29 21:01:02 +00:00
Joel Maher
924aa36a1b Bug 1486788 - make sunspider lower_is_better and indicate it is a 'ms' benchmark. r=ahal
Adjust sunspider raptor test to make lower_is_better=true and treat it as 'ms' and not a 'score'

Differential Revision: https://phabricator.services.mozilla.com/D4454

--HG--
extra : moz-landing-system : lando
2018-08-28 16:30:58 +00:00
Joel Maher
265d508303 Bug 1482151 - run wasm-misc in baseline and ion optional modes. r=ahal
move wasm-misc and unity3d benchmarks to tier2; run wasm-misc in different preferences

Differential Revision: https://phabricator.services.mozilla.com/D3903

--HG--
extra : moz-landing-system : lando
2018-08-21 18:21:40 +00:00
Joel Maher
c0d0bc65ae Bug 1481708 - run wasm-misc on desktop browsers. r=rwood
support wasm-misc as a benchmark in raptor

Differential Revision: https://phabricator.services.mozilla.com/D3616

--HG--
extra : moz-landing-system : lando
2018-08-17 19:22:29 +00:00
Rob Wood
eeb6464d68 Bug 1480841 - Raptor support for running speedometer on geckoview r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D3446

--HG--
extra : moz-landing-system : lando
2018-08-17 18:06:22 +00:00
Joel Maher
53873d772b Bug 1482149 - raptor needs the ability to set preferences from configs. r=rwood
support adding prefs in raptor .ini files

Differential Revision: https://phabricator.services.mozilla.com/D3347

--HG--
extra : moz-landing-system : lando
2018-08-15 12:43:15 +00:00
Andrew Halberstadt
3d3d8fe5f7 Bug 1482057 - [raptor] Fix benchmark setup on Windows, r=jmaher
This fixes a bug where the benchmarks weren't being copied properly on Windows.
While it is slightly slower to add every file to the manifest (~0.2 seconds), it
still outperforms shutil.copytree and is more robust (will use links on Linux/Mac
while using copy on Windows).

Differential Revision: https://phabricator.services.mozilla.com/D3234

--HG--
extra : moz-landing-system : lando
2018-08-14 18:06:20 +00:00
Rob Wood
c9ecdec925 Bug 1473365 - migrate AWFY assortedDOM tests to a raptor benchmark r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D3046

--HG--
extra : moz-landing-system : lando
2018-08-13 21:30:33 +00:00
Andrew Halberstadt
7dde9cf26e Bug 1472800 - [ci] Add the raptor unity-webgl benchmark to taskcluster r=rwood
Enables the benchmark in CI, uses a fetch task to download the benchmark.

Depends on D2307.

Differential Revision: https://phabricator.services.mozilla.com/D2469

--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:40 +00:00
Andrew Halberstadt
5df71be96e Bug 1472800 - [raptor] Add the unity-webgl benchmark r=rwood
This will run the benchmark in taskcluster as well as allow us to run it locally with:
./mach raptor-test -t raptor-unity-webgl

Depends on D2306.

Differential Revision: https://phabricator.services.mozilla.com/D2307

--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:02 +00:00