Commit Graph

6507 Commits

Author SHA1 Message Date
Mike Hommey
14434b6fd9 Bug 1573722 - Remove browser/config/mozconfigs/linux64/hazards. r=sfink
The mozconfig in the task definition is overriden in hazard-browser.sh,
so it has effectively no effect, and hazard-browser.sh has been using
js/src/devtools/rootAnalysis/mozconfig.haz since bug 1321014.

Differential Revision: https://phabricator.services.mozilla.com/D41879

--HG--
extra : moz-landing-system : lando
2019-08-17 00:47:24 +00:00
Sebastian Hengst
ada4427353 Bug 1574254 - adjust XPCshell max run times. r=gbrown
Some chunks run longer than an hour.

Differential Revision: https://phabricator.services.mozilla.com/D42544

--HG--
extra : moz-landing-system : lando
2019-08-19 18:31:30 +00:00
ffxbld
cd50c1fdba No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D42475

--HG--
extra : moz-landing-system : lando
2019-08-19 13:07:34 +00:00
Sebastian Hengst
97623914b9 Bug 1574254 - adjust XPCshell max run times. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D42481

--HG--
extra : moz-landing-system : lando
2019-08-19 10:54:31 +00:00
alexandru.ionescu
e229cae98e Bug 1564242 Split raptor.yml taskcluster test configs into smaller files: part 2 (fennec) r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D42272

--HG--
extra : moz-landing-system : lando
2019-08-19 06:20:38 +00:00
Jeff Muizelaar
0815909698 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-18 12:59:49 +00:00
Narcis Beleuzu
e2803d7c18 Backed out changeset 67be750311a1 (bug 1571969) for raptor failures on tests.py . CLOSED TREE 2019-08-18 06:22:48 +03:00
Jeff Muizelaar
5da9e3a7b5 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 22:43:48 +00:00
Razvan Maries
cff855aa9c Backed out changeset 91eca815c9fc (bug 1562686) for build bustages. CLOSED TREE 2019-08-16 22:38:19 +03:00
Razvan Maries
129bdaf0d0 Backed out changeset 4f8a94072fa6 (bug 1571969) as per Jeff's request. CLOSED TREE 2019-08-16 22:07:15 +03:00
Jeff Muizelaar
ecf25e83b1 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 17:32:45 +00:00
Dustin J. Mitchell
ad85abed68 Bug 1562686 - use AWS_IAM_CREDENTIALS_URL for all S3 sccache invocations r=chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D41454

--HG--
extra : moz-landing-system : lando
2019-08-16 17:17:02 +00:00
Aaron Amanuel
3e2b89118e Bug 1574243 - Duplicate bouncerscript submission task to point at Nazgul. r=mtabara
Duplicating the old bouncer submission task and having it point to Nazgul in both stage and prod.

Differential Revision: https://phabricator.services.mozilla.com/D42171

--HG--
extra : moz-landing-system : lando
2019-08-16 15:45:24 +00:00
Dorel Luca
f97e939824 Backed out changeset 10a056f52e49 (bug 1571969) for cpp failure. CLOSED TREE 2019-08-16 19:02:56 +03:00
Andrew Halberstadt
4eac89c065 Bug 1568277 - [ci] Add an experimental SETA optimize strategy and task to run it r=tomprince
These "shadow scheduler" tasks will generate artifacts per-push on autoland.
Basically, given the scheduling algorithms defined in
TASKGRAPH_OPTIMIZE_STRATEGIES, which tasks *would* have been scheduled on this
push.

This will allow us to download the artifacts and run comparisons against the
baseline to see whether things like code coverage or machine learning are
making the situation better or worse.

Differential Revision: https://phabricator.services.mozilla.com/D40427

--HG--
extra : moz-landing-system : lando
2019-08-16 14:46:40 +00:00
Andrew Halberstadt
fa8c3bb64c Bug 1568277 - [taskgraph] Add ability to redirect |mach taskgraph|'s output to a file, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D42172

--HG--
extra : moz-landing-system : lando
2019-08-16 14:27:14 +00:00
Andrew Halberstadt
ced1bc5442 Bug 1568277 - [taskgraph] Merge SETA implementation with optimization strategy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41012

--HG--
rename : taskcluster/taskgraph/util/seta.py => taskcluster/taskgraph/optimize/seta.py
extra : moz-landing-system : lando
2019-08-16 14:27:12 +00:00
Andrew Halberstadt
edd90ef680 Bug 1568277 - [taskgraph] Pass push and time intervals into SETA.is_low_value_task r=tomprince
This will allow us to easily tweak these values from the optimization strategy.

Differential Revision: https://phabricator.services.mozilla.com/D40206

--HG--
extra : moz-landing-system : lando
2019-08-16 14:27:08 +00:00
Andrew Halberstadt
4a606dff00 Bug 1568277 - [taskgraph] Ensure user specified optimization strategies update instead of replace the default ones r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40205

--HG--
extra : moz-landing-system : lando
2019-08-16 14:26:08 +00:00
Andrew Halberstadt
7828bae0b4 Bug 1568277 - [taskgraph] Create optimize strategy aliases for the 'test' kind r=tomprince
This allows test tasks to declare a static optimization name, which can then be
swapped in and out from the optimize code without needing to update the
transforms. This will make it easier to change optimization strategies or run
experimental ones.

Differential Revision: https://phabricator.services.mozilla.com/D40204

--HG--
extra : moz-landing-system : lando
2019-08-16 14:26:01 +00:00
Andrew Halberstadt
91d4452d2e Bug 1568277 - [taskgraph] Split optimize strategies out into a separate file r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40203

--HG--
rename : taskcluster/taskgraph/optimize.py => taskcluster/taskgraph/optimize/__init__.py
extra : moz-landing-system : lando
2019-08-16 14:25:47 +00:00
Andrew Halberstadt
83e584f864 Bug 1568277 - [taskgraph] Move 'taskgraph.transforms.job.import_all' to a utility function r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41011

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:40 +00:00
Andrew Halberstadt
a8971c3b49 Bug 1568277 - [taskgraph] Use a 'register_strategy' decorator in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40202

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:28 +00:00
Andrew Halberstadt
18543d0ff5 Bug 1568277 - [taskgraph] Remove some dead code in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40201

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:21 +00:00
Jeff Muizelaar
82fe69f5d0 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 14:34:00 +00:00
Andreas Tolfsen
a7e5e01481 bug 1540655: ci: add test job for Puppeteer tests; r=ahal
This adds a "remote(pup)" TaskCluster job for running the Google
Puppeteer tests against the new Firefox remote agent.

Earlier in this patchset we added a "./mach puppeteer-test" command
that wraps npm, and this being a source-test with access to the
full checkout, invokes this command directly instead of going
through mozharness.

Differential Revision: https://phabricator.services.mozilla.com/D37015

--HG--
extra : moz-landing-system : lando
2019-08-16 12:58:24 +00:00
Sebastian Hengst
741204a688 Backed out 10 changesets (bug 1568277) for breaking ./mach bootstrap. a=backout
Backed out changeset 056d9515483c (bug 1568277)
Backed out changeset 632d943c947b (bug 1568277)
Backed out changeset d7e8f80e2c85 (bug 1568277)
Backed out changeset 7b59ed5d703d (bug 1568277)
Backed out changeset f8b41cbaaf8e (bug 1568277)
Backed out changeset 391a90f3f02b (bug 1568277)
Backed out changeset d2b1d6c0a732 (bug 1568277)
Backed out changeset cb35fd836621 (bug 1568277)
Backed out changeset c8f797a19731 (bug 1568277)
Backed out changeset 9b89f970d46b (bug 1568277)

--HG--
rename : taskcluster/taskgraph/optimize/__init__.py => taskcluster/taskgraph/optimize.py
rename : taskcluster/taskgraph/optimize/seta.py => taskcluster/taskgraph/util/seta.py
2019-08-16 11:19:54 +02:00
Chris Manchester
8eddcea9e1 Bug 1574027 - Bump sccache used in tree to 0.2.10 release. r=nalexander,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D42188

--HG--
extra : moz-landing-system : lando
2019-08-15 20:30:27 +00:00
Andrew Halberstadt
9b4853268f Bug 1568277 - [ci] Add an experimental SETA optimize strategy and task to run it r=tomprince
These "shadow scheduler" tasks will generate artifacts per-push on autoland.
Basically, given the scheduling algorithms defined in
TASKGRAPH_OPTIMIZE_STRATEGIES, which tasks *would* have been scheduled on this
push.

This will allow us to download the artifacts and run comparisons against the
baseline to see whether things like code coverage or machine learning are
making the situation better or worse.

Differential Revision: https://phabricator.services.mozilla.com/D40427

--HG--
extra : moz-landing-system : lando
2019-08-15 19:36:35 +00:00
Andrew Halberstadt
699de357f9 Bug 1568277 - [tasgraph] Add ability to redirect |mach taskgraph|'s output to a file, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D42172

--HG--
extra : moz-landing-system : lando
2019-08-15 19:36:15 +00:00
Andrew Halberstadt
60fe63b86d Bug 1568277 - [taskgraph] Merge SETA implementation with optimization strategy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41012

--HG--
rename : taskcluster/taskgraph/util/seta.py => taskcluster/taskgraph/optimize/seta.py
extra : moz-landing-system : lando
2019-08-15 18:54:18 +00:00
Andrew Halberstadt
1d274ca26c Bug 1568277 - [taskgraph] Pass push and time intervals into SETA.is_low_value_task r=tomprince
This will allow us to easily tweak these values from the optimization strategy.

Differential Revision: https://phabricator.services.mozilla.com/D40206

--HG--
extra : moz-landing-system : lando
2019-08-15 18:49:10 +00:00
Andrew Halberstadt
41c8305e98 Bug 1568277 - [taskgraph] Ensure user specified optimization strategies update instead of replace the default ones r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40205

--HG--
extra : moz-landing-system : lando
2019-08-15 18:49:01 +00:00
Andrew Halberstadt
acd1f7b8f7 Bug 1568277 - [taskgraph] Create optimize strategy aliases for the 'test' kind r=tomprince
This allows test tasks to declare a static optimization name, which can then be
swapped in and out from the optimize code without needing to update the
transforms. This will make it easier to change optimization strategies or run
experimental ones.

Differential Revision: https://phabricator.services.mozilla.com/D40204

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:54 +00:00
Andrew Halberstadt
c8af64def2 Bug 1568277 - [taskgraph] Split optimize strategies out into a separate file r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40203

--HG--
rename : taskcluster/taskgraph/optimize.py => taskcluster/taskgraph/optimize/__init__.py
extra : moz-landing-system : lando
2019-08-15 18:48:38 +00:00
Andrew Halberstadt
069aed0ec8 Bug 1568277 - [taskgraph] Move 'taskgraph.transforms.job.import_all' to a utility function r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41011

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:30 +00:00
Andrew Halberstadt
db1d13cfab Bug 1568277 - [taskgraph] Use a 'register_strategy' decorator in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40202

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:21 +00:00
Andrew Halberstadt
524a190c6b Bug 1568277 - [taskgraph] Remove some dead code in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40201

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:07 +00:00
Csoregi Natalia
7d39932994 Merge mozilla-central to autoland. CLOSED TREE 2019-08-15 22:38:37 +03:00
Csoregi Natalia
07cae55cd2 Merge inbound to mozilla-central. a=merge 2019-08-15 22:34:31 +03:00
Mike Hommey
515ab2e11d Bug 1574128 - Fixup for bug 1573435 to unbust webrender-windows jobs. r=me
MANUAL PUSH: Fix bustage on inbound.
2019-08-15 20:09:27 +09:00
Brindusan Cristian
3a61fb322f Merge inbound to mozilla-central. a=merge 2019-08-15 12:45:55 +03:00
Mike Hommey
9d82f15c67 Bug 1573435 - Followup not to drop sccache usage from the switch to fetches. r=me
This is a straightforward translation of the code formerly in
use_toolchains.py.

MANUAL PUSH: Followup a landing on inbound.
2019-08-15 15:15:47 +09:00
Mike Hommey
8d5dc26045 No bug - Bustage fix for Windows gn builds. r=me
MANUAL PUSH: This fixes bustage on inbound on a CLOSED TREE.
2019-08-15 12:25:32 +09:00
Mike Hommey
ace4568daa Bug 1573435 - Use toolchain fetches for all remaining toolchain uses, part 2. r=nalexander
This part removes the use_toolchains transform, and adjusts all task
definitions accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D41891

MANUAL PUSH: avoid closing autoland while docker images and toolchains
are rebuilt.
2019-08-15 11:22:23 +09:00
Mike Hommey
c173540215 Bug 1573435 - Use toolchain fetches for all remaining toolchain uses. r=nalexander
The remaining uses all need adjustements to in-tree mozconfigs, so they
all need to be done at once.

However, to make things slightly more intelligible, we do this in two
steps. This is step 1: we modify the use_toolchain transform to take care of
the transformation, while keeping the task definitions intact, so that
we only deal with mozconfig and build script adjustements here.

Differential Revision: https://phabricator.services.mozilla.com/D41890
2019-08-15 11:21:52 +09:00
Mike Hommey
57a88cbf46 Bug 1573435 - Use toolchain fetches for source-test builds. r=nalexander
While here, use GECKO_PATH instead of $HOME/checkouts/gecko.

Differential Revision: https://phabricator.services.mozilla.com/D41889
2019-08-15 11:21:51 +09:00
Mike Hommey
6257ba9912 Bug 1573435 - Use toolchain fetches for spidermonkey builds. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41739
2019-08-15 11:21:50 +09:00
Mike Hommey
9b57b7f93c Bug 1573435 - Use toolchain fetches for hazard builds. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41738
2019-08-15 11:21:49 +09:00
Mike Hommey
8cd0a0666a Bug 1573435 - Use toolchain fetches for openh264 tasks. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41737
2019-08-15 11:21:48 +09:00