Commit Graph

114 Commits

Author SHA1 Message Date
Geoff Brown
153d7eeae8 Bug 1499208 - Use task name to determine gpu-ness of backfilled tasks; r=jmaher
Existing mozharness per_test_base logic determines gpu-ness in the same way: If the
requested test is in a manifest for a suite named 'reftest', '*gpu', or 'webgl*',
then the test should only be run in a gpu-enabled test-verify and will be skipped
otherwise. With this change, backfill will select between TV/TVg based on the
name of the originating task, applying the same rule. So, to backfill a test in TV,
select the backfill action from a non-gpu task; to backfill a test in TVg, select
the backfill action from a gpu task.
2018-10-16 16:13:33 -06:00
Dustin J. Mitchell
c570bc097d Bug 1497984 - whitelist allowPtrace scope, too r=bstack
Differential Revision: https://phabricator.services.mozilla.com/D8279

--HG--
extra : moz-landing-system : lando
2018-10-10 23:49:37 +00:00
Joel Maher
75b335a2dc Bug 1241535 - add support for 'geckoprofile' action task in-tree. r=bstack
Add support for 'geckoprofile' action task in-tree.

Differential Revision: https://phabricator.services.mozilla.com/D8377

--HG--
extra : moz-landing-system : lando
2018-10-11 20:22:42 +00:00
Dustin J. Mitchell
c2f2a7caaf Bug 1494333 - index crons just like artifacts r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D7099

--HG--
extra : moz-landing-system : lando
2018-10-11 13:29:11 +00:00
Andreea Pavel
50041c9be3 Backed out changeset 8db96096643b (bug 1494333) for breaking nigthlies a=backout 2018-10-11 02:51:53 +03:00
Dustin J. Mitchell
be80a48cec Bug 1494333 - index crons just like artifacts r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D7099

--HG--
extra : moz-landing-system : lando
2018-10-02 19:02:14 +00:00
Dustin J. Mitchell
461caee1d2 Bug 1491186: don't sanity check scopes for kind=task r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D6774

--HG--
extra : moz-landing-system : lando
2018-09-25 14:24:43 +00:00
Dustin J. Mitchell
1be6f07ed6 Bug 1491186: sanity check action scopes r=aki,tomprince
This provides a modicum of assurance that, for example, a non-generic action is
not being run with generic scopes. While scopes would prevent any serious
damage from such an action, this provides an extra layer of security to prevent
such abuse.

Differential Revision: https://phabricator.services.mozilla.com/D6271

--HG--
extra : moz-landing-system : lando
2018-09-19 19:13:45 +00:00
Dustin J. Mitchell
7dc58d65e7 Bug 1487500: allow context to be different based on parameters r=bstack
..and use this to allow create-interactive on level 3, but only for testers.

Differential Revision: https://phabricator.services.mozilla.com/D5573

--HG--
extra : moz-landing-system : lando
2018-09-17 23:29:28 +00:00
Dustin J. Mitchell
0220f13c83 Bug 1487500: improvements to create-interactive r=bstack
Some whitelisting of scopes, and some notes on security of the operation.

Differential Revision: https://phabricator.services.mozilla.com/D5572

--HG--
extra : moz-landing-system : lando
2018-09-17 23:28:39 +00:00
Tom Prince
52d02769e9 Bug 1490094: [taskgraph] Change release_type to include more than just rc; r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D5787

--HG--
extra : moz-landing-system : lando
2018-09-17 18:09:16 +00:00
Dustin J. Mitchell
f340848ab5 Bug 1491307: make retrigger-mochitest its own action r=tomprince
Even with no options, this is not a simple retrigger -- it adds voluminous
debug output.  So let's keep it as a custom action.

Differential Revision: https://phabricator.services.mozilla.com/D5879

--HG--
extra : moz-landing-system : lando
2018-09-14 16:25:46 +00:00
Dustin J. Mitchell
91f4fe8c61 Bug 1398277: special-case retriggering of tasks not in the taskgraph; r=bstack
This will apply to cron tasks, action tasks, and decision tasks.  It is a
distinct retrigger implementation because (a) we do not want to follow
dependencies, and (b) it takes a lot of scopes to create a decision task, so we
need to limit access to this action.

MozReview-Commit-ID: 21DVSiagcrO

--HG--
extra : rebase_source : 6f027e349e245e4aa4dbed81145a0a5d75218cb1
extra : histedit_source : eff99aee5a0e7496b0734748b29739480eb0e3fb
2018-07-04 02:46:59 +00:00
Dustin J. Mitchell
5ab4495828 Bug 1472792: give both retrigger actions the same name; r=bstack
This additionally reconsiders the order of all of the actions, spacing them 50
"units" apart and putting the more common actions first.

MozReview-Commit-ID: 98IOYKVMcGU

--HG--
extra : rebase_source : 1273a8b86625bd8e4dc3bddab80c6912241f88c8
extra : histedit_source : 16314284a2b4e0368da843b036e22aaedf485307
2018-07-06 20:28:23 +00:00
Aki Sasaki
7d42373df5 bug 1477747 - combine action task-graph-{suffix}.json into one. r=dustin
MozReview-Commit-ID: J3uaiMcTOBb

--HG--
extra : rebase_source : 693591dd09b65bbfc2f27f23f47f8d7bba7e8ee2
2018-07-24 10:21:51 -07:00
Geoff Brown
31c14cfa40 Bug 1475194 - In TV-bf, avoid use of --gpu-required for wpt; r=jmaher
Test verification backfill specifies --gpu-required for certain types
of tests (depending on test path and/or suite). web-platform-tests do
not recognize --gpu-required. This patch updates the backfill logic
to avoid --gpu-required for wpt.
2018-07-17 11:25:57 -06:00
Dustin J. Mitchell
99dafd1cff Bug 1470623 - name the action purge-cache to align with the spec; r=tomprince
MozReview-Commit-ID: G1PS0mi8Xpr

--HG--
extra : rebase_source : cdca426c55f58bc7c2f36a7fbbd32727b572f921
2018-07-05 20:17:10 +00:00
Dustin J. Mitchell
d6f7801206 Bug 1470621: actionPerm is the cb_name, not name; r=tomprince
The actionPerm is for access control, so it must limit access to a specific
callback function, not a name (which can apply to mulitple functions).

To make things nicer, we allow functions to specify their cb_name and default
it to the action name. The decorated function names are not used.

MozReview-Commit-ID: 2oiuXrrw7DE

--HG--
extra : rebase_source : 07b27db25e9c8e3226dc996d3fcef401ca498739
2018-06-28 17:34:50 +00:00
Dustin J. Mitchell
3f64667c27 Bug 1470621: make all actions use hooks r=tomprince
Everything but release-promotion (to be handled in another bug) is generic.
For the moment, these all run with the default repo scopes; once this is
landed, I can start adjusting that and granting the necessary scopes only to
these actions.

MozReview-Commit-ID: IB8OEsfeBpj

--HG--
extra : rebase_source : 6ef1697cf255b579097ef8b85be8f9f62718f548
2018-06-26 20:57:27 +00:00
Dustin J. Mitchell
9b317841af Bug 1470886 - only produce tasks for recognized tasks_for; r=tomprince
This carefully maintains tasks as an array by putting the conditional inside of
that array.  Note that `[{$if: 'false', then: 1}]` returns `[]` in JSON-e --
the missing `else` branch is treated as a missing array element.

MozReview-Commit-ID: 9ARIxW3gfWo

--HG--
extra : rebase_source : 304ce14ccc9abc9f4f48f3179adb981b5fe55a0e
2018-07-03 18:07:42 +00:00
Dustin J. Mitchell
9a09ab7fa3 Bug 1473636: move description of create_tasks to its own section; r=tomprince
MozReview-Commit-ID: 2r1br7bvlcz

--HG--
extra : rebase_source : 222ce960e052d6a7a3f4d47ba90028bacfe3f24e
2018-07-05 17:15:28 +00:00
Dustin J. Mitchell
37fd25c3c6 Bug 1473636: clarify arguments to action callbacks; r=tomprince
MozReview-Commit-ID: j3OiNkjngD

--HG--
extra : rebase_source : c1c169f5c1295628fe3ea5608407bd85cec34a00
2018-07-05 17:07:40 +00:00
Dustin J. Mitchell
dd89d35a74 Bug 1473636: raise errors in cancel-all action; r=tomprince
This changes

  File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/actions/cancel_all.py", line 30, in list_group
    for task in [t['status'] for t in response['tasks']]:
KeyError: u'tasks'

Into a more understandable error (404, in this case).

MozReview-Commit-ID: 5XnFyxIdRfo

--HG--
extra : rebase_source : 797a3117d3246c962f30980c1658fde3bd366135
2018-07-05 16:51:57 +00:00
Joel Maher
13a435915f Bug 1471227 - adjust taskcluster backfill with path to use test-verify instead of original job. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D1961

--HG--
extra : moz-landing-system : lando
2018-07-04 20:01:36 +00:00
Dustin J. Mitchell
7a41f4be8d Bug 1472776: add a 'cancel' action to cancel one task; r=tomprince
MozReview-Commit-ID: E3MTcM4TR7e

--HG--
extra : rebase_source : 41b56b8c5cc0cbafeae81582c47148f24ffbbce7
2018-06-27 15:01:40 +00:00
Brindusan Cristian
df2e2473fb Backed out changeset 66956b121b93 (bug 1470886) for signin exceptions. CLOSED TREE 2018-07-03 21:39:52 +03:00
Brindusan Cristian
ee6a82f951 Backed out changeset 06da5e793b2c (bug 1472776) for linting failure on taskgraph/actions/cancel.py:12:1. CLOSED TREE 2018-07-03 21:22:33 +03:00
Dustin J. Mitchell
5ca8ad1f5c Bug 1472776: add a 'cancel' action to cancel one task; r=tomprince
MozReview-Commit-ID: E3MTcM4TR7e

--HG--
extra : rebase_source : 7efd92b7d1c8aee63c4ec6260710f077d901209b
2018-06-27 15:01:40 +00:00
Dustin J. Mitchell
af478ed758 Bug 1470886 - only produce tasks for recognized tasks_for r=tomprince
This also updates actions to "see through" the conditional.  Soon we won't be
using kind=task, so this hack will be less important.

MozReview-Commit-ID: Aa6g9ZqoPMa

--HG--
extra : rebase_source : 7434f2047c48ff0d1fa6de9e3419fb4e0bf0bb72
2018-06-25 18:21:03 +00:00
Dustin J. Mitchell
9ea31e05b6 Bug 1472777: add create-interactive action; r=bstack
The resulting action task isn't useful to the user, so instead we send an email
containing a link to the interaction console.

MozReview-Commit-ID: 5uHnQo9WTF6

--HG--
extra : rebase_source : ec52a333582a2778c2cec12d612d681e1a9b1976
2018-07-02 20:24:16 +00:00
Ciure Andrei
24b60272b0 Backed out 1 changesets (bug 1472777) for linting failures create_interactive.py CLOSED TREE 2018-07-03 04:25:03 +03:00
Dustin J. Mitchell
f5ba8d33f9 Bug 1472777: add create-interactive action; r=bstack
The resulting action task isn't useful to the user, so instead we send an email
containing a link to the interaction console.

MozReview-Commit-ID: 5uHnQo9WTF6

--HG--
extra : rebase_source : 1213afa7c53a0bcc4a07c4c2970c7bf21ab3b7f1
2018-07-02 20:24:16 +00:00
Brian Stack
3ba851c889 Bug 1465117 - Take two at updating backfill task. Use modifier this time. r=dustin,jmaher
MozReview-Commit-ID: CAs0WRb839r

--HG--
extra : rebase_source : 5da88d38315f8b6795aa6d5a97de63883eda1ab0
2018-06-08 12:08:34 -07:00
Ciure Andrei
e0538d334b Backed out 1 changesets (bug 1465117) for fix_task_dependencies not working as expected a=backout
Backed out changeset 3d3fe54d0cb6 (bug 1465117)
2018-06-08 00:00:20 +03:00
Brian Stack
3672e158f8 Bug 1465117 - Add additional options to backfilling action task r=dustin,jmaher
MozReview-Commit-ID: FMGjhQbg4im

--HG--
extra : rebase_source : a03e351836c7356c6912af85be9108921e50aabd
2018-06-01 16:44:16 -07:00
Dustin J. Mitchell
e92f5137f3 Bug 1465945 - make retrigger an action with kind=hook; r=tomprince
MozReview-Commit-ID: LlZVweIjHsg

--HG--
extra : rebase_source : b0939194636847fd2056b533de2c21aef5290814
2018-05-31 20:03:16 +00:00
Dustin J. Mitchell
8e4ea9e029 Bug 1465970 - make backfill action a hook; r=tomprince
MozReview-Commit-ID: 1ibZPb5fMdP

--HG--
extra : rebase_source : 1a3deae3f1deacc4e06d6e4bb3fb95269295821e
2018-05-31 21:30:19 +00:00
Tom Prince
feb293ecec Bug 1458700: [release-promotion] Move configuration of version-bump and partial-update flavors to graph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1452
2018-05-30 07:16:41 +00:00
Dustin J. Mitchell
76eada579a Bug 1463522 - include .taskcluster.yml hash in hookId; r=tomprince
MozReview-Commit-ID: 7KJGRKuFlna

--HG--
extra : rebase_source : 43a988b9816ccd179a5a0b37944b18f73c596404
2018-05-22 18:28:08 +00:00
Dustin J. Mitchell
ef5e21ddad Bug 1463522 - only read .taskcluster.yml once; r=tomprince
PyYAML is not fast, so the fewer times we parse the same file, the better

MozReview-Commit-ID: KuYKFY7hFXp

--HG--
extra : rebase_source : 55df7c515db8864ee6d01895d444f7f26229bc2f
2018-05-22 18:11:23 +00:00
Dustin J. Mitchell
e35eac024a Bug 1463480 - always set task, even for taskgraph-level actions; r=tomprince
MozReview-Commit-ID: 5A50Tef72gk

--HG--
extra : rebase_source : b103cb1e92982faea5ee4a76877053433ce880e5
2018-05-22 17:24:27 +00:00
Dustin J. Mitchell
aeb0a55c25 Bug 1415868 - remove ACTION_TASK r=jonasfj,tomprince
For kind=hook, the spec doesn't include this value as it's untrustworthy.

For kind=task, it's still untrustworthy, but there is no privilege escalation
so that's not important. Still, it dramatically expands the size of the task
definition.

MozReview-Commit-ID: 6scQ2ZwxP10

--HG--
extra : rebase_source : 4dc34390a510091ddc26023755992995fe358e47
2018-04-27 22:24:42 +00:00
Dustin J. Mitchell
0f0fde3dad Bug 1415868 - add support for defining actions with kind=hook; r=jonasfj,tomprince
This does not affect any existing actions.

MozReview-Commit-ID: 9j5cT2kA7UU

--HG--
extra : rebase_source : 1191d7ecb05b8083a4923b9dbe97218faf65a088
2018-04-25 17:56:29 +00:00
Dustin J. Mitchell
0ba14ea32c Bug 1415868 - Remove support for register_action_task; r=jonasfj,tomprince
In a post-actions-as-hooks world, users will not have scopes to create tasks,
so this mode of action definition will not be possible. This is not currently
used from Treeherder (it links to
https://tools.taskcluster.net/tasks/<taskid>/interactive instead)

This drops support for the JSON-e-only interactive action; that action is not
currently used from treeherder, so that should have no impact for users.

MozReview-Commit-ID: 9i3POpjahAc

--HG--
extra : rebase_source : e6de03389a0c5c67d5332d2b1c97e1d4bf6a22d3
2018-04-23 21:20:00 +00:00
Tom Prince
8070e1498d Bug 1447460: [taskgraph] Use the graph config root to guess find the path to .taskcluster.yml in actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1126

--HG--
extra : rebase_source : b9d3dbd07df5528009bb619937aafeb158a0e40e
2018-05-02 20:30:15 -06:00
Tom Prince
90b93a6db8 Bug 1458700: [release-promotion] Use a common target task for firefox and devedition; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1122

--HG--
extra : rebase_source : cf124d67fa250f13306a98a9412e64347b9fde68
2018-05-02 18:33:52 -06:00
Tom Prince
9bebf482da Bug 1458700: [release-promotion] Move configuration of flavors into the graph configuration; r=aki,dustin
Differential Revision: https://phabricator.services.mozilla.com/D1121

--HG--
extra : rebase_source : 270cb6a6a2c6255c585b46cc410110f83010ec6f
2018-04-23 00:17:30 -06:00
Tom Prince
e05a92c940 Bug 1461784: [release-promotion] Always respect previous graphs, even on try; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1290

--HG--
extra : source : c5af9ca746a83f7a1c05e3b11f31e5f2840e42d0
extra : amend_source : 42bf68bb7905955548957b0b07452937b4c0075a
2018-05-03 04:25:03 -06:00
Aki Sasaki
6cc637e95c bug 1457034 - populate release_partner_build_number. r=nthomas
MozReview-Commit-ID: EC4jHIwBWWb

--HG--
extra : rebase_source : 8c1616bc825b51502f72df92b10e0a4904592966
2018-05-08 19:06:31 -07:00
Aki Sasaki
aa58e7acbf bug 1457034 - generate release_partner_config in release_promotion r=nthomas
If we're not passed `release_partner_config` in the input, let's poll github for it in the action.

MozReview-Commit-ID: 2swx76vhTE5

--HG--
extra : rebase_source : d16c517348e506519bc6e6296ad7a0cb2f90527c
extra : source : 3ad2e53b051d48a54dfb1cf88b743ed4d9571ff6
2018-04-25 15:16:49 -07:00