Commit Graph

77 Commits

Author SHA1 Message Date
Tom Prince
feb293ecec Bug 1458700: [release-promotion] Move configuration of version-bump and partial-update flavors to graph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1452
2018-05-30 07:16:41 +00:00
Dustin J. Mitchell
76eada579a Bug 1463522 - include .taskcluster.yml hash in hookId; r=tomprince
MozReview-Commit-ID: 7KJGRKuFlna

--HG--
extra : rebase_source : 43a988b9816ccd179a5a0b37944b18f73c596404
2018-05-22 18:28:08 +00:00
Dustin J. Mitchell
ef5e21ddad Bug 1463522 - only read .taskcluster.yml once; r=tomprince
PyYAML is not fast, so the fewer times we parse the same file, the better

MozReview-Commit-ID: KuYKFY7hFXp

--HG--
extra : rebase_source : 55df7c515db8864ee6d01895d444f7f26229bc2f
2018-05-22 18:11:23 +00:00
Dustin J. Mitchell
e35eac024a Bug 1463480 - always set task, even for taskgraph-level actions; r=tomprince
MozReview-Commit-ID: 5A50Tef72gk

--HG--
extra : rebase_source : b103cb1e92982faea5ee4a76877053433ce880e5
2018-05-22 17:24:27 +00:00
Dustin J. Mitchell
aeb0a55c25 Bug 1415868 - remove ACTION_TASK r=jonasfj,tomprince
For kind=hook, the spec doesn't include this value as it's untrustworthy.

For kind=task, it's still untrustworthy, but there is no privilege escalation
so that's not important. Still, it dramatically expands the size of the task
definition.

MozReview-Commit-ID: 6scQ2ZwxP10

--HG--
extra : rebase_source : 4dc34390a510091ddc26023755992995fe358e47
2018-04-27 22:24:42 +00:00
Dustin J. Mitchell
0f0fde3dad Bug 1415868 - add support for defining actions with kind=hook; r=jonasfj,tomprince
This does not affect any existing actions.

MozReview-Commit-ID: 9j5cT2kA7UU

--HG--
extra : rebase_source : 1191d7ecb05b8083a4923b9dbe97218faf65a088
2018-04-25 17:56:29 +00:00
Dustin J. Mitchell
0ba14ea32c Bug 1415868 - Remove support for register_action_task; r=jonasfj,tomprince
In a post-actions-as-hooks world, users will not have scopes to create tasks,
so this mode of action definition will not be possible. This is not currently
used from Treeherder (it links to
https://tools.taskcluster.net/tasks/<taskid>/interactive instead)

This drops support for the JSON-e-only interactive action; that action is not
currently used from treeherder, so that should have no impact for users.

MozReview-Commit-ID: 9i3POpjahAc

--HG--
extra : rebase_source : e6de03389a0c5c67d5332d2b1c97e1d4bf6a22d3
2018-04-23 21:20:00 +00:00
Tom Prince
8070e1498d Bug 1447460: [taskgraph] Use the graph config root to guess find the path to .taskcluster.yml in actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1126

--HG--
extra : rebase_source : b9d3dbd07df5528009bb619937aafeb158a0e40e
2018-05-02 20:30:15 -06:00
Tom Prince
90b93a6db8 Bug 1458700: [release-promotion] Use a common target task for firefox and devedition; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1122

--HG--
extra : rebase_source : cf124d67fa250f13306a98a9412e64347b9fde68
2018-05-02 18:33:52 -06:00
Tom Prince
9bebf482da Bug 1458700: [release-promotion] Move configuration of flavors into the graph configuration; r=aki,dustin
Differential Revision: https://phabricator.services.mozilla.com/D1121

--HG--
extra : rebase_source : 270cb6a6a2c6255c585b46cc410110f83010ec6f
2018-04-23 00:17:30 -06:00
Tom Prince
e05a92c940 Bug 1461784: [release-promotion] Always respect previous graphs, even on try; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1290

--HG--
extra : source : c5af9ca746a83f7a1c05e3b11f31e5f2840e42d0
extra : amend_source : 42bf68bb7905955548957b0b07452937b4c0075a
2018-05-03 04:25:03 -06:00
Aki Sasaki
6cc637e95c bug 1457034 - populate release_partner_build_number. r=nthomas
MozReview-Commit-ID: EC4jHIwBWWb

--HG--
extra : rebase_source : 8c1616bc825b51502f72df92b10e0a4904592966
2018-05-08 19:06:31 -07:00
Aki Sasaki
aa58e7acbf bug 1457034 - generate release_partner_config in release_promotion r=nthomas
If we're not passed `release_partner_config` in the input, let's poll github for it in the action.

MozReview-Commit-ID: 2swx76vhTE5

--HG--
extra : rebase_source : d16c517348e506519bc6e6296ad7a0cb2f90527c
extra : source : 3ad2e53b051d48a54dfb1cf88b743ed4d9571ff6
2018-04-25 15:16:49 -07:00
Tom Prince
98a9ca8de3 Bug 1458700: [release-promotion] Record the root of the graph configuration for use in release promotion; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1125

--HG--
extra : source : 364b590a58fe305b449fbdbbc6a0b65849a67699
extra : histedit_source : 22081606c5bfcddec126f5e22b2c257aa6ea719e
2018-05-02 20:28:11 -06:00
Tom Prince
9be271f7c9 Bug 1458700: [taskgraph] Move load_graph_config into taskgraph.config; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1123

--HG--
extra : source : 38407a04fc43074648430482c6d4b0860cb9473d
extra : histedit_source : 09c671d2923789aae334e3c8df8510a1a9f07bd0
2018-05-02 19:28:43 -06:00
Tom Prince
cdc2f74412 Bug 1418058: [taskcluster] Add graph_config to some actions that were originally missed; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1025

--HG--
extra : rebase_source : 1c6579521edd185b79646b3aa14165877c0a12b3
2018-04-23 13:08:28 -06:00
Tom Prince
8ad6e70430 Bug 1442545: [partner-repack] Add parameters needed for doing partner repacks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D977

--HG--
extra : rebase_source : 0f2ef4edf6093d644c82c6b0475ba7796ebaa90b
extra : histedit_source : b446b09b30a0f709f4c80eaf69ec40952562ce6d
2018-04-16 20:48:40 -06:00
Tom Prince
c31f0f3cb8 Bug 1418058: [taskcluster] Update actions to take and use graph configuration; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D916

--HG--
extra : rebase_source : 5b12a52dfa146a0e33b93387deb3e5178a078b3a
2018-04-09 21:30:36 -06:00
Tom Prince
d0d79d96e0 Bug 1418058: [taskcluster] Get the .taskcluster.yml from the current project; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D915

--HG--
extra : rebase_source : 0d627c485cfb2eedc713c404f03b9c8c5058e68a
2018-04-11 12:02:47 -06:00
Tom Prince
82818118aa Bug 1418058: [taskcluster] Load graph configuration for the correct project when running actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D914

--HG--
extra : rebase_source : f2e6591f3ac126b16070549789975fae58c0b3bc
2018-04-11 12:02:19 -06:00
Tom Prince
fdb3fa18c8 Bug 1418058: [taskcluster] Add the prefix for the graph parameters of the primary repo to the graph config; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D913

--HG--
extra : rebase_source : 20c7b2e7537ea55a8191b86388175c1a3ea7c42c
2018-04-11 11:08:48 -06:00
Tom Prince
ec7000854d Bug 1418058: [taskcluster] Pass a graph_config through action task generation; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D912

--HG--
extra : rebase_source : 7773c3f795e42e470c16986bd71e044169ac0f99
2018-04-11 10:24:14 -06:00
Aki Sasaki
40f11e90fa bug 1450012 - fix lint issue. r=lintfix
--HG--
extra : rebase_source : 96250f19d7d7191a4b0dc6b0c4226bbd4976abce
2018-04-03 16:32:24 -07:00
Aki Sasaki
043b1389dc bug 1450012 - add rerun task. r=bstack
--HG--
extra : rebase_source : cc80b2fdc541d098050ab046142916739b08e28e
2018-04-03 16:00:07 -07:00
Rail Aliiev
0e5f8a4da7 Bug 1398796 - Add push phase to PARTIAL_UPDATES_FLAVORS r=aki
--HG--
extra : rebase_source : a071517974cc93c1757cf6f50d6d027ee4f1ef0b
2018-02-27 11:16:20 -05:00
Rail Aliiev
ad68e73d49 Bug 1398796 - Do uptake monitoring in TC r=mtabara
MozReview-Commit-ID: 5xqEQUWOmqf

--HG--
rename : build/sparse-profiles/update-verify => build/sparse-profiles/mozharness
2018-02-15 08:49:45 -05:00
Brian Stack
f230569eee Bug 1437738 - Update actions to new repo scopes,r=jonasfj. CLOSED TREE
--HG--
extra : amend_source : 4210315a95637df03650b82bcb1291064fa58bd4
2018-02-12 22:56:15 -08:00
Aki Sasaki
a7ef9a0c06 bug 1431799 - add ship_fennec_rc relpro flavor. r=bhearsum
Also add rc-{google-play-track,rollout-percentage} for RC pushapk.

One nice side effect of using the same push-apk kind: we don't re-run push-apk during the ship_fennec relpro flavor if we've run the ship_fennec_rc flavor with the same build. (Google Play would reject the same buildid.)

This is really for bug 1433536, but MozReview is forcing me to include this patch with the others for reasons.

MozReview-Commit-ID: 69ymqVLv9E2

--HG--
extra : rebase_source : b87d4dd2394788a5452ff3f52a8ca5022a15b9ee
extra : intermediate-source : 7a826d274a4828018a836cf1149df29d403a7c11
extra : source : a3c60b0370a3e08ce765f87c1d7d5dad24879881
2018-02-02 14:50:38 -08:00
Aki Sasaki
00b7bee43f bug 1431799 - rename desktop_release_type -> release_type. r=bhearsum
This used to only be relevant to Devedition and Firefox releases.
In bug 1433536 we're going to add RC Fennec releases. Let's rename
the parameter now, for less parameters churn.

MozReview-Commit-ID: 28e1Y5FG4On

--HG--
extra : rebase_source : 59d41887d856481ab85bb8d2221dfcebca4430b0
extra : source : 4c96e312d88a3f7037c1eb39a3031d4baf997015
2018-02-01 10:07:03 -08:00
Aki Sasaki
5795b692ae bug 1431799 - add version input to release promotion action. r=bhearsum
also clean up and move more config to the promotion config.

MozReview-Commit-ID: FmTWNNPcEaZ

--HG--
extra : rebase_source : 40431217fafb6796dbd65c7dfeab0e891ac1bbd4
extra : source : 0f5418a83477c1b6b221e4d28515792410e504d0
2018-01-26 13:09:35 -08:00
Brian Stack
a455ebaa63 Bug 1434959 - Copy taskgraph before optimizing in actions r=dustin
MozReview-Commit-ID: 7uPM7X4vS3F

--HG--
extra : rebase_source : ca34daf158196ab38fe0f45f83ed6914fe5f2a51
2018-02-05 11:15:44 -08:00
Johan Lorenzo
7d18b55efa Bug 1431397 - Pass release_eta down from action task input r=bhearsum
MozReview-Commit-ID: Ggybpiv5XQo

--HG--
extra : rebase_source : 9ac9de595aad73b874e6c4850c83a9000be55e53
2018-01-18 15:10:53 +01:00
Aki Sasaki
0be9df7004 bug 1430353 - allow for an easier to read treeherder relpro symbol. r=bstack 2018-01-16 15:12:31 -08:00
Ben Hearsum
af8d160c6d bug 1425562: don't assume all desktop release_history is firefox. r=rail 2017-12-18 10:56:42 -05:00
Aki Sasaki
ded142a67b bug 1423081 - add firefox + devedition relpro. r=callek
Add support for the three firefox and devedition relpro flavors (we
could probably reduce devedition to 2).

Also, instead of defining which kinds to use from the previous graph
in `previous_graph_kinds`, specify which kinds to rebuild (ignore)
from the previous graph in `rebuild_kinds`. This list will be much
smaller (currently empty).

MozReview-Commit-ID: 5rH1TW7GbAD

--HG--
extra : rebase_source : b4294a0d17a99b2ffd48f5d62821c724324b242c
extra : histedit_source : b3fe87101e4595f5fc5c7daaa2d4a0bd88418667
2017-12-05 19:09:19 -08:00
Simon Fraser
bab833ebee Bug 1416812 ensure next_version always present, prevent UnboundLocalError r=aki a=release 2017-11-13 17:33:50 +00:00
Aki Sasaki
ec4ec0f124 bug 1415391 - parameterize next_version and build_number. r=dustin
Instead of relying on environment variables, pass these in as parameters.

MozReview-Commit-ID: An58Bu2kd1g

--HG--
extra : rebase_source : 9c7b6beb13b676a3376a897f2c8143cc042b8276
2017-11-08 15:52:48 -08:00
Rail Aliiev
6bd4a6993f Bug 1414897 - render the target_tasks_method template in release promotion r=aki
MozReview-Commit-ID: KIGf1KAKpDL

--HG--
extra : rebase_source : ab297156536325b74dba162c362b8d504057803e
2017-11-06 13:10:48 -05:00
Aki Sasaki
d16d2d20cb bug 1412690 - add task dependencies. r=rail
This patch adds the `release_deps` transform, which adds every
kind-dependency task that has the same product as a task dependency
(with some exceptions).

This patch made it clear that we need a standard way of defining
product.

MozReview-Commit-ID: 4xOJRQSCTgF

--HG--
extra : rebase_source : 4b98b040ac5d8777394cff6f3249ab354fff641b
2017-10-29 17:40:50 -07:00
Aki Sasaki
6abeef4e00 bug 1412690 - beetmover-cdns. r=rail
This patch adds the beetmover-cdns kind, and adds it to
`publish_fennec`.

This was the first non-buildbot-bridge, non-dummy relpro task, so this
needed a new transform.

This patch also updates the `previous_graph_kinds` and updates the
beetmover scopes in scriptworker.py.

MozReview-Commit-ID: 3rpkjuLjjXz

--HG--
extra : rebase_source : d491f1ce5d10ee8f2602698236106007e203c358
2017-10-29 17:32:22 -07:00
Rail Aliiev
04db73b08e Bug 1412690 - add release-bouncer-sub to publish_fennec's previous_graph_kinds. r=aki
We currently use `previous_graph_kinds` as a pointer to use a previously
built graph's task instead of generating a new task. We were re-running
`release-bouncer-sub` in the `publish_fennec` release promotion flavor
because we hadn't specified `release-bouncer-sub` as a
`previous_graph_kind`; this patch fixes that error.

MozReview-Commit-ID: 92MAVsG8Jrk

--HG--
extra : rebase_source : cf8411d017de20ef05ba9ac547e94797c88901dd
2017-10-29 17:30:56 -07:00
Rok Garbas
5ef4a1dd30 Bug 1412690 - fennec version bump in-tree task. r=aki
This patch adds the initial `release-version-bump` kind, and adds it to
the `publish_fennec` `target_tasks_method`.

It also adds support for `next_version`.

MozReview-Commit-ID: 9YRswddeuZ3

--HG--
extra : rebase_source : 991cbf89b40c4ef980c42251001e81be5cedaf00
2017-10-29 17:25:01 -07:00
Aki Sasaki
c7f7311793 bug 1412690 - add {promote,publish}_{fennec,firefox} target task methods. r=rail
This hooks up the `target_tasks_method`s and the
`release_promotion_flavor`s for these four release promotion flavors.

We also add some maple support and add `version_display.txt` to the
decision task sparse checkout so we can read the version number during
decision/action task time.

MozReview-Commit-ID: CdxUUXZtXO0

--HG--
extra : rebase_source : 99e4f060a964d34a377aea6a6e36fbcef66c6aec
2017-10-29 17:10:42 -07:00
Aki Sasaki
b1ece7d851 bug 1397552 - followup fix. r=bustage 2017-10-24 20:58:26 -07:00
Aki Sasaki
f6e2f73426 bug 1397552 - add a release promotion action. r=bstack
Add a release promotion custom action for releng's TC release promotion migration work.

This action generates a graph dependent on previously built tasks. To track these, we add the `do_not_optimize` and `existing_tasks` parameters. The `do_not_optimize` parameter specifies tasks that we want to explicitly exclude from taskgraph optimization. The `existing_tasks` parameter specifies a label-to-taskid map for tasks from previous graphs.

MozReview-Commit-ID: 1vKrNUavM4V

--HG--
extra : rebase_source : b8ba95d270aafe1464c2b3bfc318b9568500a7a1
2017-10-24 15:28:19 -07:00
Brian Stack
d2c0e62e07 Bug 1401000- Add a purge-cache action r=dustin
MozReview-Commit-ID: CaEizD3jYmc

--HG--
extra : rebase_source : 7916ab82b5a92376b15980cf5bd6a213ee40c4ae
2017-10-13 11:22:42 -07:00
Brian Stack
d3a8b56012 Bug 1406209 - Use .taskcluster.yml for action tasks templates r=dustin,jonasfj
MozReview-Commit-ID: 8I8lIouV6KF

--HG--
extra : rebase_source : 6961105d1a232e93cf2f73db9ca88f8b08278dc0
2017-10-09 18:39:00 -07:00
Brian Stack
781ed3870b Bug 1406734 - Set TASKCLUSTER_CACHES on action tasks r=dustin
MozReview-Commit-ID: EwJoy5vqcQP

--HG--
extra : rebase_source : 441f494fd45e82fa53d2989015b6e415cf97fc77
2017-10-09 09:58:38 -07:00
Brian Stack
68903cd4e9 Bug 1405740 - Add a cancel-all action task r=garndt,jonasfj
MozReview-Commit-ID: 2V8ztB5Pdkc

--HG--
extra : rebase_source : c9badef0654a9e2f24471cba34c866b681503580
2017-10-05 13:31:56 -07:00
Aki Sasaki
cce0182e98 bug 1393277 - fix raw-file link in action tasks. r=bstack
MozReview-Commit-ID: EmJ6Nsivb4H

--HG--
extra : rebase_source : 038268c0d6c98373b071e39b1ee320153f082fe3
2017-10-03 10:30:18 -07:00