Commit Graph

1739 Commits

Author SHA1 Message Date
Mike Hommey
5506b96eca Bug 1465659 - Check perfherder options across all build kinds. r=dustin
--HG--
extra : rebase_source : f2e05ac7544542c0a9a93b6c07f884857366c2c2
2018-05-31 12:57:36 +09:00
Andrew Halberstadt
9e81b12ebc Bug 1465181 - Use releng-hardware/gecko-t-linux-talos workerType for js-bench tasks, r=jmaher
This will get the js-bench tasks to run on physical hardware instead of AWS.


MozReview-Commit-ID: 44XavXAwxxn

--HG--
extra : rebase_source : ae1ba4c7f90b3a8526511a3f3c1dff913a334619
2018-05-29 16:01:04 -04:00
Andrew Halberstadt
38e69c76b1 Bug 1465181 - [taskgraph] Stop hardcoding the workdir to /builds/worker in 'job' tasks, r=gps
This adds an optional 'workdir' key to all job schemas. It still defaults to
/builds/worker, but can be overriden by individual tasks or schema
implementations.

MozReview-Commit-ID: LY20xfBhbCP

--HG--
extra : rebase_source : 7ac76ebf55d33d30c2aad73484421c6b4002cd33
2018-05-29 16:05:35 -04:00
Andrew Halberstadt
cf081cacda Bug 1465181 - [taskgraph] Support use-artifacts with native-engine in run-task, r=dustin
Extends support of the use-artifacts key to native-engine based tasks.

MozReview-Commit-ID: FJILoyD5XVZ

--HG--
extra : rebase_source : 0cf8bf63f73d0fbb634f6b437bcc9bcce7821900
2018-05-24 11:08:09 -04:00
Tom Prince
3e56699610 Bug 1458700: [taskgraph] Use beta target tasks on comm-beta/comm-esr60; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1469
2018-05-31 17:38:14 +00:00
arthur.iakab
fb18cb09bd Merge mozilla inbound to central a=merge 2018-05-31 01:05:10 +03:00
Justin Wood
9d2efb144a Bug 1286092 - Enable desktop l10n on-push for beta tasks too. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1449

--HG--
extra : rebase_source : f63e6c5a13904ba33fa2a46e05cfdd0997abd0fc
2018-05-29 12:06:10 -04:00
Justin Wood
71eebb16bc Bug 1286092 - Actually enable l10n repacks based on the same push on-change. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1409

--HG--
extra : rebase_source : 2798c5bc3e3153f8c293846d5a3d786e18bbdc34
2018-05-23 14:57:23 -04:00
Justin Wood
d0ede24b0b Bug 1286092 - Do repackage-signing on-change for on-change l10n. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1408

--HG--
extra : rebase_source : 6605d320082c767699e0c360cefa8a04e5525d10
2018-05-22 09:42:19 -04:00
Justin Wood
4a7ee168bf Bug 1286092 - Stub installer attribute. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1406

--HG--
extra : rebase_source : 207d1c25e37ab2619a09fb209282ffe55025de26
2018-05-22 18:22:37 -04:00
Csoregi Natalia
0c87942d7d Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-05-30 12:27:51 +03:00
Nick Thomas
b498a2c072 Bug 1462120 - Update verify fixes for ESR60 branch, r=bhearsum DONTBUILD 2018-05-30 11:29:09 +12:00
Tom Prince
feb293ecec Bug 1458700: [release-promotion] Move configuration of version-bump and partial-update flavors to graph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1452
2018-05-30 07:16:41 +00:00
Tom Prince
ea806e3bfe Bug 1464523: [release] Remove debugging print; r=me CLOSED TREE DONTBUILD 2018-05-29 10:04:34 -06:00
Tom Prince
6efdbcc183 Bug 1464523: [release] Pass branch prefix to secondary update-verify config generation; r=me CLOSED TREE
--HG--
extra : amend_source : df456ec1436457d71aa760cf589ba19a5de5a8bc
2018-05-29 10:01:03 -06:00
Tom Prince
3698c97d0a Bug 1464530: [release] Allow specifying which repository to get the treescript revision from; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1417

--HG--
extra : rebase_source : 1ab8b0f9b4237401e1e315739055b96f2c06d706
2018-05-23 14:56:25 -06:00
Tom Prince
d90e17f8c0 Bug 1464530: [release] Use scriptworker scope prefix for treescript workers; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1416

--HG--
extra : rebase_source : dfc023eb380a42b005f84bfe3fc38aa834a8ba29
2018-05-23 12:21:46 -06:00
Tom Prince
bfff182d10 Bug 1464530: [release] Add -dev workertype for version-bump; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1415

--HG--
extra : rebase_source : 4c03f7ef81d4783b823e14bd72cee33c66722f2c
2018-05-22 16:25:03 -06:00
Tom Prince
8da7f2a4cd Bug 1464523: [release] Pass the repository of the project being built to update-verify config generation; r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D1414

--HG--
extra : rebase_source : 5d79c925878223373ebd6608de41220ecb91952e
2018-05-23 15:34:18 -06:00
Tom Prince
91c5e8ff30 Bug 1464523: [release] Pass branch prefix to update-verify config generation; r=bhearsum
Thunderbird releases need to look at comm-beta/comm-esr* branches for old
locale/version information.

Differential Revision: https://phabricator.services.mozilla.com/D1413

--HG--
extra : rebase_source : 76625ea5859d25f270b9fbec577f9075988bf2b7
2018-05-23 15:15:34 -06:00
Joel Maher
9e5d9c55f5 Bug 1442790 - fix test-verify to not fail on: 'No checks run.'. r=ahal 2018-05-28 06:44:24 -04:00
Dorel Luca
047df7a932 Merge mozilla-inbound to mozilla-central. a=merge 2018-05-26 07:09:39 +03:00
Coroiu Cristina
c032f38419 Merge mozilla-central to inbound a=merge on a CLOSED TREE 2018-05-25 20:58:44 +03:00
Tom Prince
ce86c6c047 Bug 1462791: [taskgraph] Return list from generic_worker_hg_commands; r=dustin a=Aryx
Some code[1] expects to be able to `.extend` the result.

[1] https://searchfox.org/mozilla-central/rev/bf4def01bf8f6ff0d18f02f2d7e9efc73e12c63f/taskcluster/taskgraph/transforms/job/mozharness.py#318-331

Differential Revision: https://phabricator.services.mozilla.com/D1384

--HG--
extra : amend_source : 73e7c89d4b4f62f54e8bf7448d5e58a188590189
2018-05-25 08:55:42 -06:00
Dustin J. Mitchell
76eada579a Bug 1463522 - include .taskcluster.yml hash in hookId; r=tomprince
MozReview-Commit-ID: 7KJGRKuFlna

--HG--
extra : rebase_source : 43a988b9816ccd179a5a0b37944b18f73c596404
2018-05-22 18:28:08 +00:00
Dustin J. Mitchell
ef5e21ddad Bug 1463522 - only read .taskcluster.yml once; r=tomprince
PyYAML is not fast, so the fewer times we parse the same file, the better

MozReview-Commit-ID: KuYKFY7hFXp

--HG--
extra : rebase_source : 55df7c515db8864ee6d01895d444f7f26229bc2f
2018-05-22 18:11:23 +00:00
Chris AtLee
ddaec1c0fa Bug 1237182: Remove more buildbot references from mozharness r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1372

--HG--
extra : rebase_source : e5d962072b29de9b0cd66214df9e97e607c31dc7
2018-05-22 16:39:06 -04:00
Gregory Szorc
b59654bfbc Bug 1462791 - Remove docker_worker_add_gecko_vcs_env_vars(); r=dustin
support_vcs_checkout() always sets the environment variables that
were set by this deleted function. In addition, support_vcs_checkout()
also adds caches and scopes - at least for docker-worker and
docker-engine. For generic-worker - which was used in all call sites
of docker_worker_add_gecko_vcs_env_vars() (yes, the "docker_worker"
bit of the name was completely wrong - probably a legacy holdover) -
support_vcs_checkout() was *almost* exactly equivalent to
docker_worker_add_gecko_vcs_env_vars(). The only difference is that
support_vcs_checkout() adds the
secrets:get:project/taskcluster/gecko/hgfingerprint scope in addition
to setting the environment variables.

MozReview-Commit-ID: 8fl3u9be5fT

--HG--
extra : rebase_source : 0eec2f143f903a3fcc5502b60026f5d8061100ea
2018-04-23 13:39:16 -07:00
Gregory Szorc
d37f10a88a Bug 1462791 - Add helper function for VCS checkout on generic-worker; r=dustin
This functionality was implemented at least 3 times. Let's consolidate
it to a central function.

Returning multiple command strings is kind of funky. I preserved
existing behavior and mozharness jobs are the only ones printing the
forensic logging. We should probably move this logging into
robustcheckout so we don't need to involve taskgraph with this. But
that can be deferred to another day.

MozReview-Commit-ID: I2LglJvfI6

--HG--
extra : rebase_source : 7cb413694aee4e46a6522febe9daa4b73b5307ca
extra : source : 096d7d374af427ee950c7a550878781eebad4135
2018-04-20 13:34:45 -07:00
Johan Lorenzo
d7e248fb83 Bug 1459181 - Fetch version-specific "whatsnew" on mozilla-release only r=sfraser
MozReview-Commit-ID: Iaet3uja3vG

--HG--
extra : rebase_source : a2a7a5b449361c9ec1e89d34feda11a9f64f5d3b
2018-05-04 15:56:19 +02:00
Joel Maher
d2d30b54ee Bug 1453056 - allow mach taskgraph runs locally with no network. r=ahal 2018-05-23 16:14:17 -04:00
Joel Maher
28e3660b54 Bug 1400895 - Better try support for test-verify. r=ahal 2018-05-23 10:00:03 -04:00
Csoregi Natalia
acd92af57e Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-23 01:02:30 +03:00
Dustin J. Mitchell
e35eac024a Bug 1463480 - always set task, even for taskgraph-level actions; r=tomprince
MozReview-Commit-ID: 5A50Tef72gk

--HG--
extra : rebase_source : b103cb1e92982faea5ee4a76877053433ce880e5
2018-05-22 17:24:27 +00:00
Tom Prince
62dd3a4390 Bug 1461784: [release] Only use the partials cache on level 3 jobs; r=sfraser
When running jobs on try, we shouldn't have access to the partials, so
don't try to give them.

Differential Revision: https://phabricator.services.mozilla.com/D1352

--HG--
extra : source : 90d19b52f956ce509525ca160ef5a2af80eea1a9
extra : histedit_source : b303ac9a4117a4e8e047d6459a7ba6477b74b762
2018-05-04 12:07:05 -06:00
Tom Prince
83c17665ad Bug 1461784: Enable staging releases on try-comm-central; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1353

--HG--
extra : source : 8984e916c5d2fbf9ee878a0cad40bbd1baab4126
extra : histedit_source : f602fc2f8c6fbb631007557eb51ac1bc3fb42889
2018-05-22 13:36:58 -06:00
Dustin J. Mitchell
aeb0a55c25 Bug 1415868 - remove ACTION_TASK r=jonasfj,tomprince
For kind=hook, the spec doesn't include this value as it's untrustworthy.

For kind=task, it's still untrustworthy, but there is no privilege escalation
so that's not important. Still, it dramatically expands the size of the task
definition.

MozReview-Commit-ID: 6scQ2ZwxP10

--HG--
extra : rebase_source : 4dc34390a510091ddc26023755992995fe358e47
2018-04-27 22:24:42 +00:00
Dustin J. Mitchell
0f0fde3dad Bug 1415868 - add support for defining actions with kind=hook; r=jonasfj,tomprince
This does not affect any existing actions.

MozReview-Commit-ID: 9j5cT2kA7UU

--HG--
extra : rebase_source : 1191d7ecb05b8083a4923b9dbe97218faf65a088
2018-04-25 17:56:29 +00:00
Dustin J. Mitchell
0ba14ea32c Bug 1415868 - Remove support for register_action_task; r=jonasfj,tomprince
In a post-actions-as-hooks world, users will not have scopes to create tasks,
so this mode of action definition will not be possible. This is not currently
used from Treeherder (it links to
https://tools.taskcluster.net/tasks/<taskid>/interactive instead)

This drops support for the JSON-e-only interactive action; that action is not
currently used from treeherder, so that should have no impact for users.

MozReview-Commit-ID: 9i3POpjahAc

--HG--
extra : rebase_source : e6de03389a0c5c67d5332d2b1c97e1d4bf6a22d3
2018-04-23 21:20:00 +00:00
Joel Maher
5b3afd93d3 backout 3 patches (1ee5b2531836, cac593a84f72, 95ccdb87f63f) from bug 1392106 for not fixing font rendering problems.
--HG--
extra : rebase_source : 30b2aa771eeaa978a8e3af18009f22562d764831
2018-05-18 06:40:00 +03:00
Tom Prince
4b0bb51005 Bug 1461784: [release] Fix release notification on try; r=aki
The email address used for notification on try was templated,
but nothing actually evaluated the template. This applies the same
templating that applies to the message to any emails specified.

Differential Revision: https://phabricator.services.mozilla.com/D1297

--HG--
extra : source : dd32a78ddf2196436f2098b4bc8bd3dc5c77b526
extra : amend_source : 8eac858e2b658bb2d8c3dacabe4c7fa3c077d9bc
2018-05-14 19:22:45 -06:00
Tom Prince
8070e1498d Bug 1447460: [taskgraph] Use the graph config root to guess find the path to .taskcluster.yml in actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1126

--HG--
extra : rebase_source : b9d3dbd07df5528009bb619937aafeb158a0e40e
2018-05-02 20:30:15 -06:00
Tom Prince
90b93a6db8 Bug 1458700: [release-promotion] Use a common target task for firefox and devedition; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1122

--HG--
extra : rebase_source : cf124d67fa250f13306a98a9412e64347b9fde68
2018-05-02 18:33:52 -06:00
Tom Prince
9bebf482da Bug 1458700: [release-promotion] Move configuration of flavors into the graph configuration; r=aki,dustin
Differential Revision: https://phabricator.services.mozilla.com/D1121

--HG--
extra : rebase_source : 270cb6a6a2c6255c585b46cc410110f83010ec6f
2018-04-23 00:17:30 -06:00
Tom Prince
7b13402d7e Bug 1456234: [taskgraph]: Add a helper for adding a suffix to a possibly grouped treeherder symbol; r=dustin.
Differential Revision: https://phabricator.services.mozilla.com/D1286

--HG--
extra : rebase_source : 3cb1080e5a94e3e9e5b5a3f6909b0e8d636de09c
extra : source : 4a182c3447fa01c75fa8a231e067bebd83683da9
2018-05-15 13:00:18 -06:00
Margareta Eliza Balazs
d4b9e50875 Merge inbound to mozilla-central. a=merge 2018-05-16 13:00:51 +03:00
Chris AtLee
6e7f604585 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : aebc03899ad88aa2838825c14a45c59e1e59be05
extra : source : ba91fec47e908619d9a8f550ee65cd78f67e3d59
2018-05-04 13:51:35 -04:00
Gregory Szorc
b104bdc7af Bug 1460475 - Use stream_reader API; r=dustin
python-zstandard 0.9 has an API that exposes a file object interface
for compression and decompression. This means we can remove our
stream wrapper in order to consume a zstandard compressed tar file.

MozReview-Commit-ID: DeWWKnigJVa

--HG--
extra : rebase_source : b510b9c7cf4471df835c755299a7842d13188b67
2018-05-11 10:10:41 -07:00
Gregory Szorc
a3113a2560 Bug 1460475 - Install zstandard 0.9.0 in mach; r=dustin
The latest python-zstandard uses a newer zstandard that is faster.
It also has wheels available, which means installation doesn't require
Python development headers, etc.

MozReview-Commit-ID: 5gRq81KYmX4

--HG--
extra : rebase_source : 96ccc64e9707c6b4815c1bfa5c1a98b9a428b387
2018-05-09 20:13:28 -07:00
Justin Wood
7a24d336a5 Bug 1459198 - Set a validation method to make sure notification filters are accurately set. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1135

--HG--
extra : rebase_source : 7bea1d4a2ea48f1fa5df224be0ab5dffb3e84ad3
2018-05-04 09:44:57 -04:00