Commit Graph

16 Commits

Author SHA1 Message Date
Dustin J. Mitchell
b910cd6125 Bug 1328727: use json-e for cron decision tasks too; r=aki,jonasfj
Changes to cron decision tasks:
 - drops some unnecessary routes
 - drops tags.createdForUser: nobody@..
 - more use of environment variables within the command line

MozReview-Commit-ID: 9zoqFvwrBRs

--HG--
extra : rebase_source : 77e17089b67e5d72360d5ecb617887b7a71457fe
2017-07-21 18:08:06 +00:00
Andrew Halberstadt
e26e3d1b13 Bug 1378212 - Give cron-based decision tasks unique index routes, r=dustin
We'd like to use routes like:
index.gecko.v2.mozilla-central.latest.firefox.decision

to automatically find the latest parameters.yml file from a decision task. Unfortunately,
sometimes the latest decision task happens to be triggered by a cron job which uses a different
target_tasks method and therefore won't generate the expected tasks.

This patch *should* create a different index for these types of decision tasks, though I'm not
sure how I can test it before pushing.

MozReview-Commit-ID: 1993ISgb1Dn

--HG--
extra : rebase_source : f86fc60e823e02b922e5eec888620a28f4dc254c
2017-07-04 16:09:58 -04:00
Andrew Halberstadt
c9beaa56b4 Bug 1373294 - Fix E305 (two blank lines after method or class) in files enabled by flake8 linter, r=jmaher
This is needed before we can upgrade to flake8 3.3.0, as that version starts flagging these errors.

These files were modified by running:
autopep8 --select E305 --in-place -r <dir>

on the affected directories. I did it one dir at a time and verified the result after each.

MozReview-Commit-ID: FmlsfiKIbtr

--HG--
extra : rebase_source : 9df32258cadff5d27a0e72113c57f782756c0b18
2017-06-15 12:10:59 -04:00
Dustin J. Mitchell
76cf6b7b0f Bug 1351011: remove unused triggered_by property; r=Callek
The purpose of this parameter has been superseded by the `include_nightly`
property.

MozReview-Commit-ID: 4iXQsv9Drqg

--HG--
extra : rebase_source : c94142282909a88c29fe6809d87721bef1f198c2
2017-03-27 20:10:08 +00:00
Justin Wood
735c719944 Bug 1355105 - Cron.yml requires a 'when' for all projects even if not specified in 'run-on-projects'. r=dustin
MozReview-Commit-ID: CIKcRtGfvIM

--HG--
extra : rebase_source : b7481a705f8b0e8d2afde295bc37c8975cb61787
2017-04-10 11:23:49 -04:00
Dustin J. Mitchell
f92b1e6c0b Bug 1337360: check for schema elements that aren't dashed-identifiers, with whitelist; r=Callek
MozReview-Commit-ID: FirYCrjFXAS

--HG--
extra : rebase_source : e28844e9c5854b0b587fcea7b0533473376c5bf2
2017-03-22 16:24:38 +00:00
Mike Hommey
3854c3f71d Bug 1341214 - Add a small API to handle taskcluster queue and index requests. r=dustin
Various modules under taskcluster are doing ad-hoc url formatting or
requests to taskcluster services. While we could use the taskcluster
client python module, it's kind of overkill for the simple requests done
here. So instead of vendoring that module, create a smaller one with
a limited set of functions we need.

This changes the behavior of the get_artifact function to return a
file-like object when the file is neither a json nor a yaml, but that
branch was never used (and was actually returning an unassigned
variable, so it was broken anyways).

At the same time, make the function that does HTTP requests more
error-resistant, using urllib3's Retry with a backoff factor.

Also add a function that retrieves the list of artifacts, that while
currently unused, will be used by `mach artifact` shortly.

--HG--
extra : rebase_source : d7ef633e8e5041dc8450f3ff2f3751c85f144cdc
2017-02-17 12:04:48 +09:00
Mike Hommey
28cdcbdebb Bug 1341214 - Define GECKO in a single location. r=dustin
Instead of every file trying to get the top source directory having an
ad-hoc definition that gets wrong if the files gets moved around for
some reason, define it in a more central location.

--HG--
extra : rebase_source : 1a0cbea267193f6b388b88b36166353e20ac8569
2017-02-17 11:56:12 +09:00
Carsten "Tomcat" Book
197fbb6eb9 Backed out changeset d8122277e9fd (bug 1341214) for causing on m-c problems in vp tc tasks 2017-02-22 15:33:42 +01:00
Mike Hommey
f99718e272 Bug 1341214 - Define GECKO in a single location. r=dustin
Instead of every file trying to get the top source directory having an
ad-hoc definition that gets wrong if the files gets moved around for
some reason, define it in a more central location.

--HG--
extra : rebase_source : 06fa06d47732223e19b0201f8791fdbffdc9ee03
2017-02-17 11:56:12 +09:00
Dustin J. Mitchell
e8c3962c5e Bug 1334167: use the gecko schedulerid to avoid schedulerid conflicts; r=Callek
MozReview-Commit-ID: CdWC1y3oAQe

--HG--
extra : rebase_source : fca4eacfac28745974720ef8f02e9b58747f4887
2017-02-06 15:08:46 +00:00
Dustin J. Mitchell
53b7bc583c Bug 1334167: allow by-project for cron jobs' when property; r=Callek
This requires moving the schema utilities to their own util module.

MozReview-Commit-ID: KR5xSJ9ak5Y

--HG--
extra : rebase_source : 1c1f6bfb6a08deb8c0be4b2b58db02d85aafeb89
2017-02-01 00:30:52 +00:00
Dustin J. Mitchell
e8eacef251 Bug 1334167: use run-on-projects to parallel task graph generation; r=Callek
MozReview-Commit-ID: EQMuh4hN9Ya

--HG--
extra : rebase_source : 49eeeb005d5e74ee415add12a897b1767ee0bbd8
2017-01-31 19:49:18 +00:00
Dustin J. Mitchell
c40b565818 Bug 1334167: match times correctly; r=Callek
MozReview-Commit-ID: CZCoqmAEx9Q

--HG--
extra : rebase_source : 3ef22101d7f594426859b9eb3cbf287c2e1cb2ad
2017-01-31 18:39:33 +00:00
Dustin J. Mitchell
1468523af0 Bug 1334167: calculate head revision with -r .; r=Callek
MozReview-Commit-ID: 6tmdO5qwD4g

--HG--
extra : rebase_source : 652995c97ffc22125343aedfb5b07eddda5b7d38
2017-01-31 18:28:06 +00:00
Dustin J. Mitchell
b8d8f8a712 Bug 1252948: support for periodic taskgraphs; r=Callek,jonasfj,kmoir
This adds `.cron.yml` and a new mach command to interpret it.  While
functionality is limited to nightlies right now, there is room to expand to
more diverse periodic tasks.  Let your imagination run wild!

MozReview-Commit-ID: KxQkaUbsjQs

--HG--
extra : rebase_source : ddf0a1eadae5a1169c0ead7bcb7b9ce61b255fbf
2017-01-18 19:45:53 +00:00