Commit Graph

402 Commits

Author SHA1 Message Date
Dustin J. Mitchell
d79e5cf158 Bug 1301720: ensure Buildbot and TaskCluster v2 routes match; r=mshal
MozReview-Commit-ID: 40FmcJWkIIo

--HG--
extra : rebase_source : 601abc4e1029610921db3850eebdbd3acf370e8c
2016-09-16 15:08:57 +00:00
Dustin J. Mitchell
e50b7adea6 Bug 1301720: whitelist gecko-v2 job names; r=mshal
MozReview-Commit-ID: 7Gs1yEMSr4V

--HG--
extra : rebase_source : 3685885966129673788e7bed8e52dc97fb95180c
2016-09-14 21:32:23 +00:00
James Graham
bdf8391e8f Bug 1302796 - Add wpt manifest lint to taskcluster, r=ahal
MozReview-Commit-ID: IpNUVTC35U1

--HG--
extra : rebase_source : a87fbb242fd62b6a4b5c9e9540e56b889403d39d
2016-09-16 10:24:48 +01:00
Wes Kocher
cdf9010674 Backed out changeset f227ea4d52fe (bug 1302907) because it caused some updated packages to get built, causing linux64 failures a=backout CLOSED TREE
--HG--
rename : taskcluster/scripts/tester/test-ubuntu.sh => taskcluster/scripts/tester/test-ubuntu1604.sh
2016-09-15 14:40:10 -07:00
Gregory Szorc
9a92ffbf3d Backed out changesets 11ffdc565be, dda84d1fb12b, and 21fdf73bbb17 (bug 1302907) for Windows build bustage
Because Windows.

--HG--
extra : histedit_source : 738d1b89cf5638d31324efd01545c9963df9a174
2016-09-15 12:49:03 -07:00
Gregory Szorc
7d5dcf8909 Bug 1302907 - Run mozharness from source checkout if available; r=dustin
Currently, build tasks produce a zip file artifact containing the
content of testing/mozharness.  This zip file is downloaded and applied
by any test using mozharness (which is most of them).

Now that some tests have a source checkout, we don't need to download
a mozharness zip because we can just use the source checkout.

This commit teaches test-ubuntu.sh to accept a custom path to
mozharness files. If that path is defined, we skip downloading the
mozharness zip.

The taskgraph has been updated to pass the path of mozharness in the
checkout to test-ubuntu.sh when a source checkout is available.

MozReview-Commit-ID: 2P17Wx1oytI

--HG--
extra : rebase_source : 5d97079f054f3cd236a1c2a3039c3894207377f9
2016-09-14 18:20:57 -07:00
Gregory Szorc
1c561bad1d Bug 1302907 - Use relative path to mozharness configs; r=dustin
Same deal as the last commit except for config paths.

MozReview-Commit-ID: 3AXwc3i3Iqu

--HG--
extra : rebase_source : c249f77289e24aceaae73dbca0c994b949215814
2016-09-14 17:07:04 -07:00
Gregory Szorc
30433a1b9b Bug 1302907 - Use relative path to mozharness script; r=dustin
Mozharness scripts all live in "mozharness/scripts." So, we don't need
to redundantly define this path. Let's define the script as the relative
path within "mozharness/scripts" instead.

IMO this cosmetic improvement can stand on its own. However, the real
reason for this change is to pave the way for running mozharness from
a source checkout instead of downloading a zip archive of it.

MozReview-Commit-ID: FUnMiLlCcGK

--HG--
extra : rebase_source : 3a0093f1995120264fed89dc4af94eea3554bfe5
2016-09-14 16:56:55 -07:00
Gregory Szorc
4c216e4cdb Bug 1302907 - Merge test-ubuntu1204.sh and test-ubuntu1604.sh; r=dustin
The only difference in these files was the order that pulseaudio is
started and whether compiz is started. We rename test-ubuntu1604.sh
to test-ubuntu.sh, add some distro release detection, and add
some conditional branches so it works on both Ubuntu 12.04 and 16.04.

MozReview-Commit-ID: CaSfuDxss3d

--HG--
rename : taskcluster/scripts/tester/test-ubuntu1604.sh => taskcluster/scripts/tester/test-ubuntu.sh
extra : rebase_source : 2153d24fbf8208851a6df8728b8a820166278751
2016-09-14 16:29:25 -07:00
Wes Kocher
9cd8a9ed02 Backed out changeset 9c949b216b37 (bug 1278402) for enabling jobs outside of try that shouldn't be enabled outside of try a=backout CLOSED TREE 2016-09-15 11:43:17 -07:00
Greg Mierzwinski
8875e96f7d Bug 1278402 - Add linux64-ccov and linux64-jsdcov as code coverage build platforms to taskcluster. r=dustin,jmaher
These builds can be run on taskcluster to obtain per-test (JSDebugger) code coverage with the linux64-jsdcov build and overall (GCOV) code coverage with the linux64-ccov build. The linux64-jsdcov build also needed to have leak checking disabled for debug mode.

MozReview-Commit-ID: ASgrU2X7RQV

--HG--
extra : rebase_source : af40a6e582665ffcb575092586731f595a362ae4
2016-07-23 11:27:49 -04:00
Carsten "Tomcat" Book
08b3e66490 Merge mozilla-central to autoland 2016-09-15 12:08:47 +02:00
Carsten "Tomcat" Book
25a074d342 merge mozilla-inbound to mozilla-central a=merge 2016-09-15 11:59:50 +02:00
Dustin J. Mitchell
abfa4e2d89 Bug 1286075: remove legacy stragglers; r=Callek
MozReview-Commit-ID: D1eOItJmTJQ
2016-09-14 15:21:29 +00:00
Carsten "Tomcat" Book
d2c3fe7fd3 merge autoland to mozilla-central a=merge 2016-09-14 12:07:02 +02:00
Ryan VanderMeulen
739f3dac5a Merge m-c to autoland. a=merge 2016-09-13 20:46:39 -04:00
Dustin J. Mitchell
6b94deded3 Bug 1286075: fix flake8 error; r=gps CLOSED TREE a=KWierso
MozReview-Commit-ID: 4DWMQTVekwk

--HG--
extra : amend_source : b57aa55fd733350a0159f0e2668f33d9802e3d4c
2016-09-13 19:44:04 +00:00
Dustin J. Mitchell
f66f7fa02e Bug 1286075: adjust the branches where haz tasks run; r=sfink
MozReview-Commit-ID: Ips0u2PBiPO

--HG--
extra : rebase_source : fc57046f4d0a289703fcfbe478df1d2e52fe79b6
2016-09-09 21:14:55 +00:00
Dustin J. Mitchell
37f9b67655 Bug 1286075: remove trailing newline in env var; r=gps
MozReview-Commit-ID: FebGZoVfVdj

--HG--
extra : rebase_source : 3fb6ba586095aea2fe4e37018939eb15bde73930
2016-09-09 21:12:36 +00:00
Dustin J. Mitchell
c610bb394d Bug 1286075: remove old name for 'default' task set; r=Callek
MozReview-Commit-ID: 3bRvQijMtda

--HG--
extra : rebase_source : a21bda97d8357f0db13d2f7003e38293c0373d6b
2016-09-09 21:07:31 +00:00
Dustin J. Mitchell
3fd5749d78 Bug 1286075: disable indexing for jobs that do not need it; r=mshal
As verified in the bug.

MozReview-Commit-ID: 3LaW4xo1nrW

--HG--
extra : rebase_source : 7dfea921d93a6724f1c67dcd6d18c651e03d8ffe
2016-09-07 17:05:02 +00:00
Dustin J. Mitchell
2d6ea7ce52 Bug 1286075: remove unused secrets access from spidermonkey; r=sfink
MozReview-Commit-ID: DkctcaxkGA4

--HG--
extra : rebase_source : d2a427d84bbbbf3932fb9f70c4a6f7ae03175b22
2016-09-07 16:10:36 +00:00
Dustin J. Mitchell
62c62d49ef Bug 1286075: clean up mulet builds; r=gerard-majax
Set up tooltool to actually use its cache, and remove the unused tc-vcs cache
scope

MozReview-Commit-ID: H1VLxryQPEM

--HG--
extra : rebase_source : b52de7f5a10e5fb4576872bf3169b2faf87ded32
2016-09-07 16:09:30 +00:00
Dustin J. Mitchell
6238dab03d Bug 1286075: use the default gecko-b-* workerType for all haz builds; r=sfink
MozReview-Commit-ID: 1d2w3rhb0qj

--HG--
extra : rebase_source : 8332496948570c59c2b5f2216a61886acf7faa67
2016-09-07 16:01:22 +00:00
Dustin J. Mitchell
72b1a307ee Bug 1286075: do not use secrets for hazard jobs; r=sfink
Secrets are accessed via http://taskcluster/secrets, and the hazard scripts
show no evidence of such calls.

MozReview-Commit-ID: 6xp6D2ybwap

--HG--
extra : rebase_source : 5bfe02773f26768c7e79621a43515d6bf8b921ca
2016-09-07 15:58:29 +00:00
Dustin J. Mitchell
e4e3e5240b Bug 1286075: add how-tos covering new functionality; r=gps
MozReview-Commit-ID: 5l6v81UKskC

--HG--
extra : rebase_source : 8fb77e5c5fe5761df489eef1dc65b5ac11ab437b
2016-09-09 21:29:27 +00:00
Dustin J. Mitchell
bfea831cd8 Bug 1286075: delete the legacy kind; r=mshal
MozReview-Commit-ID: F99tUGUWj6d

--HG--
rename : taskcluster/ci/legacy/routes.json => testing/mozharness/configs/routes.json
extra : rebase_source : a437dd30dac1add3f439a98a8d910d2bdbcc843f
2016-09-08 00:31:35 +00:00
Dustin J. Mitchell
52ca0c7efa Bug 1286075: add a (temporary) android-stuff kind; r=nalexander
This leaves a lot of room for improvement, but gets the job done for now.

MozReview-Commit-ID: HmeTxZjOfOb

--HG--
extra : rebase_source : b6f55134c25cb670409e906da1acc7c0bd8d0dc0
2016-09-08 00:25:48 +00:00
Dustin J. Mitchell
36b108725b Bug 1286075: add a (temporary) marionette-harness kind; r=maja_zf
This has some notes for future work on the task, but will work for now.

MozReview-Commit-ID: 7J4tQeKj3KJ

--HG--
extra : rebase_source : d171b5393fa340a47927e8b89ece93392ff23e56
2016-09-08 00:32:50 +00:00
Dustin J. Mitchell
26f2d36fc7 Bug 1286075: add a b2g-device kind; r=gerard-majax
MozReview-Commit-ID: GaP2xGF3WzJ

--HG--
extra : rebase_source : a9e3f4c9232ccff3c135a9d3f63956e4f44c25df
2016-09-12 18:04:18 +00:00
Dustin J. Mitchell
9bb2b3ed24 Bug 1286075: add a spidermonkey kind; r=sfink
MozReview-Commit-ID: 4uI8LxHrSOS

--HG--
extra : rebase_source : e30d431e48bf12cd6752de07f224dfb232a55c14
2016-09-12 18:04:24 +00:00
Dustin J. Mitchell
eb34ebceda Bug 1286075: add a toolchain kind; r=gps
MozReview-Commit-ID: EEeQdA9aPPq

--HG--
extra : rebase_source : c1365c69e5c0d8bf4bfc8079d6f9fe8f43156cee
2016-09-12 18:04:31 +00:00
Dustin J. Mitchell
3ad0d4341d Bug 1286075: add a static-analysis kind; r=Ehsan
MozReview-Commit-ID: G8muXBcNd5L

--HG--
extra : rebase_source : 3f824f01ea7833adb8142fa9dc65c90e3fa990b3
2016-09-08 00:31:35 +00:00
Dustin J. Mitchell
a83a8a116a Bug 1286075: add a valgrind kind; r=mshal
MozReview-Commit-ID: IM6iFkBIHam

--HG--
extra : rebase_source : 7ed690bd74cc7e45dde76696ea4c6cf5af7acdf1
2016-09-07 00:48:31 +00:00
Dustin J. Mitchell
126e67628e Bug 1286075: add upload-symbols kind; r=ted.mielczarek
MozReview-Commit-ID: C3Se6gdSPri

--HG--
extra : rebase_source : 593030907b5edcdbb0f8863f4226a73b50d32b51
2016-09-07 15:08:28 +00:00
Dustin J. Mitchell
7ad064d6b0 Bug 1286075: add source-check kind; r=ahal
MozReview-Commit-ID: EDdPraYxNlH

--HG--
extra : rebase_source : aab182e3dfda2bbe831f8aef6a06a0d946384b8f
2016-09-12 18:39:05 +00:00
Dustin J. Mitchell
f24c79cf78 Bug 1286075: add l10n kind; r=Callek
MozReview-Commit-ID: 3mR5AxWSk9P

--HG--
extra : rebase_source : 14de8e0682c2dfda52bfce63905bd384c92ff7a7
2016-09-09 21:06:51 +00:00
Dustin J. Mitchell
fd289830f7 Bug 1286075: add hazard kind; r=sfink
MozReview-Commit-ID: qvFg2O6OwB

--HG--
extra : rebase_source : 0f118b793b2ff1078a72c2a60bda36d51f25ad70
2016-09-12 18:04:09 +00:00
Dustin J. Mitchell
39bb843d5d Bug 1286075: add artifact-build kind; r=chmanchester r=gps
MozReview-Commit-ID: 41WpDtXvoPb

--HG--
extra : rebase_source : c2906b9e4333fcd11568d5a7a43582203a623649
2016-09-07 01:01:52 +00:00
Dustin J. Mitchell
ea5260dea0 Bug 1286075: add a build kind, modify tests to use it; r=jlund
MozReview-Commit-ID: DkpkkSRxVB9

--HG--
extra : rebase_source : e9d8764b64dff35e374bc669b1769cb6c2ce0eeb
2016-09-12 18:34:06 +00:00
Dustin J. Mitchell
9d6518161a Bug 1286075: allow defaults in TransformTask; r=gps
MozReview-Commit-ID: 5tdnxykLTZc

--HG--
extra : rebase_source : 71340c9d9da0e29c71633f10e2afee6b9bda13fb
2016-09-01 18:48:38 +00:00
Dustin J. Mitchell
2fb0796e2b Bug 1286075: add support for optimizing based on files changed in the push; r=gps
MozReview-Commit-ID: 5di7TuL9X2P

--HG--
extra : rebase_source : 30b078178b028b22c0cd7b3d893aa12fd195cf26
2016-09-12 18:40:12 +00:00
Dustin J. Mitchell
6db7f5787e Bug 1286075: fix target task generation, including try; r=Callek
This uses the run_on_projects attribute introduced earlier for most branches,
adjusts the `ash` method to handle that branch as the legacy implementation
did, and updates try syntax to match builds as well as tests.

In the process, this enables optimizing target tasks, meaning that tasks
specifically requested in the try syntax might be optimized.  While this is
probably not ideal, it matches the existing behavior of try (where `-j all` is
the default but all jobs are set to run only when certain files have been
modified).  This change can be reverted later, in a more advanced version of
try.

MozReview-Commit-ID: 5FYeUTAsafr

--HG--
extra : rebase_source : b358e0e7cd8a401c50009e63dd55c59489c9b75b
2016-09-12 18:41:58 +00:00
Dustin J. Mitchell
d68c5bcdcc Bug 1286075: introduce job descriptions and implementations; r=gps
MozReview-Commit-ID: HNXPjt3XnXe

--HG--
extra : rebase_source : 82fc319882cad00fd5d623fb045620e157682278
2016-09-12 15:53:14 +00:00
Dustin J. Mitchell
4d387f2490 Bug 1286075: add more functionality to the task description; r=mshal
The task description now includes

 * flexible specification of index routes (this will get simpler once buildbot
   and gecko.v1 routes are removed)

 * "run-on-projects", indicating the projects on which this task should run

 * "{level}" is allowed in workerTypes

 * For the docker-worker/docker-engine worker implementations, "docker-image"
   can have the form {in-tree: in-tree-name} to use an in-tree image.  This was
   previously implemented in the test transforms, but it is useful for other
   tasks too!

 * Optimizations, currently limited to "only-if-files-changed", can be specified
   for each task.

 * TreeHerder groupSymbol is optional

 * expires-after and and deadline-after have default values (with the former
   differing for try and non-try)

 * coalesce-name triggers creation of both a coalesce route and a superseder URL

MozReview-Commit-ID: 70vtYs5lz5P

--HG--
extra : rebase_source : 9c557d68239f42466d9724d48ed5bf77648f9aa0
2016-09-12 15:51:49 +00:00
Dustin J. Mitchell
7fa48ca716 Bug 1286075: factor load_yaml into a util module; r=gps
MozReview-Commit-ID: DPWZWslcphy

--HG--
extra : rebase_source : 003971b8caf20565f03a800ae5712fe775366e92
2016-09-06 18:01:27 +00:00
Dustin J. Mitchell
f1b64e2970 Bug 1286075: dump data that fails validation; r=wcosta
This was Wander's idea, in fact!

MozReview-Commit-ID: fGBjfYwPv8

--HG--
extra : rebase_source : 61c44d02841dc497f4f9ade2a912c02e86ead62f
2016-08-31 20:10:19 +00:00
Dustin J. Mitchell
e7fecbd4ae Bug 1286075: rename taskgraph.transforms.make_task; r=wcosta
Rename to taskgraph.transforms.task.

This also adds some Required and Optional declarations to the schema to be explicit,
and adjusts the transform to handle treeherder being optional.

MozReview-Commit-ID: FuKYayvlwB9

--HG--
rename : taskcluster/taskgraph/transforms/make_task.py => taskcluster/taskgraph/transforms/task.py
extra : rebase_source : 0913aa8cdf153cd086a7786de957535e9b3a4ee8
2016-08-31 15:24:54 +00:00
Dustin J. Mitchell
09fd15c2e1 Bug 1286075: use cache names based on build_platfom+build_type; r=gerard-majax
This is cosmetic, and makes the cache names easier to generate automatically.

MozReview-Commit-ID: SPwDDnUhx9

--HG--
extra : rebase_source : 2666c8e9073f9598db4146773059065b0d9ba76e
2016-09-07 21:30:22 +00:00
Dustin J. Mitchell
89f90ff54f Bug 1286075: all device builds are at tier 3; r=gerard-majax
MozReview-Commit-ID: KV804Mdr3bu

--HG--
extra : rebase_source : d28fa3b875d18affa4c3fe6d2eb936777dde146a
2016-09-07 17:43:31 +00:00