2016-05-16 22:53:22 +00:00
|
|
|
===============
|
|
|
|
Task Attributes
|
|
|
|
===============
|
|
|
|
|
|
|
|
Tasks can be filtered, for example to support "try" pushes which only perform a
|
|
|
|
subset of the task graph or to link dependent tasks. This filtering is the
|
|
|
|
difference between a full task graph and a target task graph.
|
|
|
|
|
|
|
|
Filtering takes place on the basis of attributes. Each task has a dictionary
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-11 23:27:14 +00:00
|
|
|
of attributes and filters over those attributes can be expressed in Python. A
|
|
|
|
task may not have a value for every attribute.
|
2016-05-16 22:53:22 +00:00
|
|
|
|
|
|
|
The attributes, and acceptable values, are defined here. In general, attribute
|
|
|
|
names and values are the short, lower-case form, with underscores.
|
|
|
|
|
|
|
|
kind
|
|
|
|
====
|
|
|
|
|
|
|
|
A task's ``kind`` attribute gives the name of the kind that generated it, e.g.,
|
2016-09-08 00:31:35 +00:00
|
|
|
``build`` or ``spidermonkey``.
|
2016-09-12 15:51:49 +00:00
|
|
|
|
|
|
|
run_on_projects
|
|
|
|
===============
|
|
|
|
|
|
|
|
The projects where this task should be in the target task set. This is how
|
|
|
|
requirements like "only run this on inbound" get implemented. These are
|
|
|
|
either project names or the aliases
|
|
|
|
|
|
|
|
* `integration` -- integration branches
|
|
|
|
* `release` -- release branches including mozilla-central
|
|
|
|
* `all` -- everywhere (the default)
|
|
|
|
|
|
|
|
For try, this attribute applies only if ``-p all`` is specified. All jobs can
|
|
|
|
be specified by name regardless of ``run_on_projects``.
|
|
|
|
|
|
|
|
If ``run_on_projects`` is set to an empty list, then the task will not run
|
2016-09-24 18:31:25 +00:00
|
|
|
anywhere, unless its build platform is specified explicitly in try syntax.
|
2016-09-12 15:51:49 +00:00
|
|
|
|
2016-07-28 17:20:44 +00:00
|
|
|
task_duplicates
|
|
|
|
===============
|
|
|
|
|
|
|
|
This is used to indicate that we want multiple copies of the task created.
|
|
|
|
This feature is used to track down intermittent job failures.
|
|
|
|
|
|
|
|
If this value is set to N, the task-creation machinery will create a total of N
|
|
|
|
copies of the task. Only the first copy will be included in the taskgraph
|
|
|
|
output artifacts, although all tasks will be contained in the same taskGroup.
|
|
|
|
|
|
|
|
While most attributes are considered read-only, target task methods may alter
|
|
|
|
this attribute of tasks they include in the target set.
|
|
|
|
|
2016-05-16 22:53:22 +00:00
|
|
|
build_platform
|
|
|
|
==============
|
|
|
|
|
|
|
|
The build platform defines the platform for which the binary was built. It is
|
|
|
|
set for both build and test jobs, although test jobs may have a different
|
|
|
|
``test_platform``.
|
|
|
|
|
|
|
|
build_type
|
|
|
|
==========
|
|
|
|
|
|
|
|
The type of build being performed. This is a subdivision of ``build_platform``,
|
|
|
|
used for different kinds of builds that target the same platform. Values are
|
|
|
|
|
|
|
|
* ``debug``
|
|
|
|
* ``opt``
|
|
|
|
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-11 23:27:14 +00:00
|
|
|
test_platform
|
|
|
|
=============
|
|
|
|
|
|
|
|
The test platform defines the platform on which tests are run. It is only
|
|
|
|
defined for test jobs and may differ from ``build_platform`` when the same binary
|
|
|
|
is tested on several platforms (for example, on several versions of Windows).
|
|
|
|
This applies for both talos and unit tests.
|
|
|
|
|
|
|
|
Unlike build_platform, the test platform is represented in a slash-separated
|
|
|
|
format, e.g., ``linux64/opt``.
|
|
|
|
|
2016-05-16 22:53:22 +00:00
|
|
|
unittest_suite
|
|
|
|
==============
|
|
|
|
|
|
|
|
This is the unit test suite being run in a unit test task. For example,
|
|
|
|
``mochitest`` or ``cppunittest``.
|
|
|
|
|
|
|
|
unittest_flavor
|
|
|
|
===============
|
|
|
|
|
|
|
|
If a unittest suite has subdivisions, those are represented as flavors. Not
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-11 23:27:14 +00:00
|
|
|
all suites have flavors, in which case this attribute should be set to match
|
|
|
|
the suite. Examples: ``mochitest-devtools-chrome-chunked`` or ``a11y``.
|
2016-05-16 22:53:22 +00:00
|
|
|
|
|
|
|
unittest_try_name
|
|
|
|
=================
|
|
|
|
|
2016-09-08 00:31:35 +00:00
|
|
|
This is the name used to refer to a unit test via try syntax. It
|
2016-05-16 22:53:22 +00:00
|
|
|
may not match either of ``unittest_suite`` or ``unittest_flavor``.
|
|
|
|
|
2016-05-18 17:55:33 +00:00
|
|
|
talos_try_name
|
|
|
|
==============
|
|
|
|
|
2016-09-08 00:31:35 +00:00
|
|
|
This is the name used to refer to a talos job via try syntax.
|
2016-05-18 17:55:33 +00:00
|
|
|
|
2016-05-16 22:53:22 +00:00
|
|
|
test_chunk
|
|
|
|
==========
|
|
|
|
|
|
|
|
This is the chunk number of a chunked test suite (talos or unittest). Note
|
|
|
|
that this is a string!
|
|
|
|
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-11 23:27:14 +00:00
|
|
|
e10s
|
|
|
|
====
|
|
|
|
|
|
|
|
For test suites which distinguish whether they run with or without e10s, this
|
|
|
|
boolean value identifies this particular run.
|
|
|
|
|
2016-06-05 19:15:53 +00:00
|
|
|
image_name
|
|
|
|
==========
|
|
|
|
|
|
|
|
For the ``docker_image`` kind, this attribute contains the docker image name.
|
2016-09-16 08:20:38 +00:00
|
|
|
|
|
|
|
nightly
|
|
|
|
=======
|
|
|
|
|
|
|
|
Signals whether the task is part of a nightly graph. Useful when filtering
|
|
|
|
out nightly tasks from full task set at target stage.
|