Commit Graph

8353 Commits

Author SHA1 Message Date
Dorel Luca
7ff1c0fb61 Backed out changeset b17f8ba4211d for Gecko Decision task bustage. CLOSED TREE 2020-07-08 22:53:59 +03:00
Tom Prince
440eed985f Bug 1643817: Use a fresh taskgroup for create-interactive tasks; r=Callek
In Bug 1641971 (e7d4c490c31a) we changed `taskgraph.create.create_tasks` to
always get the decision task id to use. However, the call in create-interactive
passed `None`, expecting to have on generated. This changes that to use the
`create-interactive`s action task as the task id.

Differential Revision: https://phabricator.services.mozilla.com/D82652
2020-07-08 18:41:17 +00:00
Tom Prince
fc3ae614bc No bug: Update links to hg.mozilla.org to use default instead of tip in taskcluster/; r=Callek
The latter sometimes bites us if we have a legacy support branch that gets
pushed more recently than default.

Differential Revision: https://phabricator.services.mozilla.com/D82628
2020-07-08 18:41:17 +00:00
Tom Prince
927f176328 No bug: Be strict about treeherder symbol splitting; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82624
2020-07-08 18:18:57 +00:00
Edwin Takahashi
02a12126c0 Bug 1648851 - reduce max-run-time value of android-api-16-shippable/opt task to 1800 r=gbrown,jmaher
Changes:
  - max-run-time reduced to 1800 which should suffice.

Differential Revision: https://phabricator.services.mozilla.com/D82253
2020-07-08 17:46:37 +00:00
emilfs
dafec58d06 Bug 1643293 - added new job in doc to render documentation at review phase r=sylvestre,ahal
Differential Revision: https://phabricator.services.mozilla.com/D80428
2020-07-08 13:53:45 +00:00
Christian Holler
fcbc0dd643 Bug 1651243 - Remove leftover crashsymbols attribute from fuzzing debug job. r=truber
Differential Revision: https://phabricator.services.mozilla.com/D82683
2020-07-08 12:14:15 +00:00
alexandru.ionescu
1feda07409 Bug 1651353 Re-enable youtube widevine tests r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82692
2020-07-08 12:38:10 +00:00
Gregory Mierzwinski
8d10f86507 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Gregory Mierzwinski
6e1d467ad0 Bug 1650871 - Add option to disable firefox window recorder. r=perftest-reviewers,AlexandruIonescu
This patch adds an option to disable the firefox window recorder in browsertime, it also adds it to the browsertime-mobile taskcluster config since it is disabled there (but not on desktop).

Differential Revision: https://phabricator.services.mozilla.com/D82431
2020-07-08 07:50:11 +00:00
Tom Prince
a22772e2a2 Bug 1626058: Build docker images with kaniko, instead of dind; r=glandium,hwine
Differential Revision: https://phabricator.services.mozilla.com/D77864
2020-07-07 19:53:32 +00:00
Tom Prince
033c399c15 Bug 1626058: Don't add prefix when building a docker-context at graph generation time; r=glandium
We were building a context with a top-level directory matching the image name
during graph generation. This is not accepted by docker build. This didn't
cause issues since we only used it for digest generation. Since we are
switching to use the decision generated context, change this to match the
context being generated when building an image.

Differential Revision: https://phabricator.services.mozilla.com/D77841
2020-07-07 19:53:17 +00:00
Tom Prince
d64ad0967b Bug 1626058: Add support for writting out artifacts from transforms in the decision task; r=Callek,ahal
To support using kaniko[1] for building images, we need to generate the docker
contexts in a seprate task from the docker-image task. Since we use the hash of
the context as the cached-task digest, we generate the context in the decision
task already, so this adds a way to write that out to be used by downstream
tasks.

[1] https://github.com/GoogleContainerTools/kaniko

Differential Revision: https://phabricator.services.mozilla.com/D77839
2020-07-07 19:56:11 +00:00
Tom Prince
50513f07b4 Bug 1637544: Use sccache on instrumented builds on non-release branches; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82485
2020-07-07 16:39:28 +00:00
Tom Prince
cfe40e25ca Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 16:39:31 +00:00
Tom Prince
7ed26bf1c6 Bug 1637544: Rename needs-sccache to use-sccache; r=glandium
I'm going to change this from being autodected, to specified explicitly, and so
`use-sccache` better captures the meaning.

Differential Revision: https://phabricator.services.mozilla.com/D82483
2020-07-07 16:39:33 +00:00
Tom Prince
aa8615681b No bug: Remove unused desktop1604-test image; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82543
2020-07-07 16:17:16 +00:00
Justin Wood
bff89afddf Bug 1649383 - don't do geckoview builds on esr. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D81742
2020-07-07 16:09:35 +00:00
Mihai Alexandru Michis
a8ccb677a1 Bug 1648591 - Fix failures regarding test_cron_util.py a=fix
CLOSED TREE
2020-07-07 19:35:38 +03:00
Mihai Alexandru Michis
5acb93239f Backed out 3 changesets (bug 1637544) for causing gecko decision task bustages.
CLOSED TREE

Backed out changeset 93b955e5c048 (bug 1637544)
Backed out changeset be0717d76643 (bug 1637544)
Backed out changeset 447fea64b68d (bug 1637544)
2020-07-07 19:31:41 +03:00
Tom Prince
9c3f3b3519 Bug 1637544: Use sccache on instrumented builds on non-release branches; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82485
2020-07-07 08:39:25 +00:00
Tom Prince
2d287e7d96 Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 08:39:20 +00:00
Tom Prince
8a8dbbb549 Bug 1637544: Rename needs-sccache to use-sccache; r=glandium
I'm going to change this from being autodected, to specified explicitly, and so
`use-sccache` better captures the meaning.

Differential Revision: https://phabricator.services.mozilla.com/D82483
2020-07-07 08:39:19 +00:00
Tom Prince
b89d332bae No bug: Don't include push-id in treeherder routes; r=aki
Treeherder ignores this.

Differential Revision: https://phabricator.services.mozilla.com/D82251
2020-07-03 23:37:49 +00:00
Tom Prince
909e7275e8 Bug 1648591: Remove taskgraph based cron implementation; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D81270
2020-07-07 16:04:00 +00:00
David Major
06d9c7e99f Bug 1650239 - Build llvm-dsymutil out of the clang-10 source tree r=firefox-build-system-reviewers,rstewart
The current version hits OOM errors when dsymutil-ing files created by clang 10 and 11.

The choice of clang-10 here is somewhat arbitrary in that it's a fetch job that we conveniently already had in the tree. It doesn't have to be exactly version 10 specifically.

Differential Revision: https://phabricator.services.mozilla.com/D82453
2020-07-06 21:42:42 +00:00
James Graham
6fdb192e27 Bug 1649866 - Promote wpt print-reftests to tier-1 on desktop, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D81979
2020-07-02 12:32:44 +00:00
David Major
d38d9b8bdb Bug 1650239 - Update cctools-port to make it buildable with clang 11 r=froydnj
Fixes the bustage described in 4e1faecce8

In theory I could leave this task alone and fork a new toolchain for use by clang 11, but this seems internal-enough that existing builds shouldn't be negatively affected by this.

Differential Revision: https://phabricator.services.mozilla.com/D82444
2020-07-06 20:43:42 +00:00
Gregory Mierzwinski
99a1058fe5 Bug 1649819 - Temporarily disable youtube widevine tests on linux and windows7. r=tarek
This patch disables the linux and windows7 platforms for the youtube widevine tests.

Differential Revision: https://phabricator.services.mozilla.com/D82370
2020-07-07 11:50:28 +00:00
David Major
466f74b7ac Bug 1650239 - Name clang-9 toolchains as such explicitly r=firefox-build-system-reviewers,rstewart
We already do this for e.g. `linux64-clang-9`; this patch extends that pattern everywhere.

This will make it easy to do try runs with other clangs: just move the `toolchain-alias` lines from the `9` tasks to the `trunk` tasks.

Also, this makes dependencies more explicit: for example the gn task specifically requests a clang-9 compiler, so it will also need a clang-9-based cctools-port, rather than whatever moving value the alias represents.

Differential Revision: https://phabricator.services.mozilla.com/D82441
2020-07-06 21:42:22 +00:00
David Major
c65f6e0aff Bug 1650239 - Rename cctools-clang-10-port to cctools-port-clang-10 r=firefox-build-system-reviewers,rstewart
Some cleanup before I add more copies of this task.

Since this is based on a repo called `cctools-port` it seems like it would be better to keep that substring intact.

Differential Revision: https://phabricator.services.mozilla.com/D82439
2020-07-06 21:42:35 +00:00
Armen Zambrano G.
bcdae74a2f Bug 1639873 - Fix new backfill issue r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D82420
2020-07-06 20:41:11 +00:00
Mihai Tabara
2db7ce0b92 Bug 1627834 - update the text and screenshots on Flathub.r=rail
Differential Revision: https://phabricator.services.mozilla.com/D82360
2020-07-06 18:00:10 +00:00
Simon Fraser
28ddc204af Bug 1649930 Diagnostics for AWS request issues r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82358
2020-07-06 13:07:45 +00:00
Ben Hearsum
dc6fa9e083 Bug 1641058: fix unit test failures from remove_tasks interface change. a=fix. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D82213
2020-07-03 17:49:05 +00:00
Marco Castelluccio
9e5cdda0dd Bug 1648414 - Define some additional bugbug-based strategies and remove poorly performing ones. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D81050
2020-07-03 16:30:37 +00:00
Marco Castelluccio
a6c9cd86e2 Bug 1648414 - Add a new argument to the BugBugPushSchedules optimization strategy to only consider tasks. r=ahal
So we can define alternative strategies that only use tasks and compare them with the reduced ones.

Differential Revision: https://phabricator.services.mozilla.com/D81049
2020-07-01 15:32:48 +00:00
Marco Castelluccio
c0efb461f5 Bug 1648414 - Support defining custom DisperseGroup strategies with a different target_counts dict. r=ahal
If we don't copy the dict, all strategies will share the same.

Differential Revision: https://phabricator.services.mozilla.com/D81048
2020-07-01 15:32:25 +00:00
Ben Hearsum
8289a7e7cb Bug 1641058: tasks that only exist because of another that is later optimized away should not be scheduled r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D81745
2020-07-02 21:28:57 +00:00
Geoff Brown
e17ca5f1b5 Bug 1585726 - Run mozlint on macosx64 and win64 too; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D82200
2020-07-03 16:07:33 +00:00
Armen Zambrano G.
17affe362d Bug 1639873 - Add support for test manifest backfilling r=tomprince
We use the symbol of the original task we backfill and suffix the revision of the push
from which we backfill. This makes it a bit more clear as to from which push we requested
the backfill.

We also modify the group symbol (if available) to group backfilled tasks.

***

***

Differential Revision: https://phabricator.services.mozilla.com/D81379
2020-07-03 14:18:28 +00:00
Armen Zambrano G.
9425bdc44a Bug 1639873 - New backfill action r=tomprince
This backfill action schedules a secondary action per push. This secondary action
schedules the intended task on behalf of the primary action.

This introduces logic on how to trigger a hook by an action.

Differential Revision: https://phabricator.services.mozilla.com/D79351
2020-07-03 13:45:21 +00:00
Edwin Takahashi
3ae2d81379 Bug 1648674 - fix unary operator expected error in test-liux.sh r=glandium
Changes:
  - use parameter expansion to provide a default value of 'false' if `$NEED_COMPIZ` is not set.

Differential Revision: https://phabricator.services.mozilla.com/D81388
2020-07-02 23:03:49 +00:00
Gregory Mierzwinski
f671ac2725 Bug 1649539 - Disable non-shippable G5 raptor tests in production. r=perftest-reviewers,Bebe
A patch landed recently which added this build. This patch disables it in production.

Differential Revision: https://phabricator.services.mozilla.com/D81733
2020-07-02 19:46:36 +00:00
Narcis Beleuzu
bb1da0fa97 Backed out changeset 6a42da21836e (bug 1641058) for breaking action tasks like retriggers . CLOSED TREE 2020-07-02 21:45:53 +03:00
Tom Prince
02ebadf1a2 Bug 1649356: [taskgraph] Enforce schema identifier restrictions for source_test schema; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D81658
2020-07-02 12:45:53 +00:00
Tom Prince
4df2e5b458 Bug 1649356: [taskgraph] Don't use Schema(..., required=True); r=ahal
This is the only place where we override the default of `required=False`.
Change it to match the rest of the schemas, so as not to confuse people who
don't happen to notice the final line of the schema.

Differential Revision: https://phabricator.services.mozilla.com/D81657
2020-07-02 18:01:45 +00:00
Tom Prince
dcbbfca3e4 Bug 1649356: [taskgraph] optionally_keyed_by takes multiple fields to key by; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D81656
2020-06-30 14:11:30 +00:00
Tom Prince
78f88bf76b Bug 1649356: [taskgraph] We do not honour voluptuous default values, so don't specify them; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D81655
2020-06-30 14:10:36 +00:00
Tom Prince
da997b746b Bug 1649356: [taskgraph] Don't have unused depname key in release transforms; r=Callek
We don't ever set `depname` in any of the kinds that use these transforms.
Since we don't apply default values in schemas, `Required(..., default=...)`
behaves equivalently to `Optional(...)`, so we can just remove these options.

Differential Revision: https://phabricator.services.mozilla.com/D81654
2020-06-30 14:08:27 +00:00