Commit Graph

8374 Commits

Author SHA1 Message Date
Tom Prince
388e735d63 Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail
Add an action that will trigger a task that runs
`mach release push-scriptworker-canary`
to test a new scriptworker deployment.

Differential Revision: https://phabricator.services.mozilla.com/D82821
2020-07-10 16:12:05 +00:00
Tom Prince
ee007d06fc Bug 1649168: Add a new docker-image with the tools for pushing to try; r=rail
Differential Revision: https://phabricator.services.mozilla.com/D82820
2020-07-10 16:11:03 +00:00
Nathan Froyd
726b4f3b99 Bug 1649757 - don't upload artifacts for various SM builds; r=sfink
The artifacts (`js`, `jsapi-tests`) generated by these builds are rather
large, and we don't need them for anything.

Differential Revision: https://phabricator.services.mozilla.com/D81880
2020-07-10 15:53:38 +00:00
Nathan Froyd
df458c1e95 Bug 1651410 - include updated binutils for clang 5 toolchain; r=firefox-build-system-reviewers,glandium
This change brings this toolchain into parity with other clang toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D82741
2020-07-10 12:51:36 +00:00
Tom Prince
204d796929 Bug 1651731: [lint] Python and shell files without #! should not be executable; r=linter-reviewers,perftest-reviewers,geckoview-reviewers,agi,sylvestre,sparky
Differential Revision: https://phabricator.services.mozilla.com/D82954
2020-07-09 20:29:18 +00:00
Tom Prince
2c52622b85 Bug 1651731: [lint] Add a bunch more types of files that should never be executable; r=linter-reviewers,perftest-reviewers,geckoview-reviewers,preferences-reviewers,agi,sylvestre,sparky
Differential Revision: https://phabricator.services.mozilla.com/D82953
2020-07-09 21:28:49 +00:00
Andrew Halberstadt
d5e8716e90 Bug 1640902 - [taskcluster.test] Add some additional checks to test_mach_try_auto.py, r=marco
Adds some additional assertions against what would be ran with |mach try auto|.
This also fixes a legit bug that the 'test_important_manifests_only' test
caught.

Differential Revision: https://phabricator.services.mozilla.com/D81404
2020-07-09 12:46:49 +00:00
Andrew Halberstadt
8dc68edc8e Bug 1640902 - [ci] Add integration tests for the 'taskcluster' directory, r=tomprince
Initially this suite will only include a test for |mach try auto| pushes.

Differential Revision: https://phabricator.services.mozilla.com/D81403
2020-07-08 18:48:26 +00:00
Andrew Halberstadt
0d3d8d4744 Bug 1640902 - [python-test] Add ability to mark tests as "slow" and an arugment to run them, r=raphael
This creates a general pytest plugin under "config/mozunit" which implements
the ability to mark tests as "slow". Slow tests will be skipped by default
unless "--run-slow" is passed in.

Differential Revision: https://phabricator.services.mozilla.com/D81402
2020-07-09 17:46:07 +00:00
Andrew Halberstadt
eadca174d1 Bug 1651677 - [taskgraph] Remove 'xfail' from tests that were fixed by bug 1650067, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D82952
2020-07-09 17:46:07 +00:00
Armen Zambrano G.
5e2be1d274 Bug 1650224 - Support backfilling of manifest scheduled tasks r=tomprince
This adds the support for backfilling of manifest scheduled tasks while
preserving the existing features (e.g. schedule a specific test path).

Remove temporary new-backfill action.

Differential Revision: https://phabricator.services.mozilla.com/D82599
2020-07-09 15:20:58 +00:00
Armen Zambrano G.
28728bfafb Bug 1650224 - Drop support of testPath from backfill action r=tomprince
This optional mode to specify a test path when backfilling has been broken for a while
and is not being used to make it worth fixing. It is a mode
originally designed to be used with the test-verify tasks.

Differential Revision: https://phabricator.services.mozilla.com/D82722
2020-07-09 06:52:08 +00:00
Andrew Halberstadt
2e0601326b Bug 1650067 - [taskgraph] Fix some Python 3 compatibility issues in the 'optimize' directory, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D81577
2020-07-08 18:19:24 +00:00
Andi-Bogdan Postelnicu
222c13b10b Bug 1648710 - reduce max-run-time for coverity full tree analysis. r=marco
Differential Revision: https://phabricator.services.mozilla.com/D82871
2020-07-09 12:40:43 +00:00
Florin Strugariu
f0e6aa38e1 Bug 1531358 - [meta] ensure windows 10 ux machines running performance are only running on mozilla-central/try as tier-2 r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D81669
2020-07-09 09:04:26 +00:00
Chris AtLee
676e2f71c7 Bug 1555560: Run black format check in automation; r=ahal,sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D33126
2020-07-08 22:08:06 +00:00
Mike Hommey
675ed50acd Bug 1651549 - Remove now unnecessary order_image_tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D82810
2020-07-09 03:54:46 +00:00
Mike Hommey
459cfbe348 Bug 1651227 - Use the in-tree kaniko image builder image to build docker images. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D82622
2020-07-09 03:54:46 +00:00
Mihai Alexandru Michis
5f385df474 Backed out 2 changesets (bug 1555560) for causing multiple lint failures.
CLOSED TREE

Backed out changeset bd9460ac6e48 (bug 1555560)
Backed out changeset f2896032ced6 (bug 1555560)
2020-07-09 01:04:18 +03:00
Chris AtLee
92897f1567 Bug 1555560: Run black format check in automation; r=ahal,sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D33126
2020-07-08 20:44:41 +00:00
Tom Prince
f27be8d7e7 No bug: Be strict about treeherder symbol splitting; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82624
2020-07-08 20:02:26 +00:00
Dorel Luca
7ff1c0fb61 Backed out changeset b17f8ba4211d for Gecko Decision task bustage. CLOSED TREE 2020-07-08 22:53:59 +03:00
Tom Prince
440eed985f Bug 1643817: Use a fresh taskgroup for create-interactive tasks; r=Callek
In Bug 1641971 (e7d4c490c31a) we changed `taskgraph.create.create_tasks` to
always get the decision task id to use. However, the call in create-interactive
passed `None`, expecting to have on generated. This changes that to use the
`create-interactive`s action task as the task id.

Differential Revision: https://phabricator.services.mozilla.com/D82652
2020-07-08 18:41:17 +00:00
Tom Prince
fc3ae614bc No bug: Update links to hg.mozilla.org to use default instead of tip in taskcluster/; r=Callek
The latter sometimes bites us if we have a legacy support branch that gets
pushed more recently than default.

Differential Revision: https://phabricator.services.mozilla.com/D82628
2020-07-08 18:41:17 +00:00
Tom Prince
927f176328 No bug: Be strict about treeherder symbol splitting; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82624
2020-07-08 18:18:57 +00:00
Edwin Takahashi
02a12126c0 Bug 1648851 - reduce max-run-time value of android-api-16-shippable/opt task to 1800 r=gbrown,jmaher
Changes:
  - max-run-time reduced to 1800 which should suffice.

Differential Revision: https://phabricator.services.mozilla.com/D82253
2020-07-08 17:46:37 +00:00
emilfs
dafec58d06 Bug 1643293 - added new job in doc to render documentation at review phase r=sylvestre,ahal
Differential Revision: https://phabricator.services.mozilla.com/D80428
2020-07-08 13:53:45 +00:00
Christian Holler
fcbc0dd643 Bug 1651243 - Remove leftover crashsymbols attribute from fuzzing debug job. r=truber
Differential Revision: https://phabricator.services.mozilla.com/D82683
2020-07-08 12:14:15 +00:00
alexandru.ionescu
1feda07409 Bug 1651353 Re-enable youtube widevine tests r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82692
2020-07-08 12:38:10 +00:00
Gregory Mierzwinski
8d10f86507 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Gregory Mierzwinski
6e1d467ad0 Bug 1650871 - Add option to disable firefox window recorder. r=perftest-reviewers,AlexandruIonescu
This patch adds an option to disable the firefox window recorder in browsertime, it also adds it to the browsertime-mobile taskcluster config since it is disabled there (but not on desktop).

Differential Revision: https://phabricator.services.mozilla.com/D82431
2020-07-08 07:50:11 +00:00
Tom Prince
a22772e2a2 Bug 1626058: Build docker images with kaniko, instead of dind; r=glandium,hwine
Differential Revision: https://phabricator.services.mozilla.com/D77864
2020-07-07 19:53:32 +00:00
Tom Prince
033c399c15 Bug 1626058: Don't add prefix when building a docker-context at graph generation time; r=glandium
We were building a context with a top-level directory matching the image name
during graph generation. This is not accepted by docker build. This didn't
cause issues since we only used it for digest generation. Since we are
switching to use the decision generated context, change this to match the
context being generated when building an image.

Differential Revision: https://phabricator.services.mozilla.com/D77841
2020-07-07 19:53:17 +00:00
Tom Prince
d64ad0967b Bug 1626058: Add support for writting out artifacts from transforms in the decision task; r=Callek,ahal
To support using kaniko[1] for building images, we need to generate the docker
contexts in a seprate task from the docker-image task. Since we use the hash of
the context as the cached-task digest, we generate the context in the decision
task already, so this adds a way to write that out to be used by downstream
tasks.

[1] https://github.com/GoogleContainerTools/kaniko

Differential Revision: https://phabricator.services.mozilla.com/D77839
2020-07-07 19:56:11 +00:00
Tom Prince
50513f07b4 Bug 1637544: Use sccache on instrumented builds on non-release branches; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82485
2020-07-07 16:39:28 +00:00
Tom Prince
cfe40e25ca Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 16:39:31 +00:00
Tom Prince
7ed26bf1c6 Bug 1637544: Rename needs-sccache to use-sccache; r=glandium
I'm going to change this from being autodected, to specified explicitly, and so
`use-sccache` better captures the meaning.

Differential Revision: https://phabricator.services.mozilla.com/D82483
2020-07-07 16:39:33 +00:00
Tom Prince
aa8615681b No bug: Remove unused desktop1604-test image; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D82543
2020-07-07 16:17:16 +00:00
Justin Wood
bff89afddf Bug 1649383 - don't do geckoview builds on esr. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D81742
2020-07-07 16:09:35 +00:00
Mihai Alexandru Michis
a8ccb677a1 Bug 1648591 - Fix failures regarding test_cron_util.py a=fix
CLOSED TREE
2020-07-07 19:35:38 +03:00
Mihai Alexandru Michis
5acb93239f Backed out 3 changesets (bug 1637544) for causing gecko decision task bustages.
CLOSED TREE

Backed out changeset 93b955e5c048 (bug 1637544)
Backed out changeset be0717d76643 (bug 1637544)
Backed out changeset 447fea64b68d (bug 1637544)
2020-07-07 19:31:41 +03:00
Tom Prince
9c3f3b3519 Bug 1637544: Use sccache on instrumented builds on non-release branches; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82485
2020-07-07 08:39:25 +00:00
Tom Prince
2d287e7d96 Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 08:39:20 +00:00
Tom Prince
8a8dbbb549 Bug 1637544: Rename needs-sccache to use-sccache; r=glandium
I'm going to change this from being autodected, to specified explicitly, and so
`use-sccache` better captures the meaning.

Differential Revision: https://phabricator.services.mozilla.com/D82483
2020-07-07 08:39:19 +00:00
Tom Prince
b89d332bae No bug: Don't include push-id in treeherder routes; r=aki
Treeherder ignores this.

Differential Revision: https://phabricator.services.mozilla.com/D82251
2020-07-03 23:37:49 +00:00
Tom Prince
909e7275e8 Bug 1648591: Remove taskgraph based cron implementation; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D81270
2020-07-07 16:04:00 +00:00
David Major
06d9c7e99f Bug 1650239 - Build llvm-dsymutil out of the clang-10 source tree r=firefox-build-system-reviewers,rstewart
The current version hits OOM errors when dsymutil-ing files created by clang 10 and 11.

The choice of clang-10 here is somewhat arbitrary in that it's a fetch job that we conveniently already had in the tree. It doesn't have to be exactly version 10 specifically.

Differential Revision: https://phabricator.services.mozilla.com/D82453
2020-07-06 21:42:42 +00:00
James Graham
6fdb192e27 Bug 1649866 - Promote wpt print-reftests to tier-1 on desktop, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D81979
2020-07-02 12:32:44 +00:00
David Major
d38d9b8bdb Bug 1650239 - Update cctools-port to make it buildable with clang 11 r=froydnj
Fixes the bustage described in 4e1faecce8

In theory I could leave this task alone and fork a new toolchain for use by clang 11, but this seems internal-enough that existing builds shouldn't be negatively affected by this.

Differential Revision: https://phabricator.services.mozilla.com/D82444
2020-07-06 20:43:42 +00:00
Gregory Mierzwinski
99a1058fe5 Bug 1649819 - Temporarily disable youtube widevine tests on linux and windows7. r=tarek
This patch disables the linux and windows7 platforms for the youtube widevine tests.

Differential Revision: https://phabricator.services.mozilla.com/D82370
2020-07-07 11:50:28 +00:00