Commit Graph

8417 Commits

Author SHA1 Message Date
Razvan Maries
2af0f9a132 Backed out 4 changesets (bug 1648851) for perma failues on test_2_conformance2__glsl3__matrix-row-major-dynamic-indexing.html and test_2_conformance__state__gl-get-calls.html. CLOSED TREE
Backed out changeset 2d2686a389dc (bug 1648851)
Backed out changeset e05b2f2fdbb2 (bug 1648851)
Backed out changeset b576e680a9fa (bug 1648851)
Backed out changeset 901f16e24a60 (bug 1648851)
2020-07-17 02:19:47 +03:00
Edwin Takahashi
53eace3ac3 Bug 1648851 - Part 3: add ability to specify bootstrap script r=jmaher
Changes:
  - in `mozharness_test.py`, add new optional key `job-script` similar to existing provision for toolchain tasks.
  - set the default bootstrapping script depending on platform.
  - substitute the correct script in the final mozharness call.

Differential Revision: https://phabricator.services.mozilla.com/D83559
2020-07-16 14:00:27 +00:00
Edwin Takahashi
cdce692d0a Bug 1648851 - Part 2: create android-specific bootstrapping script r=jmaher,gbrown
Changes:
  - create a `test-android.sh` script that is based on, but removes non-android related paths from the `test-linux.sh` script.

Differential Revision: https://phabricator.services.mozilla.com/D82252
2020-07-14 22:51:40 +00:00
Edwin Takahashi
92d7799961 Bug 1648851 - Part 1: use android-test docker image for android-em test tasks r=jmaher
Changes:
  - when the taskgraph is being generated for android-em tasks, use the new `android-test` docker image.

Differential Revision: https://phabricator.services.mozilla.com/D82478
2020-07-14 22:49:10 +00:00
Edwin Takahashi
afd4560cb8 Bug 1648851 - Part 0: create android-test docker image based on Ubuntu 20.04 r=jmaher,gbrown
Changes:
  - set up a new minimal docker image for `android-em` tests.
  - reorganize commonly referenced files into a specific folder `taskcluster/docker/files` to reduce instances of same file being copy-pasted into directories.
  - add android-test docker build task to taskcluster.

Differential Revision: https://phabricator.services.mozilla.com/D82204
2020-07-08 17:46:37 +00:00
Kartikaya Gupta
bb263023fa Bug 1653279 - Expand set of file changes that trigger android wrench jobs. r=ahal
This should help catch failures due to mozharness refactorings/changes faster.

Differential Revision: https://phabricator.services.mozilla.com/D83793
2020-07-16 20:30:07 +00:00
Marco Castelluccio
b69737572a Bug 1653030 - Use Python's not operator
Differential Revision: https://phabricator.services.mozilla.com/D83849
2020-07-16 20:38:14 +00:00
Marco Castelluccio
ab73b2650b Bug 1653030 - Make 'All' optimization strategy return early as soon as one of its substrategies returns False. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D83715
2020-07-16 20:24:39 +00:00
Andrew Creskey
d1317020f2 Bug 1653293 - Disable Moto G5 performance tuning for perftests until it is tuned r=sparky
Disabled because we've observed that this is introducing noise on G5.
Also added perftuning to the other Pixel 2 tests.

Differential Revision: https://phabricator.services.mozilla.com/D83808
2020-07-16 17:00:20 +00:00
Cosmin Sabou
1129658f1a Backed out 2 changesets (bug 1652870) for bustages on Android GeckoView multi-arch fat AAR.
Backed out changeset c279e71779dc (bug 1652870)
Backed out changeset 0d8e1da6bb40 (bug 1652870)
2020-07-15 21:50:08 +03:00
Nathan Froyd
6c7c60a3ca Bug 1652870 - use new dump_syms for Android builds; r=geckoview-reviewers,snorp
Faster and more maintainable is good.

Differential Revision: https://phabricator.services.mozilla.com/D83561
2020-07-15 12:59:00 +00:00
Dorel Luca
775a192261 Backed out 2 changesets (bug 1652870) for Android bustage. CLOSED TREE
Backed out changeset 48a10a9249b0 (bug 1652870)
Backed out changeset 94ffbec77e89 (bug 1652870)
2020-07-15 15:35:45 +03:00
Nathan Froyd
c7df38111d Bug 1652870 - use new dump_syms for Android builds; r=geckoview-reviewers,snorp
Faster and more maintainable is good.

Depends on D83560

Differential Revision: https://phabricator.services.mozilla.com/D83561
2020-07-14 21:33:12 +00:00
Tom Prince
198865bdd3 Bug 1652678: [taskgraph] Fix test_transforms_job.
Differential Revision: https://phabricator.services.mozilla.com/D83470
2020-07-14 21:12:01 +00:00
David Major
2e6b6721b9 Bug 1652600 - Rename build-clang-linux-{win,macosx}-cross.sh to 'repack' r=froydnj
These scripts don't call `build-clang.py`, they just repackage artifacts from other tasks that do.

I went with `repack` over `repackage` since that seems to be the established pattern in `taskcluster/scripts/misc/`.

Differential Revision: https://phabricator.services.mozilla.com/D83532
2020-07-14 15:55:20 +00:00
Tom Prince
e0998f9228 Bug 1652786: [taskgraph] Fix parameter handling `load_tasks_for_kind; r=Callek a=Callek
DONTBUILD

Differential Revision: https://phabricator.services.mozilla.com/D83566
2020-07-14 21:09:34 +00:00
Nathan Froyd
94d53dfdef Bug 1652054 - add a job name for the codeql build job; r=nalexander,tomprince
This change doesn't seem to affect anything now, but when I was pulling out
some bits into `job-defaults`, the lack of a `job-name` resulted in some
extremely cryptic errors from inside taskcluster code.

Differential Revision: https://phabricator.services.mozilla.com/D83127
2020-07-14 16:07:48 +00:00
Nathan Froyd
0724eb65cb Bug 1652759 - mark all dump_syms toolchains as available for local development; r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D83512
2020-07-14 16:11:22 +00:00
Nathan Froyd
aa851e0e30 Bug 1652098 - move linux base toolchain builds to their own file; r=dmajor
The explanatory comment at the top of the new file provides some context.
The larger motivating context here is wanting to use `job-defaults` to clean
up the toolchain fetches for the Linux build jobs.  But if we did that, we
run into the problem that such fetches are merged with whatever the
individual job(s) specify for their toolchain fetches, not replaced.  So
we'd wind up with multiple clang toolchains being downloaded, or similar,
and things would go downhill from there, as workers attempt to unpack those
things to the same location (which is bad) or perhaps error out (which is
also bad).

This change therefore paves the way for providing `job-defaults` in linux.yml.

Differential Revision: https://phabricator.services.mozilla.com/D83158
2020-07-14 13:55:31 +00:00
David Major
82ce441b57 Bug 1616694 - Turn the macosx-cross toolchain task into a mere repackage r=nalexander
Currently the macosx-cross toolchain build pulls in a linux64-clang toolchain, uses it to build a Mac native toolchain, and then clobbers the result with pieces of the Linux toolchain. This means that the same version of LLVM is used to build the Mac pieces and be part of the final artifact. This will become a problem with upcoming LLVM 11 where we'll want to build the Mac pieces with LLVM 9 but otherwise repackage an LLVM 11 Linux toolchain.

So this commit makes the macosx-cross workflow look more like the win-cross one: take two compilers built elsewhere and just merge them.

Differential Revision: https://phabricator.services.mozilla.com/D83378
2020-07-14 11:33:50 +00:00
Tom Prince
e92bbf5dd8 No bug: [taskgraph] Make verify_test_packaging handle --target-kind gracefully; r=Callek
If we are generating only a part of the graph, to given kind, don't fail if a
build is packaging tests and there is no corresponding test task, as the tests
may not have been generated.

Differential Revision: https://phabricator.services.mozilla.com/D82097
2020-07-14 07:17:26 +00:00
Tom Prince
51f106a3a3 Bug 1652086: Make kind_dependencies_tasks a dictionary based on the label; r=Callek
I was looking at py-spy for generating the taskgraph, and found that a bunch
of time was spent in taskgraph.transforms.job.use_fetches[1]. Use a dictionary
there instead saves about 20-30s on my machine.

[1] https://searchfox.org/mozilla-central/rev/622dbd3409610ad3f71b56c9a6a92da905dab0aa/taskcluster/taskgraph/transforms/job/__init__.py#243-247

Differential Revision: https://phabricator.services.mozilla.com/D83166
2020-07-14 07:39:20 +00:00
David Major
63aa7238ca Bug 1616694 - Allow build-clang to work with different Mac SDKs r=froydnj
LLVM 11 introduces a hard requirement for SDK 10.12 in order to build for Mac. We want to keep building older LLVMs with 10.11 though, so this patch adds some flexibility so that build-clang can make use of whatever SDK package a particular task pulls from tooltool (but still requesting a deployment target of 10.11).

Differential Revision: https://phabricator.services.mozilla.com/D82621
2020-07-13 22:44:54 +00:00
Tom Prince
1691c9892d Bug 1652184: Report to perherder stats about bugbug timings; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D83212
2020-07-13 19:53:00 +00:00
Gregory Mierzwinski
a009f016fa Bug 1652451 - Disable 2020 youtube-playback tests temporarily. r=perftest-reviewers,davehunt
This patch disables all failing youtube-playback tests.

Differential Revision: https://phabricator.services.mozilla.com/D83368
2020-07-13 19:29:12 +00:00
Tarek Ziadé
7dfca9db55 Bug 1644778 - add a mozperftest to measure browser.xhtml DOM size, r=tarek,dhouse,sparky
Differential Revision: https://phabricator.services.mozilla.com/D79152
2020-07-13 15:44:38 +00:00
Tom Prince
e460c39b9a Bug 1649168: Add title to sciptworker-canary action.
Differential Revision: https://phabricator.services.mozilla.com/D83362
2020-07-13 17:35:36 +00:00
Nathan Froyd
9bdf21a5da Bug 1652089 - update dump_syms version; r=firefox-build-system-reviewers,rstewart
This change pulls in the ELF and MachO support and few other miscellaneous
things.

Differential Revision: https://phabricator.services.mozilla.com/D83151
2020-07-13 13:07:27 +00:00
Edwin Takahashi
8e3cdb9917 Bug 1652128 - only schedule web-platform-tests-backlog suites on opt variant of each platform r=jmaher
Changes:
  - removes the ability to schedule web-platform-tests-reftest-backlog and web-platform-tests-backlog from non-opt variants of each platform.
  - in addition, removes the ability to schedule the above from windows7-32, regardless of the variant.
  - clean up references to now-deprecated platforms in backlog task definitions.

Differential Revision: https://phabricator.services.mozilla.com/D83172
2020-07-10 21:08:31 +00:00
Ricky Stewart
c60f8ad9aa Bug 1652149 - Run mozwebidlcodegen unit test as part of mozbuild suite r=froydnj
We could make a new task for this, but `mozwebidlcodegen` depends on code in `mozbuild`, and vice-versa, so there doesn't really seem to be any meaningful advantage to that.

Differential Revision: https://phabricator.services.mozilla.com/D83187
2020-07-13 13:02:01 +00:00
Nathan Froyd
d9e3a915cf Bug 1652100 - use job-defaults for macosx builds; r=nalexander
This change reduces clutter.

Differential Revision: https://phabricator.services.mozilla.com/D83159
2020-07-10 20:16:05 +00:00
Nathan Froyd
bbdcb7d9d4 Bug 1652095 - don't repeatedly look up values when merging dicts; r=tomprince
We already have `value = source[key]` thanks to iteration; we should be
using `value` directly rather than re-doing `source[key]`.

Differential Revision: https://phabricator.services.mozilla.com/D83157
2020-07-10 20:43:41 +00:00
Nathan Froyd
89cf8970bb Bug 1652142 - add binutils toolchain to {fuzzing-,}ccov builds; r=firefox-build-system-reviewers,rstewart
This change brings the aforementioned toolchains to parity with the
asan-fuzzing-ccov toolchain.

Differential Revision: https://phabricator.services.mozilla.com/D83185
2020-07-10 21:45:25 +00:00
Sylvestre Ledru
f7a0736a34 Bug 1617369 - Reformat recent rust changes with rustfmt r=emilio
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D83259
2020-07-12 17:01:13 +00:00
David Major
6c935d09d1 Bug 1630092 - Don't pull in wasm sandboxing in plain or base-toolchain builds r=froydnj
The `plain` builds are intended to make sure that building with an empty mozconfig doesn't break. Since an empty mozconfig build wouldn't have wasm sandboxing, neither should the `plain` builds.

While here, also remove wasi/lucet dependencies from the base-toolchain tasks, since they don't enable sandboxing either.

Differential Revision: https://phabricator.services.mozilla.com/D83011
2020-07-11 12:48:06 +00:00
Kris Maglione
9d78661f88 Bug 1649221: Update ChromeUtils.generateQI callers to pass strings. r=mccr8,remote-protocol-reviewers,marionette-reviewers,perftest-reviewers,webcompat-reviewers,geckoview-reviewers,preferences-reviewers,agi,whimboo,Bebe,twisniewski
Differential Revision: https://phabricator.services.mozilla.com/D81594
2020-07-10 23:58:28 +00:00
Mitchell Hentges
e1aa2a866a Bug 1629337: Implements incremental dafsa algorithm r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D76893
2020-07-10 21:08:10 +00:00
Cosmin Sabou
72bb6a7f58 Backed out 2 changesets (bug 1652089, bug 1652087) for toolchains bustage.
Backed out changeset 617233706940 (bug 1652087)
Backed out changeset ebcebafde8e0 (bug 1652089)
2020-07-11 00:48:41 +03:00
Ricky Stewart
e95ebbb152 Bug 1652097 - Run featuregates Python unit tests in separate task and not in make check r=mythmon
The unit test is broken under Python 3 on macOS, so I haven't included any macOS version of this task; one should probably be added if/when that's fixed.

Differential Revision: https://phabricator.services.mozilla.com/D83169
2020-07-10 20:54:12 +00:00
Mike Hommey
ed90d5c5e6 Bug 1651938 - Update sccache to pick up basic /clang: support. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D83050
2020-07-10 20:53:19 +00:00
Nathan Froyd
60d15a3571 Bug 1652089 - update dump_syms version; r=firefox-build-system-reviewers,rstewart
This change pulls in the ELF and MachO support and few other miscellaneous
things.

Differential Revision: https://phabricator.services.mozilla.com/D83151
2020-07-10 20:32:57 +00:00
Narcis Beleuzu
d32b539f51 Bug 1649168 - Fix lint failure a=lint-fix. CLOSED TREE 2020-07-10 19:51:24 +03:00
Narcis Beleuzu
3445ca16f5 Bug 1649168 - Fix gecko decision task failure. r=fix CLOSED TREE 2020-07-10 19:31:46 +03:00
Tom Prince
388e735d63 Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail
Add an action that will trigger a task that runs
`mach release push-scriptworker-canary`
to test a new scriptworker deployment.

Differential Revision: https://phabricator.services.mozilla.com/D82821
2020-07-10 16:12:05 +00:00
Tom Prince
ee007d06fc Bug 1649168: Add a new docker-image with the tools for pushing to try; r=rail
Differential Revision: https://phabricator.services.mozilla.com/D82820
2020-07-10 16:11:03 +00:00
Nathan Froyd
726b4f3b99 Bug 1649757 - don't upload artifacts for various SM builds; r=sfink
The artifacts (`js`, `jsapi-tests`) generated by these builds are rather
large, and we don't need them for anything.

Differential Revision: https://phabricator.services.mozilla.com/D81880
2020-07-10 15:53:38 +00:00
Nathan Froyd
df458c1e95 Bug 1651410 - include updated binutils for clang 5 toolchain; r=firefox-build-system-reviewers,glandium
This change brings this toolchain into parity with other clang toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D82741
2020-07-10 12:51:36 +00:00
Tom Prince
204d796929 Bug 1651731: [lint] Python and shell files without #! should not be executable; r=linter-reviewers,perftest-reviewers,geckoview-reviewers,agi,sylvestre,sparky
Differential Revision: https://phabricator.services.mozilla.com/D82954
2020-07-09 20:29:18 +00:00
Tom Prince
2c52622b85 Bug 1651731: [lint] Add a bunch more types of files that should never be executable; r=linter-reviewers,perftest-reviewers,geckoview-reviewers,preferences-reviewers,agi,sylvestre,sparky
Differential Revision: https://phabricator.services.mozilla.com/D82953
2020-07-09 21:28:49 +00:00
Andrew Halberstadt
d5e8716e90 Bug 1640902 - [taskcluster.test] Add some additional checks to test_mach_try_auto.py, r=marco
Adds some additional assertions against what would be ran with |mach try auto|.
This also fixes a legit bug that the 'test_important_manifests_only' test
caught.

Differential Revision: https://phabricator.services.mozilla.com/D81404
2020-07-09 12:46:49 +00:00