Commit Graph

533 Commits

Author SHA1 Message Date
Simon Fraser
27e5ba55f3 Bug 1648051 Task resource monitor r=mtabara,tomprince
I've left the monitor disabled for now, so that we can have a smaller pushes for enabling and disabling it if needed. It should allow more fine grained control.

We may also want to include extracting the monitor tool from a github version instead, and also removing the assumption and it being forked from the parent, so that it's instead given a process ID to treat as the parent it should watch.

Differential Revision: https://phabricator.services.mozilla.com/D84374
2020-08-06 01:21:24 +00:00
Mike Hommey
905496641e Bug 1654882 - Add a makecab toolchain. r=froydnj
This adds a makecab toolchain for Linux. It's not hooked anywhere
because bug 1654994 will also move the use of makecab to upload-symbols
tasks, so hooking the toolchain up with builds would be a waste of
time.

Differential Revision: https://phabricator.services.mozilla.com/D84789
2020-07-24 13:03:44 +00:00
David Major
8867ebcf80 Bug 1654673 - Build dump_syms with linux64-clang-9 r=froydnj
Using the generic moving target linux64-clang adds an extra dependency that slows down clang-trunk builds.

Differential Revision: https://phabricator.services.mozilla.com/D84608
2020-07-23 00:02:57 +00:00
Nathan Froyd
bc1c3d9c34 Bug 1652782 - add a taskcluster task for building dump_syms for Mac; r=firefox-build-system-reviewers,rstewart
We don't need this for our (current) builds, which are cross-builds, but we
would need this at some future date if we ditched the breakpad `dump_syms`.

Depends on D83528

Differential Revision: https://phabricator.services.mozilla.com/D83529
2020-07-20 21:46:52 +00:00
David Major
2e6b6721b9 Bug 1652600 - Rename build-clang-linux-{win,macosx}-cross.sh to 'repack' r=froydnj
These scripts don't call `build-clang.py`, they just repackage artifacts from other tasks that do.

I went with `repack` over `repackage` since that seems to be the established pattern in `taskcluster/scripts/misc/`.

Differential Revision: https://phabricator.services.mozilla.com/D83532
2020-07-14 15:55:20 +00:00
Nathan Froyd
0724eb65cb Bug 1652759 - mark all dump_syms toolchains as available for local development; r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D83512
2020-07-14 16:11:22 +00:00
David Major
82ce441b57 Bug 1616694 - Turn the macosx-cross toolchain task into a mere repackage r=nalexander
Currently the macosx-cross toolchain build pulls in a linux64-clang toolchain, uses it to build a Mac native toolchain, and then clobbers the result with pieces of the Linux toolchain. This means that the same version of LLVM is used to build the Mac pieces and be part of the final artifact. This will become a problem with upcoming LLVM 11 where we'll want to build the Mac pieces with LLVM 9 but otherwise repackage an LLVM 11 Linux toolchain.

So this commit makes the macosx-cross workflow look more like the win-cross one: take two compilers built elsewhere and just merge them.

Differential Revision: https://phabricator.services.mozilla.com/D83378
2020-07-14 11:33:50 +00:00
Nathan Froyd
df458c1e95 Bug 1651410 - include updated binutils for clang 5 toolchain; r=firefox-build-system-reviewers,glandium
This change brings this toolchain into parity with other clang toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D82741
2020-07-10 12:51:36 +00:00
Tom Prince
cfe40e25ca Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 16:39:31 +00:00
Mihai Alexandru Michis
5acb93239f Backed out 3 changesets (bug 1637544) for causing gecko decision task bustages.
CLOSED TREE

Backed out changeset 93b955e5c048 (bug 1637544)
Backed out changeset be0717d76643 (bug 1637544)
Backed out changeset 447fea64b68d (bug 1637544)
2020-07-07 19:31:41 +03:00
Tom Prince
2d287e7d96 Bug 1637544: Set use-sccache explicitly, rather than based on an sccache toolchain being provided; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D82484
2020-07-07 08:39:20 +00:00
David Major
06d9c7e99f Bug 1650239 - Build llvm-dsymutil out of the clang-10 source tree r=firefox-build-system-reviewers,rstewart
The current version hits OOM errors when dsymutil-ing files created by clang 10 and 11.

The choice of clang-10 here is somewhat arbitrary in that it's a fetch job that we conveniently already had in the tree. It doesn't have to be exactly version 10 specifically.

Differential Revision: https://phabricator.services.mozilla.com/D82453
2020-07-06 21:42:42 +00:00
David Major
466f74b7ac Bug 1650239 - Name clang-9 toolchains as such explicitly r=firefox-build-system-reviewers,rstewart
We already do this for e.g. `linux64-clang-9`; this patch extends that pattern everywhere.

This will make it easy to do try runs with other clangs: just move the `toolchain-alias` lines from the `9` tasks to the `trunk` tasks.

Also, this makes dependencies more explicit: for example the gn task specifically requests a clang-9 compiler, so it will also need a clang-9-based cctools-port, rather than whatever moving value the alias represents.

Differential Revision: https://phabricator.services.mozilla.com/D82441
2020-07-06 21:42:22 +00:00
David Major
c65f6e0aff Bug 1650239 - Rename cctools-clang-10-port to cctools-port-clang-10 r=firefox-build-system-reviewers,rstewart
Some cleanup before I add more copies of this task.

Since this is based on a repo called `cctools-port` it seems like it would be better to keep that substring intact.

Differential Revision: https://phabricator.services.mozilla.com/D82439
2020-07-06 21:42:35 +00:00
Henrik Skupin
6f921302c7 Bug 1643099 - [geckodriver] Build geckodriver as static executable for Linux. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D81605
2020-06-30 13:19:41 +00:00
Emilio Cobos Álvarez
7c995807da Bug 1646936 - Generate a single metadata file in the objdir, and feed it to cbindgen. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D80360
2020-06-26 10:41:26 +00:00
Coroiu Cristina
302c2fa31a Backed out changeset 8f948dd74aba (bug 1646936) for SM and Toolchain failures on a CLOSED TREE 2020-06-26 13:08:09 +03:00
Emilio Cobos Álvarez
9c7c03bf30 Bug 1646936 - Generate a single metadata file in the objdir, and feed it to cbindgen. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D80360
2020-06-26 09:37:16 +00:00
Mike Hommey
90a47ff4ef Bug 1648343 - Require rustc 1.43 to build. r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D81246
2020-06-25 23:41:16 +00:00
Nick Alexander
571c7fd42e Bug 1644046 - Get Sonatype nexus with fetch task rather than when building android-build image. r=froydnj
This brings the `android-build` image very close to other build
images, paving the way for it to be folded in completely.  It also
makes us more resilient in the face of upstream service interruptions.

Differential Revision: https://phabricator.services.mozilla.com/D78945
2020-06-15 16:29:30 +00:00
Mike Hommey
266e2a5a8c Bug 1643504 - Build wine on Debian buster. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78428
2020-06-07 22:29:15 +00:00
Tom Prince
9eac413f54 Bug 1642446: Add an attribute to annotate toolchain tasks used by mach bootstrap; r=firefox-build-system-reviewers,rstewart
Toolchains that are used for local development need to be built on a level-3
branch to installable via `mach bootstrap`. Add an attribute to track the fact
that a toolchain is used that way, and:
- ensure that everything installed via `mach boostrap` has that attribute set
- ensure that everything with that attribute set is built on trunk projects

We could additionally verify that attribute is only set on things used by
bootstrap, but bootstrap doesn't currently have an exhaustive list of things
that it might install, making that difficult.

Differential Revision: https://phabricator.services.mozilla.com/D77706
2020-06-03 15:55:26 +00:00
Chris AtLee
3f6a61cb75 Bug 1640961: Force geckodriver to be rebuilt on release branches r=aki
Differential Revision: https://phabricator.services.mozilla.com/D77155
2020-05-27 21:58:13 +00:00
Dzmitry Malyshau
abaaa872a5 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-27 16:49:03 +00:00
Bogdan Tara
6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau
67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-26 21:15:40 +00:00
Tom Prince
2bf24e6359 Bug 1639955: Use prefix for geckodriver toolchain artifacts; r=aki
We originally switched it to use just `public/` becuase iscript broke with the
extra path, but that broke out-of-tree consumers. Now that iscript is fixed,
switch it back.

Differential Revision: https://phabricator.services.mozilla.com/D76409
2020-05-22 03:38:32 +00:00
Chris AtLee
4c1292f8f8 Bug 1637381: Fix reference to old tarball for win64-clang-tidy r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D76420
2020-05-22 01:12:56 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74930
2020-05-21 13:31:55 +00:00
Chris AtLee
b1c32e06b2 Bug 1637381: Use zstd for rust toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74929
2020-05-21 13:30:56 +00:00
Chris AtLee
d0a9a8b30b Bug 1637381: Use zstd for android toolchains r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D74928
2020-05-21 13:29:13 +00:00
Chris AtLee
ef685f3549 Bug 1637379: Optimize android toolchains r=gbrown
Create an emulator toolchain
Stop including mozboot/sdk-*.zip in our tarball

Differential Revision: https://phabricator.services.mozilla.com/D74931
2020-05-21 13:28:10 +00:00
Razvan Maries
40dbaf2901 Backed out changeset c17af0632260 (bug 1616692) as per Eric's request. CLOSED TREE 2020-05-20 08:29:18 +03:00
David Major
5157a6b486 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-20 07:39:23 +03:00
Dorel Luca
0a4406d5ef Backed out changeset 80ba3f3cfaf9 (bug 1616692) at dev's request. CLOSED TREE 2020-05-20 03:27:33 +03:00
Tom Prince
b2d8bbc41a Bug 1577110: Don't add default toolchain artifact directory if already specified; r=glandium
If a task has explicitly specified artifact paths, don't additionally specify
the default paths. If the task has private artifacts, having a directory
that uploads public artifacts seems like an attractive nuissance.

Differential Revision: https://phabricator.services.mozilla.com/D74200
2020-05-19 22:44:45 +00:00
Sylvestre Ledru
1529fe96cb Bug 1638260 - Remove all the 'try' values in run-on-projects r=ahal
They are not doing anything as try will choose jobs anyway.
And this is misleading for developers on what it is doing.

Differential Revision: https://phabricator.services.mozilla.com/D75490
2020-05-15 15:01:19 +00:00
Sylvestre Ledru
aa185d4837 Bug 1635826 - Remove an unrelated change to mingw r=marco
Depends on D75490

Differential Revision: https://phabricator.services.mozilla.com/D75493
2020-05-15 10:16:33 +00:00
Sylvestre Ledru
bd20e19fc3 Bug 1635826 - platform docs: split the big table into smaller docs r=marco DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D75139
2020-05-15 07:54:57 +00:00
David Major
64f56df070 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-14 13:42:38 +00:00
Razvan Maries
a9b2e6dd6f Backed out changeset 58cbc2929fb3 (bug 1616692) for reftests perma failures. CLOSED TREE 2020-05-12 21:05:56 +03:00
Razvan Maries
6740f8e47d Backed out 2 changesets (bug 1616692, bug 1635933) for reftests perma failures. CLOSED TREE
Backed out changeset 7340fb8c2297 (bug 1616692)
Backed out changeset 5695aa933c38 (bug 1635933)
2020-05-12 20:59:06 +03:00
David Major
ab03279627 Bug 1616692: followup, fix sccache task bustage. CLOSED TREE 2020-05-12 11:57:35 -04:00
David Major
50334d3714 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-12 14:02:30 +00:00
Chris AtLee
d08430e9aa Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-08 18:03:50 +00:00
Andreea Pavel
dbd1462996 Backed out changeset b76e3e988fdd (bug 1577110) for breaking geckodriver signin toolchains a=backout 2020-05-08 06:51:23 +03:00
Chris AtLee
d746c3123f Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-07 20:52:48 +00:00
Mike Hommey
4f407cb9b4 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 14:16:03 +00:00
Mike Hommey
696cb0cc9c Bug 1625696 - Update winchecksec and build/use it natively for Linux. r=dmajor
Now that upstream winchecksec builds and works natively on Linux, use
that. That should solve the random crashes under Wine. If random crashes
still happen, it will be easier to debug anyways.
We bump to the last version that doesn't use vcpkg because vcpkg makes
things more difficult.

Differential Revision: https://phabricator.services.mozilla.com/D73405
2020-05-07 00:34:36 +00:00
Narcis Beleuzu
51c3c369dd Backed out changeset 0a1edd15b210 (bug 1634204) for valgrind bustages. CLOSED TREE 2020-05-06 17:10:37 +03:00