Commit Graph

376 Commits

Author SHA1 Message Date
David Major
d8bdeae177 Bug 1584217 - Increase the timeout for the clang-aarch64 toolchain r=nalexander
With clang-8 sources, this task was already pretty close to the limit with typical times of 54-58 minutes.

In clang-9, enough new code was added that we're seeing frequent intermittent timeouts. Even the few successful builds come in just under the wire at 60 minutes.

Note for sheriffs, if the clang-9 update gets backed out, this patch can stay, we'll need it anyway.

Differential Revision: https://phabricator.services.mozilla.com/D47288

--HG--
extra : moz-landing-system : lando
2019-09-26 16:00:44 +00:00
Brindusan Cristian
e2348a18ee Backed out 2 changesets (bug 1573211) as requested by dmajor on irc. CLOSED TREE
Backed out changeset 587463567434 (bug 1573211)
Backed out changeset de0fe40466cb (bug 1573211)

--HG--
rename : build/build-clang/clang-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-linux64-aarch64-cross.json => build/build-clang/clang-8-linux64-aarch64-cross.json
rename : build/build-clang/clang-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : taskcluster/scripts/misc/build-clang-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
extra : histedit_source : 3f9570ab67fd42186265b1dbb6e93c8342bc60e2
2019-09-26 20:12:51 +03:00
Andreea Pavel
9fd779e03f Merge mozilla-central to autoland on a CLOSED TREE 2019-09-26 01:00:14 +03:00
Henrik Skupin
f0dd0f477a Bug 1580689 - [geckodriver] Build linux32 geckodriver binaries via toolchain build task. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D47109

--HG--
extra : moz-landing-system : lando
2019-09-25 20:01:16 +00:00
David Major
9d69f6a5ba Bug 1573211 - Update to clang 9.0.0 r=glandium
Updates all clang 8.0.1 to version 9.0.0, except for the mingw builds
which suffer from bug 1548624 and will be handled separately later.

Differential Revision: https://phabricator.services.mozilla.com/D44160

MANUAL PUSH: Rebuild clang toolchains without stalling autoland

--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-android.json
rename : build/build-clang/clang-8-linux64-aarch64-cross.json => build/build-clang/clang-linux64-aarch64-cross.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-macosx64.json
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-linux-macosx-cross.sh
extra : amend_source : 2dc7e91897e869ead501f19fbd7960d59c4b79bd
2019-09-21 16:26:53 +02:00
Tom Prince
01c0d3d5e7 Bug 1580622: Build geckodriver on push; r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D46229

--HG--
extra : moz-landing-system : lando
2019-09-17 23:27:13 +00:00
Nathan Froyd
706a9fa84c Bug 1579873 - use the aarch64 cross toolchain for aarch64-linux builds; r=nalexander
The aarch64 cross toolchain is unused otherwise.  The aarch64-linux
builds also exist for the express purpose of eventually standing up some
kind of fuzzing/ccov build, so we might as well start using a toolchain
that supports those use cases.

Differential Revision: https://phabricator.services.mozilla.com/D45210

--HG--
extra : moz-landing-system : lando
2019-09-09 20:33:55 +00:00
Chris Manchester
c843481e4b Bug 1578852 - Update wrench-deps to use rustc 1.37 r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D44929

--HG--
extra : moz-landing-system : lando
2019-09-06 20:08:52 +00:00
Gurzau Raul
382dc0d5aa Backed out changeset 70353f95adda (bug 1578596) for toolchain bustage on a CLOSED TREE. 2019-09-04 22:34:50 +03:00
Chris Manchester
24388ebb93 Bug 1578596 - Update wrench-deps to use rustc 1.37 r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D44707

--HG--
extra : moz-landing-system : lando
2019-09-04 19:08:28 +00:00
Razvan Maries
9415ecf29b Backed out 2 changesets (bug 1569728) for causig Linux shippable opt build bustages.
Backed out changeset 2f873da4b36e (bug 1569728)
Backed out changeset aaae16f5f29d (bug 1569728)
2019-09-01 03:42:38 +03:00
Nathan Froyd
cfdbbb32f5 Bug 1569728 - build clang toolchains with GCC 7; r=mshal
We need this change so that the newly-built clang will have
C++17-compatible libstdc++ headers installed.  I believe this change
also means that the newly-built clang (and associated tools) links
against GCC 7's libstdc++, but we set RPATH or similar appropriately, so
there shouldn't be issues stemming from that.

Differential Revision: https://phabricator.services.mozilla.com/D41251

--HG--
extra : moz-landing-system : lando
2019-08-25 19:27:47 +00:00
Noemi Erli
6ecca664f6 Backed out changeset b25884891abc (bug 1577664) for causing Gecko decision task failure CLOSED TREE 2019-08-30 07:19:45 +03:00
Nick Thomas
ce64f74ba9 Bug 1577664 - mar-tools toolchain should depend on milestone.txt, r=Callek
The mar utility stores MOZ_APP_VERSION as the default Product Version for mar creation. So mar should be rebuilt whenever the milestone changes.

Differential Revision: https://phabricator.services.mozilla.com/D44089

--HG--
extra : moz-landing-system : lando
2019-08-30 04:13:00 +00:00
Noemi Erli
3580659d00 Backed out changeset 464a2ec59a58 (bug 1577664) for causing gecko decision task failure 2019-08-30 06:29:25 +03:00
Nick Thomas
6917a454d8 Bug 1577664 - mar-tools toolchain should depend on milestone.txt, r=Callek
The mar utility stores MOZ_APP_VERSION as the default Product Version for mar creation. So mar should be rebuilt whenever the milestone changes.

Differential Revision: https://phabricator.services.mozilla.com/D44089

--HG--
extra : moz-landing-system : lando
2019-08-30 01:39:57 +00:00
Nick Alexander
e09210e873 Bug 1534533 - Add geckodriver toolchain tasks. r=chmanchester
There was quite a bit of discussion of this in `#build` on IRC,
and the consensus was that geckodriver should be built as a
stand-alone Rust crate and not as part of Firefox/Gecko (say, as a new
--enable-project target). This follows that approach, and the
expression, modeled off of cbindgen but updated to cross compile from
a Linux host to all targets, is pretty straight-forward.

A sparse profile would be nice, but the way that the Gecko Cargo
workspace works means that the profile must accumulate Rust code from
many locations.

If we want to, eventually testing/geckodriver can be removed from the
top-level Rust workspace, the geckodriver-signing tasks migrated to
these toolchain tasks, consumers migrated to the signing tasks, and
geckodriver removed from the "common" test archive.

Differential Revision: https://phabricator.services.mozilla.com/D43646

--HG--
rename : taskcluster/scripts/misc/vs-setup.sh => taskcluster/scripts/misc/vs-setup32.sh
extra : moz-landing-system : lando
2019-08-28 20:54:06 +00:00
Emilio Cobos Álvarez
c17fdaaa27 Bug 1576703 - Update cbindgen. r=boris
This cleans up the pattern of "Use a private dtor so that the helper functions
do the right thing" by enabling it everywhere using:

  https://github.com/eqrion/cbindgen/pull/377

It also caught some uninitialized value issues.

I think they're mostly harmless since we zero-initialize our structs:

https://searchfox.org/mozilla-central/rev/325c1a707819602feff736f129cb36055ba6d94f/servo/components/style/properties/gecko.mako.rs#632

And since we override the clip rect, which is the other bit of code that was
failing to build with this change.

Differential Revision: https://phabricator.services.mozilla.com/D43491

--HG--
extra : moz-landing-system : lando
2019-08-26 23:18:46 +00:00
Chris Manchester
141c62261a Bug 1574314 - Provide a rust-dist-toolchain with Windows and macOS targets installed. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D42236

--HG--
extra : moz-landing-system : lando
2019-08-26 22:04:53 +00:00
Razvan Maries
74868f6da5 Backed out 2 changesets (bug 1569728) for Android 4.0 API16+ GeckoView multi-arch fat AAR opt build bustages.
Backed out changeset a420714ee262 (bug 1569728)
Backed out changeset d24ed38c76cd (bug 1569728)
2019-08-24 19:09:21 +03:00
Nathan Froyd
e8faea9e90 Bug 1569728 - build clang toolchains with GCC 7; r=mshal
We need this change so that the newly-built clang will have
C++17-compatible libstdc++ headers installed.  I believe this change
also means that the newly-built clang (and associated tools) links
against GCC 7's libstdc++, but we set RPATH or similar appropriately, so
there shouldn't be issues stemming from that.

Differential Revision: https://phabricator.services.mozilla.com/D41251

--HG--
extra : moz-landing-system : lando
2019-08-24 13:51:57 +00:00
Eric Rahm
ba36c4c9c2 Bug 1574275 - Update builds to use Rust 1.37. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D42381

--HG--
extra : moz-landing-system : lando
2019-08-21 03:29:13 +00:00
Mike Hommey
ad4342d0d9 Bug 1571597 - Consolidate toolchain task tooltool manifests. r=nalexander
There are now only two left:
- one for the OSX 10.11 SDK
- one for Visual Studio 2017

Differential Revision: https://phabricator.services.mozilla.com/D40751

MANUAL PUSH: avoid closing autoland while all docker images and
toolchains are rebuilt.


--HG--
rename : browser/config/tooltool-manifests/win32/build-clang-cl.manifest => browser/config/tooltool-manifests/win64/vs2017.manifest
2019-08-07 13:54:40 +09:00
Mike Hommey
7f59b74885 Bug 1571597 - Use fetches tasks for ninja and cmake, instead of tooltool. r=nalexander
We could keep the same versions of cmake and ninja, but there are few
enough tasks using them to really matter.

Differential Revision: https://phabricator.services.mozilla.com/D40750
2019-08-07 13:54:28 +09:00
Mike Hommey
d931e57c8e Bug 1571596 - Reduce the number of toolchain scripts for GCC. r=nalexander
Now that all GCC and related source tarballs extract to paths
independent of their version number, the scripts are all very
look-alike, so they can be consolidated.

Differential Revision: https://phabricator.services.mozilla.com/D40749
2019-08-07 13:54:27 +09:00
Mike Hommey
4a5d564742 Bug 1571562 - Remove use_toolchain transform for toolchain kind. r=tomprince
Now that all toolchain tasks use toolchain fetches, they don't need
the transform.

Differential Revision: https://phabricator.services.mozilla.com/D40715
2019-08-07 13:54:20 +09:00
Mike Hommey
57786654e0 Bug 1571562 - Use toolchain fetches instead of use_toolchain references in toolchain task definitions. r=nalexander
And remove the use of tooltool-download where it's not needed anymore.

Differential Revision: https://phabricator.services.mozilla.com/D40714
2019-08-07 13:54:20 +09:00
Mike Hommey
0d49eb3466 Bug 1571562 - Make tooltool-download.sh download and extract to MOZ_FETCHES_DIR. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40712
2019-08-07 13:54:18 +09:00
Mike Hommey
2a8938a312 Bug 1571562 - Add missing tooltool-download.sh references as resources. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40711
2019-08-07 13:54:17 +09:00
Mike Hommey
a1e886ab5d Bug 1570541 - Revert MOZ_FETCHES_DIR hacks from bug 1570240. r=nalexander
They're not required anymore now that build-clang.py doesn't force
its build directory location.

Differential Revision: https://phabricator.services.mozilla.com/D40542
2019-08-07 13:54:16 +09:00
Mike Hommey
034e9b6b7b Bug 1570541 - Use git fetch tasks for clang. r=froydnj
What this means is that the sources for clang/llvm are downloaded
separately from the toolchain build (which also means we finally only
download a given version of clang once for all platforms).

In turn, this means the build-clang.py script needs to start with an
existing llvm-project tree, and we choose to make build-clang.py expect
that it's run from the llvm-project root directory.

This also means we don't need to download git for the windows toolchain
task.

Differential Revision: https://phabricator.services.mozilla.com/D40402
2019-08-07 13:54:15 +09:00
Mike Hommey
246fa80fb3 Bug 1570598 - Reduce the number of scripts used to build clang toolchains. r=froydnj
They are now all very similar, and there are only a few variations.

Differential Revision: https://phabricator.services.mozilla.com/D40365

MANUAL PUSH: avoid closing autoland while toolchains are rebuilt.
2019-08-03 07:08:50 +09:00
Mike Hommey
9b84c9014f Bug 1570598 - Pass the clang json file as an argument to the toolchain script. r=froydnj
Make the argument use the same format as resources, so move the
sub-script invocation accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D40364
2019-08-03 07:08:49 +09:00
Mike Hommey
7abf79ff83 Bug 1570598 - Remove redundant definitions of build-clang.py as a resource. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40188
2019-08-03 07:08:49 +09:00
Mike Hommey
e2daeefe33 Bug 1570598 - Use a common setup file for Visual Studio in toolchain scripts. r=nalexander
This has the side effect of making gn a 64-bits binary. Keeping it
32-bits is not worth the effort.

Differential Revision: https://phabricator.services.mozilla.com/D40186
2019-08-03 07:08:47 +09:00
Mike Hommey
9648466042 Bug 1570240 - Use a fetch task artifact for android-rs-glue source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40034
2019-08-03 07:08:45 +09:00
Mike Hommey
ebf4f74742 Bug 1570240 - Use fetch tasks' artifacts for clang-8-mingw sources. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40033
2019-08-03 07:08:44 +09:00
Mike Hommey
f2d5d3ee9e Bug 1570240 - Use a fetch task artifact to get fxc2 source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40032
2019-08-03 07:08:43 +09:00
Mike Hommey
7aad59e35d Bug 1570240 - Use fetch tasks' artifacts to get sccache and openssl source. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D40031
2019-08-03 07:08:43 +09:00
Mike Hommey
5096ed0b29 Bug 1570240 - Use a fetch task artifact to get grcov source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40030
2019-08-03 07:08:42 +09:00
Mike Hommey
89e989fe7c Bug 1570240 - Use a fetch task artifact to get gn source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40029
2019-08-03 07:08:41 +09:00
Mike Hommey
fd9831be96 Bug 1570240 - Use a fetch task artifact to get rust-size source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40028
2019-08-03 07:08:40 +09:00
Mike Hommey
99201dd8a2 Bug 1570240 - Use the fetch task artifact for cbindgen source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40027
2019-08-03 07:08:40 +09:00
Mike Hommey
c638ab3c85 Bug 1570796 - Use a fetch task for hfsplus-tools source code. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D40329

MANUAL PUSH: avoid closing autoland while all docker images and
toolchains are rebuilt.
2019-08-02 19:07:06 +09:00
Tom Prince
f5366339ef Bug 1570054: Specify UPLOAD_DIR explicitly in taskgraph for docker-worker built toolchains; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D39903
2019-08-02 19:05:56 +09:00
Mike Hommey
d5a633f2e9 Bug 1569887 - Use a fetch task artifact to get tup source. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D39849

--HG--
extra : moz-landing-system : lando
2019-07-30 16:39:20 +00:00
Mike Hommey
0e5de57dd0 Bug 1569887 - Use a fetch task artifact to get llvm-dsymutil source. r=chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D39848

--HG--
extra : moz-landing-system : lando
2019-07-30 21:10:09 +00:00
Mike Hommey
506f421e75 Bug 1569887 - Use the fetch task artifacts for libdmg-hfsplus. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D39847

--HG--
extra : moz-landing-system : lando
2019-07-30 21:09:24 +00:00
Mike Hommey
eab1179c45 Bug 1569887 - Use the fetch task artifacts for cctools-port/libtapi source. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D39846

--HG--
extra : moz-landing-system : lando
2019-07-30 21:08:01 +00:00
Tom Prince
fe18b3db4d Bug 1569231: Add better dependencies for in-tree toolchain tasks; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D39526

--HG--
extra : moz-landing-system : lando
2019-07-26 22:07:15 +00:00