Commit Graph

303 Commits

Author SHA1 Message Date
Robin Templeton
8f61a2db7d Bug 1455795 - Remove the AUTOMATION option from mozjs_sys's build.rs. r=sfink
This option shouldn't be used for local builds (see bug 1294157). Set
the option from the crate's taskcluster script instead, so that it's
used only for automated builds.

--HG--
extra : rebase_source : 94b398a0f1fac60094269d755735c426ecc63e17
2018-04-24 18:04:00 -04:00
Tom Prince
9203ed3c58 Bug 1456234: [mozharness] Process EXTRA_MOZHARNESS_CONFIG even if no files are specified; r=aki
This will allow mozharness configs to be specified exclusively in the taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D1017

--HG--
extra : rebase_source : a3a9b6cc9d1004c4bd396fccc3e4354a7316651d
extra : source : 10acd193df92b7c495789dc24157b85f116ade5e
2018-04-23 17:39:35 -06:00
Steve Fink
2c3ce821ef Bug 1455201 - Propagate failure out of set -e region and add verbose logging to autospider.py, r=jonco
--HG--
extra : rebase_source : 3b2b301e45e555de489ac26bc22e1e1e181c6357
2018-04-19 11:20:26 -07:00
Masatoshi Kimura
1dfe932b7e Bug 1451931 - Add gcc/lib64 to the LD_LIBRARY_PATH of sm-rust-binding. r=glandium
MozReview-Commit-ID: 6VdXCtBDiQ8

--HG--
extra : rebase_source : f3e35a9a37e5f0b7f566dcfc0aa28de1d08bea50
2018-04-06 22:02:50 +09:00
Mike Hommey
be4f305f62 Bug 1445536 - Add a toolchain job for GCC 7. r=froydnj
And adapt the build-gcc.sh script for the changes to
contrib/download_prerequisites.

--HG--
rename : taskcluster/scripts/misc/build-gcc-6-linux.sh => taskcluster/scripts/misc/build-gcc-7-linux.sh
extra : rebase_source : b1d785777b8c141c0eb0f52a73734abd2db21b94
2018-03-14 09:37:27 +09:00
Gregory Szorc
18e72cea88 Bug 1449629 - Use -L when downloading OpenSSL; r=glandium
The URL is now being redirected to
https://www.openssl.org/source/old/1.1.0/openssl-1.1.0g.tar.gz. Let's
add a -L so we follow redirects automatically.

MozReview-Commit-ID: AuZ98jGidzl

--HG--
extra : rebase_source : 07e61558024e789df45d8e2ab67ab5ad9d3d355b
2018-04-02 19:22:07 -07:00
Steve Fink
4fa97cae2b Update sixgill to ab06fc42cf0f for bug 1450379, r=bhackett
--HG--
extra : rebase_source : 5be473dc5253fe69db3ab745ce31255d966e6459
2018-03-30 15:33:15 -07:00
Steve Fink
b1be1f1ac9 Bug 1449066 - Switch hazard builds to GCC 6, r=froydnj
--HG--
extra : rebase_source : 312938733bbf76c3c9c2fc2ec35ba0b88e6f89de
2018-03-28 18:15:51 -07:00
Mike Shal
1d3020acd2 Bug 1387098 - Tup toolchain task; r=froydnj
Build the latest tup master branch with the LD_PRELOAD dependency
checker.

MozReview-Commit-ID: ALfnnmOZrky

--HG--
extra : rebase_source : 529d4392ef73e03f66fb76f089f8b88f45b44972
2018-02-20 11:12:08 -05:00
Ted Mielczarek
bd3e9df16c bug 1446665 - update sccache to pick up a fix for a PGO build failure. r=froydnj
MozReview-Commit-ID: 5uCjHMZc7JJ

--HG--
extra : rebase_source : f8aa60cca3992707e056460b01ac470cd79fc385
2018-03-23 11:37:47 -04:00
Ted Mielczarek
44322b0b23 bug 1445631 - update sccache to pick up a fix in the jobserver crate. r=chmanchester
MozReview-Commit-ID: JtHea27GTTq

--HG--
extra : rebase_source : e7b08d6b6b765c0447aadfaa7f4f606676806c73
2018-03-16 13:41:52 -04:00
Steve Fink
de4adccfc7 Bug 1444543 - toolchain: build sixgill for gcc 6.4.0, r=glandium
--HG--
extra : rebase_source : fa2f7acf63e99544b95c6a896ba015c52c04f7ae
2018-03-06 10:15:29 -08:00
Steve Fink
03dedf49bb Bug 1443233 - Update sixgill to use same qualification settings for all type printing, r=bhackett
--HG--
extra : rebase_source : 16d1361a8a020ba3d4a37e867dfa1cc7f75c92dd
2018-03-06 08:37:02 -08:00
Ted Mielczarek
f51415ef1d bug 1445218 - update sccache to 0.2.6. r=froydnj
MozReview-Commit-ID: FxFmXcAHC5A

--HG--
extra : rebase_source : b01b5aca229547dc1b4de14ec36df54d806cf7e6
2018-03-13 08:31:06 -04:00
David Major
8483a27743 Bug 1443827: Move clang-cl static analysis builds to their own toolchain task. r=froydnj
Note that static analysis was the only remaining user of the 32-bit toolchain, so I've removed win32-clang-cl (or rather, renamed it to win32-clang-cl-st-an).

--HG--
rename : build/build-clang/clang-win32.json => build/build-clang/clang-win32-st-an.json
rename : build/build-clang/clang-win64.json => build/build-clang/clang-win64-st-an.json
rename : taskcluster/scripts/misc/build-clang32-windows.sh => taskcluster/scripts/misc/build-clang32-st-an-windows.sh
rename : taskcluster/scripts/misc/build-clang64-windows.sh => taskcluster/scripts/misc/build-clang64-st-an-windows.sh
2018-03-08 17:25:52 -05:00
Steve Fink
de379f365d Bug 1442786 - Prevent set -e from leaking into calling scripts, r=nbp
--HG--
extra : rebase_source : 55509978a275e2ed32bf1d7289811ebfdd9e261c
2017-11-21 12:47:51 -08:00
Ralph Giles
2d2defe3df Bug 1428197 - Reject generic channels in rust repack jobs. r=glandium
Ensure better determinism when creating rust toolchain packages
by rejecting generic channels like 'stable' or 'nightly'. Instead,
insist on a specific version or date.

The current valid dates for beta and nightly can be obtained with:

curl -s https://static.rust-lang.org/dist/channel-rust-beta.toml | grep ^date
curl -s https://static.rust-lang.org/dist/channel-rust-nightly.toml | grep ^date

MozReview-Commit-ID: I0DXw1KJGZz

--HG--
extra : rebase_source : 92e158193072582b8568d9c9f00ffdefa0af1a9c
2018-02-26 16:54:36 -08:00
Nick Alexander
daf2cc6ccf Bug 1440428 - Remove Proguard JAR entirely. r=jchen
The Proguard dependency is now managed by Gradle.

MozReview-Commit-ID: EOvKSE5z28P

--HG--
extra : rebase_source : 760b117f500cc639cc8c24e9c02933990f358dd7
2018-02-26 11:37:41 -08:00
Jesse Schwartzentruber
5b70ea834b Bug 1425406 - Add a linux64 clang 6 (pre) toolchain with the macosx64 native sanitizer dylibs. r=froydnj
MozReview-Commit-ID: Ig9xpBDcjNu

--HG--
extra : rebase_source : 278bd4fffb82d12e1bc4eb72458bdac3ba62e11f
2018-02-08 16:58:12 -05:00
Mike Hommey
e972446107 Bug 1436208 - Avoid infinite loops in llvm-dsymutil when rust produces broken self-referencing DIEs. r=nalexander
See some details on https://bugs.llvm.org/show_bug.cgi?id=36257.

--HG--
extra : rebase_source : 1ffd99e0d52bca74449760e39138af843c837a1b
2018-02-07 08:23:10 +09:00
Nathan Froyd
38a5bb5c84 Bug 1412006 - part 3 - add an Android NDK repackaging task; r=dustin,nalexander; f=glandium
We'd like to install the NDK through the Android SDK manager.  But we
can't pin versions of the NDK with the SDK manager, and so Google
can silently upgrade the NDK on us.  Since that is undesirable, this is
the next best thing.

With the toolchain task in hand, we can make all the relevant tasks
depend on the toolchain task and remove the download of the NDK from
tooltool as well.
2018-02-01 09:59:23 -05:00
shindli
f713c5d75e Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-02-01 00:37:57 +02:00
Tom Prince
6b745cb132 Bug 1434365: Add support for specifying mozharness config paths and checking out comm-central to repackage tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D512

--HG--
extra : rebase_source : dc165357115f51475279f90679b89c14ec1c6038
2018-01-30 11:50:57 -07:00
Tom Ritter
59cfa9d5ce Bug 1432319 Bump MinGW version to incorporate Process Mitigation structs needed by the sandbox r=froydnj
MozReview-Commit-ID: HnYuQa8DflY

--HG--
extra : rebase_source : ed06ff4ffc4938a861afaec833537676e32e1907
2018-01-27 19:44:45 -06:00
Emilio Cobos Álvarez
11cd13abd8 Bug 1432563: Fetch rustfmt when repackaging rust. r=rillian
I tested this on automation and the build went on, though I couldn't test
the bindgen output because the build right now is busted on one dependent crate
with rust beta, which is the first toolchain that has this package, and will go
to release shortly.

This should work though! If I need more changes I'll adjust them in bug 1432153.

You can test the repackage manually with repack_rust.py --toolchain beta, for
example.

MozReview-Commit-ID: GI2f6vGVqTe
2018-01-27 02:02:17 +01:00
Mike Hommey
520f9865db Bug 1432397 - Switch mingw builds to a Debian stretch-based docker image. r=dustin
Don't build ucl when building upx, Debian stretch has a recent enough
version. In fact, the last upstream version doesn't build with GCC in
Debian stretch (http://bugs.debian.org/811707)

--HG--
extra : rebase_source : aae67773b9dd3b99f6ddf9ab7f59a628037e6925
2018-01-26 14:39:07 +09:00
Nick Alexander
edf219ba3b Bug 1411654 - Part 1: Upgrade to Android-Gradle 3.0+ and build-tools;26.0.2. r=maliu
New Android-Gradle plugins pin the build-tools version, and we want to
be consistent between Gradle and moz.build.

MozReview-Commit-ID: ApWS4rHzPuH

--HG--
extra : rebase_source : 22008e9333b15c594ce26c2a52f67396d6e3ab84
extra : source : f918500d9cf5112b70bc8e0a120df435b02252b7
2017-10-26 11:00:36 -07:00
Nick Alexander
cb03a352f0 Bug 1411654 - Pre: Don't block Google's maven repository. r=maliu
Turns out Google's maven repository doesn't publish checksums.  I
can't imagine why not, but there it is.  We have to think more about
whether to trust the artifacts downloaded from maven.google.com.

MozReview-Commit-ID: CdWijorq1IV

--HG--
extra : rebase_source : 6c66cf1444876624f10409ea6437863e2c2ea9b0
extra : source : 0850b319efd43ac8f4d61485451722975da55ca1
2017-10-27 14:50:27 -07:00
Tom Ritter
6f227dea91 Bug 1431809 Bump MinGW version for new Product Constants r=froydnj
MozReview-Commit-ID: CmxZTdyHP3X

--HG--
extra : rebase_source : 7aa739cb54ac0f4c52087dcd1c992fe220bda737
2018-01-23 17:57:08 -06:00
Dorel Luca
4b9ccdb392 Merge mozilla-inbound to mozilla-central r=merge a=merge 2018-01-23 12:02:17 +02:00
Tom Ritter
40e0f3ea5e Bug 1432009 Fix MinGW build failure with d_write3.h r=jfkthame
Bump mingw version to get the newest commit and do not include the
un-needed dw-extras.h on MinGW (thanks Jacek!)

MozReview-Commit-ID: OjO93XHCxs

--HG--
extra : rebase_source : 933bbb385004988a23d1069c9cd3241b3a3b336e
2018-01-22 15:01:49 -06:00
Tom Prince
0a70a075ef Bug 1424146: Simplify taskcluster l10n mozharness config; r=Callek
MozReview-Commit-ID: 5Pg480dLRbz

--HG--
extra : rebase_source : 040b3d219043ddd93bf538f0d6ba77d20110ae28
extra : source : c73e7b3292dfd0c7a1a4fa095fa614d0720d64e2
2017-11-28 12:46:22 -07:00
Tom Prince
b6125ff578 Bug 1429603: Remove mock configuration from build mozharness configs and code; r=jlund
Differential Revision: https://phabricator.services.mozilla.com/D369

--HG--
extra : rebase_source : 9fd6eab5d2c85fcc61d0420dc860dcc26c18303c
2018-01-04 13:13:24 -07:00
Mike Hommey
374330afe4 Bug 1429056 - Add llvm-symbolizer to the llvm-dsymutil toolchain. r=ted
llvm-symbolizer is necessary to get symbols in llvm-dsymutil crash
dumps. While we could use the one from clang during the build, it's
better if the llvm-dsymutil toolchain is standalone for local testing.

--HG--
extra : rebase_source : 5cd234a3e14ab52a4ce759821e0e756e68167797
2018-01-19 19:00:06 +09:00
Mike Hommey
ee232fad88 Bug 1429056 - Don't strip llvm-dsymutil. r=ted
When I originally wrote the llvm-dsymutil build script in bug 1430315,
I wasn't setting CMAKE_BUILD_TYPE to Release, and was ending up with
a very large binary (> 300MB), so I stripped it.

When I later set CMAKE_BUILD_TYPE to Release, I left the manual
stripping on, but that removes symbols that are useful for stacktraces
when dsymutil crashes (the Release type still leaves out debug info).

--HG--
extra : rebase_source : 802daadc24c0090574b1a44ea8b4e6c25735f703
2018-01-19 10:16:11 +09:00
Gregory Szorc
6f469dc037 Bug 1430908 - Use --progress=dot:mega with wget; r=glandium
By default, wget prints dots every 1k bytes. This can render a
lot of output for large files. We switch to the "mega" style, which
makes each dot represent 64k, thus reducing output by up to 64x.

We also force the use of dot display. By default, it uses "bar"
which attempts to use terminal formatting if possible. Since most
of this code executes in CI and terminal control characters can
interfere with logged output, we force the use of "dot." (Although
wget appears to automatically switch to dot in TC today. But
consistency is good.)

MozReview-Commit-ID: IpTWJdcauTV

--HG--
extra : rebase_source : 5c9aa1bbdcd78eaa0b31347ad026a2c1beaedc03
2018-01-16 14:24:31 -08:00
Ryan VanderMeulen
ac18fd5152 Backed out 20 changesets (bug 1411654) for incorrect android:debuggable. r=nalexander, a=RyanVM
Backed out changeset cfad693be918 (bug 1411654)
Backed out changeset 55776829a744 (bug 1411654)
Backed out changeset c5bf85d56fed (bug 1411654)
Backed out changeset c270f97bb0da (bug 1411654)
Backed out changeset fde9bf9c14c3 (bug 1411654)
Backed out changeset 01836fd98c63 (bug 1411654)
Backed out changeset 730a70767743 (bug 1411654)
Backed out changeset 690e265c684c (bug 1411654)
Backed out changeset f918500d9cf5 (bug 1411654)
Backed out changeset cec2b8828cc8 (bug 1411654)
Backed out changeset 76085ddd5ac7 (bug 1411654)
Backed out changeset 2b37201606f5 (bug 1411654)
Backed out changeset d0d513d1c379 (bug 1411654)
Backed out changeset e7b0cc801cf1 (bug 1411654)
Backed out changeset 901b304603d9 (bug 1411654)
Backed out changeset 373c9a71d945 (bug 1411654)
Backed out changeset 3dc3beab95f8 (bug 1411654)
Backed out changeset 22a861db1573 (bug 1411654)
Backed out changeset 0850b319efd4 (bug 1411654)
Backed out changeset d276d3deba05 (bug 1411654)

--HG--
rename : mobile/android/app/src/main/res/values-v17/themes.xml => mobile/android/base/resources/values-v17/themes.xml
2018-01-17 15:55:38 -05:00
Mike Hommey
b7f54b9288 Bug 1430315 - Add a toolchain job to build llvm-dsymutil independently. r=rillian
We've had problems with crashes in llvm-dsymutil for a while, and while
they are, in essence, due to the fact that rustc produces bad debug
info, they are a hurdle to our builds. The tool comes along clang, and
updating clang is not necessarily easy (witness bug 1409265), so, so
far, we've relied on backporting fixes, which can be time confusing
(witness bug 1410148).

OTOH, llvm-dsymutil is a rather specific tool, that doesn't strictly
need to be tied to clang. It's only tied to it because it uses the llvm
code to do some of the things it does, and it's part of the llvm source
tree. But it could just as well be a separate tool, like it was(is?) on
OSX.

So, we add a toolchain job to build it from the llvm source,
independently from clang, so that we can update it separately, if we
hit new crashes that happen to already be fixed on llvm trunk. It will
also allow to more easily update after upstream fixes crashes after we
report them.

--HG--
extra : rebase_source : b814353b4b4632e46646a24b8f54c5300618ff49
2018-01-16 16:23:33 +09:00
Nick Alexander
47c107e74f Bug 1411654 - Part 1: Upgrade to Android-Gradle 3.0+ and build-tools;26.0.2. r=maliu
New Android-Gradle plugins pin the build-tools version, and we want to
be consistent between Gradle and moz.build.

MozReview-Commit-ID: ApWS4rHzPuH

--HG--
extra : rebase_source : 38a9781c472d858f3300cbbcbdc6d2311c465713
2017-10-26 11:00:36 -07:00
Nick Alexander
e6080c2ce7 Bug 1411654 - Pre: Don't block Google's maven repository. r=maliu
Turns out Google's maven repository doesn't publish checksums.  I
can't imagine why not, but there it is.  We have to think more about
whether to trust the artifacts downloaded from maven.google.com.

MozReview-Commit-ID: CdWijorq1IV

--HG--
extra : rebase_source : a884971e51ce7b1ff993754b130f462c476646ab
2017-10-27 14:50:27 -07:00
Dorel Luca
ab63c465d9 Backed out 19 changesets (bug 1411654) for Android nightly bustages a=backout
Backed out changeset 649e7aa405ca (bug 1411654)
Backed out changeset c2e51b70519f (bug 1411654)
Backed out changeset a371f3ef4312 (bug 1411654)
Backed out changeset db978e230556 (bug 1411654)
Backed out changeset 56538ed998cf (bug 1411654)
Backed out changeset 6ff0cdf46a3d (bug 1411654)
Backed out changeset 0e493bacc5e3 (bug 1411654)
Backed out changeset 23cbcf427745 (bug 1411654)
Backed out changeset eda74143389f (bug 1411654)
Backed out changeset 359fadf9b3e9 (bug 1411654)
Backed out changeset 5c64eda20f1e (bug 1411654)
Backed out changeset bffb6a5b78d1 (bug 1411654)
Backed out changeset 43787f4089c3 (bug 1411654)
Backed out changeset 9141bbdfd13b (bug 1411654)
Backed out changeset 108674372ef7 (bug 1411654)
Backed out changeset fb15e1f54987 (bug 1411654)
Backed out changeset 264476c77210 (bug 1411654)
Backed out changeset d23f467218da (bug 1411654)
Backed out changeset 78576ff98660 (bug 1411654)

--HG--
rename : mobile/android/app/src/main/res/values-v17/themes.xml => mobile/android/base/resources/values-v17/themes.xml
2018-01-13 15:17:49 +02:00
Coroiu Cristina
c6a942e1bf Merge inbound to mozilla-central r=merge a=merge 2018-01-13 11:55:23 +02:00
Mike Hommey
68e591a606 Bug 1430270 - Disable ccache in hazard builds. r=nalexander
I don't intend to install ccache in the Debian build images. Hazard
builds are the only builds running on the desktop-build image still
using ccache somehow, and that gains them nothing, since the ccache
directory is not set to a cached directory on taskcluster, meaning
the build always starts with an empty cache. If anything, this currently
makes the build slower.

Eventually, those builds should be able to use sccache, once the
necessary setup moves out of mozconfig.cache.

--HG--
extra : rebase_source : fba6dab78b25ea61892cbe6127ead36da395b0e0
2018-01-13 06:33:12 +09:00
Csoregi Natalia
bed10b400c Merge mozilla-central to autoland. r=merge a=merge CLOSED TREE 2018-01-13 00:02:18 +02:00
Mike Hommey
eb3cf6d41b Bug 1430030 - Enable parallelism when building wine, upx and fxc2. r=ted 2018-01-12 21:25:59 +09:00
Mike Hommey
a6d328e83e Bug 1430087 - Build sccache with system GCC/binutils. r=nfroyd
It was failing to build with the GCC/binutils on the CentOS-based docker
image, but it doesn't with the Debian-based one, so we can remove the
dependency on the gcc toolchain task. This allows sccache to remain
untouched when we change the gcc build scripts, and more importantly,
this allows it to depend on no toolchain that requires building things.

This makes it now possible to use sccache as a dependency for all other
toolchains jobs that compile, if that's beneficial (which might not be
the case, given the current sccache retention time, but at least it's a
viable option, now)
2018-01-13 05:57:57 +09:00
Nick Alexander
e820c8ca18 Bug 1411654 - Part 1: Upgrade to Android-Gradle 3.0+ and build-tools;26.0.2. r=maliu
New Android-Gradle plugins pin the build-tools version, and we want to
be consistent between Gradle and moz.build.

MozReview-Commit-ID: ApWS4rHzPuH

--HG--
extra : rebase_source : 5a5730b4b9ce84af40a7c73c4f1abba017103f02
2017-10-26 11:00:36 -07:00
Nick Alexander
a0865e7202 Bug 1411654 - Pre: Don't block Google's maven repository. r=maliu
Turns out Google's maven repository doesn't publish checksums.  I
can't imagine why not, but there it is.  We have to think more about
whether to trust the artifacts downloaded from maven.google.com.

MozReview-Commit-ID: CdWijorq1IV

--HG--
extra : rebase_source : e4373273e7aea7df79d70b5fbc233233a84d2360
2017-10-27 14:50:27 -07:00
Mike Hommey
714ba3c60d Bug 1428967 - Allow to build cctools-port on Debian. r=ted
There is no /lib64 on Debian. OTOH, one doesn't need to give the full
path to a system library in LDFLAGS, so just use -l syntax instead.

--HG--
extra : rebase_source : b795f97ab209499824afa5ef1aee9da52657ceb9
2017-12-30 12:57:51 +09:00
Mike Hommey
d0497c863b Bug 1427266 - Statically link libdmg-hfsplus against OpenSSL. r=gps
libcrypto, part of OpenSSL, and that dmg links against, has a varying
ABI, and something built against libcrypto on Centos won't run on Debian
and vice versa. It might not even work between versions of the same OS
(e.g. Debian 7 vs. Debian 9).

Because of that, it is desirable to statically link it.

This incorporates https://github.com/mozilla/libdmg-hfsplus/pull/1
and sets OPENSSL_USE_STATIC_LIBS when building libdmg-hfsplus.

--HG--
extra : source : 78f2064b3811db58b364c32ce9b58a3f2dcaf8f8
2017-12-28 18:19:31 +09:00