Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-10-26 03:35:33 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
666,091 Commits 615 Branches 98 Tags 5.9 GiB
129bdaf0d0
Commit Graph

753 Commits

Author SHA1 Message Date
Dustin J. Mitchell
ad85abed68 Bug 1562686 - use AWS_IAM_CREDENTIALS_URL for all S3 sccache invocations r=chmanchester 
Differential Revision: https://phabricator.services.mozilla.com/D41454

--HG--
extra : moz-landing-system : lando
 2019-08-16 17:17:02 +00:00
Mike Hommey
515ab2e11d Bug 1574128 - Fixup for bug 1573435 to unbust webrender-windows jobs. r=me 
MANUAL PUSH: Fix bustage on inbound.
 2019-08-15 20:09:27 +09:00
Mike Hommey
8d5dc26045 No bug - Bustage fix for Windows gn builds. r=me 
MANUAL PUSH: This fixes bustage on inbound on a CLOSED TREE.
 2019-08-15 12:25:32 +09:00
Mike Hommey
c173540215 Bug 1573435 - Use toolchain fetches for all remaining toolchain uses. r=nalexander 
The remaining uses all need adjustements to in-tree mozconfigs, so they
all need to be done at once.

However, to make things slightly more intelligible, we do this in two
steps. This is step 1: we modify the use_toolchain transform to take care of
the transformation, while keeping the task definitions intact, so that
we only deal with mozconfig and build script adjustements here.

Differential Revision: https://phabricator.services.mozilla.com/D41890
 2019-08-15 11:21:52 +09:00
Mike Hommey
57a88cbf46 Bug 1573435 - Use toolchain fetches for source-test builds. r=nalexander 
While here, use GECKO_PATH instead of $HOME/checkouts/gecko.

Differential Revision: https://phabricator.services.mozilla.com/D41889
 2019-08-15 11:21:51 +09:00
Mike Hommey
6257ba9912 Bug 1573435 - Use toolchain fetches for spidermonkey builds. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D41739
 2019-08-15 11:21:50 +09:00
Mike Hommey
9b57b7f93c Bug 1573435 - Use toolchain fetches for hazard builds. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D41738
 2019-08-15 11:21:49 +09:00
Mike Hommey
ab2269d011 Bug 1469697 - s/GECKO_DIR/GECKO_PATH/ for hazard build scripts. r=nalexander 
Most other tasks use GECKO_PATH, as that's what run-task uses.

Differential Revision: https://phabricator.services.mozilla.com/D41725
 2019-08-15 11:21:45 +09:00
Mike Hommey
fb26d1619a Bug 1469697 - Use run-task transform for spidermonkey tasks. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D41724
 2019-08-15 11:21:44 +09:00
Mike Hommey
f56829593a Bug 1573375 - Normalize paths run-task sets in the environment on Windows. r=tomprince 
Using forward slash for better support in shell scripts.

Differential Revision: https://phabricator.services.mozilla.com/D41707
 2019-08-15 11:21:41 +09:00
Mike Hommey
94532ae09f Bug 1573375 - Wrap fetch-content output in run-task. r=tomprince 
Like the output from other subcommands.

Differential Revision: https://phabricator.services.mozilla.com/D41706
 2019-08-15 11:21:40 +09:00
Mike Hommey
a4e51ec9ee Bug 1572381 - Use the same tooltool manifest for webrender as for other tasks using vs2017. r=nalexander 
It turns out this task doesn't use cmake or ninja (anymore?).

Differential Revision: https://phabricator.services.mozilla.com/D41164

--HG--
extra : moz-landing-system : lando
 2019-08-12 16:13:15 +00:00
Mike Hommey
648907c1b4 Bug 1571986 - Kill vctip at the end of more tasks. r=nalexander 
Also, since we had problems with mspdbsrv in the past, kill it too.

Differential Revision: https://phabricator.services.mozilla.com/D41340

--HG--
extra : moz-landing-system : lando
 2019-08-09 16:06:42 +00:00
Mike Hommey
d2cebb5e64 Bug 1571986 - Kill vctip at the end of the wrench-windows task. r=dmajor 
Differential Revision: https://phabricator.services.mozilla.com/D41165

--HG--
extra : moz-landing-system : lando
 2019-08-08 15:40:17 +00:00
Dustin J. Mitchell
b6c8e578bf Bug 1572132 - fix URL generation in fetch-content r=glandium 
MANUAL PUSH: to allow docker images to build without closing autoland

Differential Revision: https://phabricator.services.mozilla.com/D41038

--HG--
extra : rebase_source : 60ae00549917411d1839b6e3f8e6ae962d217470
extra : amend_source : a2531b115f5732345f8c34c88669428510d100a4
 2019-08-07 15:53:15 +00:00
Mike Hommey
bf3d27d7b7 Bug 1571986 - Add some info to try to find what is going on. r=me 
MANUAL PUSH: because it starts happening with something that landed on inbound.
 2019-08-07 16:52:55 +09:00
Mike Hommey
d931e57c8e Bug 1571596 - Reduce the number of toolchain scripts for GCC. r=nalexander 
Now that all GCC and related source tarballs extract to paths
independent of their version number, the scripts are all very
look-alike, so they can be consolidated.

Differential Revision: https://phabricator.services.mozilla.com/D40749
 2019-08-07 13:54:27 +09:00
Mike Hommey
375094b924 Bug 1571596 - Repack GCC and related source tarballs. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40748
 2019-08-07 13:54:27 +09:00
Mike Hommey
b3c14183b8 Bug 1571589 - Allow simple manipulation of file paths in fetched archives. r=tomprince 
Namely:
- adding a prefix,
- stripping path components.

Differential Revision: https://phabricator.services.mozilla.com/D40741
 2019-08-07 13:54:26 +09:00
Mike Hommey
890f87dad8 Bug 1571589 - Allow to repack downloaded archives "on the fly". r=tomprince 
Bug 1479533 was proposing to add a similar functionality, but this
iteration avoids actually unpacking anything, and ensures
reproducibility by relying on the reproducible bits from the original
archives: file ordering, flags, etc. (since they are checksummed, those
are never going to change for a given archive).

Another notable difference is that this applies the repack on the fetch
task itself, rather than create a separate task to apply the repack. The
latter has advantages, in that it allows to change the repacking without
redownloading the original file from a third-party server, but in
practice, most changes to the repacking would trigger the download tasks
anyways.

This patch only takes care of changing the archive type (zip->tar), and
the compression type (anything->zstandard).

Differential Revision: https://phabricator.services.mozilla.com/D40740
 2019-08-07 13:54:25 +09:00
Mike Hommey
525bccdd60 Bug 1571589 - Abstract opening a temporary file and renaming it after close. r=tomprince 
And use that in git_checkout_archive.

Differential Revision: https://phabricator.services.mozilla.com/D40739
 2019-08-07 13:54:24 +09:00
Mike Hommey
34a2eebc79 Bug 1571589 - Use urlparse rather relying on just splitting on / being enough. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D40738
 2019-08-07 13:54:23 +09:00
Mike Hommey
57786654e0 Bug 1571562 - Use toolchain fetches instead of use_toolchain references in toolchain task definitions. r=nalexander 
And remove the use of tooltool-download where it's not needed anymore.

Differential Revision: https://phabricator.services.mozilla.com/D40714
 2019-08-07 13:54:20 +09:00
Mike Hommey
0d49eb3466 Bug 1571562 - Make tooltool-download.sh download and extract to MOZ_FETCHES_DIR. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40712
 2019-08-07 13:54:18 +09:00
Mike Hommey
034e9b6b7b Bug 1570541 - Use git fetch tasks for clang. r=froydnj 
What this means is that the sources for clang/llvm are downloaded
separately from the toolchain build (which also means we finally only
download a given version of clang once for all platforms).

In turn, this means the build-clang.py script needs to start with an
existing llvm-project tree, and we choose to make build-clang.py expect
that it's run from the llvm-project root directory.

This also means we don't need to download git for the windows toolchain
task.

Differential Revision: https://phabricator.services.mozilla.com/D40402
 2019-08-07 13:54:15 +09:00
Mike Hommey
a57cc9b49f Bug 1570541 - Use tarfile in fetch-content on Windows. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D40401
 2019-08-07 13:54:14 +09:00
Mike Hommey
246fa80fb3 Bug 1570598 - Reduce the number of scripts used to build clang toolchains. r=froydnj 
They are now all very similar, and there are only a few variations.

Differential Revision: https://phabricator.services.mozilla.com/D40365

MANUAL PUSH: avoid closing autoland while toolchains are rebuilt.
 2019-08-03 07:08:50 +09:00
Mike Hommey
9b84c9014f Bug 1570598 - Pass the clang json file as an argument to the toolchain script. r=froydnj 
Make the argument use the same format as resources, so move the
sub-script invocation accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D40364
 2019-08-03 07:08:49 +09:00
Mike Hommey
98bd74773e Bug 1570598 - Consistently use GECKO_PATH and MOZ_FETCHES_DIR in toolchain scripts. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40187
 2019-08-03 07:08:48 +09:00
Mike Hommey
e2daeefe33 Bug 1570598 - Use a common setup file for Visual Studio in toolchain scripts. r=nalexander 
This has the side effect of making gn a 64-bits binary. Keeping it
32-bits is not worth the effort.

Differential Revision: https://phabricator.services.mozilla.com/D40186
 2019-08-03 07:08:47 +09:00
Mike Hommey
7c09816a13 Bug 1570598 - Make windows clang toolchain tasks download artifact from GECKO_PATH. r=nalexander 
This makes the setup used by these builds more similar to everywhere
else, making subsequent improvements easier.

Differential Revision: https://phabricator.services.mozilla.com/D40185
 2019-08-03 07:08:46 +09:00
Mike Hommey
65e385dc5d Bug 1570598 - Use GECKO_PATH instead of WORKSPACE/build/src in tooltool-download.sh. r=nalexander 
This removes the need for the hacks in wr-macos-cross-build-setup.sh and
wrench-windows-tests.sh, while keeping things working in other scripts.

Differential Revision: https://phabricator.services.mozilla.com/D40184
 2019-08-03 07:08:46 +09:00
Mike Hommey
9648466042 Bug 1570240 - Use a fetch task artifact for android-rs-glue source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40034
 2019-08-03 07:08:45 +09:00
Mike Hommey
ebf4f74742 Bug 1570240 - Use fetch tasks' artifacts for clang-8-mingw sources. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40033
 2019-08-03 07:08:44 +09:00
Mike Hommey
f2d5d3ee9e Bug 1570240 - Use a fetch task artifact to get fxc2 source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40032
 2019-08-03 07:08:43 +09:00
Mike Hommey
7aad59e35d Bug 1570240 - Use fetch tasks' artifacts to get sccache and openssl source. r=froydnj 
Differential Revision: https://phabricator.services.mozilla.com/D40031
 2019-08-03 07:08:43 +09:00
Mike Hommey
5096ed0b29 Bug 1570240 - Use a fetch task artifact to get grcov source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40030
 2019-08-03 07:08:42 +09:00
Mike Hommey
89e989fe7c Bug 1570240 - Use a fetch task artifact to get gn source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40029
 2019-08-03 07:08:41 +09:00
Mike Hommey
fd9831be96 Bug 1570240 - Use a fetch task artifact to get rust-size source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40028
 2019-08-03 07:08:40 +09:00
Mike Hommey
99201dd8a2 Bug 1570240 - Use the fetch task artifact for cbindgen source. r=nalexander 
Differential Revision: https://phabricator.services.mozilla.com/D40027
 2019-08-03 07:08:40 +09:00
Mike Hommey
6e5fc78628 Bug 1570564 - Convert build-clang.py to python 3. r=froydnj 
Differential Revision: https://phabricator.services.mozilla.com/D40152
 2019-08-02 19:06:20 +09:00
Tom Prince
f5366339ef Bug 1570054: Specify UPLOAD_DIR explicitly in taskgraph for docker-worker built toolchains; r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D39903
 2019-08-02 19:05:56 +09:00
Tom Prince
249252f4b0 Bug 1565725: Use run-task to change the working directory; r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D39600
 2019-08-02 19:05:55 +09:00
Tom Prince
a09d72c850 Bug 1565725: Add an option to run-task to change the current directory for the command; r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D39599
 2019-08-02 19:05:55 +09:00
Razvan Maries
14c6d8b7c6 Merge mozilla-central to autoland. a=merge on a CLOSED TREE 2019-08-02 01:50:59 +03:00
Razvan Maries
3ca183c1a2 Merge mozilla-inbound to mozilla-central a=merge 2019-08-02 00:21:57 +03:00
Sylvestre Ledru
2505df426c Bug 1566336 - Build clang from git rather than subversion. r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D38361

MANUAL PUSH: avoid closing autoland while clang rebuilds.
 2019-08-01 07:26:55 +09:00
Bogdan Tara
4f87c3bc2b Backed out changeset 4ba7a3e079e3 (bug 1566336) for static analysis bustage CLOSED TREE 2019-08-01 00:38:59 +03:00
Sylvestre Ledru
86692bad14 Bug 1566336 - Build clang from git rather than subversion. r=glandium 
Differential Revision: https://phabricator.services.mozilla.com/D38361

MANUAL PUSH: avoid closing autoland while clang rebuilds.
 2019-08-01 05:56:39 +09:00
Mike Hommey
93784dd2f7 Bug 1515082 - Use "fetches.toolchain" for webrender tasks. r=tomprince 
Differential Revision: https://phabricator.services.mozilla.com/D40014

--HG--
extra : moz-landing-system : lando
 2019-08-01 21:04:09 +00:00