Commit Graph

522 Commits

Author SHA1 Message Date
Gregory Szorc
d87b04a55a Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince,dustin
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:38 +00:00
Gregory Szorc
7d0932f16a Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince,dustin
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:36 +00:00
Gregory Szorc
8fb6cd08a8 Bug 1512188 - Collect environment variables into VCS options; r=tomprince,dustin
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:28 +00:00
Gregory Szorc
17d3010722 Bug 1512188 - make VCS checkout options generic; r=tomprince,dustin
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:26 +00:00
Tom Prince
d5999f77d3 Bug 1512285: Stop checking out tools; r=nthomas,gps
This code was used by mozharness jobs to check out the tools repo.
However, those jobs aren't actually using the repository.

Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-29 05:22:38 +00:00
Gregory Szorc
8c1a7bccef Bug 1512188 - Rename --sparse-profile to --gecko-sparse-profile; r=tomprince,dustin
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:17 +00:00
Gregory Szorc
8fc5669189 Bug 1512188 - Rename --vcs-checkout to --gecko-checkout; r=tomprince,dustin
We now have multiple things we may check out. "vcs" meaning "gecko"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:09 +00:00
Dustin J. Mitchell
60d0a26a65 Bug 1492664 - update fetch-content to use TASKCLUSTER_ROOT_URL; r=tomprince
--HG--
extra : rebase_source : ae5064b8cf13ee50b4db0299e4b7fad215902af1
extra : source : 742b038bb1dd39c029afce73eb3f5b683cb590f2
2018-10-02 14:40:39 +00:00
Dustin J. Mitchell
baf08548f8 Bug 1492664 - update libdmg-hfsplus to use TASKCLUSTER_ROOT_URL; r=glandium
--HG--
extra : rebase_source : 3a6917e97cdeb2153425c96e06b1e5f85d1782f0
extra : source : 911b4b0fb6835fc7d0caaea5d64a590563ca3104
2018-12-10 20:14:52 +00:00
Gregory Mierzwinski
995b94a176 Bug 1490427 - Build and use custom d8 from a toolchain task. r=jmaher,ahal
This patch adds a toolchain task for building d8 with customized build settings and uses it in jsshell benchmark tests. A customized image with a debian9-base ('custom-v8') is added by this patch as well and is required to build the tool.

Differential Revision: https://phabricator.services.mozilla.com/D14019

--HG--
extra : moz-landing-system : lando
2018-12-21 19:21:15 +00:00
Andrew Halberstadt
828485d8db Bug 1436037 - [taskgraph] Support OSX generic-worker in run-task, r=Callek
This enables OSX generic-worker based tasks to use the run-task script.

Differential Revision: https://phabricator.services.mozilla.com/D14900

--HG--
extra : moz-landing-system : lando
2018-12-21 13:43:04 +00:00
Sebastian Hengst
767c971623 Backed out 21 changesets (bug 1492664) for breaking cron task for nightlies. a=backout
Backed out changeset a7d50dbb2c8e (bug 1492664)
Backed out changeset 2d876c4ece8b (bug 1492664)
Backed out changeset c82285d253de (bug 1492664)
Backed out changeset bf6d089640eb (bug 1492664)
Backed out changeset d9a7f2ce49c3 (bug 1492664)
Backed out changeset 06c466ab4323 (bug 1492664)
Backed out changeset c1ea4a10cc8d (bug 1492664)
Backed out changeset 4c63a04fdd47 (bug 1492664)
Backed out changeset 742b038bb1dd (bug 1492664)
Backed out changeset 911b4b0fb683 (bug 1492664)
Backed out changeset 870c8cec99e5 (bug 1492664)
Backed out changeset 77699b51336b (bug 1492664)
Backed out changeset 29f33f22fd8b (bug 1492664)
Backed out changeset e7f305408708 (bug 1492664)
Backed out changeset 335a92b1f424 (bug 1492664)
Backed out changeset c566f1c8dcdf (bug 1492664)
Backed out changeset c77ae59aba41 (bug 1492664)
Backed out changeset 9c35dd209c6b (bug 1492664)
Backed out changeset a972d6b4434e (bug 1492664)
Backed out changeset 5ea6f03f845e (bug 1492664)
Backed out changeset 0699d3873e44 (bug 1492664)

--HG--
extra : histedit_source : 5cb1f7e50f25d4a875c1a58c86b7dce902e1a89c%2C20f1ab1a843b612cfcc67cf5c6ff745d65abf076
2018-12-20 12:43:22 +02:00
Razvan Maries
f658ebcbab Merge mozilla-inbound to mozilla-central a=merge 2018-12-20 07:04:06 +02:00
Kartikaya Gupta
d2c266a024 Bug 1507884 - Add a wrench-deps toolchain to provide a tarball of crates wrench depends on. r=glandium
Although this task technically doesn't build a toolchain, the set of
steps it needs to do is very similar to what a toolchain build does, so
we're shoehorning this task into the toolchain kind. The task basically
runs `cargo vendor` on the gfx/wr/Cargo.lock file (if/when it changes)
and exports a tarball of the resulting vendored crates. This allows
downstream tasks that build stuff in gfx/wr to not have to re-fetch
these crates from crates.io on every test run.

Differential Revision: https://phabricator.services.mozilla.com/D14406

--HG--
extra : moz-landing-system : lando
2018-12-19 19:33:13 +00:00
Margareta Eliza Balazs
2e5e28f518 Backed out 16 changesets (bug 1492664) for breaking developer artifact builds, requested by standard8 a=backout
Backed out changeset 31e500489665 (bug 1492664)
Backed out changeset f4945658d45f (bug 1492664)
Backed out changeset 6d17291b8b92 (bug 1492664)
Backed out changeset 90f3faa36137 (bug 1492664)
Backed out changeset 0b229b00818a (bug 1492664)
Backed out changeset 5eb2c77d70a9 (bug 1492664)
Backed out changeset e1ebad5d89c5 (bug 1492664)
Backed out changeset 3017e5890739 (bug 1492664)
Backed out changeset c8b7e620eabf (bug 1492664)
Backed out changeset d3dfbd848236 (bug 1492664)
Backed out changeset 5c92bb5ac895 (bug 1492664)
Backed out changeset fb7cfca6ebc3 (bug 1492664)
Backed out changeset 0c4101230d4d (bug 1492664)
Backed out changeset b93a0fcc86f3 (bug 1492664)
Backed out changeset 6dc9522ee0bf (bug 1492664)
Backed out changeset 85d7f8b330eb (bug 1492664)
2018-12-19 11:45:29 +02:00
Dustin J. Mitchell
015e1e8538 Bug 1492664 - update fetch-content to use TASKCLUSTER_ROOT_URL; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D14207

--HG--
extra : moz-landing-system : lando
2018-12-18 17:26:43 +00:00
Dustin J. Mitchell
fec5b6f8ea Bug 1492664 - update libdmg-hfsplus to use TASKCLUSTER_ROOT_URL; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D14204

--HG--
extra : moz-landing-system : lando
2018-12-18 17:26:45 +00:00
Mike Hommey
b0360b6b16 Bug 1513798 - Use x86_64-darwin11 as a prefix for cctools-port, rather than x86_64-apple-darwin11. r=nalexander
This matches more closely cross toolchains prefixes (as can be seen in
e.g. media/libvpx/libvpx/README for x86_64-darwin*-gcc), and leaves it
to the build system to figure out the right --target to pass to clang on
its own.

Differential Revision: https://phabricator.services.mozilla.com/D14376
2018-12-18 10:50:08 +09:00
Mike Hommey
d9011680de Bug 1513798 - Ship lipo unprefixed as part of the cctools-port toolchain. r=nalexander
Instead of creating symbolic links every time we need it unprefixed.

Differential Revision: https://phabricator.services.mozilla.com/D14374
2018-12-18 10:50:07 +09:00
Dustin J. Mitchell
26dce736fb Bug 1492664 - update fetch-content to use TASKCLUSTER_ROOT_URL; r=tomprince
--HG--
extra : rebase_source : 1cb8dcaf83ffd97088b35d68420b506cc650f197
2018-10-02 14:40:39 +00:00
Dustin J. Mitchell
1004bb11b9 Bug 1492664 - update libdmg-hfsplus to use TASKCLUSTER_ROOT_URL; r=glandium
--HG--
extra : rebase_source : e16bc9c4bc95a9230f96fe86a8f13caa5a31320c
2018-12-10 20:14:52 +00:00
Chris Manchester
5292ba5641 Bug 1504147 - Build compiler-rt libs for android on arm. r=froydnj
This patch is based on the cmake cache files for Android checked in to the
clang repo.

Differential Revision: https://phabricator.services.mozilla.com/D14004

--HG--
extra : moz-landing-system : lando
2018-12-13 22:02:01 +00:00
Dorel Luca
aab1a051ae Backed out 12 changesets (bug 1512285, bug 1512188) for toolchain failure. CLOSED TREE
Backed out changeset 59813ae1b6ea (bug 1512188)
Backed out changeset 1f56f1e581e2 (bug 1512188)
Backed out changeset 0b3259dc10bd (bug 1512188)
Backed out changeset d0eb311b3c8f (bug 1512188)
Backed out changeset d9585e5d7a3a (bug 1512188)
Backed out changeset b4f3dc9b0956 (bug 1512188)
Backed out changeset 7d88308ca069 (bug 1512285)
Backed out changeset 838f49d718a7 (bug 1512188)
Backed out changeset 6bd036a5166d (bug 1512188)
Backed out changeset 3bcedff402fa (bug 1512188)
Backed out changeset 4f546b3e0b18 (bug 1512188)
Backed out changeset bc4232cfcfb8 (bug 1512188)
2018-12-11 23:08:27 +02:00
Gregory Szorc
ce15eca09e Bug 1512188 - Remove support for checking out symbolic revisions; r=tomprince
The functionality is no longer used. All CI should be pinned to a full
revision hash for determinism.

Differential Revision: https://phabricator.services.mozilla.com/D14166

--HG--
extra : moz-landing-system : lando
2018-12-11 19:51:00 +00:00
Gregory Szorc
671a19d3af Bug 1512188 - Remove prevent_symbolic_revisions arguments; r=tomprince
It is no longer used. We can remove it. A subsequent commit will remove
logic for handling symbolic revisions completely.

Differential Revision: https://phabricator.services.mozilla.com/D14165

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:58 +00:00
Gregory Szorc
fdbfadd8e0 Bug 1512188 - Revert to "gecko" for vcs naming; r=tomprince
For historical consistency and consistency with index paths.

"env_prefix" is no longer used after this change, so it has been
removed.

Differential Revision: https://phabricator.services.mozilla.com/D13876

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:56 +00:00
Gregory Szorc
4534a77110 Bug 1512188 - Consolidate VCS checkout from args logic; r=tomprince
We create a minimal wrapper function to call collect_vcs_options()
and vcs_checkout().

We could consolidate this logic into vcs_checkout(). But I don't have
strong feelings about doing that.

Differential Revision: https://phabricator.services.mozilla.com/D13821

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:54 +00:00
Gregory Szorc
5791caf578 Bug 1512188 - Move enforcement of non-symbolic revisions to vcs_checkout(); r=tomprince
Having this consistently enforced in the checkout function seems
better than looking at environment variables. Also, I think the old
logic was wrong, as it only ran if we weren't doing a checkout!
Although there is a strong possibility that I introduced this bug
via refactoring in this series.

Differential Revision: https://phabricator.services.mozilla.com/D13820

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:52 +00:00
Gregory Szorc
d969ada4f3 Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-11 19:51:05 +00:00
Tom Prince
b6557180f7 Bug 1512285: Stop checking out tools; r=nthomas,gps
Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:58 +00:00
Gregory Szorc
338febf855 Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:56 +00:00
Gregory Szorc
e12421349d Bug 1512188 - Collect environment variables into VCS options; r=tomprince
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:54 +00:00
Gregory Szorc
ce6d86889c Bug 1512188 - make VCS checkout options generic; r=tomprince
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:52 +00:00
Gregory Szorc
20466b6f0c Bug 1512188 - Rename --sparse-profile to --firefox-sparse-profile; r=tomprince
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:45 +00:00
Gregory Szorc
3c6f34daeb Bug 1512188 - Rename --vcs-checkout to --firefox-checkout; r=tomprince
We now have multiple things we may check out. "vcs" meaning "firefox"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-11 19:50:43 +00:00
shindli
42d8404c18 Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-12-06 06:02:52 +02:00
shindli
d1e42e895d Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-12-05 23:38:42 +02:00
Tom Prince
b121ab0ff2 Bug 1507360: Fix flake8 error in run-task; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D13811

--HG--
extra : moz-landing-system : lando
2018-12-05 15:59:51 +00:00
Tom Prince
13af5de7ea Bug 1507360: Fix python3.5 support in fetching hg fingerprints; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D13810

--HG--
extra : moz-landing-system : lando
2018-12-05 16:00:20 +00:00
Tom Prince
84412f33c4 Bug 1507360: Fetch HG fingerprint; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D11966

--HG--
extra : moz-landing-system : lando
2018-12-05 16:19:22 +00:00
Andrew Halberstadt
6f42a07813 Bug 1436037 - [taskgraph] Support Windows generic-worker with run-task, r=gps
This enables Windows generic-worker based tasks to use the run-task script.

Differential Revision: https://phabricator.services.mozilla.com/D10758

--HG--
extra : moz-landing-system : lando
2018-12-05 19:19:56 +00:00
Ciure Andrei
6918b83537 Backed out changeset 38acabd3b5b8 (bug 1507360) for causing tasks that run in docker to fail CLOSED TREE 2018-12-05 04:39:31 +02:00
Jacek Caban
45dc93101c Bug 1506450 - Use llvm-rc via mingw-llvm windres wrapper as resource compiler. r=froydnj 2018-12-05 22:10:45 +01:00
Jacek Caban
11f027f6a4 Bug 1506450 - Bump LLVM and mingw-w64 versions. r=froydnj 2018-12-05 22:10:04 +01:00
Tom Prince
e0beb89f1f Bug 1507360: Fetch HG fingerprint; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D11966

--HG--
extra : moz-landing-system : lando
2018-11-15 17:12:08 +00:00
Tom Prince
a14f56884c Bug 1502531: Adjust test script to create the properly log directories; r=Callek
Due to Bug 1503756, this couldn't be landed with the changes to the paths, as
it changed the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D10454

--HG--
extra : moz-landing-system : lando
2018-11-01 12:37:24 +00:00
Dana Keeler
cb4dcc18dc bug 1507012 - set up and start gnome-keyring-daemon so libsecret works in Firefox in our test environment r=dustin
Counterintuitively, gnome-keyring-daemon needs its capabilities removed in order for it to run in
docker (doing so means that it can't lock secrets in memory, but since this is for tests and we
aren't storing any actually sensitive secrets, this should be fine).

This patch also makes sure gnome-keyring-daemon is running with an unlocked keychain before the
tests are run.

Differential Revision: https://phabricator.services.mozilla.com/D13020

--HG--
extra : moz-landing-system : lando
2018-11-27 15:50:21 +00:00
Gregory Szorc
d9345822b6 Bug 1497660 - Add new hg.mo fingerprint to run-task fallback; r=dustin
We duplicate the hg.mo fingerprints in run-task so we can fall
back to known good values in case secrets retrieval fails.

Differential Revision: https://phabricator.services.mozilla.com/D10090

--HG--
extra : rebase_source : dd351633400d110fdc35c580ca4b9b907cda6db8
extra : intermediate-source : ce441b8a784c3c08fc575f5ff1632a303a244fa3
extra : source : fe2744d3413d28aafe9334c1bac1081ca5702cbd
2018-10-31 14:15:30 -07:00
Mike Shal
a2f8b431ea Bug 1476604 - update sccache; r=firefox-build-system-reviewers,nalexander,ted
This change updates sccache to this revision:
8f295c09cf

Primarily to pick up the changes for handling -Xclang: https://github.com/mozilla/sccache/pull/332

MozReview-Commit-ID: GHinVG4XNDg

Differential Revision: https://phabricator.services.mozilla.com/D13288

--HG--
extra : moz-landing-system : lando
2018-12-04 19:17:54 +00:00
Nick Alexander
1e4af0de3c Bug 1509572 - Part 1: Bump Gradle wrapper to 4.10.2; decouple script from Gradle version. r=snorp
This depends on there being only one Gradle version downloaded, but I
think that is safe enough.

Differential Revision: https://phabricator.services.mozilla.com/D12790

--HG--
extra : moz-landing-system : lando
2018-11-26 21:42:27 +00:00