Commit Graph

4684 Commits

Author SHA1 Message Date
Panos Astithas
ef97797c28 Bug 1485117 - Make standalone bootstrap work without a git checkout. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20426

--HG--
extra : moz-landing-system : lando
2019-02-26 06:39:55 +00:00
Andrew Halberstadt
80bdd47243 Bug 1518572 - [mach] Stuff the 'handler' instance into the context when applicable r=firefox-build-system-reviewers,mshal
For mach commands that have 'pass_context=True', we should implicitly add the
handler instance to the context. This will give mach command implementations an
easy way to access things like the command/subcommand names, the parser, argv
list, etc.

Differential Revision: https://phabricator.services.mozilla.com/D20521

--HG--
extra : moz-landing-system : lando
2019-02-25 16:19:05 +00:00
Ted Mielczarek
0539de896a bug 1481614 - detect icecream usage in build telemetry. r=chmanchester,glandium
This patch adds detection for when icecream is in use to build telemetry.
icecream is commonly enabled in two ways: by either setting CC/CXX to point
to icecream's cc/c++ symlinks, or by setting adding
mk_add_options 'export CCACHE_PREFIX=icecc' to a mozconfig when also using
ccache. For the former, this patch adds a simple configure check to see
if CXX is a symlink to a file named 'icecc'. For the latter this patch adds
CCACHE_PREFIX as a configure subst to capture the value.

We don't currently have a facility for writing telemetry tests that depend on
configure values. Local manual testing shows that it does work as expected.

Differential Revision: https://phabricator.services.mozilla.com/D18138

--HG--
extra : moz-landing-system : lando
2019-02-25 19:06:27 +00:00
Andrew Halberstadt
db9e1a5ab1 Bug 1367092 - [flake8] Take exclusion handling away from flake8, r=egao
The motivations for this are:

1) Apply global excludes. This merges the exclusion rules defined in
tools/lint/mach_commands.py with the ones in .flake8.

2) Improve performance. Switching to a blacklist will result in a much longer
runtime for linting the entire tree and flake8 handles exclusions incredibly
slowly. Without this patch (and the blacklist change applied), I gave up
waiting after 30 minutes. With this patch, it takes 30 seconds.

Depends on D20495

Differential Revision: https://phabricator.services.mozilla.com/D20496

--HG--
rename : tools/lint/test/files/flake8/bad.py => tools/lint/test/files/flake8/subdir/exclude/bad.py
extra : moz-landing-system : lando
2019-02-22 22:16:57 +00:00
Andrew Halberstadt
2152caf120 Bug 1367092 - [lint] Move py2/py3 linter's exludes logic into mozlint, r=egao
This will be re-used by the flake8 linter, so moving it into mozlint for
re-useability.

Depends on D20493

Differential Revision: https://phabricator.services.mozilla.com/D20494

--HG--
extra : moz-landing-system : lando
2019-02-22 21:18:22 +00:00
Christian Frey
fccf4fa2b5 Bug 1517493 - migrated pageInfo.dtd and pageInfo.properties to pageInfo.ftl r=jaws,flod,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D16931

--HG--
extra : moz-landing-system : lando
2019-02-22 15:26:15 +00:00
Mike Hommey
f4f3f52f4d Bug 1529195 - Allow to pass a different directory than $DIST to install artifacts to. r=chmanchester
Depends on D20446

Differential Revision: https://phabricator.services.mozilla.com/D20447

--HG--
extra : moz-landing-system : lando
2019-02-21 22:53:31 +00:00
Mike Hommey
d3af9d50b9 Bug 1529195 - Allow to opt-in to symbols/host-bin artifacts from the CLI. r=chmanchester
and to opt-out of test artifacts.

Depends on D20445

Differential Revision: https://phabricator.services.mozilla.com/D20446

--HG--
extra : moz-landing-system : lando
2019-02-21 22:53:43 +00:00
Mike Hommey
79bf8a087d Bug 1529195 - Remove the get_job_details function. r=chmanchester
It is now not useful to keep as a separate function.

Depends on D20444

Differential Revision: https://phabricator.services.mozilla.com/D20445

--HG--
extra : moz-landing-system : lando
2019-02-21 22:53:59 +00:00
Mike Hommey
7e1a73e686 Bug 1529195 - Cache list of artifacts and task id for a given set of (tree, job, rev). r=chmanchester
Instead of having cache misses for all variables that may vary when
getting job details. While the currently used variables are mostly
constants, we're going to introduce some flexibility in an subsequent
change.

Depends on D20443

Differential Revision: https://phabricator.services.mozilla.com/D20444

--HG--
extra : moz-landing-system : lando
2019-02-21 22:54:32 +00:00
Mike Hommey
b98e6f78b9 Bug 1529195 - Move per-job package regexp to per-platform. r=chmanchester
Once all tests regexp are gone, we come to realize that all the package
regexp are the same for each ArtifactJob subclass, some we move the
definitions to the subclasses.

Depends on D20442

Differential Revision: https://phabricator.services.mozilla.com/D20443

--HG--
extra : moz-landing-system : lando
2019-02-21 22:54:42 +00:00
Mike Hommey
097ed542ab Bug 1529195 - Remove per-job tests regexp definition. r=chmanchester
Once the firefox-* and fennec-* regexp are gone, we come to realize
that all jobs have the same regexp for tests, so we can just
use that across the board and remove the definition from JOB_DETAILS.

Depends on D20441

Differential Revision: https://phabricator.services.mozilla.com/D20442

--HG--
extra : moz-landing-system : lando
2019-02-21 22:54:49 +00:00
Mike Hommey
e266c550f5 Bug 1529195 - Remove artifact filters for firefox-* and fennec-*. r=chmanchester
The filters were added back when buildbot was still used, and some
artifacts were still using file names beginning with "firefox" or
"fennec".
That is not true now that all builds are on taskcluster, and for all of
them, they are now target.$ext.

Differential Revision: https://phabricator.services.mozilla.com/D20441

--HG--
extra : moz-landing-system : lando
2019-02-21 22:55:08 +00:00
Oana Pop Rus
d259530ce5 Backed out changeset d28d0498bd7b (bug 1517493) for bc failures at browser_firstPartyIsolation_saveAs.js 2019-02-21 14:28:56 +02:00
Christian Frey
df96294465 Bug 1517493 Migrating pageInfo to Fluent r=jaws,flod,Gijs
Translating most string from pageInfo.properties and making pageInfo.js and security.js use Fluent

Differential Revision: https://phabricator.services.mozilla.com/D16931

--HG--
extra : moz-landing-system : lando
2019-02-21 11:31:05 +00:00
Mike Hommey
de6692d10a Bug 1528892 - Make preprocessor output more reproducible. r=froydnj
On CI, Windows builds start from different directories on every build,
except when sccache is enabled. This affects many build types, such as
l10n repacks, and the preprocessor likes to put full paths in its
output, which means it includes those different directories, making the
builds non reproducible.

This changes the preprocessor to replace the source and object
directories with generic strings.

Differential Revision: https://phabricator.services.mozilla.com/D20421

--HG--
extra : moz-landing-system : lando
2019-02-21 05:09:52 +00:00
Cosmin Sabou
9f8b29287b Merge mozilla-central to autoland. 2019-02-21 05:43:34 +02:00
Cosmin Sabou
f3db52f4cf Merge mozilla-inbound to mozilla-central. a=merge 2019-02-21 05:42:03 +02:00
Mike Hommey
c71f4ec3ee Bug 1529139 - Mark .asm GENERATED_FILES as required_for_compile. r=froydnj
This will avoid trying to generate them during artifact builds.

Depends on D20587

Differential Revision: https://phabricator.services.mozilla.com/D20436

--HG--
extra : moz-landing-system : lando
2019-02-21 00:12:52 +00:00
Marco Castelluccio
19bbc158b4 Bug 1491004 - Exclude Visual Studio files from coverage instrumentation. r=chmanchester,calixte,glandium
Differential Revision: https://phabricator.services.mozilla.com/D18511

--HG--
extra : moz-landing-system : lando
2019-02-20 12:18:56 +00:00
Marco Castelluccio
2dffc6b8bf Bug 1491004 - Set CFLAGS and CXXFLAGS in toolchain.configure for coverage builds. r=chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D18510

--HG--
extra : moz-landing-system : lando
2019-02-20 12:18:32 +00:00
Csoregi Natalia
e2ff25bf86 Backed out changeset 88a27dc859b9 (bug 1529139) for bustage due to missing fficonfig.h. CLOSED TREE 2019-02-20 14:19:27 +02:00
Mike Hommey
49e3e41e5c Bug 1529139 - Mark .asm GENERATED_FILES as required_for_compile. r=froydnj
This will avoid trying to generate them during artifact builds.

Differential Revision: https://phabricator.services.mozilla.com/D20436

--HG--
extra : moz-landing-system : lando
2019-02-20 11:17:31 +00:00
Daniel Varga
4587d14668 Merge mozilla-inbound to mozilla-central. a=merge 2019-02-20 06:01:45 +02:00
Mike Hommey
41d0022e0c Bug 1528860 - Synchronize artifact command --job options with artifacts.JOB_DETAILS. r=ted
Differential Revision: https://phabricator.services.mozilla.com/D20227
2019-02-20 07:46:41 +09:00
Mike Hommey
2ead86b7c1 Bug 1528241 - Add a trace mode to python configure that logs internal values. r=chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D19940
2019-02-20 07:46:22 +09:00
Mike Hommey
b2f1a3fc7f Bug 1528194 - Run config.sub when split_target fails when not running it. r=mshal
In bug 1522354, we changed host and target detection to not invoke
config.sub, assuming the output from config.guess would satisfy our
needs in split_target.

It turns out that on some plaforms, that doesn't work out, so, while we
still skip config.sub, we now catch errors from split_target when doing
so, and try again after running config.sub when split_target fails.

Differential Revision: https://phabricator.services.mozilla.com/D19937
2019-02-20 07:46:17 +09:00
Mike Hommey
8a74f32d09 Bug 1528194 - Print mach-invoked pseudo-configure output when it fails. r=mshal
Since bug 1522788, mach invokes a part of configure as part of getting
mozconfig and target information for its own purpose. The problem is
that the sandboxed code may sys.exit(), which then makes mach silently
exit.

So when the sandboxed configure code does sys.exit(), instead of
silently failing, we catch the exit call, and print out what we
captured.

Differential Revision: https://phabricator.services.mozilla.com/D19936
2019-02-20 07:46:09 +09:00
Mike Hommey
4b2309140a Bug 1528123 - Allow artifact builds to pull from a specific taskid. r=chmanchester
Currently, artifact builds pull from some task they determine from the
job type, and finding a pushhead.

Sometimes that latter fails, most notably on automation. But automation
can already know the right task to use without guesswork.

This change allows artifact builds to pull from a specific taskid given
through an environment variable, and make tasks from the artifact-build
kind (not the --artifact builds from try) use that.

Remove the workaround from bug 1382982 because it's now dead code.

Differential Revision: https://phabricator.services.mozilla.com/D19881
2019-02-20 07:45:55 +09:00
Coroiu Cristina
dee1f146c8 Backed out changeset f4094fd9e1df (bug 1517528) for mochitest failures on a CLOSED TREE 2019-02-19 22:25:55 +02:00
Nicholas Cowles
6cab4dbf63 Bug 1517528 - Capstone: convert about:privatebrowsing using gandalf's conversion script, r=jaws,zbraniecki,flod
Differential Revision: https://phabricator.services.mozilla.com/D19250

--HG--
extra : moz-landing-system : lando
2019-02-19 19:17:14 +00:00
Yuan Cheng
12a33aae75 Bug 1523737 - Migrate printProgress.dtd, printPageSetup.dtd, and printPreviewProgress.dtd to Fluent, r=jaws,flod
Differential Revision: https://phabricator.services.mozilla.com/D19322

--HG--
extra : moz-landing-system : lando
2019-02-19 17:59:05 +00:00
shindli
428bc0ca50 Backed out changeset cfb1a7fbbfa7 (bug 1517493) for bc failures in browser/base/content/test/static/browser_all_files_referenced.js 2019-02-18 22:49:05 +02:00
Christian Frey
59bf1f3f79 Bug 1517493 Migrating pageInfo to Fluent r=jaws,flod
Translating most string from pageInfo.properties and making pageInfo.js and security.js use Fluent

Differential Revision: https://phabricator.services.mozilla.com/D16931

--HG--
extra : moz-landing-system : lando
2019-02-07 06:31:04 +00:00
Emilio Cobos Álvarez
61afcd6fcc Bug 1528643 - Fix mach clang-format -c in mercurial. r=sylvestre
Turns out hg diff works differently, and when Miko tried to use this
option last week he realized it didn't work quite as expected.

Differential Revision: https://phabricator.services.mozilla.com/D20102

--HG--
extra : moz-landing-system : lando
2019-02-18 08:13:45 +00:00
Cosmin Sabou
8cb8ef3973 Merge mozilla-central to autoland. 2019-02-15 20:50:34 +02:00
Benjamin Bouvier
ab4bcb3e97 Bug 1521772: Run clang-format in parallel; r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D19943

--HG--
extra : moz-landing-system : lando
2019-02-15 16:32:48 +00:00
Daniel Varga
1e9aa9e1fc Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE
--HG--
rename : browser/components/nsBrowserContentHandler.js => browser/components/BrowserContentHandler.jsm
2019-02-15 03:51:05 +02:00
Mike Hommey
ef3ad686ee Bug 1512504 - Remove support for MSVC. r=froydnj
Consequently, this removes:
- MOZ_LIBPRIO, which is now always enabled.
- non_msvc_compiler, which is now always true.
- The cl.py wrapper, since it's not used anymore.
- CL_INCLUDES_PREFIX, which was only used for the cl.py wrapper.
- NONASCII, which was only there to ensure CL_INCLUDES_PREFIX still
  worked in non-ASCII cases.

This however keeps a large part of detecting and configuring for MSVC,
because we still do need it for at least headers, libraries, and midl.

Depends on D19614

Differential Revision: https://phabricator.services.mozilla.com/D19615

--HG--
extra : moz-landing-system : lando
2019-02-14 21:45:27 +00:00
Geoff Brown
7e2ceb9259 Bug 1527011 - Support win64-aarch64 artifact builds; r=nalexander 2019-02-12 18:03:38 -07:00
Andi-Bogdan Postelnicu
843d0d6fcf Bug 1527286 - For 'mach clang-format' don't pass files that we don't exist on the disk. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D19481

--HG--
extra : moz-landing-system : lando
2019-02-12 12:54:22 +00:00
Andi-Bogdan Postelnicu
1a6a9cbcf1 Bug 1520920 - do not 'mach configure' when downloading clang-tidy artifact. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D16969

--HG--
extra : moz-landing-system : lando
2019-02-12 10:44:17 +00:00
Dorel Luca
7d3d8441a9 Backed out changeset d6bda0108d61 (bug 1520920) as requested by the dev 2019-02-12 12:38:48 +02:00
Andi-Bogdan Postelnicu
72161a32a3 Bug 1520920 - do not 'mach configure' when downloading clang-tidy artifact. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D16969

--HG--
extra : moz-landing-system : lando
2019-02-12 10:27:19 +00:00
Jeff Gilbert
721d8c2e22 Bug 1526509 - Remove lib32-libstdc++5 requirement from mozboot/archlinux.py. r=glandium
lib32-libstdc++5 moved from multilib to AUR, but it seems like we don't
need this anymore anyway.

Differential Revision: https://phabricator.services.mozilla.com/D19276

--HG--
extra : moz-landing-system : lando
2019-02-12 02:49:16 +00:00
Chris Manchester
7b468805c5 Bug 1525733 - Require rust 1.32 to build. r=firefox-build-system-reviewers,ted
Differential Revision: https://phabricator.services.mozilla.com/D19244

--HG--
extra : moz-landing-system : lando
2019-02-11 19:43:18 +00:00
Mike Hommey
e3b77d6ed3 Bug 1526062 - Add a configure lint for undefined variables. r=nalexander
There are cases that can be easily detected where an undefined variable
is used, and such mistakes seem to happen more often than they should,
as all the errors fixed in the previous patches (that this new lint
caught).

Depends on D19112

Differential Revision: https://phabricator.services.mozilla.com/D19113

--HG--
extra : moz-landing-system : lando
2019-02-08 20:38:05 +00:00
Mike Hommey
83b2adb600 Bug 1526062 - Improve error reporting by the configure lint. r=nalexander
Currently, running the configure lint will raise errors with little
context, if any, which can make finding the cause of the errors tedious.

So instead of raising exceptions directly, we use a hack to make the
exception appear as if they had been thrown at the code location an
issue is reported for, which makes the test harness print more useful
context.

With more context, printed out, some exception messages can be made
lighter.

The added _raise_from method does more than is necessary here, but will
be fully used in a new check shortly.

Depends on D19111

Differential Revision: https://phabricator.services.mozilla.com/D19112

--HG--
extra : moz-landing-system : lando
2019-02-08 22:47:02 +00:00
Mike Hommey
845718811d Bug 1526062 - Add AssertionError to the python configure sandbox builtins. r=nalexander
Using the `assert` keyword actually generates bytecode that uses the
`AssertionError` class under the hood. Ideally, we should probably not
use asserts in python configure, but there are currently so many that
it's easier to allow it, until a better strategy is decided upon.

Depends on D19110

Differential Revision: https://phabricator.services.mozilla.com/D19111

--HG--
extra : moz-landing-system : lando
2019-02-08 16:57:55 +00:00
Mike Hommey
39bdbdd823 Bug 1525999 - Default to arm instead of armv7a for android builds. r=nalexander
That makes target.toolchain match what the NDK provides.

Differential Revision: https://phabricator.services.mozilla.com/D19116

--HG--
extra : moz-landing-system : lando
2019-02-08 22:37:25 +00:00