Commit Graph

3216 Commits

Author SHA1 Message Date
Mike Hommey
184d10ed22 Bug 1407465 - Make most _MANIFESTS variables use SourcePaths. r=chmanchester
--HG--
extra : rebase_source : 5124bcc7393d7cadb26a3a96b9a1b78d902cdaa3
2017-10-05 11:15:27 +09:00
Nick Alexander
68f1512696 Bug 1405408 - Part 1: Use Task Cluster proxy to download non-public artifacts. r=dustin
MozReview-Commit-ID: L6VfQuAmHLC

--HG--
extra : rebase_source : 8346a0d9822834fe1ab2bb463c826cb15b69a0e9
2017-10-04 13:24:41 -07:00
Nick Alexander
abeea7e96e Bug 1405408 - Pre: Handle query string and fragments in URL parameters. r=dustin
This was simply oversight before.  I ran into this using the
taskcluster-proxy /bewit interface, which returns a URL of the form
https://domain.net/short/path/to.file?bewit="several thousand
characters", which leads to an IOError due to the long path.  Let's
assume that such query strings and fragments are transient; we should
drop these parts of the fetched URLs when writing to disk.

MozReview-Commit-ID: FMJHMp7a3rA

--HG--
extra : rebase_source : da701e7d5250f59f39e4b6262952a08d0068e9ac
2017-10-05 13:30:21 -07:00
Sebastian Hengst
296a098e22 merge mozilla-central to autoland. r=merge a=merge 2017-10-10 23:57:56 +02:00
Zibi Braniecki
1a94113a62 Bug 1407395 - Guard against empty defines entry when generating langpack manifest. r=Pike
MozReview-Commit-ID: t4Oc1tqbxE

--HG--
extra : rebase_source : 0a43772e13064fc7e468d7bd46c5c63dc773f779
2017-10-10 13:16:29 -07:00
André Reinald
5516cf8a4c Bug 1405389 - Change port name from py27-readline to py27-gnureadline to enable mach bootstrap on current macports. r=nfroyd
MozReview-Commit-ID: E9AlS8RCSp9

--HG--
extra : amend_source : 1d50db24437832978a5c793978cdb8c91c5c599d
2017-10-10 11:17:24 +02:00
Mike Hommey
6a8726dd5f Bug 1319332 - Derive the rust targets from the build host/target. r=froydnj
--HG--
extra : rebase_source : acf6ee7f0a3f172480e653acc58c5ced1c13c254
2017-10-05 16:10:45 +09:00
Joel Maher
fcf8cee97a Bug 1395247 - copy speedometer into talos package. r=rwood 2017-10-09 11:10:34 -04:00
Andi-Bogdan Postelnicu
80b3b45176 Bug 1405602 - add clang-apply-replacements to path used by mach static-analysis. r=sylvestre
MozReview-Commit-ID: CiJ8sckSXNw

--HG--
extra : rebase_source : cbc692dc5ab46202a5c998b350363fe3f78dc300
2017-10-04 17:02:50 +03:00
Andi-Bogdan Postelnicu
f5b2afe28b Bug 1405654 - set default value for header-filter the same as source. r=sylvestre
MozReview-Commit-ID: 705as3mM1dA

--HG--
extra : rebase_source : e873da5dd97d0709b67ec7275dc9ab19bde55515
2017-10-05 16:26:53 +03:00
Andi-Bogdan Postelnicu
f83a012c7c Bug 1405607 - do not pass to run-clang-tidy files that are going to be scanned. r=sylvestre
MozReview-Commit-ID: BPyk9v7vzLr

--HG--
extra : rebase_source : 3f4bc945d473cffb85678e7a51a8ec80d66a4597
2017-10-04 12:41:31 +03:00
Andreas Tolfsen
894334f11e Bug 1405304 - Add Unix formatter for mozlint. r=ahal
This patch introduces a new report formatter for the mozlint
framework used by "./mach lint" that respects Unix output conventions,
popularised by grep(1), compilers, and preprocessors.

The output format looks like this:

	testing/marionette/driver.js:1153:48: no-unused-vars error: 'resp' is defined but never used.

Many editors (ed, Emacs, vi, Acme) recognise this format, allowing
users to interact with the output like a hyperlink to jump to the
specified location in a file.

MozReview-Commit-ID: 3IyiFmNbtMY

--HG--
extra : rebase_source : a2628a999c187a1c43f3cc5d32e6db835028eca4
2017-10-03 14:45:17 +01:00
Andrew Halberstadt
6b65448914 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc

--HG--
extra : rebase_source : b81ab806cd2455f4e4fc761863fe699feadd0bb5
2017-09-26 10:47:22 -04:00
Andi-Bogdan Postelnicu
c400efcc18 Bug 1403846 - add "header-filter" option argument to static-analysis from mach. r=sylvestre
MozReview-Commit-ID: GulGPCCi9U4

--HG--
extra : rebase_source : e7ed44a35c8eb4bba677c1d2ad50c382fc4879f7
2017-09-28 11:21:34 +03:00
Wes Kocher
382a7d90d6 Merge inbound to central, a=merge
MozReview-Commit-ID: CvJ9hmTQBcR
2017-10-02 16:22:37 -07:00
Nathan Froyd
f0fcd23367 Bug 1373878 - part 2 - build system support for Rust tests; r=rillian 2017-10-02 09:21:22 -04:00
Sebastian Hengst
b1575a7d2b Backed out changeset ddfc127526b2 (bug 1403222) for failing python/mozbuild/mozbuild/test/frontend/test_reader.py::TestBuildReader::test_schedules, at least for Linux asan opt builds. r=backout on a CLOSED TREE 2017-10-02 16:03:12 +02:00
Andrew Halberstadt
ef896de9c0 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc

--HG--
extra : rebase_source : 6c456c91985f2006910bda66fdbc5d18e066d020
2017-09-26 10:47:22 -04:00
Andrew Halberstadt
98df27cb1b Bug 1401199 - [mozversioncontrol] Add property to get hash of HEAD revision, r=mshal
MozReview-Commit-ID: 9XWlLeGcPeQ

--HG--
extra : rebase_source : 89cf1dbe133d2ce4d8ffaad017aa151ed08491cd
2017-09-29 11:10:59 -04:00
Andi-Bogdan Postelnicu
88b1f10b9f Bug 1402302 - sync checkers for static-analysis with the mozreview bot. r=sylvestre
MozReview-Commit-ID: I5rn4DEXGOK

--HG--
extra : rebase_source : 049079671c84a670718cf2efa2bd1a8c851446cc
2017-09-30 14:54:58 +03:00
Wes Kocher
2d79871195 Backed out changeset 048af66f7711 (bug 1402302) for lint issues in config.yaml a=backout
MozReview-Commit-ID: 8vkN5D8YVks
2017-09-29 14:23:59 -07:00
Andi-Bogdan Postelnicu
c182f3e18d Bug 1402302 - sync checkers for static-analysis with the mozreview bot. r=sylvestre
MozReview-Commit-ID: I5rn4DEXGOK

--HG--
extra : rebase_source : 880d5ed66b45ca3de83b12561bf1a75eb5f1b198
2017-09-29 23:48:19 +03:00
Mike Shal
9e6798ac00 Bug 1402012 - Update buildconfig.py to use PartialConfigEnvironment; r=glandium
By using the PartialConfigEnvironment, the clients of buildconfig will
depend on config.statusd/ files instead of config.status directly.
Clients can access substs and defines using buildconfig.substs['FOO'] or
buildconfig.defines['BAR'], and then collect file-level dependencies for
make using buildconfig.get_dependencies(). All GENERATED_FILES rules
already make use of this because file_generate.py automatically includes
these dependencies (along with all python modules loaded).

As a result of this commit, re-running configure will no longer cause
the world to be rebuilt. Although config.status is updated, no build
steps use config.status directly and instead depend on values in
config.statusd/, which are written with FileAvoidWrite. Since those
files are not official targets according to the make backend, make won't
try to continually rebuild the backend when those files are out of date.
And since they are FileAvoidWrite, make will only re-run dependent steps
if the actual configure value has changed.

As a result of using JSON to load data from the config.statusd
directory, substs can be unicode (instead of a bare string type).
generate_certdata.py converts the subst manually to a string so the
value can be exported to the environment without issue on Windows.

Additionally, patching the buildconfig.substs dict no longer works, so
the unit-symbolstore.py test was modified to patch the underlying
buildconfig.substs._dict instead.

The other files that needed to be modified make use of all the defines
for the preprocessor. Those that are used during 'mach build' now use
buildconfig.defines['ALLDEFINES'], which maps to a special
FileAvoidWrite file generated for the PartialConfigEnvironment.

MozReview-Commit-ID: 2pJ4s3TVeS8

--HG--
extra : rebase_source : d6bb0208483f9f043e7be1b36907ca13243985f8
2017-08-24 22:52:01 -04:00
Mike Shal
7db69cf3f7 Bug 1402012 - Use PartialConfigEnvironment in process_define_files.py; r=glandium
This removes the dependency on config.status for CONFIGURE_DEFINE_FILES.
Instead, each file depends on the specific configure values that it
uses.

MozReview-Commit-ID: H4oLmJei1KR

--HG--
extra : rebase_source : 287498e8c336d24b1c95d29caf97e5febb56063b
2017-08-21 15:34:07 -04:00
Mike Shal
10d4a372fd Bug 1402012 - Create config.statusd directory; r=glandium
The config.statusd directory is created alongside config.status, which
contains the same information but is split across many files instead of
all in a single file. This allows the build system to track dependencies
on individual configure values.

MozReview-Commit-ID: 2DbwKCJuNSX

--HG--
extra : rebase_source : 8b6257fd9c75cff3e4b6513d69048c0e3fdda5f4
2017-08-18 10:41:50 -04:00
Andrew Halberstadt
a73d388c79 Bug 1401309 - [mozlint] Remove vcs.py and use mozversioncontrol instead, r=gps
This also migrates the vcs.py test to mozversioncontrol and adds a new task for
it.

MozReview-Commit-ID: 9jTRkjNupVA

--HG--
extra : rebase_source : 400f27498e00ea45234ad7c951770b098e916b8e
2017-09-25 16:30:27 -04:00
Andrew Halberstadt
34a14440b5 Bug 1401309 - [mozversioncontrol] Add an option to make failed subprocess commands non-fatal, r=gps
Sometimes commands return non-zero even though everything is ok. For example,
'hg outgoing' returns 1 if there are no outgoing files. This adds a way for
specific function calls not to abort if something goes wrong. Instead, stderr
will be printed (if any) and an empty string is returned.

MozReview-Commit-ID: E089djeHrmr

--HG--
extra : rebase_source : be351f357705e09c3fe876cecefa7ddd9c48987e
2017-09-25 16:30:13 -04:00
Andrew Halberstadt
8bee138c46 Bug 1401309 - [mozversioncontrol] Add ability to get outgoing files, r=gps
This adds 'get_outgoing_files'. First it automatically attempts to find the
upstream remote the current change is based on, then returns all files changed
in the local branch.

If an upstream remote can't be detected, it raises MissingUpstreamRepo

MozReview-Commit-ID: 9zSB9EdwVU8

--HG--
extra : rebase_source : e352d6d471644ef9eda76b972b789d6b54449471
2017-09-20 10:15:09 -04:00
Andrew Halberstadt
13b127e919 Bug 1401309 - [mozversioncontrol] Merge get_modified_files and get_added_files into a single function, r=gps
There's currently a function for getting added files (A) and modified files
(M). We'll also eventually need the ability to get deleted files (D) and any
combination of the above, e.g (AM). Rather than creating a new function for
each possible case, let's have a single function where you can pass in which
modifiers you are interested in. With this patch, if you want all modified and
added files, you can do:

get_changed_files('AM')

By default 'ADM' is used.

This also adds a 'mode' option for git. This allows consumers to return staged
files, unstaged files or both. The default ('unstaged') keeps the current
behaviour in tact.

MozReview-Commit-ID: 9IA1bxaJS80

--HG--
extra : rebase_source : 160f650220ca9a35b4b116bc9fa13f28d84419fa
2017-09-20 10:06:11 -04:00
Andrew Halberstadt
8dd527bf64 Bug 1401309 - Add python/mozversioncontrol to flake8 linter, r=gps
MozReview-Commit-ID: KuyEYa3Mbgd

--HG--
extra : rebase_source : cd3c111432de83d19004946c491f10959fd6d675
2017-09-20 10:02:26 -04:00
Wes Kocher
93c9384395 Bug 1402445 - Tweak the error message for errors processing mozbuild files r=gps
MozReview-Commit-ID: Js8F8OSgoWT

--HG--
extra : rebase_source : 81e8d4edf6e2fe17b42cff3fbcd0f6c3ddc96bc8
2017-09-22 12:44:24 -07:00
Zibi Braniecki
8677f9f1f6 Bug 1395459 - Store the version of the locale data in a langpack based on HG push timestamp. r=gps
MozReview-Commit-ID: ELx9VW81s6Q

--HG--
extra : rebase_source : 2ca118bea6c566899a5ac558d3548bf1b4037c77
2017-09-10 19:57:34 -07:00
Tom Ritter
83f834aede Bug 1392643 Turn on c++14 for MinGW globally r=bagder,froydnj
Technically this turns on gnu++14. I encountered a few errors when using c++14:
1) _USE_MATH_DEFINES needed to be defined for MinGW
2) MinGW did not define _finite under c++14
3) MinGW's float.h did not define Microsoft specific float functions under c++14

All of these were because c++14 defines _STRICT_ANSI_ which MinGW obeys and
avoids defining certain functions. The first two could be patched around, but
the third was a blocker, so we switched to gnu++14

MozReview-Commit-ID: 6Y7gEQgApYp

--HG--
extra : rebase_source : dabbd40c049c36e780b585e0bef0a8e25887d089
2017-09-22 12:26:42 -05:00
Philip Jenvey
e4826ee93d Bug 1401718: adapt to xcode's new non-ascii license error r=gps
avoid unicode conversion (since unicode_literals is in use)

MozReview-Commit-ID: AfgzAWsjRp
2017-09-22 14:58:28 -07:00
Dustin J. Mitchell
0448e8d8a4 Bug 1383880: handle keyError from find_task_id; r=gps
MozReview-Commit-ID: F3mVgKcqZwA

--HG--
extra : rebase_source : ff3b24ff42caf9a8770e196d7ee80edb25ff0ead
2017-09-21 12:02:44 +00:00
Dustin J. Mitchell
acc7db19cc Bug 1383880: --from-build is a dev tool, not for automation; r=glandium
MozReview-Commit-ID: EGs3Zy012JA

--HG--
extra : rebase_source : f279cca0734553e6d03b91cadf844c217d572b4f
extra : source : 5da5cf9bf3583621dd5cfaa4d64e41b9a039fc07
2017-09-15 12:26:14 +00:00
Dustin J. Mitchell
fc50c56e23 Bug 1383880: adjust mach artifact toolchain --from-build; r=glandium
MozReview-Commit-ID: AhGS54jB8Wl

--HG--
extra : rebase_source : 2153d538daaf7f049fac1f0aa23f83eb5d2fb77b
2017-09-19 12:55:37 +00:00
Dustin J. Mitchell
ffbea5ddef Bug 1383880: add support for SCHEDULES in moz.build; r=gps
MozReview-Commit-ID: 2pfLr0VTy2J

--HG--
extra : rebase_source : bd8c9892913b7d2263c856273de9f3abd92c29f6
extra : source : 63ded86f8e0e02c50088d96f9ea5d74fbed55a2b
2017-07-31 20:44:56 +00:00
Phil Ringnalda
aad01e0dc2 Backed out 12 changesets (bug 1383880) for decision task bustage
CLOSED TREE

Backed out changeset fd3615e7e0a3 (bug 1383880)
Backed out changeset 8cceb6a82bfb (bug 1383880)
Backed out changeset 571a6c9054a5 (bug 1383880)
Backed out changeset ec2b8ba5a949 (bug 1383880)
Backed out changeset 8e5847d9acda (bug 1383880)
Backed out changeset b354fdf6e233 (bug 1383880)
Backed out changeset ebdd6ccbcfca (bug 1383880)
Backed out changeset ebcc9d20981a (bug 1383880)
Backed out changeset 97eedc84d6e8 (bug 1383880)
Backed out changeset a3116da52b4e (bug 1383880)
Backed out changeset b3eb0c939720 (bug 1383880)
Backed out changeset 7c07cb798530 (bug 1383880)

MozReview-Commit-ID: EPDuQHr7w2y
2017-09-20 19:57:39 -07:00
Dustin J. Mitchell
a85b853e7e Bug 1383880: --from-build is a dev tool, not for automation; r=glandium
MozReview-Commit-ID: EGs3Zy012JA

--HG--
extra : rebase_source : d3118116fbef2a5908e3914de3c6cb70bf9dafc5
extra : source : 5da5cf9bf3583621dd5cfaa4d64e41b9a039fc07
2017-09-15 12:26:14 +00:00
Dustin J. Mitchell
abaa8d508a Bug 1383880: adjust mach artifact toolchain --from-build; r=glandium
MozReview-Commit-ID: AhGS54jB8Wl

--HG--
extra : rebase_source : 3b4de9c51fdd6bb7d9aeb14cd418f72fcb75365f
2017-09-19 12:55:37 +00:00
Dustin J. Mitchell
c3eb4c804e Bug 1383880: add support for SCHEDULES in moz.build; r=gps
MozReview-Commit-ID: 2pfLr0VTy2J

--HG--
extra : rebase_source : 96198c158ea8a92ad0a3e555894dca1c0db61548
extra : source : 63ded86f8e0e02c50088d96f9ea5d74fbed55a2b
2017-07-31 20:44:56 +00:00
Chris Manchester
89a09e8d67 Bug 1398897 - Move os includes to computed flags. r=glandium
MozReview-Commit-ID: Ef1wu5fQo7M

--HG--
extra : rebase_source : b5f15b2da47e724790ffee0512b5477059ae1c3a
2017-09-20 12:43:24 -07:00
Chris Manchester
73a827ed43 Bug 1398897 - Move includes associated with CPP_UNIT_TESTS to the CppUnitTests template. r=glandium
MozReview-Commit-ID: DhjnzhAjoyy

--HG--
extra : rebase_source : 75faf6212f3a9913d75ecb223f29ce7e9ac46a1c
2017-09-20 12:43:24 -07:00
Chris Manchester
d3b657984e Bug 1398897 - Move breakpad include munging to moz.build r=glandium
Unfortunately this also needs to be kept in Makefile.in to handle
other consumers of INCLUDES while we transition them.

MozReview-Commit-ID: 9OYlu6Jv1XZ

--HG--
extra : rebase_source : 719200501a93e836a03a64b5e1cd950a8f2e696a
2017-09-20 12:43:24 -07:00
Chris Manchester
c6f31b26d8 Bug 1398897 - Move includes to computed flags. r=glandium
MozReview-Commit-ID: Ec0wZfoV63B

--HG--
extra : rebase_source : c004185b9a9938343efb93920f646afd30b4b01e
2017-09-20 12:43:23 -07:00
Chris Manchester
6de6ad13ab Bug 1398897 - Move defines to computed compile flags. r=glandium
MozReview-Commit-ID: CgQv79dYj7Y

--HG--
extra : rebase_source : 2e95f04d586ccb31bbd68e76b550fe1afcac32ec
2017-05-01 18:13:48 -07:00
Chris Manchester
46abf17fd3 Bug 1398897 - Do not emit compile flags for directories only containing rust libraries. r=glandium
MozReview-Commit-ID: 94PFyi5VQux

--HG--
extra : rebase_source : a3e43e0a212daf72c0c7d2bade3c8b1b479ea44a
2017-09-20 12:43:14 -07:00
Andi-Bogdan Postelnicu
14b2bd3b4d Bug 1328454 - Run static analysis based on clang-tidy from mach. r=glandium
MozReview-Commit-ID: 7H1HvYE9umf

--HG--
extra : rebase_source : e4498731634e48072ea84984fff80bbfdbbd5f33
2017-05-04 14:41:34 +03:00
Andrew Halberstadt
d59f62ddf2 Bug 1392787 - [mozlint] Fix bugs in path filtering and add a test, r=jmaher
MozReview-Commit-ID: LG47ASBMA17

--HG--
extra : rebase_source : 3d6394d2839bf4c12dedbdb84f5b7dd118c92fea
2017-08-23 06:33:06 -04:00