Commit Graph

5837 Commits

Author SHA1 Message Date
Mitchell Hentges
b6eb2ea22e Bug 1627072 - Runs pip-compile in same directory as temporary requirements file r=rstewart
pip-compile can annotate each requirement with a reason why it is included (e.g.: transitive dependency, or depended-on directly).

When annotating direct dependencies, it notes it as "via -r <direct path to requirements.in file>".
Since we were using a temporary directory, the path of the directory was being included, making the output non-deterministic.

This change ensures that we run pip-compile in the same working directory as the temporary requirements file, enabling
the annotations to be deterministic: "via -r requirements-mach-vendor-python.in".

Differential Revision: https://phabricator.services.mozilla.com/D72181
2020-04-24 20:54:06 +00:00
Kagami Sascha Rosylight
2f8b998e96 Bug 1628726 - Use os.path.realpath consistently r=rstewart
`os.path.realpath` in Python 3.8 now always uppercases Windows drive letter, while it was just an alias of `os.path.abspath` in Windows. This patch uses `.realpath()` consistently to get `topobjdir` to fix the incompatibility from the behavior change.

Differential Revision: https://phabricator.services.mozilla.com/D72188
2020-04-24 20:59:03 +00:00
Chris AtLee
b246a1493c Bug 1632601: Create test archives for jsreftest and jittest r=ahal
Split out jsreftest and jittest files into their own packages, removing them
from the common package.

This speeds up extracting files from the common test archive for
non-jsreftest/jittest suites.

Also, remove some files from the web-platform test archive that are already
present in the common archive.

Differential Revision: https://phabricator.services.mozilla.com/D72192
2020-04-24 20:18:58 +00:00
Joel Maher
f8875234b3 Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 18:54:51 +00:00
Coroiu Cristina
04697a7080 Merge mozilla-central to autoland a=merge on a CLOSED TREE 2020-04-24 21:32:19 +03:00
Tom Prince
07fa71e0fe Bug 1632688: [mozversioncontrol] Don't try to add files if none are provided; r=ahal,rstewart a=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72414
2020-04-24 12:18:26 -06:00
Mike Hommey
5e8b3e9559 Bug 1632353 - Convert mach resource-usage to python3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72117
2020-04-23 22:56:37 +00:00
Ricky Stewart
725728fc20 Bug 1621451 - Remove remaining in-build references to Python 2 GENERATED_FILES as well as underlying build system support r=dmajor
We still need to resolve bug 1621448, at which point we can delete the `py_action` macro entirely.

Differential Revision: https://phabricator.services.mozilla.com/D71795
2020-04-22 17:34:23 +00:00
Mitchell Hentges
38e0a4b340 Bug 1550832 - synchronize makefile blacklist with mozbuild variables r=rstewart
As we migrate from makefiles to moz.build, we want to warn developers if
variables only used by moz.build are accidentally defined in a makefile.

This was the purpose of `MOZBUILD_VARIABLES` in recursivemake.py, though it became out-of-date.

This patch defines `MOZBUILD_VARIABLES` off the official list from `mozbuild.frontend.context.VARIABLES`, and
removes unused (?) code from makefiles accordingly

Note that the following variables use to be in `MOZBUILD_VARIABLES`, but aren't there any more because
they aren't in `mozbuild.frontend.context.VARIABLES`:
* CMSRCS
* CMMSRCS
* EXTRA_JS_MODULES
* EXTRA_PP_COMPONENTS
* EXTRA_PP_JS_MODULES
* HOST_CSRCS
* HOST_CMMSRCS
* HOST_EXTRA_LIBS
* JAVA_JAR_TARGETS
* LIBS
* MAKE_FRAMEWORK
* MODULE
* NO_DIST_INSTALL
* NO_INTERFACES_MANIFEST
* PARALLEL_DIRS
* PREF_JS_EXPORTS
* RESOURCE_FILES
* SHARED_LIBRARY_LIBS
* TEST_DIRS
* TOOL_DIRS
* XPCSHELL_TESTS

Differential Revision: https://phabricator.services.mozilla.com/D72076
2020-04-24 14:47:04 +00:00
Cosmin Sabou
f56aee4c5c Backed out changeset 022f4f67d388 (bug 1550832) for causing SM bustages. CLOSED TREE 2020-04-24 19:22:27 +03:00
Mitchell Hentges
373ffb5d65 Bug 1550832 - synchronize makefile blacklist with mozbuild variables r=rstewart
As we migrate from makefiles to moz.build, we want to warn developers if
variables only used by moz.build are accidentally defined in a makefile.

This was the purpose of `MOZBUILD_VARIABLES` in recursivemake.py, though it became out-of-date.

This patch defines `MOZBUILD_VARIABLES` off the official list from `mozbuild.frontend.context.VARIABLES`, and
removes unused (?) code from makefiles accordingly

Note that the following variables use to be in `MOZBUILD_VARIABLES`, but aren't there any more because
they aren't in `mozbuild.frontend.context.VARIABLES`:
* CMSRCS
* CMMSRCS
* EXTRA_JS_MODULES
* EXTRA_PP_COMPONENTS
* EXTRA_PP_JS_MODULES
* HOST_CSRCS
* HOST_CMMSRCS
* HOST_EXTRA_LIBS
* JAVA_JAR_TARGETS
* LIBS
* MAKE_FRAMEWORK
* MODULE
* NO_DIST_INSTALL
* NO_INTERFACES_MANIFEST
* PARALLEL_DIRS
* PREF_JS_EXPORTS
* RESOURCE_FILES
* SHARED_LIBRARY_LIBS
* TEST_DIRS
* TOOL_DIRS
* XPCSHELL_TESTS

Differential Revision: https://phabricator.services.mozilla.com/D72076
2020-04-24 14:47:04 +00:00
Bogdan Tara
a5112d03db Backed out changeset 97280448a042 (bug 1621095) for test_ext_test.html failures CLOSED TREE 2020-04-24 17:09:37 +03:00
Joel Maher
b9a6e9d31c Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 12:35:12 +00:00
Mike Hommey
56ca1ef0e7 Bug 1631211 - In configure, pass extra compiler flags after source path. r=dmajor,rstewart
When running e.g. check_symbols with extra flags like when checking
for vpx_codec_dec_init_ver when building against system libvpx, in some
configurations, the test can fail when the library flags (-l) appear
before the source file path.

The reason is that in some configurations, the compiler passes
--as-needed to the linker before both the flags and the object file
path, and the object file path is in the same position as the source
file path was. With --as-needed, -l flags are dropped if the library
wasn't needed for any of the linked code that appears *before* the flag.
So linking with `--as-needed -lfoo foo.o`, is equivalent to linking with
`foo.o` only in practice, while `--as-needed foo.o -lfoo` is equivalent
to `foo.o -lfoo`.

Differential Revision: https://phabricator.services.mozilla.com/D71456
2020-04-23 21:46:01 +00:00
Tarek Ziadé
b1ad9498a5 Bug 1632404 - added missing error logger r=sparky
The android layer calls layer.error(), let's make sure it's
really there :)

Differential Revision: https://phabricator.services.mozilla.com/D72102
2020-04-23 21:46:49 +00:00
Tarek Ziadé
92eb19eb28 Bug 1632402 - added --browsertime-iterations r=sparky
Added the --browsertime-iterations option

Differential Revision: https://phabricator.services.mozilla.com/D72101
2020-04-23 19:40:56 +00:00
Tarek Ziadé
b6d9b10181 Bug 1632267 - Clean up the android layer r=acreskey
We're back to an explicit --android option and --android-app-name, the layer won't use the --browser-binary option as an implicit
fallback anymore. This is cleaner.

Differential Revision: https://phabricator.services.mozilla.com/D72031
2020-04-23 14:33:32 +00:00
Gabriele Svelto
96edbb04b7 Bug 1631382 - Update the Gentoo |mach bootstrap| implementation r=glandium
This fixes multiple issues:
* It switches mobile builds from the Oracle JDK to OpenJDK and removes all the
  logic needed to download the former
* It only installs the build dependencies required for building Firefox and
  stores them in the world file

Differential Revision: https://phabricator.services.mozilla.com/D71539
2020-04-23 08:09:37 +00:00
shravanrn@gmail.com
e0273c024b Bug 1626174 - Enable use of wasm sandboxed libOgg in the OggDemuxer in linux, mac, try servers r=padenot,erahm,dmajor,firefox-build-system-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D70652
2020-04-22 11:16:10 +00:00
Tarek Ziadé
37c5e7f665 Bug 1632192 - create a specific test job for mozperftest r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D71987
2020-04-22 17:13:27 +00:00
Tarek Ziadé
43f8df442e Bug 1632075 - split the browsertime layer into manageable chunks r=sparky
Started to split the browsertime layer into logical modules

Differential Revision: https://phabricator.services.mozilla.com/D71906
2020-04-22 14:21:16 +00:00
Tarek Ziadé
b6fd1a9c74 Bug 1631805 - Standardize options r=sparky
- each layer will have an implicit bool argument that's the layer name.
- each argument will be automatically prefixed with --layer-name-xxx
- a layer can set its own args with set_arg() but not other layers' args
- a layer can read all args
- an arg lookup will try in the layer itself first, with or without the layer
  prefix, then in all layers, with the prefix

Differential Revision: https://phabricator.services.mozilla.com/D71896
2020-04-22 15:04:27 +00:00
Tarek Ziadé
6ac291547f Bug 1631966 - prevent mozprofile to own the profile cleanup r=sparky
mozprofile is doing an undeterministic deletion of the profile
based on garbage collection, so we don't when it's happening.
This patch makes it deterministic and prevents double deletion.

Differential Revision: https://phabricator.services.mozilla.com/D71891
2020-04-22 13:21:59 +00:00
Tarek Ziadé
efd5a4fd5a Bug 1631851 - renamed and move --extra-options r=sparky
Moved the option to where it belongs

Differential Revision: https://phabricator.services.mozilla.com/D71890
2020-04-22 13:37:25 +00:00
Matthew Noorenberghe
bc3a45bd19 Bug 1631944 - Add Lockwise as a keyword for login and password preferences. r=jaws,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D71830
2020-04-21 23:49:21 +00:00
xuanqi xu
b89b5e73ce Bug 1630873 - Shorten transformer names, and delete an obselete file. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D71700
2020-04-21 16:29:48 +00:00
Brindusan Cristian
c4fd863aaa Backed out 2 changesets (bug 1626174, bug 1625876) for build bustages at LibrarySandboxPreload.cpp and OggDemuxer.cpp. CLOSED TREE
Backed out changeset 40fea0f3ab6c (bug 1626174)
Backed out changeset a3117fce845d (bug 1625876)
2020-04-21 19:29:02 +03:00
shravanrn@gmail.com
f0399f4146 Bug 1626174 - Enable use of wasm sandboxed libOgg in the OggDemuxer in linux, mac, try servers r=padenot,erahm,dmajor,firefox-build-system-reviewers
Depends on D68764

Differential Revision: https://phabricator.services.mozilla.com/D70652
2020-04-21 15:30:37 +00:00
Ricky Stewart
2399f846de Bug 1628838 - Fix mach python on Windows by unsetting PYTHONUNBUFFERED. r=glandium
The existence of this environment variable breaks the Python shell on Windows, so make sure it's unset (but only in this case to avoid regressing bug 1627873).

Differential Revision: https://phabricator.services.mozilla.com/D70542
2020-04-21 14:07:19 +00:00
Tooru Fujisawa
2108f90fcf Bug 1623965 - Improve error message when binary not found while testing. r=glandium,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,Bebe,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D67726
2020-04-21 11:58:04 +00:00
Tarek Ziadé
95355d71ce Bug 1631596 - Fix the setup step in the browsertime layer r=acreskey
Adds back the setup step and surfaced clobber/install url

Differential Revision: https://phabricator.services.mozilla.com/D71651
2020-04-21 08:26:02 +00:00
Tarek Ziadé
43fca3ecc1 Bug 1628277 - Created the android layer r=acreskey
also, isolate the profile handling in its layer,
added the --proxy and --profile options

Differential Revision: https://phabricator.services.mozilla.com/D71044
2020-04-20 14:06:10 +00:00
Masatoshi Kimura
8d036ee03e Bug 1631199 - Specify the encoding explicitly when opening backend files to be deleted. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D71459
2020-04-20 15:25:54 +00:00
Bingjing Yan
907c0653c5 Bug 1523736 - migrate updates.dtd to fluent r=fluent-reviewers,flod,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D69490
2020-04-20 10:41:41 +00:00
Tarek Ziadé
11b953d576 Bug 1630972 - [mozperftest] Put the cycles inside the browser layer r=sparky
Cycles belong to the browser layer

Differential Revision: https://phabricator.services.mozilla.com/D71335
2020-04-17 15:08:25 +00:00
Tarek Ziadé
df5581830d Bug 1630586 - [mozperftest] refactor arguments r=sparky
Refactor out arguments

Differential Revision: https://phabricator.services.mozilla.com/D71168
2020-04-17 14:26:45 +00:00
Julian
2ca7b71c9f Bug 1609562 - Migrate popup-notifications.inc to Fluent. r=fluent-reviewers,Gijs,flod
Differential Revision: https://phabricator.services.mozilla.com/D69754
2020-04-17 20:13:27 +00:00
Daniel Varga
60946bafd9 Backed out changeset afe014a1b475 (bug 1523736) for causing build bustages
CLOSED TREE
2020-04-17 19:12:57 +03:00
Bingjing Yan
592cd1dc88 Bug 1523736 - migrate updates.dtd to fluent r=fluent-reviewers,flod,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D69490
2020-04-17 15:51:22 +00:00
Gijs Kruitbosch
b6f57a5d9e Bug 1629832 - add tooltips to all the window control buttons, r=dao,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D71199
2020-04-17 12:55:05 +00:00
Ricky Stewart
a68fb761e8 Bug 1630668 - Fix incompatible type signatures in subclasses of Repository r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D71200
2020-04-16 17:07:19 +00:00
Bob Clary
6caaf2e39b Bug 1630426 - mach should log to stderr if not logging to a file, r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D71107

--HG--
extra : moz-landing-system : lando
2020-04-15 22:33:43 +00:00
Ricky Stewart
c9156704b1 Bug 1630317 - Add a warning if there is an attempt to mach bootstrap from an "old commit" r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D71076

--HG--
extra : moz-landing-system : lando
2020-04-15 20:58:58 +00:00
Tom Prince
01409a49a6 Bug 1630047 - Allow mozversioncontrol to add or remove multiple files at once; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D70938

--HG--
extra : moz-landing-system : lando
2020-04-15 22:16:49 +00:00
Gregory Mierzwinski
7870c996a2 Bug 1628158 - Integrate perftest-notebook into mozperftest. r=tarek
This patch integrates the majority of the mach-perftest-notebook project from the github project to the in-tree mozperftest package/tool. Certain portions of it are disabled in this integration (posting to iodide, and transform searching).

Differential Revision: https://phabricator.services.mozilla.com/D70134

--HG--
extra : moz-landing-system : lando
2020-04-15 20:24:36 +00:00
Ricky Stewart
cf2b22e357 Bug 1628621 - Ensure whenever we write to the terminal, if ascii or charmap are the default locale, use utf-8 instead. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D70429

--HG--
extra : moz-landing-system : lando
2020-04-15 04:00:15 +00:00
Ricky Stewart
6e90564cb9 Bug 1629159 - Open the mach log-file with the correct mode. r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D70606

--HG--
extra : moz-landing-system : lando
2020-04-14 19:00:22 +00:00
Kartikaya Gupta
e9cc085269 Bug 1629595 - Avoid rewriting .mozconfig.json in mixed-python environments. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D70708

--HG--
extra : moz-landing-system : lando
2020-04-14 17:47:48 +00:00
Julian
ef534a1b06 Bug 1609557 - Migrate placesContextMenu.inc.xhtml to Fluent. r=fluent-reviewers,flod,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D68733

--HG--
extra : moz-landing-system : lando
2020-04-14 09:13:52 +00:00
Tarek Ziadé
2da872c93f Bug 1627623 - [mozperftest] Implement Andrew's tests r=acreskey
Implements https://github.com/acreskeyMoz/browsertime_on_android_scripts
changes to mach perftest and prototype

Differential Revision: https://phabricator.services.mozilla.com/D69801

--HG--
extra : moz-landing-system : lando
2020-04-14 07:46:51 +00:00