Commit Graph

5463 Commits

Author SHA1 Message Date
Jonathan Watt
7c7fe33b1d Bug 1603804. Move third_party/python/lldbutils to python/lldbutils. r=ahal
This undoes the mistaken move of this directory into third_party that happened
as part of bug 1346025.

Differential Revision: https://phabricator.services.mozilla.com/D57141

--HG--
rename : third_party/python/lldbutils/README.txt => python/lldbutils/README.txt
rename : third_party/python/lldbutils/lldbutils/__init__.py => python/lldbutils/lldbutils/__init__.py
rename : third_party/python/lldbutils/lldbutils/content.py => python/lldbutils/lldbutils/content.py
rename : third_party/python/lldbutils/lldbutils/general.py => python/lldbutils/lldbutils/general.py
rename : third_party/python/lldbutils/lldbutils/gfx.py => python/lldbutils/lldbutils/gfx.py
rename : third_party/python/lldbutils/lldbutils/layout.py => python/lldbutils/lldbutils/layout.py
rename : third_party/python/lldbutils/lldbutils/utils.py => python/lldbutils/lldbutils/utils.py
extra : moz-landing-system : lando
2019-12-20 17:10:12 +00:00
Nathan Froyd
6476df37aa Bug 1605215 - apply shared library naming conventions to wasm sandboxed libraries; r=firefox-build-system-reviewers,rstewart
Because that's what they really are under the hood.

Differential Revision: https://phabricator.services.mozilla.com/D57872

--HG--
extra : moz-landing-system : lando
2019-12-19 22:20:44 +00:00
Edwin Takahashi
691d57b5ad Bug 1581016 - mozpack/copier.py and mozpack/test_copier.py supports python3 r=glandium,rstewart
Change import order.

Enable python3 testing for `test_copier.py`.

In the test methods, ensure the returned file names are decoded as UTF-8 by default.

In the test methods, check for byte-string by default; in python2, this would be treated like the standard string.

Differential Revision: https://phabricator.services.mozilla.com/D55187

--HG--
extra : moz-landing-system : lando
2019-12-19 22:00:39 +00:00
Razvan Maries
eef36cc7e7 Backed out 2 changesets (bug 1605215) for perma fails on test_emitter.py. CLOSED TREE
Backed out changeset 2e26df04968e (bug 1605215)
Backed out changeset de5881f3d6ce (bug 1605215)
2019-12-19 23:36:43 +02:00
Nathan Froyd
cf45cda557 Bug 1605215 - apply shared library naming conventions to wasm sandboxed libraries; r=firefox-build-system-reviewers,rstewart
Because that's what they really are under the hood.

Depends on D57871

Differential Revision: https://phabricator.services.mozilla.com/D57872

--HG--
extra : moz-landing-system : lando
2019-12-19 20:54:38 +00:00
Razvan Maries
4a6468a68a Backed out changeset 69687a23245e (bug 1603804) for Lint failure. CLOSED TREE
--HG--
rename : python/lldbutils/README.txt => third_party/python/lldbutils/README.txt
rename : python/lldbutils/lldbutils/__init__.py => third_party/python/lldbutils/lldbutils/__init__.py
rename : python/lldbutils/lldbutils/content.py => third_party/python/lldbutils/lldbutils/content.py
rename : python/lldbutils/lldbutils/general.py => third_party/python/lldbutils/lldbutils/general.py
rename : python/lldbutils/lldbutils/gfx.py => third_party/python/lldbutils/lldbutils/gfx.py
rename : python/lldbutils/lldbutils/layout.py => third_party/python/lldbutils/lldbutils/layout.py
rename : python/lldbutils/lldbutils/utils.py => third_party/python/lldbutils/lldbutils/utils.py
2019-12-19 20:16:17 +02:00
Jonathan Watt
8e978a5ef3 Bug 1603804. Move third_party/python/lldbutils to python/lldbutils. r=ahal
This undoes the mistaken move of this directory into third_party that happened
as part of bug 1346025.

The .flake8 changes are required because lldbutils used to be excluded from
linting by virtue of being inside third_party, but would otherwise be subject
to it after this move. Fixing the existing lint errors will happen in:

  - https://bugzilla.mozilla.org/show_bug.cgi?id=1605144
  - https://bugzilla.mozilla.org/show_bug.cgi?id=1605145

Differential Revision: https://phabricator.services.mozilla.com/D57141

--HG--
rename : third_party/python/lldbutils/README.txt => python/lldbutils/README.txt
rename : third_party/python/lldbutils/lldbutils/__init__.py => python/lldbutils/lldbutils/__init__.py
rename : third_party/python/lldbutils/lldbutils/content.py => python/lldbutils/lldbutils/content.py
rename : third_party/python/lldbutils/lldbutils/general.py => python/lldbutils/lldbutils/general.py
rename : third_party/python/lldbutils/lldbutils/gfx.py => python/lldbutils/lldbutils/gfx.py
rename : third_party/python/lldbutils/lldbutils/layout.py => python/lldbutils/lldbutils/layout.py
rename : third_party/python/lldbutils/lldbutils/utils.py => python/lldbutils/lldbutils/utils.py
extra : moz-landing-system : lando
2019-12-19 16:37:46 +00:00
Andrew Halberstadt
20606598b3 Bug 1604360 - [python] Fix ./mach python --ipython, r=mars
We recently updated the version of pip we use, and it no longer supports
--use-wheels.

Differential Revision: https://phabricator.services.mozilla.com/D57404

--HG--
extra : moz-landing-system : lando
2019-12-17 23:05:29 +00:00
Coroiu Cristina
4b1f3db61d Backed out changeset 254b3c9cfd03 (bug 1603804) for lint failure at builds/worker/checkouts/gecko/python/lldbutils/lldbutils on a CLOSED TREE
--HG--
rename : python/lldbutils/README.txt => third_party/python/lldbutils/README.txt
rename : python/lldbutils/lldbutils/__init__.py => third_party/python/lldbutils/lldbutils/__init__.py
rename : python/lldbutils/lldbutils/content.py => third_party/python/lldbutils/lldbutils/content.py
rename : python/lldbutils/lldbutils/general.py => third_party/python/lldbutils/lldbutils/general.py
rename : python/lldbutils/lldbutils/gfx.py => third_party/python/lldbutils/lldbutils/gfx.py
rename : python/lldbutils/lldbutils/layout.py => third_party/python/lldbutils/lldbutils/layout.py
rename : python/lldbutils/lldbutils/utils.py => third_party/python/lldbutils/lldbutils/utils.py
2019-12-19 14:44:28 +02:00
Jonathan Watt
93534e98f9 Bug 1603804. Move third_party/python/lldbutils to python/lldbutils. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D57141

--HG--
rename : third_party/python/lldbutils/README.txt => python/lldbutils/README.txt
rename : third_party/python/lldbutils/lldbutils/__init__.py => python/lldbutils/lldbutils/__init__.py
rename : third_party/python/lldbutils/lldbutils/content.py => python/lldbutils/lldbutils/content.py
rename : third_party/python/lldbutils/lldbutils/general.py => python/lldbutils/lldbutils/general.py
rename : third_party/python/lldbutils/lldbutils/gfx.py => python/lldbutils/lldbutils/gfx.py
rename : third_party/python/lldbutils/lldbutils/layout.py => python/lldbutils/lldbutils/layout.py
rename : third_party/python/lldbutils/lldbutils/utils.py => python/lldbutils/lldbutils/utils.py
extra : moz-landing-system : lando
2019-12-16 19:39:06 +00:00
Dan Mosedale
42eb841eff Bug 1604295 - Update NodeJS to 8.17.0 and npm to 6.13.4 r=Standard8
This patch causes the newest version of NodeJS 8.17.0 to be used to build the mozilla toolchains installed on the CI machines as well as by `mach bootstrap`, which in turn gets an important security fix by updating to npm 6.13.4.

This patch also causes mach commands which call npm to abort if the version in use is older than 6.13.4 to avoid (especially) exploits on local developers that exfiltrate their data.

Differential Revision: https://phabricator.services.mozilla.com/D57674

--HG--
extra : moz-landing-system : lando
2019-12-18 21:59:33 +00:00
Ricky Stewart
27fa46c7df Bug 1604337 - mozpack/packager/* files support python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57386

--HG--
extra : moz-landing-system : lando
2019-12-18 23:35:54 +00:00
Ricky Stewart
4bb9805afe Bug 1604277 - mozpack/errors.py and mozpack/manifests.py support python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57362

--HG--
extra : moz-landing-system : lando
2019-12-18 22:06:35 +00:00
Ricky Stewart
7c927ba04b Bug 1602540 - mozpack/files.py and test_files.py support Python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57004

--HG--
extra : moz-landing-system : lando
2019-12-18 23:23:12 +00:00
Bogdan Tara
9351449802 Backed out 3 changesets (bug 1604337, bug 1602540, bug 1604277) for build-linux64-artifact/opt (AB) bustages CLOSED TREE
Backed out changeset 4ac19b94051e (bug 1604337)
Backed out changeset 93e2ef0d77b3 (bug 1604277)
Backed out changeset 4ac9cc8c39b1 (bug 1602540)
2019-12-19 00:02:39 +02:00
Ricky Stewart
6131b0e7ab Bug 1604337 - mozpack/packager/* files support python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57386

--HG--
extra : moz-landing-system : lando
2019-12-18 16:43:09 +00:00
Ricky Stewart
c8aa318a85 Bug 1604277 - mozpack/errors.py and mozpack/manifests.py support python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57362

--HG--
extra : moz-landing-system : lando
2019-12-18 16:43:09 +00:00
Ricky Stewart
3e58392872 Bug 1602540 - mozpack/files.py and test_files.py support Python3 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D57004

--HG--
extra : moz-landing-system : lando
2019-12-18 21:15:48 +00:00
Mike Shal
0e0d7f71a9 Bug 1602857 - Only install mercurial if required in OSX mach boostrap; r=firefox-build-system-reviewers,rstewart
If mercurial is already installed via pip (or possibly other means),
then mach bootstrap will fail. We should check if we already have a
sufficient mercurial before forcing it to be installed with
ports/homebrew.

Differential Revision: https://phabricator.services.mozilla.com/D57566

--HG--
extra : moz-landing-system : lando
2019-12-17 23:44:17 +00:00
Zibi Braniecki
bb46639778 Bug 1600528 - Migrate browser-context.inc to Fluent. r=Gijs,flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D55396

--HG--
extra : moz-landing-system : lando
2019-12-18 06:26:58 +00:00
Sylvestre Ledru
41312ab8df Bug 1601578 - mach - doc environment with python 3 r=ahal,firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D55937

--HG--
extra : moz-landing-system : lando
2019-12-17 19:17:43 +00:00
Razvan Maries
c98dba73a9 Backed out 5 changesets (bug 1601612, bug 1601578) for Lint failure. CLOSED TREE
Backed out changeset c5b62adb19f1 (bug 1601612)
Backed out changeset 67431d96c78f (bug 1601612)
Backed out changeset 22099810071a (bug 1601612)
Backed out changeset 457049dcb9b4 (bug 1601612)
Backed out changeset 45277ab0d639 (bug 1601578)
2019-12-17 09:49:51 +02:00
Sylvestre Ledru
e945783c5b Bug 1601578 - mach - doc environment with python 3 r=ahal,firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D55937

--HG--
extra : moz-landing-system : lando
2019-12-17 01:30:41 +00:00
Andrew Halberstadt
68fc6af908 Bug 1603561 - [mozbuild] Ignore all potential objdirs in BuildReader._relevant_mozbuild_finder, r=firefox-build-system-reviewers,chmanchester
Currently BuildReader._relevant_mozbuild_finder attempted to exclude objdirs by
ignoring the pattern 'obj*'. However this can cause problems for developers who
don't prefix their objdirs with the string 'obj'. This attempts to ignore all
objdirs by looking for 'config.status' files in the topsrcdir.

This wasn't a huge issue before because BuildReader._relevant_mozbuild_finder
was only used in a handful of obscure edge cases. But now it's being invoked by
the taskgraph and consequently |mach try|. So we'll see this issue pop up for
people more frequently.

Differential Revision: https://phabricator.services.mozilla.com/D57113

--HG--
extra : moz-landing-system : lando
2019-12-17 01:35:05 +00:00
Chris Manchester
43db981303 Bug 1528374 - Add a simple script to wrap mozinstall. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D20408

--HG--
extra : moz-landing-system : lando
2019-12-16 22:05:32 +00:00
Oana Pop Rus
b49aefd3c9 Backed out 3 changesets (bug 1528374) for build bustages failures during artifact upload: file-missing-on-worker: Could not read directory /Users/task_1576213467/artifacts on a CLOSED TREE
Backed out changeset 3c2a1cf616b4 (bug 1528374)
Backed out changeset 967d0072cd2f (bug 1528374)
Backed out changeset 0d0186ecd70e (bug 1528374)
2019-12-16 23:50:45 +02:00
Chris Manchester
5ae641c13d Bug 1528374 - Add a simple script to wrap mozinstall. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D20408

--HG--
extra : moz-landing-system : lando
2019-12-13 05:43:44 +00:00
J.C. Jones
942507de3e Bug 1594931 - Stop compiling NSS' DBM legacy database r=kjacobs,keeler,mhowell,MattN
This change modifies all tests that use key3/cert8 to use the new files. It
removes test_sdr_upgraded_with_password, as without the upgrade part that is now
the same test as test_sdr_preexisting_with_password.

Differential Revision: https://phabricator.services.mozilla.com/D55708

--HG--
rename : security/manager/ssl/tests/unit/test_sdr_preexisting/key4.db => security/manager/ssl/tests/unit/test_broken_fips/key4.db
extra : moz-landing-system : lando
2019-12-16 17:35:49 +00:00
Csoregi Natalia
5f6f55422f Backed out changeset 5c137b3793a7 (bug 1594931) for failures on test_sdr_preexisting.js. CLOSED TREE
--HG--
rename : security/manager/ssl/tests/unit/test_broken_fips/key4.db => security/manager/ssl/tests/unit/test_sdr_preexisting/key4.db
2019-12-16 18:52:41 +02:00
J.C. Jones
4916451c01 Bug 1594931 - Stop compiling NSS' DBM legacy database r=kjacobs,keeler,mhowell,MattN
This change modifies all tests that use key3/cert8 to use the new files. It
removes test_sdr_upgraded_with_password, as without the upgrade part that is now
the same test as test_sdr_preexisting_with_password.

Differential Revision: https://phabricator.services.mozilla.com/D55708

--HG--
rename : security/manager/ssl/tests/unit/test_sdr_preexisting/key4.db => security/manager/ssl/tests/unit/test_broken_fips/key4.db
extra : moz-landing-system : lando
2019-12-14 18:52:26 +00:00
Ricky Stewart
479b38bcac Bug 1603262 - mozbuild/makeutil.py and mozbuild/test_makeutil.py support python3 r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D56968

--HG--
extra : moz-landing-system : lando
2019-12-13 20:49:13 +00:00
Andreea Pavel
1adff31cb1 Backed out changeset 7d55de92c194 (bug 1594931) for failing xpcshell at test_sdr_preexisting.js on a CLOSED TREE
--HG--
rename : security/manager/ssl/tests/unit/test_broken_fips/key4.db => security/manager/ssl/tests/unit/test_sdr_preexisting/key4.db
2019-12-13 22:48:02 +02:00
J.C. Jones
515c7f644c Bug 1594931 - Stop compiling NSS' DBM legacy database r=kjacobs,keeler,mhowell,MattN
This change removes the legacy libnssdbm database that we migrated away from since Firefox 60.

This change modifies all tests that use key3/cert8 to use the new files. It
removes test_sdr_upgraded_with_password, as without the upgrade part that is now
the same test as test_sdr_preexisting_with_password. It otherwise removes support for libnssdbm everywhere in Gecko.

Differential Revision: https://phabricator.services.mozilla.com/D55708

--HG--
rename : security/manager/ssl/tests/unit/test_sdr_preexisting/key4.db => security/manager/ssl/tests/unit/test_broken_fips/key4.db
extra : moz-landing-system : lando
2019-12-13 19:00:35 +00:00
Eric Rahm
6c0b70d6d9 Bug 1594344 - Part 3: Use new dump_syms in automation. r=froydnj
This optionally uses the rust-based `dump_syms` toolchain if it has been
installed, otherwise it uses the locally built version.

Differential Revision: https://phabricator.services.mozilla.com/D53320

--HG--
extra : moz-landing-system : lando
2019-12-13 10:28:13 +00:00
Noemi Erli
24e02f049b Backed out 3 changesets (bug 1528374) per tomprice's request for breaking macOS signing jobs CLOSED TREE
Backed out changeset 5a6fa3b5123b (bug 1528374)
Backed out changeset 32f3b1b3fe3b (bug 1528374)
Backed out changeset a412a319534c (bug 1528374)
2019-12-13 06:48:05 +02:00
Chris Manchester
358028ed9e Bug 1528374 - Add a simple script to wrap mozinstall. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D20408

--HG--
extra : moz-landing-system : lando
2019-12-12 01:23:33 +00:00
Masatoshi Kimura
7276b36871 Bug 1590693 - Unship empty chrome.manifest files. r=glandium
Bug 1295542 added empty chrome.manifest files to prevent malware from abusing
them. This workaround is no longer necessary because Firefox stopped reading
chrome.manifest outside omni.ja since bug 1543761.

Differential Revision: https://phabricator.services.mozilla.com/D55954

--HG--
extra : moz-landing-system : lando
2019-12-12 11:13:42 +00:00
Chris Manchester
b98761748c Bug 1603300 - Fix regex in test_toolchain_helpers. r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D56828

--HG--
extra : moz-landing-system : lando
2019-12-12 01:42:38 +00:00
Coroiu Cristina
37bd29f93c Backed out changeset 5b1c7a3bd4b2 (bug 1603300) for flake failure at mozbuild/test/configure/test_toolchain_helpers.py
--HG--
extra : amend_source : 97d3600c2c14d18b21d9ac45ac98d3bc3a872e88
2019-12-12 03:31:15 +02:00
Chris Manchester
8f2f5c50d4 Bug 1603300 - Fix regex in test_toolchain_helpers. r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D56828

--HG--
extra : moz-landing-system : lando
2019-12-12 01:17:01 +00:00
Ricky Stewart
8125df23f2 Bug 1603181 - mozbuild/preprocessor.py and test_preprocessor.py support Python3 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D56808

--HG--
extra : moz-landing-system : lando
2019-12-12 00:13:25 +00:00
Ricky Stewart
e642c8a1b2 Bug 1602961 - ./mach clobber gradle should clean up $topobjdir/gradle r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D56638

--HG--
extra : moz-landing-system : lando
2019-12-11 21:23:22 +00:00
Māris Fogels
030fc0897c Bug 1590745 - Make the $PYTHON3 build var use a virtualenv r=mshal
Make the $PYTHON3 build var point to a full virtualenv bootstrapped with
the same libraries as the $PYTHON Python 2 build var. This allows us to
upgrade build tasks from $PYTHON to $PYTHON3.

This patch adds some debug logging and documentation to the Python
2 virtualenv so that it is easier to diagnose issues that may arise
from running two different Python interpreters in re-entrant
multiprocess routines.

Differential Revision: https://phabricator.services.mozilla.com/D50819

--HG--
extra : moz-landing-system : lando
2019-12-03 18:49:06 +00:00
Ricky Stewart
d43df94c5e Bug 1601753 - ./mach build does not build WASM_LIBRARY by default r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D56092

--HG--
extra : moz-landing-system : lando
2019-12-10 15:48:38 +00:00
Ricky Stewart
2a74ae61fc Bug 1602525 - mozpack/archive.py and mozpack/test_archive.py support python3 r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D56419

--HG--
extra : moz-landing-system : lando
2019-12-09 22:09:54 +00:00
Dorel Luca
682cfaa718 Backed out 3 changesets (bug 1594344) for Decision task failure on taskcluster/ci/toolchain/rust-size.yml. CLOSED TREE
Backed out changeset 3208e2b16458 (bug 1594344)
Backed out changeset 57b641bb4d4b (bug 1594344)
Backed out changeset 36458762149d (bug 1594344)

--HG--
rename : taskcluster/ci/toolchain/dump-syms.yml => taskcluster/ci/toolchain/rust-size.yml
rename : taskcluster/scripts/misc/build-dump-syms.sh => taskcluster/scripts/misc/build-rust-size.sh
2019-12-10 15:59:12 +02:00
Eric Rahm
cb21b61e01 Bug 1594344 - Part 3: Use new dump_syms in automation. r=froydnj
This optionally uses the rust-based `dump_syms` toolchain if it has been
installed, otherwise it uses the locally built version.

Differential Revision: https://phabricator.services.mozilla.com/D53320

--HG--
extra : moz-landing-system : lando
2019-12-10 13:37:45 +00:00
Mike Shal
580f0c293f Bug 1557788 - Remove OBJS_VAR_SUFFIX & .i_o suffix for instrumented builds; r=firefox-build-system-reviewers,chmanchester
In 1-tier PGO builds that shared the objdir between the instrumented and
profile-use builds, the instrumented build objects used a different
suffix (.i_o) to separate them from the profile-use build (which uses
the default .o suffix). These builds are now always in separate objdirs,
and don't need special suffix rules anymore.

As a bonus, this helps fix an issue with buildid.cpp continually
rebuilding because libxul_so.list always lists the inputs as *.o, which
don't exist if we're using a .i_o suffix. Make would always re-create
buildid.cpp and therefore libxul.so in the instrumented build even when
nothing has changed.

Differential Revision: https://phabricator.services.mozilla.com/D56115

--HG--
extra : moz-landing-system : lando
2019-12-09 18:03:49 +00:00
Andrew Halberstadt
4cd0658446 Bug 1464038 - Update virtualenv to version 16.7.8 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D56229

--HG--
rename : third_party/python/virtualenv/tests/__init__.py => third_party/python/virtualenv/docs/changelog/.gitkeep
rename : third_party/python/virtualenv/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl => third_party/python/virtualenv/tests/old-wheels/pip-9.0.1-py2.py3-none-any.whl
rename : third_party/python/virtualenv/virtualenv_support/setuptools-36.8.0-py2.py3-none-any.whl => third_party/python/virtualenv/tests/old-wheels/setuptools-30.4.0-py2.py3-none-any.whl
rename : third_party/python/virtualenv/virtualenv_support/setuptools-39.0.1-py2.py3-none-any.whl => third_party/python/virtualenv/virtualenv_support/setuptools-41.6.0-py2.py3-none-any.whl
extra : moz-landing-system : lando
2019-12-09 15:45:24 +00:00
Ted Campbell
04d3467fd8 Bug 1602228 - Support ./mach run for application=js builds r=froydnj
Allow running the jsshell using ./mach run. This copies the debugger
parameter handling from desktop configurations.

Differential Revision: https://phabricator.services.mozilla.com/D56296

--HG--
extra : moz-landing-system : lando
2019-12-09 14:55:35 +00:00