Commit Graph

79 Commits

Author SHA1 Message Date
Mike Hommey
9c03a7015d Bug 1632348 - Convert mach artifact to python 3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72114
2020-04-26 21:53:57 +00:00
Noemi Erli
7f6a7f8cf2 Backed out changeset 90bd5342c58f (bug 1632348) for causing toolchains bustage 2020-04-26 02:37:07 +03:00
Mike Hommey
568944c117 Bug 1632348 - Convert mach artifact to python 3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72114
2020-04-24 20:51:24 +00:00
Mike Hommey
5e8b3e9559 Bug 1632353 - Convert mach resource-usage to python3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72117
2020-04-23 22:56:37 +00:00
Mike Hommey
55f5d3fe7a Bug 1632354 - Switch a few mach commands to python 3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72087
2020-04-23 21:30:39 +00:00
Ricky Stewart
2fdf5b0a0a Bug 1617748 - Run ./mach build, ./mach build-backend, ./mach configure with Python 3 r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D66107

--HG--
extra : moz-landing-system : lando
2020-04-04 20:38:01 +00:00
Stefan Hindli
ee18f66aca Backed out 3 changesets (bug 1625014, bug 1617748, bug 1623701) for causing linting failure CLOSED TREE
Backed out changeset e62f3effd132 (bug 1617748)
Backed out changeset 14968570b2f5 (bug 1623701)
Backed out changeset 60ac25427773 (bug 1625014)
2020-03-26 17:13:39 +02:00
Ricky Stewart
c8523eaadb Bug 1617748 - Run ./mach build, ./mach build-backend, ./mach configure with Python 3 r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D66107

--HG--
extra : moz-landing-system : lando
2020-03-25 22:05:06 +00:00
Coroiu Cristina
8df06c6842 Backed out 2 changesets (bug 1617748, bug 1623701) on request by dev
Backed out changeset 547716d123e2 (bug 1617748)
Backed out changeset dc80296ade17 (bug 1623701)
2020-03-26 00:01:03 +02:00
Ricky Stewart
b9a1da8820 Bug 1617748 - Run ./mach build, ./mach build-backend, ./mach configure with Python 3 r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D66107

--HG--
extra : moz-landing-system : lando
2020-03-20 19:13:02 +00:00
Ricky Stewart
c1c042cab7 Bug 1623765 - mach watch supports Python 3 r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D67927

--HG--
extra : moz-landing-system : lando
2020-03-23 21:34:16 +00:00
William Lachance
5c5eb36533 Bug 1616584 - Run mach mozregression with Python 3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D67555

--HG--
extra : moz-landing-system : lando
2020-03-20 19:12:51 +00:00
Kartikaya Gupta
8881acea8d Bug 1621718 - Use proper email parsing library for parsing patches. r=ahal
This uses the `email` module to parse the .patch file that Github generates,
so that it properly decodes encoded-words in the headers. Also using this
module is better with python3, so this patch also takes the command off the
python2 whitelist and makes it python3-compatible.

Differential Revision: https://phabricator.services.mozilla.com/D66621

--HG--
extra : moz-landing-system : lando
2020-03-16 19:46:13 +00:00
Bogdan Tara
d64fc8c8c9 Backed out changeset 5eb9dee1b6f2 (bug 1617748) for hazard bustages CLOSED TREE 2020-03-13 00:52:12 +02:00
Ricky Stewart
1a53b93361 Bug 1617748 - Run ./mach build, ./mach build-backend, ./mach configure with Python 3 r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D66107

--HG--
extra : moz-landing-system : lando
2020-03-12 22:34:19 +00:00
Steve Fink
4efc95ae8c Bug 1619475 - partial Python 3 compatibility for jit-tests and jstests r=arai
This fixes all of the jit-test problems I encountered, and fixes all but the wpt portion of jstests. This is unnecessary, but it also ports jstests from optparse to argparse (because optparse is deprecated, because I like argparse better, and because it happened to fix the minor compatibility issue I ran into even though it has a trivial fix on its own.)

Differential Revision: https://phabricator.services.mozilla.com/D65047

--HG--
extra : moz-landing-system : lando
2020-03-06 18:07:38 +00:00
Divya Rani
427ae6c5f6 Bug 1619280 - Port warnings-summary [mach] to Python 3.r=championshuttler,firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D64951

--HG--
extra : moz-landing-system : lando
2020-03-03 19:18:52 +00:00
Steve Fink
6c335b53f8 Bug 1614518 - Implement mach hazards command set for running the GC rooting hazard analysis. r=ahal,jonco,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D62384

--HG--
extra : moz-landing-system : lando
2020-02-20 18:27:50 +00:00
Hamzah
3464fec8e5 Bug 1615423 - Run ./mach busted with Python 3, DONTBUILD r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D62823

--HG--
extra : moz-landing-system : lando
2020-02-19 14:57:36 +00:00
Hamzah
becd55c159 Bug 1614771 - Run ./mach addtest with Python 3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D62541

--HG--
extra : moz-landing-system : lando
2020-02-13 16:56:44 +00:00
Axel Hecht
7633ad1e18 Bug 1612579, use python3 for fluent-migration-test r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D62020

--HG--
extra : moz-landing-system : lando
2020-02-07 19:18:59 +00:00
Ricky Stewart
d259591a1c Bug 1569059 - Run 'mach bootstrap' with Python 3 r=firefox-build-system-reviewers,mshal,Callek
Differential Revision: https://phabricator.services.mozilla.com/D60898

--HG--
extra : moz-landing-system : lando
2020-02-07 18:12:23 +00:00
Sylvestre Ledru
41312ab8df Bug 1601578 - mach - doc environment with python 3 r=ahal,firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D55937

--HG--
extra : moz-landing-system : lando
2019-12-17 19:17:43 +00:00
Razvan Maries
c98dba73a9 Backed out 5 changesets (bug 1601612, bug 1601578) for Lint failure. CLOSED TREE
Backed out changeset c5b62adb19f1 (bug 1601612)
Backed out changeset 67431d96c78f (bug 1601612)
Backed out changeset 22099810071a (bug 1601612)
Backed out changeset 457049dcb9b4 (bug 1601612)
Backed out changeset 45277ab0d639 (bug 1601578)
2019-12-17 09:49:51 +02:00
Sylvestre Ledru
e945783c5b Bug 1601578 - mach - doc environment with python 3 r=ahal,firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D55937

--HG--
extra : moz-landing-system : lando
2019-12-17 01:30:41 +00:00
Kris Maglione
84a0be4145 Bug 1581684: Make sure ./mach mach-completion <command> uses the correct Python. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D46098

--HG--
extra : moz-landing-system : lando
2019-12-09 19:41:01 +00:00
James Graham
d13deb4671 Bug 1600695, Add mach wpt-test-paths command, r=dheiberg
This command takes a list of test ids and returns the list of test
files that correspond to those test ids. The mapping is one-to-many
between files and test ids i.e. a single file can generate many tests.

Differential Revision: https://phabricator.services.mozilla.com/D56192

--HG--
extra : moz-landing-system : lando
2019-12-09 10:46:50 +00:00
Edwin Takahashi
79d87a899e Bug 1598839 - run mach environment with python3 r=ahal
Changes:

Remove `environment` from the python3 blacklist.

Remove the option to specify `configure` for the formatting argument, since it has never been supported (the method has never been implemented).

Differential Revision: https://phabricator.services.mozilla.com/D54395

--HG--
extra : moz-landing-system : lando
2019-11-25 18:27:28 +00:00
Edwin Takahashi
b66e852ab2 Bug 1592855 - run mach vendor python with python3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D51414

--HG--
extra : moz-landing-system : lando
2019-11-05 15:29:44 +00:00
Edwin Takahashi
072601476a Bug 1591220 - migrate python-safety to run with python3 by default r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D51184

--HG--
extra : moz-landing-system : lando
2019-11-04 21:55:21 +00:00
Ted Campbell
cabef1d645 Bug 1593486 - Add ./mach jit-test command r=sfink,froydnj
This allows running the jit_test.py harness using mach. It works very
similarly to the existing 'mach jstests' command.

Differential Revision: https://phabricator.services.mozilla.com/D51518

--HG--
extra : moz-landing-system : lando
2019-11-04 19:46:43 +00:00
Edwin Takahashi
8eb4f8e716 Bug 1581224 - convert mach uuid to be compatible with both python2/3 r=Callek
Changes:
- remove `uuid` from the python3 blacklist in `mach`
- enable `test_telemetry.py` for python3
- adjust test outcome expectation for Windows + python3, suspect `mozpack.path` is not filtering Windows path correctly in python3 environment
- switch file read mode between `r` and `rb` depending on version of python

Differential Revision: https://phabricator.services.mozilla.com/D45903

--HG--
extra : moz-landing-system : lando
2019-10-21 16:33:00 +00:00
Edwin Takahashi
3d4f9b4d8c Bug 1581015 - convert vcs-setup to run with python3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D45817

--HG--
extra : moz-landing-system : lando
2019-09-19 15:11:20 +00:00
Axel Hecht
a335900e65 Bug 1578348, drop compare-locales from the mach python2 list, r=Callek,ahal
Also enable running mach from the obj dir in a py3 world.

Differential Revision: https://phabricator.services.mozilla.com/D44439

--HG--
extra : moz-landing-system : lando
2019-10-08 13:58:33 +00:00
Andrew Halberstadt
8336574b61 Bug 1584567 - Merge desktop + android commands (run and install) back together, r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D47626

--HG--
extra : moz-landing-system : lando
2019-09-30 16:59:27 +00:00
Andrew Halberstadt
d3eae4b83c Bug 1580280 - [mozlint] Run |mach lint| with Python 3 and drop support for Python 2 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D45441

--HG--
extra : moz-landing-system : lando
2019-09-30 15:09:41 +00:00
Oana Pop Rus
4b9792db7c Backed out changeset 371641b1010b (bug 1580280) for lints failure on a CLOSED TREE 2019-09-26 00:18:33 +03:00
Andrew Halberstadt
fdc7d0afac Bug 1580280 - [mozlint] Run |mach lint| with Python 3 and drop support for Python 2 r=mars
Differential Revision: https://phabricator.services.mozilla.com/D45441

--HG--
extra : moz-landing-system : lando
2019-09-25 20:03:14 +00:00
championshuttler
a19f899a6f Bug 1580492 - Run mach 'core' commands with Python 3. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D45694

--HG--
extra : moz-landing-system : lando
2019-09-12 20:26:45 +00:00
Andrew Halberstadt
23aca97aa6 Bug 1577501 - [mach] Make sure ./mach help <command> uses the correct Python, r=glandium
Some commands use external argument parsers, so invoking |mach help <command>| will import
external modules (which may only be Python 2 compatible).

This makes sure that we detect the actual subcommand we're generating help for
and use the proper Python.

A much simpler solution would have been to run |mach help| with Python 2 all
the time. However, as we convert things to Python 3 this would have meant that
Python 3 only code would blow up. This would have forced us to continue
supporting Python 2, even for Python 3-only commands.

Differential Revision: https://phabricator.services.mozilla.com/D43989

--HG--
extra : moz-landing-system : lando
2019-09-03 00:39:22 +00:00
Edwin Gao
a0497df342 Bug 1577603 - convert mach clobber to run with python 3.5 r=nalexander
Changes:
- remove binary encoding when the subdirectories are being collected
- do not open file in binary mode when reading from `telemetry_client_id.json`

Differential Revision: https://phabricator.services.mozilla.com/D44057

--HG--
extra : moz-landing-system : lando
2019-08-30 17:25:47 +00:00
Andrew Halberstadt
77e2553e92 Bug 1555762 - [mach] Get SearchProvider commands to run with Python 3 r=Callek
This includes the following commands:
* dxr
* google
* mdn
* search
* searchfox

Differential Revision: https://phabricator.services.mozilla.com/D36843

--HG--
extra : moz-landing-system : lando
2019-08-26 14:01:32 +00:00
Andrew Halberstadt
333ffc4bcf Bug 1473498 - [mach] Support running mach commands with python 3 r=glandium,mars
Credit: mars for making the shell POSIX compliant

This embeds a blacklist of every mach command that needs to run with Python 2
directly in the mach driver itself. Initially this is every mach command. We
then use a bit of shell to determine whether the command being run needs Python
2 or 3.

While this approach may seem a bit hacky, it has several benefits:

1. No need to add complex machinery in mach's registration code.
2. No need to spawn two separate Python interpreters in the event a different
   Python from the original interpreter is needed.
3. Perf impact is negligible.
4. New commands are Python 3 by default.

It is also only a temporary hack. Once all commands are running with Python 3,
we can revert back to the original mach driver.

Differential Revision: https://phabricator.services.mozilla.com/D36103

--HG--
extra : moz-landing-system : lando
2019-08-27 03:08:08 +00:00
Chris Manchester
2d2292267f Bug 1316140 - Allow use of multiprocessing from config.status on windows. r=mshal
This generalizes the monkey-patching of the main module added
in bug 914563 to allow multiprocessing to be used from config.status
(which triggers the same bug as when it's used with `mach` as main).

MozReview-Commit-ID: AdOdpKzmbsp
2016-12-21 16:28:28 -08:00
Andrew Halberstadt
21bb6ea0b7 Bug 1279020 - [mach] Follow symlinked mach binary when searching for a srcdir, r=gps
The mach binary needs to find a srcdir (or test zip) to operator on. As a last resort,
it checks the directory containing the binary itself. If the binary has been symlinked
to say, $HOME/bin, it won't follow the symlink to the proper location, and the check
will fail.

Fixing this means developers can run `mach` from outside of the srcdir, as the symlink
will be followed to the actual srcdir. The motivation for this is actually to improve
the UX of debugging failures on interactive workers. With this fix, we can provide
developers with a mach environment directly from $HOME without them needing to go
find it.

MozReview-Commit-ID: ZEH8MuyKv

--HG--
extra : rebase_source : 2b5adbad1b5261f2268f6a30e7dd884d7820da5e
2016-06-09 17:20:02 -04:00
Andrew Halberstadt
b5b5de46a4 Bug 1278900 - [mach] Also look for config.status when detecting an objdir, r=gps
Currently the mach binary will look for 'mozinfo.json' and if it finds it assume
we are in an objdir. But now, 'mozinfo.json' can also be found in an extracted
tests.zip (depending which zips were used). This trips up the tests.zip mach
environment and causes some problems.

This works around the issue by looking for both 'mozinfo.json' and 'config.status'

MozReview-Commit-ID: BIXcCm4LzE2

--HG--
extra : rebase_source : 6e2dc0502de1cddec8eccdfe30524864be81536c
2016-06-08 10:33:54 -04:00
Andrew Halberstadt
6a55c03d43 Bug 1058923 - Package mach in tests.zip; create bootstrap script for test package, r=gps
--HG--
extra : rebase_source : 9f988171182a0abd54724e0cc2906fe678da318f
extra : source : 7923a0c837b56efcd1376b95318fe4cdce03d5e8
2015-05-01 12:20:55 -04:00
Ehsan Akhgari
3e88d83106 Bug 892973 - Add support for the YouCompleteMe vim plugin; r=gps 2015-04-27 13:08:43 -04:00
Gregory Szorc
2949694ec0 Bug 1043144 - Don't write machc bytecode file; r=mshal
When writing bytecode, Python will append "c" to the loaded filename to
produce a bytecode file. Since "mach" was being imported, this resulted
in the creation of a "machc" file.

The implementation of imp.load_module() in CPython's import.c checks
sys.dont_write_bytecode. So, we wrap imp.load_module to set this flag
when importing mach.

--HG--
extra : rebase_source : 248a2349663affee3920a0726e10818d57c6ff17
extra : amend_source : 221280da9963cf91975658144ff3011353852fee
2014-08-05 10:39:24 -07:00
Mike Shal
74972b4fdc Bug 914563 - re-enable build resource recording on Windows; r=gps 2014-07-15 13:59:10 -04:00