Commit Graph
7 Commits
Author SHA1 Message Date
Mitchell Hentges 46dbb54a12 Bug 1713377: Change vendoring to use wheels where possible r=ahal,glandium
Vendoring wheels has three benefits:
* There's far less files, so Firefox checkouts will be smaller.
* It works around `zipp` not allowing `pip install`
  from extracted source `tar.gz` files. Now, we should
  be able to use the pip resolver against vendored
  packages, which will be needed for future
  mach virtualenv work.
* `./mach vendor python` takes far less time to execute.

Since we need the raw Python to be available to add to the `sys.path`,
we extract the wheels before putting them in tree.
Due to the structure of some wheels being less nested
than of a source `tar.gz`, `common_virtualenv_packages`
needed to be adjusted accordingly.

`install_pip_package()` had to be tweaked as well since you can't
`pip install` an extracted wheel. So, we "re-bundle" the wheel
before installing from a vendored package.

Replace python packages with wheels where possible

This contains the vendoring changes caused by the
last patch.

For reviewing, there's a couple things to note:
* A bunch of files are deleted, since there's generally
  less files in a wheel than in a source archive.
* There's a new `.dist-info` directory for each
  extracted wheel, so expect roughly 5 or
  6 new files for each wheel'd package.
* There should be no source code changes other than
  moves from package names changing from having
  `-` to having `_`.

Differential Revision: https://phabricator.services.mozilla.com/D116512
2021-06-16 15:53:16 +00:00
Alessio Placitelli bc775b3390 Bug 1619555 - Add the missing sources to vendored python libs. r=ahal
The vendored packaged were fetched using vanilla "pip download", which downloads
wheel files by default (missing LICENSE, setup.py, etc.). This changeset was
created by downloading the "glean_parser" dependencies using "pip download
--no-binary :all:" which is the same thing that "mach vendor python" does.
It additionally removes all the /tests and /docs directories of the vendored
dependencies.

Differential Revision: https://phabricator.services.mozilla.com/D65171
2020-03-11 15:27:21 +00:00
Alessio Placitelli 49c243a544 Bug 1602773 - Vendor glean_parser and its dependencies. r=ahal CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D64313
2020-03-02 15:34:05 +00:00
Mihai Alexandru Michis 231202de17 Backed out 3 changesets (bug 1602773) for causing lint failures.
CLOSED TREE

Backed out changeset 01548614184b (bug 1602773)
Backed out changeset 430c8e6b0c5a (bug 1602773)
Backed out changeset 1b4e2b044fcd (bug 1602773)
2020-03-02 18:29:16 +02:00
Alessio Placitelli 17a9710ccb Bug 1602773 - Vendor glean_parser and its dependencies. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D64313
2020-03-02 15:34:05 +00:00
Noemi Erli 10a931be3f Backed out 3 changesets (bug 1602773) for causing build bustages CLOSED TREE
Backed out changeset 32cc140d3bde (bug 1602773)
Backed out changeset 8d19f60fd6f8 (bug 1602773)
Backed out changeset f42ff169813d (bug 1602773)
2020-02-28 17:52:32 +02:00
Alessio Placitelli 5e5dfa9801 Bug 1602773 - Vendor glean_parser and its dependencies. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D64313
2020-02-28 15:06:43 +00:00