Commit Graph
183 Commits
Author SHA1 Message Date
serge-sans-paille e5d1464a79 Bug 1885183 - Properly vendor mako r=emilio,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D204532
2024-03-13 21:25:08 +00:00
Jan-Erik Rediger c06db9f6de Bug 1884881 - Update Glean to v58.1.0. r=perry.mcmanis,supply-chain-reviewers,mach-reviewers
Depends on D204347

Differential Revision: https://phabricator.services.mozilla.com/D204348
2024-03-12 21:02:40 +00:00
Sylvestre Ledru 3796b461e3 Bug 1828390 - doc: upgrade to myst-parser 2.0 (fixes link issues) r=firefox-source-docs-reviewers,championshuttler DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D204334
2024-03-12 12:06:23 +00:00
Chris H-C 643e12fdb8 Bug 1882615 - Vendor Glean SDK to v58.0.0 r=perry.mcmanis,supply-chain-reviewers,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D203187
2024-03-01 15:13:21 +00:00
Travis Long 8a9f6f6a69 Bug 1879857 - Update Glean to v57.0.0. r=chutten,supply-chain-reviewers,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D201621
2024-02-13 20:47:02 +00:00
Andrew Halberstadt 28db412cd3 Bug 1752677 - Add a task config to set the 'existing_tasks' parameter, r=releng-reviewers,bhearsum,jcristau
This adds the `-E/--use-existing-tasks` flag to the `fuzzy` or `chooser`
selectors. For example:

  ./mach try fuzzy -E

This queries the Treeherder API to find your latest try push, then any tasks
that exist on that push, but aren't explicitly selected this time, will be
replaced with those older tasks.

You can also run:

  ./mach try fuzzy -E task-id=<task id>

Where `<task id>` is the id of the Decision task from the push you would like
to use as the base.

Differential Revision: https://phabricator.services.mozilla.com/D200380
2024-02-03 02:29:38 +00:00
Cristian Tuns 30405970ad Backed out changeset 1ddc1733cf76 (bug 1752677) for causing python mach failures on mac CLOSED TREE 2024-02-02 12:09:59 -05:00
Andrew Halberstadt 65f169a61f Bug 1752677 - Add a task config to set the 'existing_tasks' parameter, r=releng-reviewers,bhearsum,jcristau
This adds the `-E/--use-existing-tasks` flag to the `fuzzy` or `chooser`
selectors. For example:

  ./mach try fuzzy -E

This queries the Treeherder API to find your latest try push, then any tasks
that exist on that push, but aren't explicitly selected this time, will be
replaced with those older tasks.

You can also run:

  ./mach try fuzzy -E task-id=<task id>

Where `<task id>` is the id of the Decision task from the push you would like
to use as the base.

Differential Revision: https://phabricator.services.mozilla.com/D200380
2024-02-02 16:45:55 +00:00
Tom Marble 9862fcd8e7 Bug 1877537 - Update tomlkit to 0.12.3 and mozci to 2.4.0 r=jmaher,mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D200114
2024-01-31 18:57:03 +00:00
Perry McManis 8e68e94339 Bug 1874923 - Update Glean to 56.1.0 r=janerik,supply-chain-reviewers,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D199093
2024-01-22 15:45:27 +00:00
Mike Hommey bc44b0df20 Bug 1874758 - Upgrade boto3 to latest version for upload-generated-sources. r=firefox-build-system-reviewers,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D198640
2024-01-16 04:38:51 +00:00
Tom Marble d2ec27a41a Bug 1682371 - mach skipfails part 3: complete editing manifest r=jmaher,mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D195892
2023-12-22 14:35:14 +00:00
Mike Hommey 2f82879d0f Bug 1860630 - Upgrade zstandard to 0.22. r=firefox-build-system-reviewers,mach-reviewers,sergesanspaille,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D194184
2023-12-13 02:39:24 +00:00
Noemi Erli 8c536d621c Backed out changeset 83540e45dfb8 (bug 1860630) for causing mach related bustage 2023-12-12 23:00:01 +02:00
Mike Hommey 04ead7cd7c Bug 1860630 - Upgrade zstandard to 0.22. r=glandium CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D194184
2023-12-12 20:11:48 +00:00
Ben Dean-Kawamura 79578ec640 Bug 1867639 - Vendor in new application-services / Glean / UniFFI. r=markh,janerik,supply-chain-reviewers,mach-reviewers,ahal
Updated uniffi-bindgen-gecko-js to work with UniFFI 0.25.2:
- Use `config.toml` to list UniFFI sources.  This makes it easier to
  associate data with them, for example the `crate_name` field that's
  now required to generate the sources.
- Enable the `extern-rustbuffer` feature on `uniffi_core`
- Updated the external types fixture to work around
  https://github.com/mozilla/uniffi-rs/issues/1872

Ran mach vendor and mach cargo vet to update the Rust crates.

Differential Revision: https://phabricator.services.mozilla.com/D195163
2023-12-12 14:13:44 +00:00
ahochheiden a7c29534e9 Bug 1843209 - Regenerate the third_party/python lockfile with Python 3.8 as the minimum version r=firefox-build-system-reviewers,glandium,mach-reviewers,ahal
If this is not done, the next person to vendor will also make all of the changes in this commit, which is unnecessary noise.

Differential Revision: https://phabricator.services.mozilla.com/D183450
2023-12-12 03:52:01 +00:00
Narcis Beleuzu 49e6a6d3dc Backed out 2 changesets (bug 1867639) for causing WR bustages
Backed out changeset b77038bd9fee (bug 1867639)
Backed out changeset cf885f915fdf (bug 1867639)
2023-12-05 22:35:09 +02:00
Ben Dean-Kawamura 870b3b7ccc Bug 1867639 - Vendor in new application-services / Glean / UniFFI. r=markh,janerik,supply-chain-reviewers,mach-reviewers,ahal
Updated uniffi-bindgen-gecko-js to work with UniFFI 0.25.2:
- Use `config.toml` to list UniFFI sources.  This makes it easier to
  associate data with them, for example the `crate_name` field that's
  now required to generate the sources.
- Enable the `extern-rustbuffer` feature on `uniffi_core`
- Updated the external types fixture to work around
  https://github.com/mozilla/uniffi-rs/issues/1872

Ran mach vendor and mach cargo vet to update the Rust crates.

Differential Revision: https://phabricator.services.mozilla.com/D195163
2023-12-05 19:55:30 +00:00
Andrew Halberstadt 8d7924010f Bug 1854327 - [docs] Upgrade Sphinx==6.2.1 + other dependencies, r=firefox-source-docs-reviewers,mach-reviewers,sylvestre,championshuttler,ahochheiden
Also remove dependencies that we don't depend on directly. I assume these were
previously added to get a lockfile of sorts, but maintaining our dependencies'
dependencies manually is an excercise in futility.

Let's forget about locking, and if it becomes a problem implement locking into
mach's sites logic.

Differential Revision: https://phabricator.services.mozilla.com/D195300
2023-12-04 21:26:17 +00:00
Andrew Halberstadt ada279d7cb Bug 1867848 - [docs] Stop processing Markdown frontmatter, r=firefox-source-docs-reviewers,necko-reviewers,mach-reviewers,championshuttler,valentin,sylvestre,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D195284
2023-12-04 21:26:13 +00:00
Noemi Erli 36ac1fc131 Backed out 2 changesets (bug 1867639) for causing wrench bustages CLOSED TREE
Backed out changeset 014768de11ca (bug 1867639)
Backed out changeset 375a5bb63fa7 (bug 1867639)
2023-12-01 23:21:07 +02:00
Ben Dean-Kawamura e3f087b56c Bug 1867639 - Vendor in new application-services / Glean / UniFFI. r=markh,janerik,supply-chain-reviewers,mach-reviewers,ahal
Updated uniffi-bindgen-gecko-js to work with UniFFI 0.25.2:
- Use `config.toml` to list UniFFI sources.  This makes it easier to
  associate data with them, for example the `crate_name` field that's
  now required to generate the sources.
- Enable the `extern-rustbuffer` feature on `uniffi_core`
- Updated the external types fixture to work around
  https://github.com/mozilla/uniffi-rs/issues/1872

Ran mach vendor and mach cargo vet to update the Rust crates.

Differential Revision: https://phabricator.services.mozilla.com/D195163
2023-12-01 14:26:03 +00:00
Tom Marble 7a88122b46 Bug 1682371 - mach skipfails part 2: enable ci r=jmaher,mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D195017
2023-11-30 19:38:30 +00:00
Tom Marble 8514021d85 Bug 1682371 - mach skipfails part 1: add dependencies r=jmaher,mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D193150
2023-11-29 00:12:23 +00:00
Cosmin Sabou ef2484fe0d Backed out changeset 4c5b3ec73a9a (bug 1682371) for python related failures. CLOSED TREE 2023-11-28 01:20:46 +02:00
Tom Marble 023771f69a Bug 1682371 - mach skipfails part 1: add dependencies r=jmaher,mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D193150
2023-11-27 23:00:41 +00:00
Cosmin Sabou 4d28b93ff6 Backed out 2 changesets (bug 1843209) for python3 related browser accessible failures. CLOSED TREE
Backed out changeset 052214d67a99 (bug 1843209)
Backed out changeset 36c5e6c2819f (bug 1843209)
2023-11-23 02:41:22 +02:00
ahochheiden 6d5d8d77dd Bug 1843209 - Regenerate the third_party/python lockfile with Python 3.8 as the minimum version r=firefox-build-system-reviewers,glandium,mach-reviewers,ahal
If this is not done, the next person to vendor will also make all of the changes in this commit, which is unnecessary noise.

Differential Revision: https://phabricator.services.mozilla.com/D183450
2023-11-22 20:07:42 +00:00
James Graham ac02154157 Bug 1865606 - Update ipython for mach python --ipython, r=mach-reviewers,ahal
This is the latest version that still support 3.7.x. The 8.x series initially requires 3.8 and later
3.9. We could perhaps update to a 3.8-requiring version since this isn't used anywhere in automation,
but this version is a conservative choice for now.

Differential Revision: https://phabricator.services.mozilla.com/D194052
2023-11-21 14:46:36 +00:00
Alexandra Borovova a436c61afa Bug 1863685 - Update pathes of h2, hpack, hyperframe packages and use vendored version of h2 for raptor and talos r=perftest-reviewers,mach-reviewers,jgraham,sparky
In the scope of the wptserve update (https://bugzilla.mozilla.org/show_bug.cgi?id=1862598), also h2, hpack, hyperframe packages got updated and changed their folder structure, which requires paths to be updated.

Differential Revision: https://phabricator.services.mozilla.com/D193908
2023-11-19 15:30:34 +00:00
Jan-Erik Rediger 9b7567a12f Bug 1860506 - Update to Glean v55 and glean_parser v10. r=TravisLong,supply-chain-reviewers,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D192960
2023-11-13 14:29:54 +00:00
Kagami Sascha Rosylight 0c9a556309 Bug 1861659 - Update to mots 0.10.0 r=zeid,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D192076
2023-10-27 17:11:17 +00:00
Mike Hommey 115ec173c0 Bug 1859997 - Switch manifestparser to toml instead of tomlkit. r=jmaher,ahal,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D191394
2023-10-26 07:30:55 +00:00
Cristina Horotan e638ce647a Backed out changeset e17da829b210 (bug 1859997) for causing mochitest failures at test_docload_shutdown.html on a CLOSED TREE 2023-10-26 08:59:31 +03:00
Mike Hommey 7c21a75bd7 Bug 1859997 - Switch manifestparser to toml instead of tomlkit. r=jmaher,ahal,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D191394
2023-10-25 20:54:17 +00:00
Butkovits Atila 095616554c Backed out changeset 7ff55ad72883 (bug 1859997) for causing python related mass failures. CLOSED TREE 2023-10-25 02:02:35 +03:00
Mike Hommey f2121c1af4 Bug 1859997 - Switch manifestparser to toml instead of tomlkit. r=jmaher,ahal,mach-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D191394
2023-10-24 21:36:23 +00:00
James Graham 7fe7d73f29 Bug 1852325 - Support calculating interop scores adjusted for expected failures, r=Sasha,mach-reviewers,ahal
Add an --expected-failures option to `mach wpt-inerop-score`. This
takes the path to a file which has the format:

\# Mark entire test as expected failure
/test/id.html
\# Mark one subtest as expected failure
/another/test/id.html,subtest name

The output is the actual interop score, plus two extra columns, one
giving the fraction of the score accounted for by expected failures,
and one giving the score after accounting for expected failures.

Differential Revision: https://phabricator.services.mozilla.com/D188729
2023-10-23 13:25:07 +00:00
Julien Cristau 19787dd229 Bug 1858455 - update vendored json-e to 4.5.3 r=mach-reviewers,releng-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D190700
2023-10-12 08:13:23 +00:00
Connor Sheehan 6c53680dc2 Bug 1835962: add support for mach try to submit to Lando r=zeid,mach-reviewers,ahochheiden
Add support for submitting stacks of commits to Lando for queueing
on Try, instead of pushing to hg.mozilla.org directly. This patch
implements the Device Code Authorization flow for Auth0, simple changeset
discovery and patch gathering, and submissing to Lando via HTTP POST.

Add a `try.txt` virtualenv site that contains packages from the common
virtualenv as well as the `auth0-python` package for verifying Auth0
JWTs. Use this new virtualenv for `mach try` and related subcommands.
Add a `--push-to-lando` flag that controls whether the push will be made
via the Lando API or using the VCS to hg.mozilla.org directly.

Create a `lando.py` module in the `tryselect` package that handles the
details around submitting to Lando. Authentication is handled by the
Device Code Authorization flow, and the returned access token is saved
to the mozbuild state directory. Auth0 details are added to the `.lando.ini`
file in the repo root, and a `LANDO_TRY_USE_DEV` environment variable can
be set to control submitting to the prod or dev Lando environments.
This module also includes patch stack gathering and discovery via `mozversioncontrol`.

mozversioncontrol's `Repository` subclass is extended with helper functions
to gather patch files from Mercurial and Git. We also add a `try_config_commit`
context manager that creates a temporary commit to hold try syntax commit
messages and/or a `try_task_config.json` file, which is removed from version
control on submission.

The `mach try` cram tests now use a separate virtualenv that must be built
before running, causing unexpected output in the tests. Run `mach try --help`
in the test setup to force the virtualenv to be built before running any
test.

`mach try chooser` would previously install packages for a small web application
from a `requirements.txt` file when run. Install these via the new `try.txt`
site environment instead. The required dependencies are also added to the
`python-test.txt` site since they will cause some tests to fail due to the
missing dependencies.

Differential Revision: https://phabricator.services.mozilla.com/D187641
2023-10-02 14:31:43 +00:00
ahochheiden 137cdeabce Bug 1855716 - Move jsonschema, pyrsistent, and pkgutil_resolve_name dependencies back into mach.txt instead of specifying them in individual sites r=mach-reviewers,ahal
D180501 made the original change that this patch undoes. An earlier
change in that stack inadvertently silently disabled Telemetry, which
hid this issue.

The problem is that `glean` (which we optionally install in the `mach`
site also needs `jsonschema` (and `jsonschema` depends on `pyrsistent`
and `pkgutil_resolve_name`). Since our vendored version was no longer
specified in the `mach.txt` site, it pulled a different version
(`4.19.1`) from the vendored version (`4.17.3`) which causes issues in
the `wpt` site.

Since glean explicitly needs `jsonschema` it never should have been
taken out of the `mach` site, so this patch corrects that mistake.

Differential Revision: https://phabricator.services.mozilla.com/D189553
2023-09-28 20:42:50 +00:00
Connor Sheehan fe70aea21e Bug 1854496: update vendored aiohttp/requests and add new dependencies r=firefox-build-system-reviewers,mach-reviewers,ahochheiden
Update `aiohttp` to version 3.8.5 and `requests` to version 2.31.0,
and vendor their respective dependencies. Add all the new dependencies
to the various required site virtualenv requirements files.

Differential Revision: https://phabricator.services.mozilla.com/D188904
2023-09-25 14:22:11 +00:00
Jan-Erik Rediger 082029bf3f Bug 1852921 - Upgrade to Glean v54.0.0 r=chutten,supply-chain-reviewers,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D188084
2023-09-19 08:18:12 +00:00
Sandor Molnar 08ea5603af Backed out changeset 1e582a0e5593 (bug 1852921) for causing build bustages 2023-09-19 01:43:08 +03:00
Jan-Erik Rediger c9de06e6a2 Bug 1852921 - Upgrade to Glean v54.0.0 r=chutten,supply-chain-reviewers,mach-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D188084
2023-09-18 14:09:18 +00:00
Logan Rosen 4a0f461ae4 Bug 1750450 - update to Sphinx 5.3.0 r=sylvestre,firefox-source-docs-reviewers DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D187860
2023-09-11 07:16:10 +00:00
Logan Rosen 673c4dae7f Bug 1786490 - remove references to vendored pyparsing r=sylvestre,mach-reviewers,ahal,ahochheiden
Not necessary because pyparsing is no longer a dependency of packaging, so it is no longer vendored.

Differential Revision: https://phabricator.services.mozilla.com/D186411
2023-09-06 16:14:30 +00:00
Travis Long 7ad961010b Bug 1626969 - Include locale in Glean pings.r=chutten,supply-chain-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D185153
2023-08-07 11:02:56 +00:00
Cristina Horotan 43aef254d9 Backed out changeset 672918ecc3bc (bug 1626969) for causing mach failures on a CLOSED TREE 2023-08-04 22:09:05 +03:00