Commit Graph
9364 Commits
Author SHA1 Message Date
Mike Hommey 1a0720f219 Bug 1903175 - Skip long pause at the end of mach try when using git. r=sheehan
Differential Revision: https://phabricator.services.mozilla.com/D214061
2024-06-18 07:23:38 +00:00
Norisz Fay efb37b410d Backed out changeset 97d38c9c9b5f (bug 1903175) for causing python failures on test_push_to_try.py CLOSED TREE 2024-06-18 08:49:46 +03:00
Mike Hommey 7508dd859c Bug 1903175 - Skip long pause at the end of mach try when using git. r=sheehan
Differential Revision: https://phabricator.services.mozilla.com/D214061
2024-06-18 03:28:13 +00:00
Jan-Erik Rediger af7397deb4 Bug 1898570 - Update to Glean v60.3.0 r=chutten,supply-chain-reviewers,mach-reviewers,android-reviewers,tthibaud
Differential Revision: https://phabricator.services.mozilla.com/D211415
2024-06-17 12:52:00 +00:00
ahochheiden 6f934fcdd7 Bug 1902140 - Make ReFS detection work for volumes mounted on NTFS drives r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D213523
2024-06-14 16:20:14 +00:00
Mike Hommey 27c73fdcf3 Bug 1902214 - Use -std:c++17 on clang-cl builds. r=firefox-build-system-reviewers,sergesanspaille
For some reason, we ended up using -Xclang -std=c++17, when we could
just have used -std:c++17, which simplifies things.

Differential Revision: https://phabricator.services.mozilla.com/D213537
2024-06-14 01:59:05 +00:00
Mike Hommey bb63cc610d Bug 1902211 - Don't add compiler flags to host linker flags. r=firefox-build-system-reviewers,sergesanspaille
On clang-cl builds, the compiler and the linker are two completely different
things. The linker thankfully ignores the flags it doesn't know but
it's not optimal that it has to complain about them.

The historical reason we add compiler flags to linker flags is that some
flags, mostly related to optimization, such as -flto or --profile-generate,
need to be applied to both. This generally keeps being true for builds
using clang or GCC, although ideally we'd set things separately.

Anyways, generally speaking, we don't expect such flags to be necessary
for host linking, so let's start by cleaning up those. This does affect
all builds, but shouldn't matter.

It is worth noting that commands to link target things on clang-cl
builds actually use a different set of flags, so the linker doesn't end
up complaining about unknown arguments there.

Differential Revision: https://phabricator.services.mozilla.com/D213524
2024-06-13 20:21:56 +00:00
Noemi Erli 35f162af9c Backed out 8 changesets (bug 1899681, bug 1888570, bug 1898817) as requested by the dev CLOSED TREE
Backed out changeset 5be4d65a269f (bug 1899681)
Backed out changeset 4b2b91958615 (bug 1898817)
Backed out changeset 91cfbbe6cacd (bug 1898817)
Backed out changeset 689cadd510e1 (bug 1888570)
Backed out changeset dee593604635 (bug 1888570)
Backed out changeset 2fc073aab920 (bug 1898817)
Backed out changeset c68493490b5c (bug 1898817)
Backed out changeset eb50a220de69 (bug 1898817)
2024-06-12 21:19:10 +03:00
Julien Cristau c5f590926f Bug 1901717 - add esr128 to cross-channel. r=flod
Differential Revision: https://phabricator.services.mozilla.com/D213434
2024-06-12 16:26:43 +00:00
ahochheiden 385190326b Bug 1898817 - Add custom copy_tree_update to replace distutils.dir_util.copy_tree r=mozperftest-reviewers,sparky
We can't use `shutil.copy_tree` here, since we need the `update=True`
functionality implemented by the `distutils` variant, but not by the
`shutil` one. This looks like the only place in the repo we use this
functionality, so it seems fine to implement an equivalent ourselves
here directly.

Differential Revision: https://phabricator.services.mozilla.com/D211632
2024-06-12 16:10:35 +00:00
ahochheiden 317fb15476 Bug 1898817 - Replace distutils.spawn.find_executable with shutil.which within mozperftest r=mozperftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D211631
2024-06-12 16:10:34 +00:00
ahochheiden a7f90e7ba4 Bug 1898817 - Replace distutils.spawn.find_executable with shutil.which within mozlint r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D211630
2024-06-12 16:10:34 +00:00
Ben Hearsum 158296f675 Bug 1900421: flip l10n strings to new github repository r?#releng-reviewers!,eemeli!
This patch contains everything we need to flip all the l10n consumers in the tree to the new github repository:
* Enable fetching strings for builds (`desktop_l10n.py` for Desktop, `android-mozharness-build.json` for Android)
* l10n bumper (`l10n-bump/kind.yml`)
* merge automation (`merge-automation/kind.yml`)
* deb repackages (`repackaging/deb.py`)
* Switch `l10n-changesets` files to git refs to avoid breaking repacks before l10n bumper runs

This will need a final update because it will no doubt be bitrotted by the l10n bumper.

Differential Revision: https://phabricator.services.mozilla.com/D212462
2024-06-11 13:20:29 +00:00
Greg Mierzwinski b523501cad Bug 1900065 - Add additional env variables for shell scripts. r=perftest-reviewers,kshampur
This patch adds a couple additional variable that shell scripts can use. One of them is the name of the app being tested, and the other is a temporary directory for the script that is removed once the script finishes. At the same time, the logging from the script is changed to use print directly instead of the logger due to bug 1900056.

Differential Revision: https://phabricator.services.mozilla.com/D212628
2024-06-10 11:57:58 +00:00
Greg Mierzwinski adf2ba11f6 Bug 1900256 - Use binary in android layer if it's available. r=perftest-reviewers,aglavic
This patch enables the android layer to use the binary setting from metadata if it exists.

Differential Revision: https://phabricator.services.mozilla.com/D212627
2024-06-10 11:57:57 +00:00
andrej 9bca33d472 Bug 1900428 - Add time delay when passing the skipping onbarding flag to ensure it can take effect. r=perftest-reviewers,sparky
A regression was introduced in the startup tests accidentally when re-formatting the android_startup file.
This patch resolves that issue, which was forgetting a sleep timer of 4 seconds to allow the skip on-boarding flag to propagate

Differential Revision: https://phabricator.services.mozilla.com/D212645
2024-06-05 18:46:53 +00:00
Mike Conley 48c038080f Bug 1900618 - Add an automation test condition to mozinfo. r=jmaher,taskgraph-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D212602
2024-06-05 13:04:12 +00:00
Otto Länd 96196fc55a Bug 1841370: apply code formatting via Lando
# ignore-this-changeset
2024-06-05 09:06:24 +00:00
Alexandre Lissy 342132bb48 Bug 1841370 - Add mach repackage snap and snap-install for testing development builds under Snap. r=firefox-build-system-reviewers,sergesanspaille
This adds the command `mach repackage snap`, which packages the current
build as a Snap (with the app name firefox_devel, to not interfere with
installs of the normal firefox package).  It can also accept a tar file
as input, for example to repack a build from Taskcluster.

It also adds `mach repackage snap-install`, which installs the package
and connects its plugs with `snap connect` (normally done by default,
but not for an unsigned package like this).

Building a Snap package requires the `snapcraft` command, which is
available as a Snap (and maybe from other package managers).

Depends on D182615

Differential Revision: https://phabricator.services.mozilla.com/D182616
2024-06-05 09:02:26 +00:00
Alexandre Lissy 3ab4eddca1 Bug 1876590 - Undo platform.ini packaging changes r=nalexander
This reverts commit a70f59c7d9da728a355a38dd4dbbd33d5730d442.

Differential Revision: https://phabricator.services.mozilla.com/D199853
2024-06-04 18:29:15 +00:00
serge-sans-paille 70080e0fd8 Bug 1899098 - No longer use GNU_CC, CLANG_CC and the likes in moz.build r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D211720
2024-06-04 09:42:12 +00:00
Ben Hearsum e09d7efefe Bug 1881272: ignore rare, recoverable error condition during l10n repack r=eemeli
Differential Revision: https://phabricator.services.mozilla.com/D211985
2024-06-04 00:25:07 +00:00
Norisz Fay 7393a53103 Backed out 4 changesets (bug 1881272) for causing l10n related Android bustages CLOSED TREE
Backed out changeset 7bace6d14823 (bug 1881272)
Backed out changeset 4c893612d034 (bug 1881272)
Backed out changeset f8cd7bfc3c98 (bug 1881272)
Backed out changeset ccfc9b7a1f39 (bug 1881272)
2024-05-31 22:33:33 +03:00
Jan-Erik Rediger aae6d7cae5 Bug 1892230 - Update to Glean v60.1.1 r=TravisLong,supply-chain-reviewers,mach-reviewers,android-reviewers,daabel
Differential Revision: https://phabricator.services.mozilla.com/D212253
2024-05-31 16:25:30 +00:00
Ben Hearsum a6c9be9953 Bug 1881272: ignore rare, recoverable error condition during l10n repack r=eemeli
Differential Revision: https://phabricator.services.mozilla.com/D211985
2024-05-31 13:42:50 +00:00
Bryan Olsson e0318cd85e Bug 1899905 - Add Saraiki (skr) to language names in mozIntl and language pack metadata, r=flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D212203
2024-05-31 06:06:07 +00:00
Tamas Szentpeteri 240ba29abf Backed out 7 changesets (bug 1876590) as requested by Gerard for causing gtest failures related to BuildIDReader.ReadFromRealLib. CLOSED TREE
Backed out changeset 9ac3a93622c8 (bug 1876590)
Backed out changeset 2cd2cc626c44 (bug 1876590)
Backed out changeset 6d978847d7dd (bug 1876590)
Backed out changeset 0b07a6f1beac (bug 1876590)
Backed out changeset 55cc3acc9297 (bug 1876590)
Backed out changeset 115753252616 (bug 1876590)
Backed out changeset c75ebb5f3a80 (bug 1876590)
2024-05-31 08:16:07 +03:00
andrej dce048bb67 Bug 1898554 - Clean up android startup script by adding functionality to android_device in android.py. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D211444
2024-05-31 00:57:56 +00:00
Alexandre Lissy 795229659a Bug 1876590 - Undo platform.ini packaging changes r=nalexander
This reverts commit a70f59c7d9da728a355a38dd4dbbd33d5730d442.

Differential Revision: https://phabricator.services.mozilla.com/D199853
2024-05-30 14:41:53 +00:00
Malte Juergens 0cf663e6c5 Bug 1896978 - Return empty list of changed files instead of nothing in SrcRepository r=ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D210561
2024-05-29 20:16:14 +00:00
Mathew Hodson 8404a8cef8 Bug 1898651 - Use -Zi instead of -Z7 with ml r=firefox-build-system-reviewers,glandium
The debug flag for ml.exe and ml64.exe is -Zi instead of -Z7,
which is used with clang-cl.

Set this when CC_TYPE is "clang-cl" to match the if-statements in
`default_debug_flags` and `as_info` in toolchain.configure.

Fixes warning A4018: invalid command-line option.

Differential Revision: https://phabricator.services.mozilla.com/D211480
2024-05-29 19:15:21 +00:00
Julien Cristau 0b7de29da2 Bug 1899174 - add esr128 support to gecko taskgraph. r=taskgraph-reviewers,releng-reviewers,hneiva
Differential Revision: https://phabricator.services.mozilla.com/D211758
2024-05-29 16:00:50 +00:00
Tom Ritter fffa9324d8 Bug 1892292: Have a better error message for when patching fails r=maltejur
Differential Revision: https://phabricator.services.mozilla.com/D211058
2024-05-29 15:40:34 +00:00
Nick Alexander c1d63c5fb2 Bug 1896514 - Make mach lint accommodate Windows drive case differences. r=ahal
We hand-roll to avoid `os.path.realpath` invoking potentially
expensive filesystem APIs.

Differential Revision: https://phabricator.services.mozilla.com/D210230
2024-05-28 20:29:38 +00:00
Greg Mierzwinski 49eda2189a Bug 1898256 - Add a layer to run bash shell scripts. r=perftest-reviewers,kshampur
This patch adds a new layer that will allow us to run custom/adhoc bash scripts in mozperftest. Currently, the layer can only handle bash scripts. At the same time, a new flavor is added for this, and additional script parsing capabilities are added.

Differential Revision: https://phabricator.services.mozilla.com/D211740
2024-05-28 15:43:50 +00:00
Greg Mierzwinski de2642a8fb Bug 1712337 - Add a layer for gathering the binary version. r=perftest-reviewers,aglavic
This patch adds a layer to gather the version of a given binary. The layer makes use of the tooling from `setups.py` to do this.

Differential Revision: https://phabricator.services.mozilla.com/D211739
2024-05-28 15:43:50 +00:00
Greg Mierzwinski 182f029c90 Bug 1712337 - Add a binary setup layer. r=perftest-reviewers,kshampur,aglavic
This patch adds a layer to setup the binary, and provide a single interface for specifying it and using it through the metadata. At the same time, some changes were made to the perfherder metrics production to gather the application name, and version from the metadata. The intermediate results are also properly passed into the perfherder blob production step as they were previously being ignored.

Differential Revision: https://phabricator.services.mozilla.com/D211738
2024-05-28 15:43:49 +00:00
Greg Mierzwinski 4c84af9e86 Bug 1712337 - Add helper classes for gathering binary, and binary version. r=perftest-reviewers,aglavic
This patch adds a set of classes that will be used for gathering the binary path, and binary version in the VersionProducer, and BinarySetup layers.

Differential Revision: https://phabricator.services.mozilla.com/D211737
2024-05-28 15:43:49 +00:00
Raphaël Gomès edf044da5b Bug 1897079 - Improve speed of fs traversal in all_mozbuild_paths. r=glandium?sergesanspaille
This makes the total time of `all_mozbuild_paths` go down from 6+ seconds to
around 600ms on the same machine.

Differential Revision: https://phabricator.services.mozilla.com/D210653
2024-05-28 08:19:16 +00:00
Cosmin Sabou 8f0106c957 Merge mozilla-central to autoland. 2024-05-28 03:22:14 +03:00
Cosmin Sabou 1bd9c16ca0 Backed out 2 changesets (bug 1897219, bug 1898570) for breaking fenix builds. a=backout
Backed out changeset 0c597c01bdea (bug 1897219)
Backed out changeset 78257216533d (bug 1898570)
2024-05-28 03:12:03 +03:00
ahochheiden 8be4568a09 Bug 1898798 - Bump poetry to version 1.8.3 and poetry-core to version 1.9, add poetry-plugin-export at version 1.8.0 r=firefox-build-system-reviewers,mach-reviewers,sergesanspaille,ahal
We need this version bump on `poetry` to resolve a conflict with the
vendored `build` that's needed by `pip-tools`.

Differential Revision: https://phabricator.services.mozilla.com/D211600
2024-05-27 23:06:20 +00:00
ahochheiden 1f74b463e3 Bug 1857470 - Vendor pip-tools at version 7.4.1 r=mach-reviewers,ahal
While nothing explicitly prompted updating this, letting `pip` and
`pip-tools` diverage too greatly in version release dates seems like
a bad idea, especially with the various deprecations in
`pip` and `python3.12`.

This also vendors the implicit dependencies `build`, `tomli`, and
`pyproject_hooks`.

Differential Revision: https://phabricator.services.mozilla.com/D210526
2024-05-27 23:06:19 +00:00
ahochheiden ba2b9be0d9 Bug 1857470 - Vendor pip at version 24.0 r=mach-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D210525
2024-05-27 23:06:18 +00:00
Alex Finder 8aa8f7cf5c Bug 1824194 - Enable python code coverage for raptor unit tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D210937
2024-05-27 13:08:16 +00:00
Jan-Erik Rediger 3938f5b852 Bug 1898570 - Update to Glean v60.2.0 r=chutten,supply-chain-reviewers,mach-reviewers,android-reviewers,tthibaud
Differential Revision: https://phabricator.services.mozilla.com/D211415
2024-05-27 08:07:29 +00:00
Matthew Gaudet d3d69d76f2 Bug 1898777 - Throw MissingUpstreamRepo from SrcRepository when calling get_outgoing_files r=ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D211579
2024-05-24 19:09:17 +00:00
Julien Cristau 0c0438783f Bug 1884138 - make scriptworker-canary ignore tree closure on try r=releng-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D203918
2024-05-24 13:24:22 +00:00
ahochheiden 944dea40d3 Bug 1776255 - Add the appropriate 'when' to all 'option' that end up calling 'pkg_check_modules' later r=firefox-build-system-reviewers,glandium
We don't check for pkg-config on some platforms (Windows, OSX, Android).
On those platforms, calling 'pkg_check_modules' will not work. Adding
the same 'when' used for the 'pkg_config' check to all the options that
end up calling 'pkg_check_modules' effectively disables them, and prevents
'pkg_check_modules' from being called.

Differential Revision: https://phabricator.services.mozilla.com/D150649
2024-05-23 23:55:38 +00:00
Alex Finder 75c223dd05 Bug 1850903 - Add --raptor option for mach perftest-test r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D210935
2024-05-23 14:05:35 +00:00