Commit Graph

13248 Commits

Author SHA1 Message Date
Tom Ritter
71d0de09c4 Bug 1887079: send updatebot cron failures to freddy r=freddyb
Differential Revision: https://phabricator.services.mozilla.com/D205474
2024-03-25 12:49:06 +00:00
Alexandre Lissy
b5edd8ceb2 Bug 1887538 - Update QA PDF test selection screenshot r=benchatt,?mboldan!
Differential Revision: https://phabricator.services.mozilla.com/D205530
2024-03-25 10:17:39 +00:00
pstanciu
5001818ebf Backed out changeset 7e6185a6c167 (bug 1871883) for causing build bustages on rust.mk CLOSED TREE 2024-03-23 06:09:20 +02:00
Mike Hommey
6393a05402 Bug 1886927 - Avoid getting hostutils.manifest off hg.mozilla.org. r=jmaher
This introduces a toolchain task that just re-exposes the hostutils from
tooltool, which means adding that task as dependency of the relevant
tests gets it automatically. We can then get the hostutils from
MOZ_FETCHES_DIR directly.

Differential Revision: https://phabricator.services.mozilla.com/D205424
2024-03-22 20:34:15 +00:00
Mike Hommey
0f2b6ec73e Bug 1871883 - Update builders to rustc 1.77. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D204991
2024-03-22 20:33:42 +00:00
Joel Maher
1645400ee6 Bug 1886907 - move linux no-fission testing to mozilla-central only. r=aryx
Differential Revision: https://phabricator.services.mozilla.com/D205405
2024-03-22 18:26:54 +00:00
Heitor Neiva
b1ae9d5558 Bug 1886051 - Cleanup signing tasks config r=releng-reviewers,taskgraph-reviewers,bhearsum,haik
Differential Revision: https://phabricator.services.mozilla.com/D205146
2024-03-22 18:09:32 +00:00
Joel Maher
b6c93590b3 Bug 1885009 - clean up test scheduling for swgl variant and make permanent. r=aryx
Differential Revision: https://phabricator.services.mozilla.com/D205102
2024-03-21 17:09:57 +00:00
Julien Cristau
a42c855dac Bug 1886767 - fix nightly-all target tasks method to include ship-geckoview. r=taskgraph-reviewers,bhearsum
In bug 1882100 I updated the nightly-android method to include
ship-geckoview, but in bug 1882083 I'd picked the wrong function to
select android tasks as part of nightly-all, so geckoview ship tasks
went missing.

Remove the duplicate/confusing target_tasks_nightly from
android_taskgraph to prevent something like this happening again.

Differential Revision: https://phabricator.services.mozilla.com/D205330
2024-03-21 16:21:25 +00:00
Julien Cristau
6f86e7fe32 Bug 1886767 - add test params for nightly-all cron job. r=releng-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D205329
2024-03-21 16:21:25 +00:00
Iulian Moraru
d62eb13c67 Bug 1886193 - fix linting failures on conftest.py. r=fix CLOSED TREE 2024-03-21 19:17:06 +02:00
Andrew Halberstadt
7176a9a02c Bug 1886193 - Use 'build' optimization strategy for new Android builds, r=geckoview-reviewers,taskgraph-reviewers,jcristau,tthibaud
By setting these to the "build" optimization, it means that bugbug will apply its
machine learning algorithm on autoland and with `mach try auto`.

But in addition, this also sets up some new SCHEDULES rules. A new mutually
exclusive SCHEDULES group around the "application" is created. Namely it can be
one of:

- firefox
- fenix
- focus-android

Files under `/browser` are tagged with the "firefox" component, while files
under `mobile/android` will be tagged with both "fenix" and "focus-android"
components. Files under the `mobile/android/fenix` or
`mobile/android/focus-android` dirs are further restricted to their respective
component. Note that any files that can impact Gecko should not be tagged with
any of these components.

On the task side, all of the prior Firefox builds and tests are tagged with the
"firefox" component, while all of the new Android builds and tests are tagged
with "fenix", "focus-android" or both (depending on the task).

The upshot of all this, is that patches that *only* modify files under
`/mobile/android` will not run any of the Firefox builds and tests. Conversely
patches that *only* modify files under `/browser` will not run any of the
Android builds and tests.

Differential Revision: https://phabricator.services.mozilla.com/D205127
2024-03-21 16:02:24 +00:00
Julien Cristau
c50a5c5724 Bug 1886456 - really only run nightlyasrelease pgo builds on trunk. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D205324
2024-03-21 15:41:54 +00:00
Julien Cristau
30b95de9d6 Bug 1885155 - fetch-content: retry downloads on size or checksum mismatch. r=releng-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D205244
2024-03-21 15:38:03 +00:00
Gabriele Svelto
cba87da3de Bug 1870823 - Add product name, version, release channel and build id to the symbol files r=gerard-majax
Differential Revision: https://phabricator.services.mozilla.com/D196838
2024-03-21 14:47:41 +00:00
Iulian Moraru
4263e22a5e Backed out changeset d90b4451e543 (bug 1885319) for causing multiple xpcshell failures. 2024-03-21 17:53:03 +02:00
Julien Cristau
e55ec92207 Bug 1886737 - fetch-content: fix download_to_memory retries. r=releng-reviewers,bhearsum DONTBUILD
Previously we would append data from each download to the previous,
failed one(s).

Differential Revision: https://phabricator.services.mozilla.com/D205315
2024-03-21 12:46:04 +00:00
Nazım Can Altınova
d80e4360d5 Bug 1885319 - Make SIGPROF a sync signal on TSan of our clang and rust builds r=sergesanspaille,glandium
Due to SIGPROF being async, it was hanging on some cases because some functions
were incorrectly marked non-blocking. This patch is merge to LLVM in:
https://github.com/llvm/llvm-project/pull/85188 But we want to patch our clang
here to start benefiting from that quickly.

We are also patching our rustc here. Even though they are not used by default
during our normal builds, this custom rustc is needed for building and
running TSan already:
https://firefox-source-docs.mozilla.org/tools/sanitizer/tsan.html#llvm-clang-rust

Differential Revision: https://phabricator.services.mozilla.com/D204631
2024-03-21 12:43:24 +00:00
Julien Cristau
bef8b6cfa3 Bug 1886656 - remove code-review attribute from android build/test tasks. r=jlorenzo DONTBUILD
We don't want to run those tasks on every phabricator patch update.

Differential Revision: https://phabricator.services.mozilla.com/D205288
2024-03-21 09:13:40 +00:00
Julien Cristau
eb09a3af42 Bug 1886521 - bump release-notify-testrail max-run-time. r=jajohnson DONTBUILD
This task checks out the source repository, which can easily take more
than 2 minutes.

It would probably be worthwhile to make it not need that, but this
should do for now.

Differential Revision: https://phabricator.services.mozilla.com/D205245
2024-03-21 09:09:52 +00:00
Greg Mierzwinski
4c65b35ff4 Bug 1860111 - Remove talos windows10 ref hw tests, and platform configurations. r=jmaher,taskgraph-reviewers,perftest-reviewers,kshampur
This patch removes the windows 10 reference hardware talos tests, and removes the platform config for it. With talos tests disabled on the windows10 reference hardware, we can also remove any configuration steps that we have for that platform since there are no other tests running on those machines.

Differential Revision: https://phabricator.services.mozilla.com/D205080
2024-03-20 18:14:06 +00:00
Julien Cristau
5c4a8dfc81 Bug 1886386 - query the local repo before going to hg.m.o in update-verify-config. r=taskgraph-reviewers,bhearsum DONTBUILD
In most cases we already have the information we need in the local repo,
so we don't need to hit the remote server.

Differential Revision: https://phabricator.services.mozilla.com/D204470
2024-03-20 17:14:52 +00:00
Jeff Muizelaar
d4b3adbea3 Bug 1886456. Only run the nightly-as-release jobs on Nightly. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D205229
2024-03-20 15:35:13 +00:00
andrej
03573054e5 Bug 1880170 - Add chromedriver for chrome 123. r=perftest-reviewers,taskgraph-reviewers,sparky,jmaher
A new version of chrome has released and we are adding the appropriate chromedriver to be able to test on it

Differential Revision: https://phabricator.services.mozilla.com/D205209
2024-03-20 14:36:09 +00:00
Andrew Halberstadt
b3ca18ec8a Bug 1886230 - [ci] Add dummy 'files_changed' value to test_mach_try_auto.py, r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D205133
2024-03-20 13:21:37 +00:00
Andrew Halberstadt
18e77586c4 Bug 1886230 - Backed out changeset dc701f4ef6c4, r=taskgraph-reviewers,bhearsum
This didn't fix the problem and was actually a no-op.

Differential Revision: https://phabricator.services.mozilla.com/D205132
2024-03-20 13:21:37 +00:00
KS
e44d656188 Bug 1858675 - Run motionmark 1.3 on Chrome on Android A51 in CI. r=perftest-reviewers,taskgraph-reviewers,ahal,sparky
This patch enables motionmark 1.3 on Chrome in CI for the A51 devices as
it was previously on all other apps except for `chrome-m`

Differential Revision: https://phabricator.services.mozilla.com/D204820
2024-03-20 13:04:32 +00:00
Norisz Fay
267318e072 Backed out changeset 9bad61381e60 (bug 1860111) for causing python failure on test_set_test_setting CLOSED TREE 2024-03-20 15:10:25 +02:00
Joel Maher
40e4e74bf6 Bug 1885983 - reduce spi-nw tests until the project is active again. r=aryx,kershaw
Differential Revision: https://phabricator.services.mozilla.com/D205095
2024-03-20 12:35:51 +00:00
Greg Mierzwinski
24ab6f2cd1 Bug 1860111 - Remove talos windows10 ref hw tests, and platform configurations. r=jmaher,taskgraph-reviewers,perftest-reviewers,kshampur
This patch removes the windows 10 reference hardware talos tests, and removes the platform config for it. With talos tests disabled on the windows10 reference hardware, we can also remove any configuration steps that we have for that platform since there are no other tests running on those machines.

Differential Revision: https://phabricator.services.mozilla.com/D205080
2024-03-20 12:21:37 +00:00
Julien Cristau
f315309bdc Bug 1882100 - ship geckoview as part of the firefox-android ship graph. r=taskgraph-reviewers,bhearsum,releng-reviewers,gabriel
Differential Revision: https://phabricator.services.mozilla.com/D205041
2024-03-20 07:37:24 +00:00
Julien Cristau
2b044a3860 Bug 1882100 - ship geckoview as part of nightly-android. r=taskgraph-reviewers,bhearsum,releng-reviewers,gabriel
Remove ship-geckoview cron job and target-tasks method.

Differential Revision: https://phabricator.services.mozilla.com/D205040
2024-03-20 07:37:23 +00:00
Jeff Muizelaar
af35f31ead Bug 1876157. Use a nightly-as-release profile when building nightly-as-release r=firefox-build-system-reviewers,glandium
Without this we have a bunch of CFG hash mismatches and the performance is bad.

Differential Revision: https://phabricator.services.mozilla.com/D204083
2024-03-20 01:54:10 +00:00
Mike Hommey
00e0f0e616 Bug 1886068 - Upgrade clang 18 toolchain to 18.1.1. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D205015
2024-03-19 20:11:30 +00:00
Jason Kratzer
cb3fb6dd48 Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 19:52:30 +00:00
Greg Mierzwinski
9bd7407795 Bug 1881785 - Run fenix performance tests on mozilla-central, and autoland. r=aglavic,perftest-reviewers,taskgraph-reviewers,jcristau
This patch sets up the scheduling for fenix performance tests on mozilla-central, and autoland. All the same tests will be running across both branches. However, the youtube-playback tests will only be running on mozilla-central. It also removes fenix speedometer tests from the gpt cron since they'll be running on every commit.

Differential Revision: https://phabricator.services.mozilla.com/D202872
2024-03-19 19:00:34 +00:00
Julien Cristau
af1c02eb33 Bug 1882083 - combine desktop and android nightly hooks. r=RyanVM,releng-reviewers,taskgraph-reviewers,bhearsum DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D202720
2024-03-19 17:02:43 +00:00
Julien Cristau
78a4cd48df Bug 1885917 - Backed out changeset a13052a3e0b9 (bug 1839869), served its purpose. r=releng-reviewers,gbrown DONTBUILD
This backs out "Bug 1839869 - push fenix/focus nightly to the internal track on
play store.", and reverts to pushing to the default track instead.

Differential Revision: https://phabricator.services.mozilla.com/D204934
2024-03-19 17:00:32 +00:00
Julien Cristau
b2aff34309 Bug 1886053 - don't run nightly-simulation fenix build on each push. r=sparky DONTBUILD
Instead, let it get pulled in whenever we schedule perf tests.

Differential Revision: https://phabricator.services.mozilla.com/D205071
2024-03-19 16:12:01 +00:00
Dave Townsend
f35244e188 Bug 1864896: Autofix unused function arguments (general). r=nika,jfkthame,ckerschb
Differential Revision: https://phabricator.services.mozilla.com/D203007
2024-03-19 14:59:22 +00:00
Geoff Brown
6a13707407 Bug 1886053 - Use nightly-<project> as default update channel for android builds r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D205072
2024-03-19 14:55:16 +00:00
Sandor Molnar
f13b5d1aab Backed out changeset f983e945bb0d (bug 1883622) for causing toolchain bustages 2024-03-19 18:05:35 +02:00
Julien Cristau
745b8ae450 Bug 1886152 - only send slack notification from release-notify-testrail task on level3 repos. r=releng-reviewers,jajohnson,gbrown DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D205057
2024-03-19 14:27:37 +00:00
Andrew Halberstadt
50bd75fa63 Bug 1884364 - Use local files_changed in Taskcluster integration tests, r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D204929
2024-03-19 14:13:56 +00:00
Andrew Halberstadt
7093cdf30b Bug 1884364 - Re-enable tgdiff task and force local files changed, r=taskgraph-reviewers,jcristau
Previously we were using `json-automationrelevance` to compute the base_rev.
But recently we improved the Decision task to be smarter about determining
this, so the value already baked into the parameters should be sufficient.

Note that bug 1884386 already removed the transform that was calling
`get_json_automationrelevance`. Rather than re-adding it, this patch uses the
`task_context` transforms to grab the value from parameters instead.

This additionally adds the `--force-local-files-changed` flag to the command,
as we might miss something if we just used the fake values baked into the test
params.

Differential Revision: https://phabricator.services.mozilla.com/D204258
2024-03-19 14:13:55 +00:00
Andrew Halberstadt
e4d3244f27 Bug 1884364 - Add an option to |mach taskgraph| to force using locally changed files, r=taskgraph-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D204257
2024-03-19 14:13:55 +00:00
Andrew Halberstadt
4c371dd4d8 Bug 1884364 - Create a new 'files_changed' parameter, r=taskgraph-reviewers,releng-reviewers,jcristau
We use hg.m.o's `json-automationrelevance` endpoint for a variety of reasons
such as getting the files changed for optimization purposes, or finding the
base revision for diff purposes. But this endpoint is slow and puts undue load
on hg.mozilla.org if queried too often.

The helper function that fetches this is memoized, so in theory we should only
ever make this request once per graph generation. However, there are still cases
where we request this unnecessarily:

1. When running `./mach taskgraph` locally, we first fetch
`json-automationrelevance` and then fall back to fetching it locally if the
revision wasn't found. I believe the reason for this is to be able to generate
identical graphs as produced by CI.

2. When specifying multiple parameters (so graphs are generated in parallel),
the memoize won't cache across processes, so we make the request once per
parameter set.

3. Any other time we generate tasks outside the context of a Decision task (e.g
`./mach try`), as there are transforms that call this function.

By turning `files_changed` into a parameter, we can ensure that this value gets
"frozen" by the Decision task and it will never need to be recomputed. E.g, you
could use `-p task-id=<decision id>` and you'd still get the `files_changed`
value that Decision task computed. This means, that for all non-Decision use
cases we can rely on local VCS to give us our changed files.

This should greatly cut back on the number of queries being made to `hg.m.o`.

Differential Revision: https://phabricator.services.mozilla.com/D204127
2024-03-19 14:13:54 +00:00
Andrew Halberstadt
a22dd3944a Bug 1884364 - Convert gecko_taskgraph/test/test_decision.py to pytest format, r=taskgraph-reviewers,gbrown
I intially converted this because I was having problems getting 'responses' to
work with the unittest style tests. But then later I ended up not using 'responses'
at all.

Oh well, I think this looks much better anyway.

Differential Revision: https://phabricator.services.mozilla.com/D204126
2024-03-19 14:13:54 +00:00
Jason Kratzer
47c14cf7a4 Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 14:07:26 +00:00
Sandor Molnar
114a00145b Backed out 2 changesets (bug 1870823) for causing build bustages CLOSED TREE
Backed out changeset 8e71522c5b0c (bug 1870823)
Backed out changeset bf23686d4852 (bug 1870823)
2024-03-19 12:24:05 +02:00