Commit Graph

676 Commits

Author SHA1 Message Date
Sylvestre Ledru
82bc783c85 no bug - docs: remove references to non existing docs r=geckoview-reviewers,owlish
Depends on D194633

Differential Revision: https://phabricator.services.mozilla.com/D194634
2023-11-24 20:25:56 +00:00
Sylvestre Ledru
82db67a6be Bug 1860157 - Fix typos found by codespell 2.2.6 r=webdriver-reviewers,zeid,search-reviewers,perftest-reviewers,devtools-reviewers,releng-reviewers,gbrown,sparky,jteow
Differential Revision: https://phabricator.services.mozilla.com/D191480
2023-10-19 20:52:10 +00:00
Andrew Halberstadt
1c883bcd1a Bug 1858698 - Fix |mach taskgraph ... --target-kind| by syncing upstream Taskgraph changes, r=taskgraph-reviewers,jcristau
This happened because I made changes to `--target-kind` in upstream Taskgraph,
but forgot to sync the `main.py` bits over to `gecko_taskgraph`.

Differential Revision: https://phabricator.services.mozilla.com/D190807
2023-10-12 18:20:12 +00:00
Alexandre Lissy
09c8bc179c Bug 1854553 - Introduce simple tests of Snap package r=releng-reviewers,taskgraph-reviewers,jmaher,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D188932
2023-10-03 11:09:17 +00:00
Andrew Halberstadt
8c2bcdc84b Bug 1850423 - Decomission esr102 from taskgraph, build toolchains and WPT, r=gbrown,jcristau,taskgraph-reviewers,releng-reviewers,jgraham
Differential Revision: https://phabricator.services.mozilla.com/D186993
2023-09-28 14:39:35 +00:00
Andrew Halberstadt
bc372f5217 Bug 1839891 - [ci] Convert signing tasks to 'from_deps' transforms, r=gbrown,jcristau,taskgraph-reviewers,releng-reviewers
This results in an identical diff after running:

    $ ./mach taskgraph full -p taskcluster/test/params --diff .~1 -J --fast --exclude-key attributes.primary-kind-dependency

Differential Revision: https://phabricator.services.mozilla.com/D181900
2023-07-21 20:39:54 +00:00
Andrew Halberstadt
ca8b4b930b Bug 1844592 - [ci] Default enable_always_target parameter to docker-image tasks, r=jcristau,taskgraph-reviewers
Upstream taskgraph removed the special casing of `docker-image` tasks w.r.t
implicitly adding them to the graph, and instead switched over to relying on
the `always_target` feature to accomplish this.

However, in Gecko we usually disable the `always_target` feature entirely (only
enabling it on autoland and try). As a compromise, we implemented a feature in
Taskgraph to allow selectively enabling `always_target` to a specific list of
kinds.

This patch gets Gecko to start using this new feature.

Differential Revision: https://phabricator.services.mozilla.com/D184107
2023-07-20 16:20:46 +00:00
Stanca Serban
659f59074c Backed out 3 changesets (bug 1839891) for causing py3 failures. CLOSED TREE
Backed out changeset 06748e1bdfcb (bug 1839891)
Backed out changeset ba91e51b4501 (bug 1839891)
Backed out changeset 16dd34d01d61 (bug 1839891)
2023-07-18 23:15:54 +03:00
Andrew Halberstadt
2067728303 Bug 1839891 - [ci] Convert signing tasks to 'from_deps' transforms, r=gbrown,jcristau,taskgraph-reviewers,releng-reviewers
This results in an identical diff after running:

    $ ./mach taskgraph full -p taskcluster/test/params --diff .~1 -J --fast --exclude-key attributes.primary-kind-dependency

Differential Revision: https://phabricator.services.mozilla.com/D181900
2023-07-18 19:19:16 +00:00
Alexandre Lissy
481771d6f0 Bug 1839317 - Add Firefox Snap build of all branches using upstream toolings r=releng-reviewers,taskgraph-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181502
2023-07-17 15:13:11 +00:00
Heitor Neiva
b74ee2c8b9 Bug 1836078 - Update gecko taskgraph to support ESR115 r=releng-reviewers,taskgraph-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D180026
2023-06-09 20:58:21 +00:00
Heitor Neiva
ef1754890e Bug 1774273 - Transition mac geckodriver notarization to signingscript r=releng-reviewers,taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D179272
2023-05-29 15:25:54 +00:00
Heitor Neiva
de10bf9824 Bug 1774273 - Transition mac notarization to signingscript r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D176162
2023-05-23 17:31:37 +00:00
Heitor Neiva
72b4a15e49 Bug 1833487 - Remove unused partner mac signing and notarization tasks to fix beta release r=releng-reviewers,taskgraph-reviewers,gabriel
These tasks are not in use yet. Will be added back on https://phabricator.services.mozilla.com/D176162

Differential Revision: https://phabricator.services.mozilla.com/D178246
2023-05-16 22:31:38 +00:00
Heitor Neiva
b9e4817434 Bug 1774273 - Add eme-free, l10n and partner repack notarization + pkg support r=releng-reviewers,taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D174781
2023-04-14 18:08:28 +00:00
Heitor Neiva
ffa2a1f79d Bug 1774273 - Add mac notarization on signingscript r=bhearsum
Created a separate kind for only signing with iscript, and another for notarization.
Once we validate this is good, we need to add it to l10n/emfree/etc and point repackage kind at it.

Differential Revision: https://phabricator.services.mozilla.com/D173967
2023-03-30 20:21:47 +00:00
Gabriel Bustamante
02b45781bd Bug 1799769 - Import the Firefox .deb packages to the product delivery APT repository r=taskgraph-reviewers,hneiva
Differential Revision: https://phabricator.services.mozilla.com/D172619
2023-03-27 20:31:22 +00:00
Ben Hearsum
abd2a1fcbb Bug 1814727: add tasks for attributing l10n builds r=ahal
The kind is more or less the same as the en-US counterpart in the previous revision.

As with the en-US attribution kind, this also does does _not_ use the `multi_dep` loader to set up the per-locale tasks. Of course, we do need to split by locale, which is now being done quite explicitly by the new `split_by_locale` that looks at the specified locales file, and uses specific platforms specified in the kind. As with the previous revision, please feel free to push back if any of you feel any of this is going in the wrong direction, is worse than multi_dep, etc. etc.

Differential Revision: https://phabricator.services.mozilla.com/D170245
2023-03-13 19:04:06 +00:00
Ben Hearsum
8e86487f21 Bug 1814727: add tasks for attributing en-US builds r=ahal,nalexander
Notably, the actual attribution code we're using is stored in `browser`. This was largely motivated by the fact that the subsequent revision in this stack will also need it, and this seemed like the best way to make it shareable between the two. The only alternative I could come up with was stuffing it into a transforms - but it's really just data - there's no reason it ought to live in such a place. (We do have precedent for this sort of thing with both locale and whats new page information, so I don't think it's breaking huge new ground.) Nick - I'm tagging you mainly on this part, but I welcome any other comments you may have (here or in the rest of the stack for that matter).

The other notable part of this patch is that I've _explicitly_ decided not to use the `multi_dep` loader, nor reimplement any of its magic pulling of properties in a transform. I find that this makes it more clear what's _actually_ going on, and easier to debug when making changes. The dwonside, of course, is that there's some verboseness in the kind - all platforms we need to run this for must be explicitly listed. I'm open to debate on whether or not this is the right trade-off, so feel free to push back if you disagree.

Differential Revision: https://phabricator.services.mozilla.com/D170243
2023-03-13 19:04:06 +00:00
Ben Hearsum
89e06a6146 Bug 1814727: Rename partner_attribution.py to a more generic name r=releng-reviewers,gbrown
There's actually nothing partner-specific in this script, and it's about to be used for other types of attribution as well.

Differential Revision: https://phabricator.services.mozilla.com/D170239
2023-03-13 19:04:04 +00:00
Johan Lorenzo
d0ccca1c26 Bug 1799042 - part 9: Create repackage-deb-l10n tasks r=gabriel
Depends on D171124

Differential Revision: https://phabricator.services.mozilla.com/D171125
2023-03-07 19:28:25 +00:00
Mike Hommey
7eedd547b3 Bug 1522986 - Automatically wrap private local toolchains. r=taskgraph-reviewers,hneiva,firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D167770
2023-02-01 09:45:10 +00:00
Mike Hommey
41c895c0d7 Bug 1245969 - Add tasks that perform a bootstrap on various bare Linux environments. r=taskgraph-reviewers,firefox-build-system-reviewers,jlorenzo,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D162974
2022-12-16 21:44:19 +00:00
Gabriel Bustamante
929a011067 Bug 1799233 - Add tasks to repack Firefox nightly builds into Debian Packages r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D161743
2022-12-05 21:10:07 +00:00
Cristian Tuns
3ef28fd16c Backed out changeset 93a99f808df6 (bug 1799233) for causing endless exceptions 2022-12-01 18:39:18 -05:00
Gabriel Bustamante
4da6f3c01b Bug 1799233 - Add tasks to repack Firefox nightly builds into Debian Packages r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D161743
2022-12-01 21:26:53 +00:00
Iulian Moraru
0c21622862 Backed out 2 changesets (bug 1245969) - for causing bootstrap bustages. CLOSED TREE
Backed out changeset b5967ff5a23c
Backed out changeset 03596bbe6b15 (bug 1245969)
2022-11-25 05:06:42 +02:00
Mike Hommey
f84ec6b249 Bug 1245969 - Add tasks that perform a bootstrap on various bare Linux environments. r=taskgraph-reviewers,firefox-build-system-reviewers,jlorenzo,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D162974
2022-11-25 02:18:50 +00:00
Andrew Halberstadt
92f0b6ef83 Bug 1795921 - [taskgraph] Use an 'enable_always_target' param to control when 'always_target' should apply, r=releng-reviewers,gbrown
This is a bit more general purpose and flexible than hardcoding `hg-push` here.
It is also something that can be upstreamed to standalone taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D160536
2022-10-31 13:14:23 +00:00
Johan Lorenzo
0e57af4969 Bug 1784232 - Bump taskgraph to v3.2.0 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D155978
2022-09-20 09:11:45 +00:00
Johan Lorenzo
b984b3449b Bug 1786291 - Remove esr91 references r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D156972
2022-09-19 13:23:03 +00:00
Sebastian Hengst
685203e4bc Backed out changeset f737234929d4 for breaking mach commands with git-cinnbar clone. a=backout 2022-09-08 14:35:27 +02:00
Johan Lorenzo
461fbf1994 Bug 1784232 - Bump taskgraph to v3.0.0 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D155978
2022-09-07 09:13:40 +00:00
Suhaib Mujahid
22e1292f7c Bug 1787333 - Update the documentation for variants and add the expiration policy. r=jmaher DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D155999
2022-08-30 19:24:50 +00:00
Alexandre Lissy
11edda8db3 Bug 1779245 - Add symbol reprocessing r=gsvelto,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D151638
2022-07-20 14:33:59 +00:00
Andrew Halberstadt
3c131b2865 Bug 1779646 - [docs] Re-structure the 'how-to' section of taskgraph docs, r=taskgraph-reviewers,aki
This links directly to the taskgraph howto section in most cases:
https://taskcluster-taskgraph.readthedocs.io/en/latest/howto/index.html

Then removes documentation that duplicates that section.

Jira: RELENG-709

Differential Revision: https://phabricator.services.mozilla.com/D151937
2022-07-15 20:58:34 +00:00
Andrew Halberstadt
5e36818adc Bug 1779646 - [docs] Re-structure/remove taskgraph documentation that duplicates standalone docs, r=taskgraph-reviewers,aki
Lots of this documentation has been migrated to:
https://taskcluster-taskgraph.readthedocs.io/en/latest/index.html

Rather than maintain two sets of parallel docs, this refactors the Gecko docs
to point to the taskgraph ones where appropriate.

Jira: RELENG-709

Differential Revision: https://phabricator.services.mozilla.com/D151935
2022-07-15 20:58:33 +00:00
Andrew Halberstadt
1ac8426830 Bug 1779646 - [docs] Remove 'taskcluster/docs/task-graph.rst', r=taskgraph-reviewers,aki
This was an import from MDN that I don't think was providing much value.

Jira: RELENG-709

Differential Revision: https://phabricator.services.mozilla.com/D151934
2022-07-15 20:58:33 +00:00
Andrew Halberstadt
ddf5db77a4 Bug 1779646 - [docs] Re-write landing page for Taskcluster / Taskgraph documentation, r=taskgraph-reviewers,aki
Jira: RELENG-709

Differential Revision: https://phabricator.services.mozilla.com/D151933
2022-07-15 20:58:32 +00:00
Yulia
89693fb77a Bug 1771587 - Implement are-we-esmified-yet check on ci; r=marco,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D150369
2022-07-06 08:24:18 +00:00
Marco Castelluccio
b5b348a72e Bug 1774544 - doc: Update link to cron.yml schema. r=sylvestre DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D149502
2022-06-16 08:44:28 +00:00
Kirk Steuber
6e1fd2e517 Bug 1646989 - Update docs to account for --enable-unverified-updates flag r=nalexander,application-update-reviewers
Also adds docs for how to run the Maintenance Service tests, which is another thing that the --enable-unverified-updates will be useful for.

Differential Revision: https://phabricator.services.mozilla.com/D148870
2022-06-15 17:49:46 +00:00
Julien Cristau
a5fe1d9c13 Bug 1738321 - remove iris test suite. r=tracy
Differential Revision: https://phabricator.services.mozilla.com/D148374
2022-06-15 15:43:40 +00:00
Gian-Carlo Pascutto
da575c1347 Bug 1772141 - Update "Using the Mozilla Source Server" documentation. r=sylvestre DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D147877
2022-06-01 17:04:10 +00:00
Dave Townsend
418ef7501d Bug 1771920: Clarify the docs on generating MAR files for macOS. r=bhearsum DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D147750
2022-05-31 14:56:02 +00:00
Gabriel Bustamante
b094ef5722 Bug 1766928 - Configure Taskgraph to support esr102 r=releng-reviewers,jcristau,gbrown,aki
Differential Revision: https://phabricator.services.mozilla.com/D145900
2022-05-16 16:13:57 +00:00
Gregory Mierzwinski
2ddffcb64a Bug 1677559 - Remove the vismet browsertime tasks. r=perftest-reviewers,afinder
This patch removes all the code related to the second task (the `*-vismet` tasks) we were using for visual-metrics processing.

Differential Revision: https://phabricator.services.mozilla.com/D142837
2022-05-02 12:26:13 +00:00
Andrew Halberstadt
20b83081a2 Bug 1748926 - [taskgraph] Move Task.release_artifacts to an attribute, r=aki
The 'release_artifacts' attribute of the Task object doesn't exist in upstream
taskgraph. This attribute is only needed by certain kinds and likely doesn't
belong on the general purpose Task container. Move it to an attribute instead.

This was tested via `taskgraph --diff` on all release tasks. While there is a
diff in that 'release_artifacts' moves from the top-level to under an
attribute, there is no change to the payload of any tasks. So this shouldn't
affect any release graphs.

Depends on D140081

Differential Revision: https://phabricator.services.mozilla.com/D140082
2022-03-03 16:51:19 +00:00
Julien Cristau
6bc918d507 Bug 1728882 - upload generated sources for both x64 and aarch64 mac builds r=releng-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D139162
2022-02-24 16:19:35 +00:00
Julien Cristau
80488968b6 Bug 1753621 - add upload-symbols-dummy task kind to handle macosx. r=releng-reviewers,aki
Without this, the desktop nightly graph does not include upload-symbols
tasks for mac, because these tasks don't have the macosx64-shippable
build_platform due to the split x64 / aarch64 build.

Differential Revision: https://phabricator.services.mozilla.com/D139149
2022-02-24 16:19:34 +00:00