Commit Graph

169 Commits

Author SHA1 Message Date
Justin Wood
d55e3df106 Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D67152
2020-05-18 14:37:12 +00:00
Mike Hommey
4f407cb9b4 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 14:16:03 +00:00
Narcis Beleuzu
51c3c369dd Backed out changeset 0a1edd15b210 (bug 1634204) for valgrind bustages. CLOSED TREE 2020-05-06 17:10:37 +03:00
Mike Hommey
87df0b2d72 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 07:35:52 +00:00
Narcis Beleuzu
845e286da1 Backed out changeset b4d73278792e (bug 1634204) as per glandium req. 2020-05-06 10:33:08 +03:00
Mike Hommey
80e8586858 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 04:56:14 +00:00
Csoregi Natalia
dc4560dcaa Backed out changeset 2bf3343d2994 (bug 1634204) as per request. CLOSED TREE 2020-05-06 07:24:07 +03:00
Mike Hommey
d0b2cc67af Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-05 12:13:27 +00:00
Mike Hommey
3d64f74464 Bug 1634204 - Update Debian-based docker images to a newer snapshot. r=froydnj
20190228 is the last snapshot of Debian wheezy available on dockerhub.

Differential Revision: https://phabricator.services.mozilla.com/D73781
2020-05-05 12:15:35 +00:00
Mike Hommey
340788143e Bug 1632693 - Upgrade wine to 5.0. r=rstewart
It requires a newer version of bison to build, which we get by using a
more recent version of Debian for the toolchain build (Debian 9 being
the version we use for the builds that depend on wine, so it will work
there).

Differential Revision: https://phabricator.services.mozilla.com/D72254
2020-04-25 21:02:23 +00:00
Mike Hommey
eacc64e6c5 Bug 1450088 - Create a Debian 10-based docker image to build toolchains. r=froydnj
With a backport of a more recent version of cmake.

Differential Revision: https://phabricator.services.mozilla.com/D68154

--HG--
extra : moz-landing-system : lando
2020-03-26 21:53:00 +00:00
Mihai Tabara
f6462fdfc3 Bug 1591387 - add flatpak release automation. r=rail
Adjust runme to be executable

Rm sdk/pltf install.Manually add meta

Enforce firefox run instead of notify

Add policy to disable updates

Temp hack to default to firefox instead of notify-send

Fix mach linters

Remove firefox command hack. Proper fix

Remove duplicate cmd in runme

Fix indentantion in kind

Fix more linters

Differential Revision: https://phabricator.services.mozilla.com/D59561

--HG--
extra : moz-landing-system : lando
2020-03-09 12:16:51 +00:00
Simon Fraser
ae80827888 Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-update/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-05 13:49:24 +00:00
Ciure Andrei
6fb6ae2327 Backed out changeset 7e16fe72804a (bug 1619944) for causing gecko decision bustage CLOSED TREE
--HG--
rename : taskcluster/ci/python-dependency-updates/kind.yml => taskcluster/ci/pipfile-update/kind.yml
rename : taskcluster/docker/python-dependency-update/Dockerfile => taskcluster/docker/pipfile-updates/Dockerfile
rename : taskcluster/docker/python-dependency-update/README.md => taskcluster/docker/pipfile-updates/README.md
rename : taskcluster/docker/python-dependency-update/runme.sh => taskcluster/docker/pipfile-updates/runme.sh
rename : taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh => taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh
rename : taskcluster/docker/python-dependency-update/setup.sh => taskcluster/docker/pipfile-updates/setup.sh
rename : taskcluster/taskgraph/transforms/python_update.py => taskcluster/taskgraph/transforms/pipfile_update.py
2020-03-05 13:05:34 +02:00
Simon Fraser
c8f4578a7f Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-updates/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-04 17:47:49 +00:00
Edwin Takahashi
f0abec95b9 Bug 1612279 - condprof to use ubuntu1804-test image r=tarek
Changes:

Use the `ubuntu1804-test` image for condprof generation.

Differential Revision: https://phabricator.services.mozilla.com/D61297

--HG--
extra : moz-landing-system : lando
2020-01-30 14:50:27 +00:00
Dzmitry Malyshau
82be8c479a Bug 1596127 - wgpu Rust tests CI job r=ahal,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D58414

--HG--
extra : moz-landing-system : lando
2020-01-23 20:42:22 +00:00
Dzmitry Malyshau
69b270f2c6 Bug 1605171 - Replace wrupdater with github-sync r=tomprince
this is an evolution of wrupdater

Differential Revision: https://phabricator.services.mozilla.com/D58972

--HG--
extra : moz-landing-system : lando
2020-01-14 18:37:28 +00:00
Dzmitry Malyshau
785a7cfbc2 Bug 1596126 - Github synchronization for gfx/wgpu r=Callek,tomprince
This change introduces a "github-sync" component into tools,
which aims to support synchronizing both wgpu and WebRender with github.
~~It also features a "cargo test" job for standalone wgpu (bug  1596127)~~

The code is ported from "gfx/wr/scripts/wrupdater" folder. Changes are:
  1. remove explicit WR parts and make them configurable by command line params
  2. detect "mozilla-xxx" tags and use them in addition to the commits

As a follow up, wrupdater will be removed in favor of github-sync.

Status:
  - [x] get the CI test job working
  - [x] get @kats to fork "wgpu" github for "moz-gfx" bot
  - [x] remove the wgpu testing CI job (into separate PR)
  - [x] create new secret and reference it

Differential Revision: https://phabricator.services.mozilla.com/D57057

--HG--
extra : moz-landing-system : lando
2019-12-28 02:44:59 +00:00
Steve Fink
624723e687 Bug 1597005 - Add taskcluster job to run gdb prettyprinter tests r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D54237

--HG--
extra : moz-landing-system : lando
2019-12-20 03:35:43 +00:00
Tom Prince
e1a48b10ff Bug 1604909: Switch condprof to use debian test image as base; r=tarek
The ppa we were using to get a python newer than 3.5 is no longer public.
Switch to a newer base image, that is on a distribution that provides python3.7
natively.

Differential Revision: https://phabricator.services.mozilla.com/D57659

--HG--
extra : moz-landing-system : lando
2019-12-18 20:23:36 +00:00
Tom Prince
f0235b4f0c Bug 1596775: Import scripts for uploading windows system symbols; r=marco
This imports the code from
https://github.com/marco-c/breakpad-win-update-symbols

Differential Revision: https://phabricator.services.mozilla.com/D55322

--HG--
extra : moz-landing-system : lando
2019-12-11 10:14:29 +00:00
Tom Prince
9e2fc7ebbc Bug 1596775: Import scripts for downloading macOS system symbols; r=marco
Import the code from
https://github.com/marco-c/breakpad-mac-update-symbols/
and
https://github.com/marco-c/breakpad-scrape-system-symbols

Differential Revision: https://phabricator.services.mozilla.com/D55321

--HG--
extra : moz-landing-system : lando
2019-12-12 02:05:21 +00:00
Mike Hommey
70a2f77dfa Bug 1598186 - Upgrade diffoscope to a more recent version. r=froydnj
This has the side effect of updating all debian10-based docker images
(except the ones based on debian10-test)

Differential Revision: https://phabricator.services.mozilla.com/D54069

--HG--
extra : moz-landing-system : lando
2019-11-21 15:03:56 +00:00
Edwin Takahashi
63414f3417 Bug 1563864 - add ubuntu18.04 dockerfile and enable codepath to specify image for use in linux testing r=jmaher
Changes:

Add Ubuntu 18.04 `dockerfile`, support files and `ubuntu1804-test-system-setup.sh` that slightly differs from `ubuntu1604-test-system-setup.sh` in package contents.

Add a temporary flag to `try fuzzy` selector, taskcluster decision and taskgraphs to enable selection of Ubuntu 18.04 docker image to run linux tests.

Differential Revision: https://phabricator.services.mozilla.com/D53750

--HG--
extra : moz-landing-system : lando
2019-11-20 18:18:07 +00:00
Jesse Schwartzentruber
e326136cb6 Bug 1596953 - Add valgrind to android-build image. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D53287

--HG--
extra : moz-landing-system : lando
2019-11-18 20:38:11 +00:00
Wes Kocher
c4acd9439a Bug 1573271 - Run the iris test suite in CI on Windows and Linux r=grenade,tomprince
This patch enables the iris test suite to run in CI against Windows and Linux shippable builds on mozilla-central and try. The framework is in place for Iris to run against MacOS in CI, but it is currently disabled while bootstrapping issues are sorted out.

Linux uses a new docker image based on the debian10-test parent image that installs preinstalls most of Iris's dependencies. Windows installs a few dependencies using the scoop package manager. Both then install the rest of the python dependencies via pip.

This adds a new toolchain artifact to fetch the iris_firefox git repo without touching the outside network.

Differential Revision: https://phabricator.services.mozilla.com/D41638

--HG--
extra : moz-landing-system : lando
2019-10-02 01:58:31 +00:00
Nathan Froyd
65e0042e18 Bug 1578535 - base arm64-related build images off debian10; r=glandium
Our build toolchains don't contain libstdc++ headers for aarch64, so our
aarch64 builds rely on whatever libstdc++ headers the system has
installed.  To bring in newer headers on our aarch64 builds, then, we
need to update the system images for those builds, which this patch does.

Depends on D45861

Differential Revision: https://phabricator.services.mozilla.com/D45862

--HG--
extra : moz-landing-system : lando
2019-09-18 02:58:56 +00:00
Tarek Ziadé
5dd9d5bcd0 Bug 1562870 - generate conditioned profiles r=gbrown,bc,aerickson
Generates "conditioned" profiles.

Differential Revision: https://phabricator.services.mozilla.com/D38211

--HG--
extra : moz-landing-system : lando
2019-09-16 19:44:35 +00:00
Andi-Bogdan Postelnicu
1b886ecee7 Bug 1576659 - Update infer to 0.17.0. r=bastien
Differential Revision: https://phabricator.services.mozilla.com/D43471

--HG--
extra : moz-landing-system : lando
2019-09-13 14:25:32 +00:00
Razvan Maries
98fb942aa9 Backed out changeset 70e72871917e (bug 1576659) for Linux x64 debug build bustages. CLOSED TREE 2019-09-12 15:51:31 +03:00
Andi-Bogdan Postelnicu
bc7bd7de68 Bug 1576659 - Update infer to 0.17.0. r=bastien
Differential Revision: https://phabricator.services.mozilla.com/D43471

--HG--
extra : moz-landing-system : lando
2019-09-12 12:17:50 +00:00
Barret Rennie
1ab6ec337d Bug 1563090 - Add a visual metrics treeherder task r=nalexander,tomprince
This new task fetches the visualmetrics.py script from the
github.com/mozilla/browsertime repository and runs it in parallel for the
specified jobs. Jobs are specified in a JSON blob passed through to the task in
an environment variable. A follow up patch specifies a command line argument to
make this configuration available to `./mach try {fuzzy|chooser}`

Differential Revision: https://phabricator.services.mozilla.com/D41052

--HG--
extra : moz-landing-system : lando
2019-09-04 16:42:31 +00:00
Narcis Beleuzu
3fca079bae Backed out 2 changesets (bug 1563090) for Linting failure on run-visual-metrics.py . CLOSED TREE
Backed out changeset 1b2389663474 (bug 1563090)
Backed out changeset 9071c90b2e84 (bug 1563090)
2019-09-04 19:03:58 +03:00
Barret Rennie
df8c6f79f1 Bug 1563090 - Add a visual metrics treeherder task r=nalexander,tomprince
This new task fetches the visualmetrics.py script from the
github.com/mozilla/browsertime repository and runs it in parallel for the
specified jobs. Jobs are specified in a JSON blob passed through to the task in
an environment variable. A follow up patch specifies a command line argument to
make this configuration available to `./mach try {fuzzy|chooser}`

Differential Revision: https://phabricator.services.mozilla.com/D41052

--HG--
extra : moz-landing-system : lando
2019-09-03 22:05:26 +00:00
Edwin Takahashi
3607d54634 Bug 1565332 - add new dockerfile for debian 10 (buster) test image and add necessary piping without switching the main CI pipeline from ubuntu 16.04 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D42597

--HG--
extra : moz-landing-system : lando
2019-08-31 09:59:43 +00:00
Mike Hommey
21665e187c Bug 1569124 - Add git support to fetch tasks. r=tomprince
This is loosely based on what was in bug 1467359, but simplified to
handle git only, and simply using git-archive because, at least now,
it's deterministic (it uses the commit date as timestamp in tar
archives).

This also adds 4 tasks for some of the things we use for toolchains, but
doesn't hook them up yet.

This also upgrades the fetch docker image to Debian buster, and installs
the required packages in it.

Differential Revision: https://phabricator.services.mozilla.com/D39480
2019-07-30 14:43:31 +09:00
Mike Hommey
bb9fe7e1bd Bug 1566768 - Do not use our backport of valgrind in the docker image for base toolchain builds. r=mshal
Not that it's causing any problem, but I noticed the build-base image
was being rebuilt when updating valgrind, and that seemed odd.

Differential Revision: https://phabricator.services.mozilla.com/D38297

--HG--
extra : moz-landing-system : lando
2019-07-19 04:28:17 +00:00
Mike Hommey
b0cf4ceea4 Bug 1566730 - Switch the diffoscope docker image to Debian 10. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D38274

--HG--
extra : moz-landing-system : lando
2019-07-17 21:54:25 +00:00
Mike Hommey
f8fabf1391 Bug 1566730 - Add docker images based on Debian 10. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D38273

--HG--
extra : moz-landing-system : lando
2019-07-17 21:26:53 +00:00
Kartikaya Gupta
2d73759624 Bug 1523321 - Run the wrupdater on m-c pushes that touch gfx/wr. r=tomprince,jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D33548

--HG--
extra : moz-landing-system : lando
2019-07-16 15:38:39 +00:00
Narcis Beleuzu
ab956a715f Backed out 2 changesets (bug 1523321) for webrender bustages. CLOSED TREE
Backed out changeset d86e7c8f1e14 (bug 1523321)
Backed out changeset 18414da977c3 (bug 1523321)
2019-07-16 18:23:45 +03:00
Kartikaya Gupta
b3bebb6eca Bug 1523321 - Run the wrupdater on m-c pushes that touch gfx/wr. r=tomprince,jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D33548

--HG--
extra : moz-landing-system : lando
2019-07-16 14:09:47 +00:00
Brindusan Cristian
3de8b088e1 Backed out 2 changesets (bug 1523321) for breaking Gecko Decision Task. CLOSED TREE
Backed out changeset c032bed595dc (bug 1523321)
Backed out changeset 0a4f53b896b1 (bug 1523321)
2019-07-16 17:00:24 +03:00
Kartikaya Gupta
c6cc78e85f Bug 1523321 - Run the wrupdater on m-c pushes that touch gfx/wr. r=tomprince,jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D33548

--HG--
extra : moz-landing-system : lando
2019-07-16 13:49:54 +00:00
Tom Prince
85e8be2031 Bug 1550816: Enforce consistent indenting in taskcluster yaml; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D30684

--HG--
extra : moz-landing-system : lando
2019-05-10 21:19:48 +00:00
Nathan Froyd
f1626f7f7b Bug 1540082 - add a toolchain-arm64-build docker image; r=nalexander
We need this image for building clang on machines with arm64
sysroots.  (Note that this image *is* a linux x86-64 image, just with
some arm64 cross-compilation packages available.)

Differential Revision: https://phabricator.services.mozilla.com/D28404

--HG--
extra : moz-landing-system : lando
2019-04-23 19:44:55 +00:00
Mike Hommey
99edb1f46a Bug 1541823 - Derive the fetch docker image from debian9-raw rather than debian9-base. r=dustin
This will make the image smaller, and will make it happen earlier in
cases its dependencies need to be rebuilt.

Differential Revision: https://phabricator.services.mozilla.com/D26082
2019-04-11 16:24:50 +09:00
Johan Lorenzo
5e83fc51e7 Bug 1540152 - Run checks done in push-apk in promote-phase, instead of the very last task of the pipeline r=mtabara
Run checks done in push-apk in promote-phase, instead of the very last task of the pipeline

Differential Revision: https://phabricator.services.mozilla.com/D26328

--HG--
rename : taskcluster/docker/google-play-strings/Dockerfile => taskcluster/docker/mozapkpublisher/Dockerfile
extra : moz-landing-system : lando
2019-04-09 14:56:52 +00:00
Mike Hommey
b22d57ac74 Bug 1541821 - Update debian7 docker images for CVE-2019-3462. r=tomprince
This imports the changes from wheezy-lts (http://deb.freexian.com/extended-lts/)
and creates a package we install in the debian7-based images (with a
modified version number to work around bug #1419577.

This leaves out debian7-raw and debian7-packages as unpatched, because
of the chicken-and-egg problem.

Depends on D26100

Differential Revision: https://phabricator.services.mozilla.com/D26102

--HG--
extra : moz-landing-system : lando
2019-04-04 16:23:58 +00:00