Commit Graph

65 Commits

Author SHA1 Message Date
Mike Hommey
bc8366ddca Bug 1648256 - Upgrade valgrind to latest release. r=firefox-build-system-reviewers,rstewart
There isn't a Debian package for that verson yet, so keep using the code
that pulls from the git repository, but use the revision that was
released as 3.16.1.

Differential Revision: https://phabricator.services.mozilla.com/D80957
2020-06-24 20:55:05 +00:00
Mike Hommey
3437f37ac4 Bug 1647880 - Upgrade cmake to 3.16.3 for toolchain builds. r=firefox-build-system-reviewers,rstewart
This gets us to the same version as the one used on the Debian 10
toolchain docker image.

Differential Revision: https://phabricator.services.mozilla.com/D80818
2020-06-24 15:17:03 +00:00
Mike Hommey
ef2aafa5a5 Bug 1643504 - Remove not unused Debian stretch-based docker images. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D78433
2020-06-09 01:01:33 +00:00
Mike Hommey
98b889cf83 Bug 1622963 - Install python 3.6 in build docker images. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D77753
2020-06-02 03:51:14 +00:00
Mike Hommey
4f407cb9b4 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 14:16:03 +00:00
Narcis Beleuzu
51c3c369dd Backed out changeset 0a1edd15b210 (bug 1634204) for valgrind bustages. CLOSED TREE 2020-05-06 17:10:37 +03:00
Mike Hommey
87df0b2d72 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 07:35:52 +00:00
Narcis Beleuzu
845e286da1 Backed out changeset b4d73278792e (bug 1634204) as per glandium req. 2020-05-06 10:33:08 +03:00
Mike Hommey
80e8586858 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 04:56:14 +00:00
Csoregi Natalia
dc4560dcaa Backed out changeset 2bf3343d2994 (bug 1634204) as per request. CLOSED TREE 2020-05-06 07:24:07 +03:00
Mike Hommey
d0b2cc67af Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-05 12:13:27 +00:00
Mike Hommey
3d64f74464 Bug 1634204 - Update Debian-based docker images to a newer snapshot. r=froydnj
20190228 is the last snapshot of Debian wheezy available on dockerhub.

Differential Revision: https://phabricator.services.mozilla.com/D73781
2020-05-05 12:15:35 +00:00
Mike Hommey
eacc64e6c5 Bug 1450088 - Create a Debian 10-based docker image to build toolchains. r=froydnj
With a backport of a more recent version of cmake.

Differential Revision: https://phabricator.services.mozilla.com/D68154

--HG--
extra : moz-landing-system : lando
2020-03-26 21:53:00 +00:00
Mike Hommey
99572b3223 Bug 1606007 - Upgrade valgrind to current git trunk. r=froydnj
The added hacks are derived from what was used in bug 1479055.

Differential Revision: https://phabricator.services.mozilla.com/D60806

--HG--
extra : moz-landing-system : lando
2020-01-23 21:12:14 +00:00
Mike Hommey
713a866401 Bug 1569355 - Upgrade python-zstandard to 0.11.1. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D39583

MANUAL PUSH: avoid closing autoland while all docker images and
toolchains are rebuilt due to both changes.
2019-07-30 14:49:16 +09:00
Mike Hommey
83c4e99e8e Bug 1566768 - Upgrade valgrind to 3.15.0. r=mshal
Differential Revision: https://phabricator.services.mozilla.com/D38296

--HG--
extra : moz-landing-system : lando
2019-07-19 04:28:38 +00:00
Mike Hommey
f8fabf1391 Bug 1566730 - Add docker images based on Debian 10. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D38273

--HG--
extra : moz-landing-system : lando
2019-07-17 21:26:53 +00:00
Tom Prince
85e8be2031 Bug 1550816: Enforce consistent indenting in taskcluster yaml; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D30684

--HG--
extra : moz-landing-system : lando
2019-05-10 21:19:48 +00:00
Tom Prince
e0ca5b4dd8 Bug 1532783: [taskgraph] Switch to using worker aliases for docker-worker and generic-worker; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D24238

--HG--
extra : moz-landing-system : lando
2019-04-30 22:58:06 +00:00
Mike Hommey
b22d57ac74 Bug 1541821 - Update debian7 docker images for CVE-2019-3462. r=tomprince
This imports the changes from wheezy-lts (http://deb.freexian.com/extended-lts/)
and creates a package we install in the debian7-based images (with a
modified version number to work around bug #1419577.

This leaves out debian7-raw and debian7-packages as unpatched, because
of the chicken-and-egg problem.

Depends on D26100

Differential Revision: https://phabricator.services.mozilla.com/D26102

--HG--
extra : moz-landing-system : lando
2019-04-04 16:23:58 +00:00
Mike Hommey
564e4e46d2 Bug 1532883 - Remove nasm Debian packages. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D22257

--HG--
extra : moz-landing-system : lando
2019-03-07 05:50:31 +00:00
Mike Hommey
ec4fc79e18 Bug 1524703 - Install nasm 2.13 in static-analysis-autotest docker image. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D18477

--HG--
extra : moz-landing-system : lando
2019-02-04 17:56:06 +00:00
Gregory Szorc
12bd06909d Bug 1513320 - SQLite package backport for Debian 7; r=glandium
The SQLite in Debian 7 (3.7.13) lacks support for common table
expressions (the WITH keyword), which was introduced in SQLite
3.8.3. The Mercurial SQLite storage backend currently relies on
CTEs. Even if a future Mercurial doesn't require CTE, it is likely
that it will still use CTE if available for performance reasons.
So, it is in our best interest to give Mercurial access to a
modern SQLite. Plus, using a modern SQLite and avoiding potential
bugs in old versions seems prudent.

This commit introduces a SQLite package backport for Debian 7
so we can use the new SQLite feature. We had to minimally patch
the build to work with an older version of TCL that isn't using
multiarch.

I observed libsqlite3 being installed as part of building various
other packages (such as Python). I initially added the package as
a dependency so packages would be built against a more modern
SQLite. But glandium doesn't believe it matters, since nothing
should be doing build-time feature detection. Python is the most
important downstream package (since Mercurial uses its SQLite).
I audited the CPython build system and did not see any build-time
SQLite feature detection or version sniffing. So I think we'll be
fine building against an older SQLite.

Differential Revision: https://phabricator.services.mozilla.com/D14194

--HG--
extra : moz-landing-system : lando
2018-12-12 22:11:59 +00:00
Thomas Daede
ff5c8168d3 Bug 1511223 - Update deb7 nasm to 2.13.01. r=glandium
This pulls a newer version of the nasm package, and patches
out doc building in order to make it compile on debian 7.

Differential Revision: https://phabricator.services.mozilla.com/D13510

--HG--
extra : moz-landing-system : lando
2018-12-07 18:50:18 +00:00
Tom Prince
09b40dbe1d Bug 1471905: [taskgraph] Consistently include the cache digests of parent tasks in downstream cached tasks; r=dustin
There are several kinds that cache tasks based on the inputs that go into the task. Historically,
these inputs included the name of upstream tasks. This change these tasks to include the digest
of the upstream tasks.

This also bumps the version of the docker and toolchain as every digest is changed for them.

Differential Revision: https://phabricator.services.mozilla.com/D11949

--HG--
extra : moz-landing-system : lando
2018-12-05 02:15:56 +00:00
Gregory Szorc
53543bee19 Bug 1512075 - Upgrade to Mercurial 4.8.1; r=ted
This was released a few minutes ago. It contains some fixes necessary to support
partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D13768

--HG--
extra : moz-landing-system : lando
2018-12-04 23:31:26 +00:00
Gregory Szorc
67bc92af82 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

--auto-deconfigure was added because desktop1604-test now inherits
from a base image with Mercurial installed.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : moz-landing-system : lando
2018-12-04 21:34:50 +00:00
Ciure Andrei
5f24ab251d Backed out changeset 5c22ecb14543 (bug 1505579) for docker image bustages CLOSED TREE 2018-12-04 21:44:13 +02:00
Gregory Szorc
305a96b279 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : rebase_source : 712fa08226f74ef9cfe306b7c68ff3dd3f54d9d3
extra : source : a438eff7d106f25a951c690c22f30b37d40d54a6
2018-11-09 03:53:26 +00:00
Mike Hommey
4d20055393 Bug 1507390 - Upgrade valgrind to version 3.14.0. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D11991

--HG--
extra : moz-landing-system : lando
2018-11-19 17:18:23 +00:00
Thomas Daede
fc38f7c404 Bug 1501796: Add nasm 2.12 backport to Debian 7 packages. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D10802

--HG--
extra : moz-landing-system : lando
2018-11-16 21:51:18 +00:00
Csoregi Natalia
7193f85c68 Backed out changeset 6357c007967a (bug 1501796) for packages for Debian 7 bustage. CLOSED TREE 2018-11-16 00:12:42 +02:00
Thomas Daede
67effe82c2 Bug 1501796: Add nasm 2.12 backport to Debian 7 packages. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D10802

--HG--
extra : moz-landing-system : lando
2018-11-09 05:27:52 +00:00
Noemi Erli
d5165d5f53 Backed out changeset a438eff7d106 (bug 1505579) for breaking Docker images CLOSED TREE 2018-11-15 08:09:55 +02:00
Gregory Szorc
7698680404 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : moz-landing-system : lando
2018-11-09 03:53:26 +00:00
Mike Hommey
3af56ebd55 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 19:49:39 +09:00
Mike Hommey
57ba658870 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 19:49:38 +09:00
Mike Hommey
ad2fed0601 Backed out 6 changesets (bug 1504906 and bug 1505652) to give time to toolchains and docker images to build without blocking other landings.
Backed out changeset 2fe1e2b7d9c6 (bug 1504906)
Backed out changeset 27b4002951a4 (bug 1504906)
Backed out changeset f7a685b16579 (bug 1504906)
Backed out changeset f8064dbb8009 (bug 1504906)
Backed out changeset f899fbb4a5d7 (bug 1504906)
Backed out changeset 3f71db4aef73 (bug 1505652)
2018-11-08 17:18:05 +09:00
Mike Hommey
01409eddf4 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 17:13:24 +09:00
Mike Hommey
ecdd3c0534 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 17:13:23 +09:00
Mike Hommey
d0ec6a60ce Backout changesets 2e0ed8c61e24, b569742fbbf2 and 6f8c933b7938 (bug 1504906) to give time to docker images to build without blocking other landings. 2018-11-08 10:49:16 +09:00
Mike Hommey
7b276b9a22 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 10:44:53 +09:00
Mike Hommey
ca374653a7 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 10:44:10 +09:00
Connor Sheehan
b33e4325ee Bug 1480228: upgrade Mercurial clients to 4.7.1 in Debian based Docker images r=gps
Upgrading to 4.7.1 will apply a fix to a performance regression
that was introduced in 4.7.

Differential Revision: https://phabricator.services.mozilla.com/D4961

--HG--
extra : rebase_source : 0139856b2f2a22c5a0e8876d5e34cc8f7e8e0307
extra : source : 1b49fa4d48428ad7bac0cca69fb5f5f3767c43b9
2018-09-06 17:16:32 +00:00
Mike Hommey
370eb66bdb Bug 1479055 - Upgrade valgrind to current git trunk. r=froydnj 2018-08-14 07:25:08 +09:00
Connor Sheehan
26defb7b4a Bug 1446453 - upgrade Mercurial clients to 4.7 in Debian based Docker images; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D2623

--HG--
extra : amend_source : f6504bdfcf3f51dc63f5250652812c2648ddff86
extra : histedit_source : 82fdfa1ae13949b2f3339a3592e7e1c6ccb55c89
2018-08-02 11:57:13 -07:00
Gregory Szorc
fb21a1e517 Bug 1466746 - Debian packages for python-zstandard; r=glandium
python-zstandard's 0.9.1 source distribution contains a debian/
directory.

On Squeeze, producing a Debian package is straightforward.

On Wheezy, we need to hack up Build-Depends because Wheezy doesn't
have a package for the Hypothesis fuzzing library. This package is
only used for testing and our package building disables testing,
so we don't even need to further hack up the packaging to disable
tests.

MozReview-Commit-ID: 6raXjdzggCH

--HG--
extra : rebase_source : 672492a40d65df8430eb17ba033bcb1c0890b7df
2018-06-04 23:10:59 -07:00
Gregory Szorc
cb55d0ae63 Bug 1466746 - dh-python backport for wheezy; r=glandium
dh-python isn't available in Wheezy. Let's backport it so we can
build Python packages that use it.

Fortunately for us, the package builds without any modifications.
The only customization we need is to ensure our custom Python
packages are present in order to satisfy Build-Depends.

MozReview-Commit-ID: CqZtwvosA6K

--HG--
extra : rebase_source : 36515905a6c5937ba16f5f4b566b61715b4f26ac
2018-06-04 23:06:01 -07:00
Gregory Szorc
a339b799f8 Bug 1460451 - Add /usr/bin/python3 to Debian images; r=glandium
The python3-minimal package provides /usr/bin/python3 on Debian.

This commit installs this package so a `python3` executable is
provided.

This required backporting the package to wheezy. The final patch
is trivial. But I wasted a bit of time figuring out why `mk-build-deps`
wasn't working. It would no-op and exit 0 and then the build would
complain about missing dependencies!

glandium's theory is that the ":any" multiarch support on wheezy
isn't complete. Removing ":any" seems to make things "just work."

MozReview-Commit-ID: FBicpK4SmkQ

--HG--
extra : rebase_source : a28ce731024e8ed6a43fb30e2ed57da2abb50d0f
2018-05-09 19:54:21 -07:00
Gregory Szorc
cbab55349e Bug 1449629 - Install Python 3.5 in Debian 7 base image; r=glandium
Debian 7 ships Python 3.2 by default. That's too old for our
upcoming build requirement of Python 3.5.

This commit adds a Python 3.5 package for wheezy that backports
the Python 3.5 from a much later Debian version.

The patch was inspired by the existing patch for Python 2.7.
However, it needed additional work. The changes and reasons
should all be documented in the changelog file as part of the
package diff we apply.

I'm a bit disappointed we had to disable PGO. But it was
reliably segfaulting during the build. I didn't feel like going
down that rabbit hole.

MozReview-Commit-ID: ABpHW1KYFQP

--HG--
extra : rebase_source : 02dbd13236fe741cb33f07c803218fda339c214e
2018-04-02 19:27:12 -07:00