Commit Graph

47 Commits

Author SHA1 Message Date
Tom Prince
e0ca5b4dd8 Bug 1532783: [taskgraph] Switch to using worker aliases for docker-worker and generic-worker; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D24238

--HG--
extra : moz-landing-system : lando
2019-04-30 22:58:06 +00:00
Mike Hommey
b22d57ac74 Bug 1541821 - Update debian7 docker images for CVE-2019-3462. r=tomprince
This imports the changes from wheezy-lts (http://deb.freexian.com/extended-lts/)
and creates a package we install in the debian7-based images (with a
modified version number to work around bug #1419577.

This leaves out debian7-raw and debian7-packages as unpatched, because
of the chicken-and-egg problem.

Depends on D26100

Differential Revision: https://phabricator.services.mozilla.com/D26102

--HG--
extra : moz-landing-system : lando
2019-04-04 16:23:58 +00:00
Mike Hommey
564e4e46d2 Bug 1532883 - Remove nasm Debian packages. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D22257

--HG--
extra : moz-landing-system : lando
2019-03-07 05:50:31 +00:00
Mike Hommey
ec4fc79e18 Bug 1524703 - Install nasm 2.13 in static-analysis-autotest docker image. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D18477

--HG--
extra : moz-landing-system : lando
2019-02-04 17:56:06 +00:00
Gregory Szorc
12bd06909d Bug 1513320 - SQLite package backport for Debian 7; r=glandium
The SQLite in Debian 7 (3.7.13) lacks support for common table
expressions (the WITH keyword), which was introduced in SQLite
3.8.3. The Mercurial SQLite storage backend currently relies on
CTEs. Even if a future Mercurial doesn't require CTE, it is likely
that it will still use CTE if available for performance reasons.
So, it is in our best interest to give Mercurial access to a
modern SQLite. Plus, using a modern SQLite and avoiding potential
bugs in old versions seems prudent.

This commit introduces a SQLite package backport for Debian 7
so we can use the new SQLite feature. We had to minimally patch
the build to work with an older version of TCL that isn't using
multiarch.

I observed libsqlite3 being installed as part of building various
other packages (such as Python). I initially added the package as
a dependency so packages would be built against a more modern
SQLite. But glandium doesn't believe it matters, since nothing
should be doing build-time feature detection. Python is the most
important downstream package (since Mercurial uses its SQLite).
I audited the CPython build system and did not see any build-time
SQLite feature detection or version sniffing. So I think we'll be
fine building against an older SQLite.

Differential Revision: https://phabricator.services.mozilla.com/D14194

--HG--
extra : moz-landing-system : lando
2018-12-12 22:11:59 +00:00
Thomas Daede
ff5c8168d3 Bug 1511223 - Update deb7 nasm to 2.13.01. r=glandium
This pulls a newer version of the nasm package, and patches
out doc building in order to make it compile on debian 7.

Differential Revision: https://phabricator.services.mozilla.com/D13510

--HG--
extra : moz-landing-system : lando
2018-12-07 18:50:18 +00:00
Tom Prince
09b40dbe1d Bug 1471905: [taskgraph] Consistently include the cache digests of parent tasks in downstream cached tasks; r=dustin
There are several kinds that cache tasks based on the inputs that go into the task. Historically,
these inputs included the name of upstream tasks. This change these tasks to include the digest
of the upstream tasks.

This also bumps the version of the docker and toolchain as every digest is changed for them.

Differential Revision: https://phabricator.services.mozilla.com/D11949

--HG--
extra : moz-landing-system : lando
2018-12-05 02:15:56 +00:00
Gregory Szorc
53543bee19 Bug 1512075 - Upgrade to Mercurial 4.8.1; r=ted
This was released a few minutes ago. It contains some fixes necessary to support
partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D13768

--HG--
extra : moz-landing-system : lando
2018-12-04 23:31:26 +00:00
Gregory Szorc
67bc92af82 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

--auto-deconfigure was added because desktop1604-test now inherits
from a base image with Mercurial installed.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : moz-landing-system : lando
2018-12-04 21:34:50 +00:00
Ciure Andrei
5f24ab251d Backed out changeset 5c22ecb14543 (bug 1505579) for docker image bustages CLOSED TREE 2018-12-04 21:44:13 +02:00
Gregory Szorc
305a96b279 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : rebase_source : 712fa08226f74ef9cfe306b7c68ff3dd3f54d9d3
extra : source : a438eff7d106f25a951c690c22f30b37d40d54a6
2018-11-09 03:53:26 +00:00
Mike Hommey
4d20055393 Bug 1507390 - Upgrade valgrind to version 3.14.0. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D11991

--HG--
extra : moz-landing-system : lando
2018-11-19 17:18:23 +00:00
Thomas Daede
fc38f7c404 Bug 1501796: Add nasm 2.12 backport to Debian 7 packages. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D10802

--HG--
extra : moz-landing-system : lando
2018-11-16 21:51:18 +00:00
Csoregi Natalia
7193f85c68 Backed out changeset 6357c007967a (bug 1501796) for packages for Debian 7 bustage. CLOSED TREE 2018-11-16 00:12:42 +02:00
Thomas Daede
67effe82c2 Bug 1501796: Add nasm 2.12 backport to Debian 7 packages. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D10802

--HG--
extra : moz-landing-system : lando
2018-11-09 05:27:52 +00:00
Noemi Erli
d5165d5f53 Backed out changeset a438eff7d106 (bug 1505579) for breaking Docker images CLOSED TREE 2018-11-15 08:09:55 +02:00
Gregory Szorc
7698680404 Bug 1505579 - Upgrade Docker images to Mercurial 4.8; r=sheehan
We need to run Mercurial 4.8 so we can start using SQLite storage
and wire protocol version 2 for partial clones.

Differential Revision: https://phabricator.services.mozilla.com/D11399

--HG--
extra : moz-landing-system : lando
2018-11-09 03:53:26 +00:00
Mike Hommey
3af56ebd55 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 19:49:39 +09:00
Mike Hommey
57ba658870 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 19:49:38 +09:00
Mike Hommey
ad2fed0601 Backed out 6 changesets (bug 1504906 and bug 1505652) to give time to toolchains and docker images to build without blocking other landings.
Backed out changeset 2fe1e2b7d9c6 (bug 1504906)
Backed out changeset 27b4002951a4 (bug 1504906)
Backed out changeset f7a685b16579 (bug 1504906)
Backed out changeset f8064dbb8009 (bug 1504906)
Backed out changeset f899fbb4a5d7 (bug 1504906)
Backed out changeset 3f71db4aef73 (bug 1505652)
2018-11-08 17:18:05 +09:00
Mike Hommey
01409eddf4 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 17:13:24 +09:00
Mike Hommey
ecdd3c0534 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 17:13:23 +09:00
Mike Hommey
d0ec6a60ce Backout changesets 2e0ed8c61e24, b569742fbbf2 and 6f8c933b7938 (bug 1504906) to give time to docker images to build without blocking other landings. 2018-11-08 10:49:16 +09:00
Mike Hommey
7b276b9a22 Bug 1504906 - Build 32-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
This creates 32-bits variants of the same packages that were added for
64-bits builds, with a few additions:
- python-defaults, so that the python package can be installed as a
  dependency of the libglib2.0-dev package,
- xkeyboard-config, so that the xkb-data package can be installed as a
  dependency of the libxkbcommon0 package.

Additionally, because the 32-bits and 64-bits packages are built
separately (the 32-bits packages can't, on Wheezy, be built on a 64-bits
host), they don't end up with the same
changelog.Debian/changelog.Debian.gz file because of a timestamp within
it. One way to address this would be to make the taskgraph more complex,
by adding a task creating the source package, and then two tasks
building the 32-bits and 64-bits binary packages from that source, but
that's not worth the overhead, when a simple hack works around the
problem: We make dpkg skip installing the changelog.Debian* files.

Differential Revision: https://phabricator.services.mozilla.com/D11140
2018-11-08 10:44:53 +09:00
Mike Hommey
ca374653a7 Bug 1504906 - Build 64-bits Gtk+ 3.10 packages for Debian Wheezy. r=gps
Along with all the updated dependencies that are necessary to achieve
this.

Differential Revision: https://phabricator.services.mozilla.com/D11138
2018-11-08 10:44:10 +09:00
Connor Sheehan
b33e4325ee Bug 1480228: upgrade Mercurial clients to 4.7.1 in Debian based Docker images r=gps
Upgrading to 4.7.1 will apply a fix to a performance regression
that was introduced in 4.7.

Differential Revision: https://phabricator.services.mozilla.com/D4961

--HG--
extra : rebase_source : 0139856b2f2a22c5a0e8876d5e34cc8f7e8e0307
extra : source : 1b49fa4d48428ad7bac0cca69fb5f5f3767c43b9
2018-09-06 17:16:32 +00:00
Mike Hommey
370eb66bdb Bug 1479055 - Upgrade valgrind to current git trunk. r=froydnj 2018-08-14 07:25:08 +09:00
Connor Sheehan
26defb7b4a Bug 1446453 - upgrade Mercurial clients to 4.7 in Debian based Docker images; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D2623

--HG--
extra : amend_source : f6504bdfcf3f51dc63f5250652812c2648ddff86
extra : histedit_source : 82fdfa1ae13949b2f3339a3592e7e1c6ccb55c89
2018-08-02 11:57:13 -07:00
Gregory Szorc
fb21a1e517 Bug 1466746 - Debian packages for python-zstandard; r=glandium
python-zstandard's 0.9.1 source distribution contains a debian/
directory.

On Squeeze, producing a Debian package is straightforward.

On Wheezy, we need to hack up Build-Depends because Wheezy doesn't
have a package for the Hypothesis fuzzing library. This package is
only used for testing and our package building disables testing,
so we don't even need to further hack up the packaging to disable
tests.

MozReview-Commit-ID: 6raXjdzggCH

--HG--
extra : rebase_source : 672492a40d65df8430eb17ba033bcb1c0890b7df
2018-06-04 23:10:59 -07:00
Gregory Szorc
cb55d0ae63 Bug 1466746 - dh-python backport for wheezy; r=glandium
dh-python isn't available in Wheezy. Let's backport it so we can
build Python packages that use it.

Fortunately for us, the package builds without any modifications.
The only customization we need is to ensure our custom Python
packages are present in order to satisfy Build-Depends.

MozReview-Commit-ID: CqZtwvosA6K

--HG--
extra : rebase_source : 36515905a6c5937ba16f5f4b566b61715b4f26ac
2018-06-04 23:06:01 -07:00
Gregory Szorc
a339b799f8 Bug 1460451 - Add /usr/bin/python3 to Debian images; r=glandium
The python3-minimal package provides /usr/bin/python3 on Debian.

This commit installs this package so a `python3` executable is
provided.

This required backporting the package to wheezy. The final patch
is trivial. But I wasted a bit of time figuring out why `mk-build-deps`
wasn't working. It would no-op and exit 0 and then the build would
complain about missing dependencies!

glandium's theory is that the ":any" multiarch support on wheezy
isn't complete. Removing ":any" seems to make things "just work."

MozReview-Commit-ID: FBicpK4SmkQ

--HG--
extra : rebase_source : a28ce731024e8ed6a43fb30e2ed57da2abb50d0f
2018-05-09 19:54:21 -07:00
Gregory Szorc
cbab55349e Bug 1449629 - Install Python 3.5 in Debian 7 base image; r=glandium
Debian 7 ships Python 3.2 by default. That's too old for our
upcoming build requirement of Python 3.5.

This commit adds a Python 3.5 package for wheezy that backports
the Python 3.5 from a much later Debian version.

The patch was inspired by the existing patch for Python 2.7.
However, it needed additional work. The changes and reasons
should all be documented in the changelog file as part of the
package diff we apply.

I'm a bit disappointed we had to disable PGO. But it was
reliably segfaulting during the build. I didn't feel like going
down that rabbit hole.

MozReview-Commit-ID: ABpHW1KYFQP

--HG--
extra : rebase_source : 02dbd13236fe741cb33f07c803218fda339c214e
2018-04-02 19:27:12 -07:00
Gregory Szorc
af8f8380c6 Bug 1448438 - Upgrade to Mercurial 4.5.2; r=sheehan
We bump the version of Mercurial for Debian packages and for Ubuntu
Docker images.

MozReview-Commit-ID: KYmG4rOm3TQ

--HG--
extra : rebase_source : cbb817a9ee4c27f0bc59f4fa1e2a708fac1cb093
2018-03-23 12:09:36 -07:00
Mike Hommey
a7182c9720 Bug 1436283 - Build a modern gdb version for Wheezy. r=dustin
The GDB version in Debian wheezy doesn't handle the DWARF data that the
GCC version we use to build Firefox and toolchains produce. So we take
the GDB version from Debian stretch and backport it.

--HG--
extra : rebase_source : dae0e9dcd5dde5a7c74b6cefd560480fccd9c5fa
2018-02-07 16:55:49 +09:00
Mike Hommey
220ae81745 Bug 1433033 - Create a mercurial package for Debian stretch. r=dustin
--HG--
extra : rebase_source : 6408957ddc6acf671c7fa190ec156e347124f588
2018-01-25 22:23:15 +09:00
Mike Hommey
8d30282b40 Bug 1431297 - Build a xz-utils package for Debian wheezy. r=dustin
There were a few constraints in the choice of the version of dpkg to
backport:
- 1.17.20 is the first version that supports the debian source format
  for that xz-utils package.
- versions >= 1.17.10 and <= 1.17.22 fail to build on wheezy.
- versions >= 1.17.21 depend on a version of patch not available on
  wheezy.

All in all, the simpler choice was to go with version 1.17.20 with a
backport of the build failure fix.

That version of dpkg breaks the version of devscripts in wheezy, so the
version from wheezy-backports would be better to use, but we can't
unconditionally use it on all builds, because it happens that
mk-build-deps from that version is broken with the dpkg in wheezy.

In the end, it's simpler to build that backport and rely on package task
dependencies rather than selectively install the package from
wheezy-backports, so we do that. Except we can't use version
2.14.11~bpo70+1 because of bug 1419577.

--HG--
extra : rebase_source : 19ad1a44b770229fbc7e15bbcf01d3cb101315a8
2018-01-18 14:41:11 +09:00
Mike Hommey
9eb36d84be Bug 1430984 - Automatically create a debian/changelog entry when there is no patch. r=dustin
--HG--
extra : rebase_source : d3d0cb7134470633460ecfc3ef52018145b8325f
2018-01-17 15:18:47 +09:00
Mike Hommey
4c676f87cd Bug 1430984 - Drive-by: Move debian package jobs defaults to kind.yml. r=dustin
--HG--
extra : rebase_source : 7a395a777f4221f0b1e1e393e1b34112f36f972c
2018-01-11 07:24:11 +09:00
Mike Hommey
dc03a55695 Bug 1430984 - Drive-by: Use urls from the main snapshot archive for cmake and ninja. r=dustin
--HG--
extra : rebase_source : 0ae76da7f27d7be5c12c7259daa5d94fb1483836
2018-01-17 14:52:25 +09:00
Mike Hommey
d82350c48a Bug 1429998 - Exclude toolchain and package tasks from the target task set. r=dustin
Back in bug 1360609, we added `run-on-projects` to a list so that the
toolchain tasks wouldn't run on every push on release branches.

Fast forward to now, and they're depended upon by other tasks, meaning
they are triggered when appropriate, without resorting to that trick. In
fact, the commit message for bug 1360609 said we could switch to an
empty list once the jobs have dependencies.

The same is true from package tasks, which, in fact, I suspect would
happen on every push on release branches.

The only exception is for a few toolchains that are depended upon by
nothing, and that are produced for developer consumption with e.g. mach
artifact toolchain.

--HG--
extra : rebase_source : bb8624fed7490b85f4bd72b7ceb2db7a72b4c2ab
2018-01-17 14:30:57 +09:00
Mike Hommey
17462147e3 Bug 1430504 - Build a GNU make package for Debian wheezy. r=gps
The one available in Debian wheezy is 3.81, but we're explicitly using
4.0 on CentOS, most notably because of its --output-sync option which
helps make logs better in some ways.

This takes the package from Debian jessie and builds it for Debian
wheezy.

--HG--
extra : rebase_source : 20bb550703fec41ed0175ef7f78c5b9a394160f3
2018-01-12 14:52:05 +09:00
Mike Hommey
c1667043b2 Bug 1430011 - Build a Git package for Debian wheezy. r=gps
The one available in Debian wheezy is 1.7.10.4, which is really old, and
on our centos images, we're using 2.8.0rc3, which, while old too, is
more modern. While we may want to go with a more recent version, I'd
rather avoid differing from what we currently use, so use the exact same
version.

--HG--
extra : rebase_source : dfdf75a635073c248faef8a67648b2a83e4a1d84
2018-01-12 14:52:05 +09:00
Mike Hommey
4f2f1a88f6 Bug 1429685 - Build a Valgrind package for Debian wheezy. r=dustin
Apply the patch from bug 1382280 (build/valgrind/valgrind-epochs.patch).

--HG--
extra : rebase_source : 283dbc749e231bc00ea3135423e1606161f0bcd4
2018-01-11 16:06:45 +09:00
Mike Hommey
398539b2db Bug 1429669 - Build a mercurial package for Debian Wheezy. r=dustin
--HG--
extra : rebase_source : 22f0e8de5dc50c9d4e3df5790b74ecfe69349a59
2018-01-11 14:07:36 +09:00
Mike Hommey
0f364f58ca Bug 1429669 - Group url and sha256 of dsc file in package definitions. r=dustin
This will be useful two patches down the road.

--HG--
extra : rebase_source : bfb3ccc53837c243703ad5fb1fd480063d906c1a
2018-01-11 07:35:32 +09:00
Mike Hommey
48af0db891 Bug 1429285 - Add cmake and ninja packages to the toolchain-build docker image. r=gps
We build packages of the same versions that were installed by
taskcluster/docker/recipes/install-cmake.sh and
taskcluster/docker/centos6-build/system-setup.sh in the desktop-build
image.

--HG--
extra : rebase_source : 843b89065daabd450f54ebf7a2cf55d00977e23a
2017-12-29 15:43:43 +09:00
Mike Hommey
51725c8a00 Bug 1427326 - Build a python package for Debian 7. r=dustin
--HG--
extra : rebase_source : b31d301859a0b6f6ecbb7763a82f162d7673379f
2017-12-29 13:00:59 +09:00