Commit Graph

342 Commits

Author SHA1 Message Date
Mathieu Leplatre
a43f7613d3 Bug 1451040 - Download remote settings dumps regularly r=sfraser
MozReview-Commit-ID: BCCEplOq1O8

--HG--
extra : rebase_source : 4a9840b7a36b1d08e3fa012fcad755516e292ec2
2018-05-16 13:03:22 +02:00
Johan Lorenzo
0a90b7dd57 Bug 1459980 - google-play-strings: pin mozapkpublisher to 0.7.2 r=gps
MozReview-Commit-ID: 65Puqafnlkw

--HG--
extra : rebase_source : af9293b3d6838857c2588aead2ebf774847d7385
2018-05-16 18:45:02 +02:00
Dorel Luca
7285fe0e8b Merge mozilla-central to autoland
--HG--
extra : rebase_source : 28cf949fe5cbd372058adac2d3a9d6e66902e6e3
2018-05-16 00:58:05 +03:00
Geoff Brown
432ab75dea Bug 1460411 - Follow-up - diffoscope repo moved; updated url; r=me on a CLOSED TREE 2018-05-15 11:36:28 -06:00
Geoff Brown
bd4f5cfdbf Bug 1460411 - Add kvm to desktop1604-test image; r=jmaher
Our normal ubuntu 16.04 test image is suitable for hosting an Android x86
emulator with these minor updates: Install kvm and make sure /dev/kvm
rw permissions are open for everyone. Note that /dev/kvm is generally
only visible when running docker with --privileged; its permissions
cannot be modified in the Dockerfile, only at run-time: run-task is the
first opportunity.
2018-05-15 09:57:27 -06:00
Gregory Szorc
99b6ca1c73 Bug 1460475 - Port download-and-compress to Python 3; r=dustin
download-and-compress isn't very complicated and should work on Python 3
with minimal effort. So let's switch it to use Python 3.

MozReview-Commit-ID: 9G1WfcbbKEY

--HG--
extra : rebase_source : 3a6bab06c8500a90413e8b7642a7bf7bdff04a46
2018-05-09 19:41:07 -07:00
Gregory Szorc
b92916aaf5 Bug 1460475 - Upgrade python-zstandard in image_builder; r=dustin
Version 0.9.0 bundles a newer version of the zstandard library, which
is a little faster and has a few minor bug fixes (none that we were
likely hitting, however).

MozReview-Commit-ID: 9YgSZ0G41eg

--HG--
extra : rebase_source : 8f5a68323b1e1fe7e9f1dd1a92e132434972d21d
2018-05-09 17:54:38 -07:00
Gregory Szorc
c65d079532 Bug 1460475 - Install Python 3 on image_builder; r=dustin
We want Python 3 available everywhere because it is 2018.

MozReview-Commit-ID: L3wufNXKdnp

--HG--
extra : rebase_source : c260923e3c13f8b28e30eaaf6e1bd38f79500052
2018-05-09 17:45:39 -07:00
Sylvestre Ledru
274ecb9460 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 155b8b64b3aac06682f9b4191293974d7b9cd844
2018-05-09 21:57:36 +02:00
Dorel Luca
a5bc0b3f70 Backed out 4 changesets (bug 1460402) for lint failure on intl/locales/en-US/hyphenation/hyph_en_US.dic. CLOSED TREE
Backed out changeset c2e8fbd72ca6 (bug 1460402)
Backed out changeset 3676e913dbff (bug 1460402)
Backed out changeset bb12ffd4b96e (bug 1460402)
Backed out changeset 3e50885329c4 (bug 1460402)
2018-05-11 00:47:34 +03:00
Sylvestre Ledru
4f1403c359 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 4784a5af43e806f2ec017fe16d930b3845fe2dde
2018-05-09 21:57:36 +02:00
Dorel Luca
74bbb3c1eb Backed out 4 changesets (bug 1460402) for breaking taskcluster images. CLOSED TREE
Backed out changeset 5b40f3f18f42 (bug 1460402)
Backed out changeset 17526c61b995 (bug 1460402)
Backed out changeset e1caff997e5a (bug 1460402)
Backed out changeset 06ceda084d69 (bug 1460402)
2018-05-10 23:54:38 +03:00
Sylvestre Ledru
a7f37d6509 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 23d87e6b352378aa41e8c539ce8640da68fe604c
2018-05-09 21:57:36 +02:00
Gregory Szorc
a339b799f8 Bug 1460451 - Add /usr/bin/python3 to Debian images; r=glandium
The python3-minimal package provides /usr/bin/python3 on Debian.

This commit installs this package so a `python3` executable is
provided.

This required backporting the package to wheezy. The final patch
is trivial. But I wasted a bit of time figuring out why `mk-build-deps`
wasn't working. It would no-op and exit 0 and then the build would
complain about missing dependencies!

glandium's theory is that the ":any" multiarch support on wheezy
isn't complete. Removing ":any" seems to make things "just work."

MozReview-Commit-ID: FBicpK4SmkQ

--HG--
extra : rebase_source : a28ce731024e8ed6a43fb30e2ed57da2abb50d0f
2018-05-09 19:54:21 -07:00
Gregory Szorc
bdf45558d2 Bug 1459737 - Add missing package dependencies to google-play-strings Dockerfile; r=nalexander CLOSED TREE
This Dockerfile downloads non-deterministic remote content (by cloning a
Git repo) and then executes code from it. Part of that code is
executing Python package installs.

Since this Docker image was generated, it appears the remote code
requires new build dependencies. This commit adds those package
dependencies.

Not having deterministic Docker image builds is a bug. I'll file a
follow-up so we pin the Git commit used for building so this type
of failure doesn't occur again.

--HG--
extra : amend_source : 533a95abeb7cf7ddc9a1329549f5d294baf983f5
2018-05-08 09:03:35 -07:00
Gregory Szorc
5d87fc997f Bug 1459737 - Move run-task into taskcluster/scripts; r=dustin
In preparation for making it usable on Windows, after which point
having it in a directory with "docker" in it doesn't make much sense.

MozReview-Commit-ID: Hgu0buFyJwF

--HG--
rename : taskcluster/docker/recipes/run-task => taskcluster/scripts/run-task
extra : rebase_source : 3c0b502d28b5aad54bd04069efbfda88e25bbb20
2018-05-04 17:23:31 -07:00
Gregory Szorc
7a11019c3c Bug 1459077 - Install known working pip and virtualenv; r=ted
Previously, we installed the latest version of pip and virtualenv.

This commit pins the pip and virtualenv version so we install known
working versions (pip 10 breaks the image build for some reason).

MozReview-Commit-ID: hOAMencdcr

--HG--
extra : rebase_source : 2cb44c2ef55e29c55cf3d1b354e90d6fb5414cce
2018-05-04 13:10:50 -07:00
Chris AtLee
9472cb160b Bug 1450029: Remove buildbot/buildbot-bridge references from taskcluster r=aki,tomprince
MozReview-Commit-ID: Hu9ju4XVQpA

--HG--
extra : rebase_source : dba8ba385a86ef24a031bca58f01c6ec553d1459
2018-05-01 16:07:19 -04:00
Kris Maglione
a259026c9d Bug 1456035: Part 4 - Convert callers of XPCOMUtils.generateQI to ChromeUtils.generateQI. r=mccr8
This also removes any redundant Ci.nsISupports elements in the interface
lists.

This was done using the following script:

acecb401b7/processors/chromeutils-generateQI.jsm

MozReview-Commit-ID: AIx10P8GpZY

--HG--
extra : rebase_source : a29c07530586dc18ba040f19215475ac20fcfb3b
2018-04-22 20:55:06 -07:00
Johan Lorenzo
5b3fccf5b2 Bug 1456327 - Snap: pin desktop-gtk3 dependency for causing start up crash r=sfraser
MozReview-Commit-ID: 4diqZRxNwj3

--HG--
extra : rebase_source : cf97f01c31e8e67ebb05c2360a55cb44d0a5d1db
2018-04-27 11:17:02 +02:00
Gregory Szorc
80069167e7 Bug 1456326 - Bump version of decision image; r=dustin
Version number is arbitrary.

MozReview-Commit-ID: EGfDiyGuCPI

--HG--
extra : rebase_source : e7412924db64446fcb9c3c11c100077376ef95ef
2018-04-23 17:53:16 -07:00
Gregory Szorc
3c563381fe Bug 1456326 - Trim some fat from decision image; r=dustin
The big win comes from removing the APT lists. We also reduce the
number of layers while we're here.

This makes the image 162 MB instead of 202 MB.

MozReview-Commit-ID: K2ic4zcr31j

--HG--
extra : rebase_source : afda144f1a1319971842642b58460de169e245fa
2018-04-23 17:52:45 -07:00
Ben Hearsum
f6aa7204c0 Bug 1442545: [partner-repack] Add docker image for partner repacks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D979

--HG--
extra : rebase_source : 9d5b469a66c872a3c9623e2f8afbe21c0514059e
extra : histedit_source : e2371130271cc7a44dab498ecc01c4f7d243e3bf
2018-04-19 10:00:47 -06:00
Mihai Tabara
633c612131 Bug 1447688 - Retire first generation of in-tree beetmover and relpro postrelease scripts.r=rail 2018-04-18 18:58:27 +01:00
Dorel Luca
97278c775c Backed out changeset f5f4089f457e (bug 1447688) for Gecko Decision Task failures. CLOSED TREE 2018-04-18 11:14:20 +03:00
Mihai Tabara
bbffa87016 Bug 1447688 - Retire first generation of in-tree beetmover and relpro postrelease scripts.r=rail DONTBUILD 2018-04-18 09:01:20 +01:00
Simon Fraser
957369ecbe Bug 1454411 Update stat calls in funsize r=catlee
Reviewers: catlee

Reviewed By: catlee

Bug #: 1454411

Differential Revision: https://phabricator.services.mozilla.com/D952

--HG--
extra : rebase_source : 3cd2e0499436eb72be3427881627142e606e8edd
2018-04-17 08:03:54 +01:00
Simon Fraser
91ea0d21ac Bug 1452159 periodic file udpates, fix awk behaviour r=jlorenzo
Summary:
a difference in behaviours between awks meant the original didn't work in-situ,
although the task didn't fail due to the pipe chain.

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452159

Differential Revision: https://phabricator.services.mozilla.com/D899

--HG--
extra : rebase_source : b31b7ceeb59c79aeecf206c079b8ea436967e7c7
2018-04-10 13:10:45 +01:00
Simon Fraser
a5bf57e641 Bug 1452584 Removing pinning for periodic file updates r=jlorenzo
Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452584

Differential Revision: https://phabricator.services.mozilla.com/D883

--HG--
extra : rebase_source : ed1fcd37ca79b0ed8a3b209789313f26fb76906f
2018-04-09 12:04:17 +01:00
Simon Fraser
ecbb3b8bae Bug 1452159 periodic file update clears out old reviews r=jlorenzo
Summary:
the periodic file updates keep adding new reviews, and it's easy to fall behind.
This adjusts the script so it clears out any previous submissions that are still awaiting review.

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452159

Differential Revision: https://phabricator.services.mozilla.com/D872

--HG--
extra : rebase_source : 4a36ddd91bf7e971fd6b424d02117bd4739a91ed
2018-04-09 11:18:06 +01:00
Johan Lorenzo
bd5684096a Bug 1447263 - Snap: Split build and upload task r=rail
MozReview-Commit-ID: DGLQZLTjJDu

--HG--
rename : taskcluster/ci/release-snap/kind.yml => taskcluster/ci/release-snap-repackage/kind.yml
rename : taskcluster/taskgraph/transforms/release_snap.py => taskcluster/taskgraph/transforms/release_snap_repackage.py
extra : rebase_source : dcd16e9e7e28f1817de12ff469c1456305a2dafc
2018-03-20 17:19:50 +01:00
Ciure Andrei
7208a2fee8 Merge inbound to mozilla-central. a=merge 2018-04-04 00:54:16 +03:00
Olivier Tilloy
e9b0682a45 Bug 1449864: [snap package] add the removable-media plug to allow saving downloaded files to /media. r=jlorenzo
MozReview-Commit-ID: LcKaZOZP6vS

--HG--
extra : rebase_source : 52b66130a2d7044f35e0ef7f645469d62f81d0fb
2018-03-29 10:10:53 +02:00
Gregory Szorc
70d55f427e Bug 1449629 - Install Python 3.5 in debian-base; r=glandium
We want Python 3.5+ to be available everywhere so various processes
can start using it.

The debian-base Dockerfile is shared by Debian 7 and 9 images.
Debian 9 ships with Python 3.5 and after the previous commit, we
have a Python 3.5 package for Debian 7. So we simply install the
"python3.5" package to get Python on all the Debian images.

MozReview-Commit-ID: 9ZmoSxtHWTZ

--HG--
extra : rebase_source : be4e62e7d731a3c39ee9ce205d75f1e525192acc
2018-04-02 16:58:21 -07:00
Simon Fraser
e4385fcf42 Bug 1379773 Update funsize to allow mar/mbsdiff definitions r=bhearsum 2018-03-26 12:16:08 +01:00
Csoregi Natalia
fb262254f8 Backed out changeset b42a6edd2645 (bug 1379773) for flake failure on scripts/funsize.py:229. CLOSED TREE 2018-03-26 13:55:44 +03:00
Simon Fraser
f86f28e420 Bug 1379773 Update funsize to allow mar/mbsdiff definitions r=bhearsum 2018-03-26 11:38:05 +01:00
Gregory Szorc
af8f8380c6 Bug 1448438 - Upgrade to Mercurial 4.5.2; r=sheehan
We bump the version of Mercurial for Debian packages and for Ubuntu
Docker images.

MozReview-Commit-ID: KYmG4rOm3TQ

--HG--
extra : rebase_source : cbb817a9ee4c27f0bc59f4fa1e2a708fac1cb093
2018-03-23 12:09:36 -07:00
Gregory Szorc
79e8198e43 Bug 1448438 - Install Mercurial via install-mercurial.sh; r=Callek
All in-tree Docker images should be installing Mercurial via
install-mercurial.sh so that the Mercurial install is consistent
across all Docker images.

I noticed this image wasn't using install-mercurial.sh because
attempting to rebuild the image currently fails due to
mercurial-4.3.1-2 not being available in the upstream package repo.

install-mercurial.sh has been taught to handle Ubuntu 18.04 and the
Docker image building process has been taught to use
install-mercurial.sh. install-mercurial.sh uses tooltool and behavior
should work and be deterministic over all of time.

As part of this, we had to establish a standalone shell script for
building the image. That's because install-mercurial.sh requires a
"tooltool_fetch" alias. Meaningful image building code has been
moved into the new setup.sh. This also means things run as a single
RUN statement. So we don't need to hack around minimizing RUN
invocations.

I also discovered that the pinned curl version is no longer available.
So I removed the version pinning. FWIW we can't rely on version
pinning unless the Apt repository is snapshotted. Packages do get
yanked from time to time. Unless we absolutely require a specific
version of a specific package, we can probably get away without pinning
- at least for this Docker image. But that can be a follow-up.

MozReview-Commit-ID: As7Hq470QcK

--HG--
extra : rebase_source : e5868ff1dfd6a14a12d3df08aca2954d1d9ea99f
2018-03-23 13:23:02 -07:00
Johan Lorenzo
fe8f5fc199 Bug 1448239 - Force apt database update so snapcraft can fetch packages r=rail
MozReview-Commit-ID: KAp4dCyHMRA

--HG--
extra : rebase_source : 15210a4ad3e402859f11771bb4a212132b002ac6
2018-03-23 12:06:51 +01:00
Simon Fraser
b643e91189 Bug 1430600 Fix retries for partials async downloads r=callek
Summary: This doesn't solve the download timeouts, but does ensure that retries are happening as they should.

Reviewers: rail

Reviewed By: rail

Bug #: 1430600

Differential Revision: https://phabricator.services.mozilla.com/D821

--HG--
extra : rebase_source : ba2e30cb7f190f5ee2ef06dadd80d7fe9bc61d54
2018-04-03 18:31:05 +01:00
Johan Lorenzo
c0b485fa3a Bug 1444898 - Snap: Use dedicated snap docker image instead of the Ubuntu one r=rail
MozReview-Commit-ID: 2wDKUHJI9tr

--HG--
extra : rebase_source : 43ca551162eeeea43800c268c4033892da3644d2
extra : intermediate-source : 1e0275c17b6cf25563de0f6af4f60c57edc0400a
extra : source : 64c2b865e1f277e0a5965e4331dce75cf5458f50
2018-03-12 15:23:32 +01:00
Ken VanDine
4bdff4292f Bug 1444140 - xdg-utils shouldn't be bundled in the firefox snap r=jlorenzo
MozReview-Commit-ID: CI6j8lxxA1T

--HG--
extra : rebase_source : da0e99aa8d494044269051c50531e5018cad8aca
2018-03-09 10:56:44 +00:00
Mark Banner
cd8efbae2c Bug 1443547 - Upgrade Docker images to node 8.9.4 & npm 5.6.0. r=dustin
MozReview-Commit-ID: 3rrH3JcOrnu

--HG--
extra : rebase_source : bda65b81a15fd5098faf3c1a99a8c949e712e076
2018-03-06 19:37:13 +00:00
Brindusan Cristian
eb51abf4fb Merge inbound to mozilla-central. a=merge 2018-03-08 20:00:36 +02:00
Ken VanDine
7d4a79ab48 Bug 1442419 - Fixed typo in the mimeapps.list bundled in the snap r=jlorenzo 2018-03-08 13:25:12 +00:00
shindli
568f98c908 Merge inbound to mozilla-central. a=merge 2018-03-08 02:20:08 +02:00
Andreea Pavel
2d590755fc Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE 2018-03-07 17:21:25 +02:00
Simon Fraser
1003fa56fd Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : amend_source : fb6f5356c2ad1b6a4b1ac39460109bd91cbb2f7d
2018-03-06 15:27:58 +00:00
Andreea Pavel
ecb8a6e568 Backed out changeset 514feaa0c698 (bug 1436369) for taskcluster-images bustage on a CLOSED TREE
--HG--
rename : taskcluster/docker/periodic-updates/.eslintrc.js => taskcluster/docker/periodic_updates/.eslintrc.js
rename : taskcluster/docker/periodic-updates/Dockerfile => taskcluster/docker/periodic_updates/Dockerfile
rename : taskcluster/docker/periodic-updates/README.md => taskcluster/docker/periodic_updates/README.md
rename : taskcluster/docker/periodic-updates/runme.sh => taskcluster/docker/periodic_updates/runme.sh
rename : taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh
2018-03-07 14:22:54 +02:00