Commit Graph

2974 Commits

Author SHA1 Message Date
Aki Sasaki
28c81a5f8e bug 1430834 - don't add beetmover-checksums to push-apk upstreamArtifacts. r=jlorenzo
MozReview-Commit-ID: 8OMNJyyf5bK
2018-01-24 13:37:26 -08:00
Kim Moir
5b4d564d91 Bug 1430834 - fennec: push-apk should also depend on beetmover-checksums r=mtabara
MozReview-Commit-ID: 2JjnZXSAl7Q

--HG--
extra : source : 50a9a7b47e166ed790070f45209a4757cfd637be
2018-01-18 12:52:57 -05:00
Rob Wood
ce234fa0c1 Bug 1431427 - Add tc linux configs for new talos nightly profiling suite; r=jmaher
MozReview-Commit-ID: 78kwx6q0mjc

--HG--
extra : rebase_source : a504c727ecd70399ce784fd878263636b4d451b6
2018-01-29 14:23:29 -05:00
Simon Fraser
5acab0f13e Bug 1432627 Add shellcheck linter to CI r=ahal
MozReview-Commit-ID: 2IYUsXunfab

--HG--
extra : rebase_source : 806ab4abfb1838a1b5eec279f5e93ce5c703685d
2018-01-29 15:27:04 +00:00
Gurzau Raul
c380dfe905 Merge inbound to mozilla-central. a=merge 2018-01-30 12:01:49 +02:00
Mike Hommey
64dc538bff Bug 1433703 - Remove the libxss-dev package from the build image. r=gps
This will disable libxss-based code in the screenshot tool, like it was
before the switch to Debian-based build images in bug 1399679. There are
other places in the code that use libXss, but they don't require the
development headers, and use dlopen().

--HG--
extra : rebase_source : 4842361b680c70924b9fc0890a7e4f4dcbc7e338
2018-01-30 13:45:17 +09:00
Gregory Szorc
59b5e99b26 Bug 1432395 - Change cache version to force new caches; r=glandium
This is basically the same deal as e331a3b9fae2. Caching is hard.

MozReview-Commit-ID: 9uWHHdnHgq1

--HG--
extra : rebase_source : fc7107a018f067d83dbee3796d8861c5187823b2
2018-01-29 15:15:41 -08:00
Cosmin Sabou
37bb870512 Merge mozilla-central to autoland. a=merge on a CLOSED TREE 2018-01-30 00:47:39 +02:00
Marco Castelluccio
1d7efd79f2 Bug 1433610 - Increase number of chunks for mochitest-devtools-chrome on windows10-64-ccov. r=jmaher
--HG--
extra : rebase_source : 144a31db13253fcfeb2d4a33b94fc2a004d73f7a
2018-01-29 11:51:17 +01:00
Mike Hommey
1d38c4309b Bug 1432398 - Remove the desktop-build docker image and related files. r=dustin
--HG--
extra : rebase_source : 158e14474ce049343105d2be95aabc03ec0b7854
2018-01-27 11:04:23 +09:00
Mike Hommey
2edd1f5387 Bug 1432398 - Move oauth.txt and buildprops.json to taskcluster/docker/recipes. r=dustin
--HG--
rename : taskcluster/docker/desktop-build/buildprops.json => taskcluster/docker/recipes/buildprops.json
rename : taskcluster/docker/desktop-build/oauth.txt => taskcluster/docker/recipes/oauth.txt
extra : rebase_source : ac6b6c6a2394e3cd2e3be5c9bd48f3f16708eba6
2018-01-27 10:52:39 +09:00
Mike Hommey
dd7448479b Bug 1432395 - Switch the valgrind build to a Debian-based docker image. r=dustin
We start from the image used for Firefox builds, and add the debug
packages for all the system libraries.

--HG--
extra : rebase_source : 2c759975d9837beabdc08a15fd926a99fd1cecf8
2018-01-27 10:25:58 +09:00
Mike Hommey
be42ffae02 Bug 1433704 - Use system GCC for host compilations on mingw32 builds. r=froydnj
The binutils we currently use as part of our GCC toolchain artifact
doesn't understand some relocations in the CRT objects on Debian
stretch, making the embedded CRT objects from bug 1427344, which we want
to remove in bug 1431251, necessary.

OTOH, there is no benefit from using our GCC toolchain artifact for host
compilations on those builds. In fact, Android builds, which are in a
similar position, being built on Debian stretch and being cross-builds,
don't care to use our GCC toolchain artifact.

It's arguably a good thing that those builds are not tied to the version
of GCC we use to build Firefox for linux, so let's remove this
dependency.

--HG--
extra : rebase_source : a80d4e4fb01a4862b844ebde0c521a635f462c0a
2018-01-27 20:40:36 +09:00
Tom Prince
d0a8cfbb8a Bug 1433975: Error out if a parent docker image isn't present in the configuration; r=dustin
MozReview-Commit-ID: ASeCAXLzOEZ

--HG--
extra : rebase_source : f8aabee33e98bc7e76310a24d4cc5ca908b38814
2018-01-29 11:03:06 -07:00
Nick Thomas
a696ee8f71 Bug 1433467 - disable binary transparency task, r=bhearsum
--HG--
extra : amend_source : 965b0b3fef3429760dd05bd9f198b4c1315e8c8f
2018-01-30 12:17:03 +13:00
Nick Thomas
4f8f657e10 Bug 1433809 - No SHASUMS or KEY files in 59.0b4 release directories, r=aki 2018-01-30 12:16:04 +13:00
Joel Maher
b2e035bcdf Bug 1433702 - run linux64 talos on new moonshot hardware via taskcluster instead of buildbot and IX hardware. r=rwood 2018-01-29 10:56:58 -05:00
Geoff Brown
0cb433c1e0 Bug 1433560 - Run Android opt mochitest in more test chunks; r=jmaher 2018-01-29 08:35:18 -07:00
Tom Ritter
59cfa9d5ce Bug 1432319 Bump MinGW version to incorporate Process Mitigation structs needed by the sandbox r=froydnj
MozReview-Commit-ID: HnYuQa8DflY

--HG--
extra : rebase_source : ed06ff4ffc4938a861afaec833537676e32e1907
2018-01-27 19:44:45 -06:00
Tiberius Oros
a530cab0d4 Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-01-27 23:56:11 +02:00
Cosmin Sabou
9366900c12 Merge mozilla-central to inbound. a=merge on a CLOSED TREE 2018-01-27 11:58:35 +02:00
Joel Maher
3e42ad5221 Bug 1433276 - adjust non-e10s test scheduling. r=ahal 2018-01-27 04:49:36 -05:00
Joel Maher
5f87938fff Bug 1433075 - removed h1/h2 from test-sets so they are not accidentally run. r=rwood 2018-01-27 04:49:04 -05:00
Tom Prince
6cfd4299c2 Bug 1433415: Get revision from task in floating L10N repack task; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D468

--HG--
extra : rebase_source : 721255f0efcc6be4711236727e80c18e94085bf1
extra : amend_source : 6dc7db63cace3e397bcef90e2ce43020e0acd6f9
2018-01-26 11:09:59 -07:00
Andreea Pavel
1dcfffb058 Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE 2018-01-26 19:51:43 +02:00
Marco Castelluccio
29c0c6bdf5 Bug 1433403 - Don't run test-verify on Windows code coverage build. r=jmaher
--HG--
extra : rebase_source : ea11380b6e13b1d2edfb165990d3ebe34c950692
2018-01-26 11:58:47 +01:00
Simon Fraser
935d2ffd99 Bug 1432763 Linting compliance for funsize docker images r=mtabara
MozReview-Commit-ID: IdHYknfUZXx

--HG--
extra : rebase_source : ae7c721938626a3a3c12d1aff084bf54cce62e81
2018-01-24 12:46:21 +00:00
Brindusan Cristian
9a068e3d05 Merge mozilla-central to autoland a=merge on a CLOSED TREE 2018-01-27 13:09:27 +02:00
Brindusan Cristian
674c27a54e Merge inbound to mozilla-central. a=merge 2018-01-27 13:04:15 +02:00
Sylvestre Ledru
8238fab711 Bug 1433410 - Add codespell support for mach lint r=ahal
MozReview-Commit-ID: Ii6QjPMN0Ks

--HG--
extra : rebase_source : 854dc0994e9e204c5c5f9f25a4e956c9f51001d0
2018-01-27 10:35:31 +01:00
Emilio Cobos Álvarez
11cd13abd8 Bug 1432563: Fetch rustfmt when repackaging rust. r=rillian
I tested this on automation and the build went on, though I couldn't test
the bindgen output because the build right now is busted on one dependent crate
with rust beta, which is the first toolchain that has this package, and will go
to release shortly.

This should work though! If I need more changes I'll adjust them in bug 1432153.

You can test the repackage manually with repack_rust.py --toolchain beta, for
example.

MozReview-Commit-ID: GI2f6vGVqTe
2018-01-27 02:02:17 +01:00
Mike Hommey
520f9865db Bug 1432397 - Switch mingw builds to a Debian stretch-based docker image. r=dustin
Don't build ucl when building upx, Debian stretch has a recent enough
version. In fact, the last upstream version doesn't build with GCC in
Debian stretch (http://bugs.debian.org/811707)

--HG--
extra : rebase_source : aae67773b9dd3b99f6ddf9ab7f59a628037e6925
2018-01-26 14:39:07 +09:00
shindli
4615d385bd Backed out changeset e414096f1c3b (bug 1433410) for yaml lint failures in tools/lint/codespell.yml:12:81 on a CLOSED TREE 2018-01-27 01:20:16 +02:00
Mike Hommey
a5428cd701 Bug 1432392 - Switch the spidermonkey rust bindings job to a Debian-based docker image. r=dustin
This job requires cmake, which should be fixed, but in the meanwhile,
create a separate docker image with it installed, based on the image we
use for other spidermonkey builds.

--HG--
extra : rebase_source : da43a7999b6bd86dbba816358d907c902415bed4
2018-01-26 11:43:31 +09:00
Sylvestre Ledru
904937e12f Bug 1433410 - Add codespell support for mach lint r=ahal
MozReview-Commit-ID: Ii6QjPMN0Ks

--HG--
extra : rebase_source : f5aec5f35d5f882132fb09fe094dc2cfc41b1392
2018-01-26 23:58:29 +01:00
Sylvestre Ledru
3a35e750f3 Bug 1433417 - Fix a bunch of typo in the doc r=ahal
MozReview-Commit-ID: LRgL0CMJdDP

--HG--
extra : rebase_source : b99364bb96c1501a674a1726a3b5fdf0664a8e4f
2018-01-26 12:50:07 +01:00
Mike Hommey
9d3a568f03 Bug 1433033 - Make APT retry when it fails to download files. r=dustin
We've observed apt failures multiple times where it apparently fails to
get a file in full from snapshot.debian.org. Making it retry
automatically rather than retriggering tasks seems better.

--HG--
extra : rebase_source : f3ffb415ccc30b7e7c44e6a48b29eb20e69efdd5
2018-01-26 12:40:26 +09:00
Mike Hommey
3ab004d966 Bug 1433033 - Derive the android-build image from a base Debian stretch image. r=dustin
--HG--
extra : rebase_source : 8be13be0a0c3979f6596514f62765a9b741fd8f7
2018-01-25 22:31:48 +09:00
Mike Hommey
ae1ce5d571 Bug 1433033 - Workarounds for Debian stretch. r=dustin
The apt in Debian stretch doesn't allow repositories with a Release file
not being GPG signed. Setting up GPG signatures on the
taskcluster-artifact-based repositories is a tricky process, and not
strictly necessary. It turns out not creating a Release file at all
works just as well, and works across all current Debian versions. The
packages priorities remain the same, such that packages from those
repositories are still prefered over the ones from the main Debian
repository (as long as versions are higher).

See comment in cloud-mirror-workaround.sh for that part.

--HG--
extra : rebase_source : df5af330859a314285a6c1922d899489997d2f19
2018-01-25 22:26:06 +09:00
Mike Hommey
220ae81745 Bug 1433033 - Create a mercurial package for Debian stretch. r=dustin
--HG--
extra : rebase_source : 6408957ddc6acf671c7fa190ec156e347124f588
2018-01-25 22:23:15 +09:00
Mike Hommey
db4394b257 Bug 1433033 - Create a base Debian docker image. r=dustin
That image is used to derive all the debian7-* images, and its
definition is parametrized, which will allow to create other images
based on other versions of Debian, from the same definition.

XZ_OPT is kept in each of those because we don't want to automatically
set it in all further derived images.

--HG--
extra : rebase_source : 7f4597c1ea4af83627a9373dbdc7945d20b7d996
2018-01-25 22:15:19 +09:00
Mike Hommey
3972032498 Bug 1433033 - Don't apt-get clean from Debian-based docker images. r=dustin
The base images from docker hub actually contain a
/etc/apt/apt.conf.d/docker-clean that does the equivalent of an apt-get
clean after installing packages.

--HG--
extra : rebase_source : 190de9e3b10a0309cf9cfb3260a91477a5a93ba3
2018-01-25 21:57:13 +09:00
Mike Hommey
04b424481d Bug 1433033 - Set apt defaults to avoid passing -q, -y and --no-install-recommends to it. r=dustin
--HG--
extra : rebase_source : 53c8f00ef24dc8757d8eb45d1a9e08da48539a7a
2018-01-25 22:09:56 +09:00
Mike Hommey
ce90eb437b Bug 1433033 - Set Acquire::Check-Valid-Until in apt config file rather than pass it on the command line. r=dustin
Also set it in the android-build image, which is Debian-snapshot-based too.

--HG--
extra : rebase_source : a64a0d6833c98025bfe287e197a9ef255b12a9bc
2018-01-25 15:24:05 +09:00
Mike Hommey
fd6008421c Bug 1433033 - Remove a few packages from the toolchain-build image. r=dustin
python-dev was required to build mercurial, but the need for that was
removed in bug 1429669.
The others were required for mingw32 toolchains, but they are using a
different docker image and will switch to another different docker image.

--HG--
extra : rebase_source : b65c586a325f220c565e79afb3d3c9acc9f922bc
2018-01-25 15:13:20 +09:00
Simon Fraser
54d71de730 Bug 1432763 Linting compliance for funsize docker images r=mtabara
MozReview-Commit-ID: IdHYknfUZXx

--HG--
extra : rebase_source : aa21c059c79e3c6743419ae2f5a704b463e5c7d1
2018-01-24 12:46:21 +00:00
Dorel Luca
f8bc8becf5 Backed out changeset e00fb451089f (bug 1432763) for breaking nightly partial update generation a=backout 2018-01-26 03:53:42 +02:00
Mike Hommey
49993bfe85 Bug 1432390 - Allow to derive docker images from other in-tree images. r=dustin
So far, the best we've been able to do is to upload an image to the
docker hub, and point an image's Dockerfile's FROM to the version
uploaded onto the hub.

That is a cumbersome process, and makes the use of "layered" docker
images painful.

This change allows to declare a parent docker image in the
taskcluster/ci/docker-image/kind.yml definitions, which will be
automatically loaded before building the image. The Dockerfile can then
reference the image, using the DOCKER_IMAGE_PARENT argument, which will
contain the full image name:tag.

Some details are left off, for now, such as VOLUMEs. At this point,
VOLUMEs should all be defined in leaf docker images.

--HG--
extra : rebase_source : 221cff0ca5a91d694ff5c3626fe707c15ba45e23
2018-01-25 11:07:54 +09:00
Mike Hommey
fd6ffda3c8 Bug 1432390 - Make mach taskcluster-build-image talk directly to the docker socket in the image builder. r=dustin
Now that `mach taskcluster-build-image` can, we can avoid all the manual
handling based on curl and jq in the image builder.

An additional advantage on relying on `mach taskcluster-build-image`
doing more is that less changes to the build-image.sh script will be
necessary, and thus less updates of the image builder docker image.

--HG--
extra : rebase_source : dd174d60675e41e4391894f28235c674c1840829
2018-01-25 13:36:47 +09:00
Mike Hommey
f5386c6b51 Bug 1432390 - Directly call the docker API over its unix socket instead of calling docker build. r=dustin
This allows to avoid writing out a tar file to then extract it to feed
it to `docker build`. This is essentially what the image-builder docker
image does, except it uses a temporary file for the tar.

--HG--
extra : rebase_source : 8275d737e02714fc198d3ba3d3e62e3f18d8e0bf
2018-01-24 15:55:31 +09:00