Commit Graph

5270 Commits

Author SHA1 Message Date
Tom Prince
ccff54c1ae Bug 1528362: [taskgraph] Use trust-domain prefixed caches; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D20049

--HG--
extra : moz-landing-system : lando
2019-02-21 07:32:36 +00:00
Tom Prince
663f25863f Bug 1528362: [taskgraph] Change scheduler-id to include the trust-domain; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D20048

--HG--
extra : moz-landing-system : lando
2019-02-21 07:32:31 +00:00
Edwin Gao
efb8b5a94e Bug 1529339 - replace test-provisioner with permanent bitbar provisioner id r=jmaher
Changes:

- replaced existing references to `test-provisioner/bitbar` with `bitbar/gecko-t-win10-aarch64` (proposed permanent provisioner-id)

Differential Revision: https://phabricator.services.mozilla.com/D20536

--HG--
extra : moz-landing-system : lando
2019-02-20 21:52:13 +00:00
Justin Wood
466d0b2dfb Bug 1522111 - Followup, improve SETA algorithm a bit more by treating opt low value as low value for pgo as well. Unless there is a high value task to override. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20390

--HG--
extra : moz-landing-system : lando
2019-02-20 17:16:43 +00:00
Chris AtLee
b6aa3ee4b4 Bug 1528427: Optimize tasks scheduled with try syntax r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20403

--HG--
extra : moz-landing-system : lando
2019-02-20 14:31:26 +00:00
Andreea Pavel
86ca08bb6b Backed out changeset fe259096e7ed (bug 1529033) for failing toolchains on a CLOSED TREE 2019-02-20 16:19:23 +02:00
David Major
ef4b7f86ac Bug 1529033 - Update gn build to pick up MSVC /WX fix r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20375

--HG--
extra : moz-landing-system : lando
2019-02-20 05:00:28 +00:00
Daniel Varga
4587d14668 Merge mozilla-inbound to mozilla-central. a=merge 2019-02-20 06:01:45 +02:00
Mike Hommey
53509aba7d Bug 1528900 - Actively prevent nightly tasks from depending on sccache. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D20300
2019-02-20 07:52:43 +09:00
Mike Hommey
3a860e2e63 Bug 1528900 - Remove sccache dependencies from nightly builds. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D20299
2019-02-20 07:52:38 +09:00
Mike Hommey
4b2309140a Bug 1528123 - Allow artifact builds to pull from a specific taskid. r=chmanchester
Currently, artifact builds pull from some task they determine from the
job type, and finding a pushhead.

Sometimes that latter fails, most notably on automation. But automation
can already know the right task to use without guesswork.

This change allows artifact builds to pull from a specific taskid given
through an environment variable, and make tasks from the artifact-build
kind (not the --artifact builds from try) use that.

Remove the workaround from bug 1382982 because it's now dead code.

Differential Revision: https://phabricator.services.mozilla.com/D19881
2019-02-20 07:45:55 +09:00
Mike Hommey
901d68ed91 Bug 1519816 - Simplify build-custom-v8 script and avoid installing packages during build. r=sparky
The build script currently is doing some unnecessary steps:
- Running `gclient` only prints out an help message. It is a step
indicated in various documentations, but is only necessary to keep
depot-tools up-to-date, which they are, since we just cloned it.
- The `fetch v8` command creates a v8 directory, no need to create
another layer.
- `gclient sync` is run as part of `fetch`. Same as `gclient`, this step
is only given in documentations to keep things up-to-date on an existing
clone, but we just freshly got one.
- Same goes for `git pull && gclient sync`
- `git checkout master` is not necessary, as `fetch` gets us there
already (albeit, in a detached head state)
- install-build-deps.sh installs build dependencies for chrome or
whatever. That's way too much for v8, that barely needs pkg-config and
glib, which we now install in the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D20082
2019-02-20 07:45:47 +09:00
Henrik Skupin
18b40fa4b8 Bug 1527842 - [web-platform-tests] Use "preflight_run_cmd_suites" in mozharness config. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20320

--HG--
extra : moz-landing-system : lando
2019-02-19 15:13:20 +00:00
Justin Wood
f295852137 Bug 1522111 - Followup, Use better SETA transformation which reads high value list and applies opt high value tests to heuristics to prevent them from being optimized out on pgo. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20045

--HG--
extra : moz-landing-system : lando
2019-02-19 09:29:54 +00:00
Justin Wood
55e24bcecd Bug 1522111 - Followup, ensure test sets align between opt and pgo. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D19968

--HG--
extra : moz-landing-system : lando
2019-02-18 17:55:46 +00:00
Justin Wood
f6a3f70adb Bug 1522111 - Make l10n kind depend on -pgo where available instead of opt. r=tomprince
This avoids opt being pulled in even when l10n is optimized out

Differential Revision: https://phabricator.services.mozilla.com/D19840

--HG--
extra : moz-landing-system : lando
2019-02-18 17:55:38 +00:00
Justin Wood
c8a7da7127 Bug 1522111 - fix SETA to account for new tests, so we still filter them out even if SETA data doesn't include them. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D19838

--HG--
extra : moz-landing-system : lando
2019-02-18 17:55:36 +00:00
Justin Wood
d1ad88fb6e Bug 1522111 - Make -qr tests depend on -pgo where applicable, leaving old -qr sets in place. r=gbrown,jmaher,kats
Also set the run-on-projects for various tests to be central/try when opt

Differential Revision: https://phabricator.services.mozilla.com/D19742

--HG--
extra : moz-landing-system : lando
2019-02-19 13:22:49 +00:00
jmaher
9669bf017d Bug 1522111 - disable opt builds/tests when we have pgo builds/tests for integration branches. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D18104

--HG--
extra : moz-landing-system : lando
2019-02-18 17:55:18 +00:00
Tom Prince
8d611bc63b Bug 1526584: [win64-aarch64] Add paths to balrog for win64-aarch64 release builds; r=nthomas
Differential Revision: https://phabricator.services.mozilla.com/D19993

--HG--
extra : moz-landing-system : lando
2019-02-17 22:01:46 +00:00
ffxbld
41b0c16034 No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=sfraser
Differential Revision: https://phabricator.services.mozilla.com/D20131

--HG--
extra : moz-landing-system : lando
2019-02-18 18:28:33 +00:00
Dorel Luca
33e05d0370 Merge mozilla-central to mozilla-inbound 2019-02-17 12:50:55 +02:00
Mike Hommey
e42ae134c3 Bug 1528155 - Use sparse profiles in Windows toolchain tasks. r=tomprince
Also fix support_vcs_checkout call for docker-image based toolchain
tasks.

Differential Revision: https://phabricator.services.mozilla.com/D19912
2019-02-17 19:15:56 +09:00
Mike Hommey
68af671f02 No bug - Disable caches on Windows toolchain tasks. r=me 2019-02-17 19:15:55 +09:00
Mike Hommey
eeb59260ed Backout changeset 834d38825814 (bug 1528155) and b759c45d1f01 to give time to toolchains to build. 2019-02-16 20:35:08 +09:00
Mike Hommey
e62cab9ab7 Bug 1528155 - Use sparse profiles in Windows toolchain tasks. r=tomprince
Also fix support_vcs_checkout call for docker-image based toolchain
tasks.

Differential Revision: https://phabricator.services.mozilla.com/D19912
2019-02-16 20:31:26 +09:00
Mike Hommey
64d832a30a No bug - Disable caches on Windows toolchain tasks 2019-02-16 20:31:02 +09:00
Coroiu Cristina
e6520f0a4d Merge inbound to mozilla-central a=merge 2019-02-16 11:36:46 +02:00
Kartikaya Gupta
d980fb1af2 Bug 1528380 - Add nasm dependency to searchfox Windows jobs. r=TD-Linux
Differential Revision: https://phabricator.services.mozilla.com/D20003

--HG--
extra : moz-landing-system : lando
2019-02-16 19:20:11 +00:00
Noemi Erli
7f0a1d33d8 Backed out 5 changesets (bug 1522111) for breaking windows opt wpts
Backed out changeset aa6103c8ef0f (bug 1522111)
Backed out changeset 14e9ed41b8be (bug 1522111)
Backed out changeset c10783ea070b (bug 1522111)
Backed out changeset cc97d772a8db (bug 1522111)
Backed out changeset 6fbfc8bc2388 (bug 1522111)
2019-02-16 00:06:17 +02:00
Justin Wood
bf0aadb8ef Bug 1522111 - Followup, ensure test sets align between opt and pgo. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D19968

--HG--
extra : moz-landing-system : lando
2019-02-15 18:12:40 +00:00
Florin Strugariu
8584f3a17e Bug 1508379 Add BinAST version of Instagram to tp6 r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D18824

--HG--
extra : moz-landing-system : lando
2019-02-15 15:41:53 +00:00
Justin Wood
2326f1cc69 Bug 1522111 - Make l10n kind depend on -pgo where available instead of opt. r=tomprince
This avoids opt being pulled in even when l10n is optimized out

Differential Revision: https://phabricator.services.mozilla.com/D19840

--HG--
extra : moz-landing-system : lando
2019-02-15 15:36:50 +00:00
Justin Wood
80f12772a6 Bug 1522111 - fix SETA to account for new tests, so we still filter them out even if SETA data doesn't include them. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D19838

--HG--
extra : moz-landing-system : lando
2019-02-15 15:36:43 +00:00
Justin Wood
09b6e81ea4 Bug 1522111 - Make -qr tests depend on -pgo where applicable, leaving old -qr sets in place. r=gbrown
Also set the run-on-projects for various tests to be central/try when opt

Differential Revision: https://phabricator.services.mozilla.com/D19742

--HG--
extra : moz-landing-system : lando
2019-02-15 15:36:43 +00:00
jmaher
7f40f7abcc Bug 1522111 - disable opt builds/tests when we have pgo builds/tests for integration branches. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D18104

--HG--
extra : moz-landing-system : lando
2019-02-15 15:36:36 +00:00
Chris AtLee
5085d8b510 Bug 1527138: Remove references to old taskcluster worker types r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D19445

--HG--
extra : moz-landing-system : lando
2019-02-12 21:12:27 +00:00
Kartikaya Gupta
56bd94dd33 Bug 1516568 - Add jobs to cross-compile cargo test binaries and run them on macOS. r=glandium
Similar to the previous patch, this adds two jobs. One that
cross-compiles the binaries produced by `cargo test` and publishes them
as an artifact. The other job downloads the artifact and runs the
resulting binaries.

Differential Revision: https://phabricator.services.mozilla.com/D19370

--HG--
extra : source : 79120d13e713114032263c0851455ec5f981d72c
2019-02-15 01:32:21 +00:00
Kartikaya Gupta
10e1acc2e9 Bug 1516568 - Add jobs to cross-compile wrench and use the resulting binaries. r=glandium
One job (which runs on a Linux docker worker) cross compiles wrench in
two configurations (regular and headless) and publishes artifacts with
the binaries. The other job (which runs on macOS) downloads the
artifacts and uses them to run the WebRender macOS CI release-mode
scripts, which basically consists of running the WebRender reftest
suite.

Differential Revision: https://phabricator.services.mozilla.com/D19369

--HG--
extra : source : 028c0ed368b844a4e54f3c38177b0fe65211d484
2019-02-15 01:32:16 +00:00
Kartikaya Gupta
3674245c97 Bug 1516568 - Provide path to python executable when invoking fetch-content script. r=ahal
The shebang at the top of fetch-content doesn't work on macOS because
the path to python3 is not /usr/bin. Using /usr/bin/env doesn't work
properly on all platforms either so instead we invoke the script using
the currently running python executable.

Differential Revision: https://phabricator.services.mozilla.com/D19744

--HG--
extra : source : f6413e576a2169855f766085704570c9fc851ee2
2019-02-15 01:30:48 +00:00
Kartikaya Gupta
21e4a3d645 Bug 1516568 - Allow run-task jobs on docker-worker to use internal tooltool downloads. r=ahal
This code already exists for other (non-run-task jobs) on docker worker,
so this patch just reuses the existing code but adds a bit to the
run-task schema to allow the task to opt in.

Differential Revision: https://phabricator.services.mozilla.com/D19365

--HG--
extra : source : e9f887f489e59e828c7a62a4818c32cb5121f182
2019-02-15 01:30:39 +00:00
Dorel Luca
b73b2c4f67 Backed out 7 changesets (bug 1516568) for Docker and Toolchain failures. CLOSED TREE
Backed out changeset 79120d13e713 (bug 1516568)
Backed out changeset 028c0ed368b8 (bug 1516568)
Backed out changeset f06721b552a8 (bug 1516568)
Backed out changeset ee403c79877e (bug 1516568)
Backed out changeset 8990eef6c31e (bug 1516568)
Backed out changeset f6413e576a21 (bug 1516568)
Backed out changeset e9f887f489e5 (bug 1516568)
2019-02-15 05:16:55 +02:00
Kartikaya Gupta
ad84b74ed1 Bug 1516568 - Add jobs to cross-compile cargo test binaries and run them on macOS. r=glandium
Similar to the previous patch, this adds two jobs. One that
cross-compiles the binaries produced by `cargo test` and publishes them
as an artifact. The other job downloads the artifact and runs the
resulting binaries.

Differential Revision: https://phabricator.services.mozilla.com/D19370

--HG--
extra : moz-landing-system : lando
2019-02-15 01:32:21 +00:00
Kartikaya Gupta
dc62fcc29a Bug 1516568 - Add jobs to cross-compile wrench and use the resulting binaries. r=glandium
One job (which runs on a Linux docker worker) cross compiles wrench in
two configurations (regular and headless) and publishes artifacts with
the binaries. The other job (which runs on macOS) downloads the
artifacts and uses them to run the WebRender macOS CI release-mode
scripts, which basically consists of running the WebRender reftest
suite.

Differential Revision: https://phabricator.services.mozilla.com/D19369

--HG--
extra : moz-landing-system : lando
2019-02-15 01:32:16 +00:00
Kartikaya Gupta
a03acb6831 Bug 1516568 - Provide path to python executable when invoking fetch-content script. r=ahal
The shebang at the top of fetch-content doesn't work on macOS because
the path to python3 is not /usr/bin. Using /usr/bin/env doesn't work
properly on all platforms either so instead we invoke the script using
the currently running python executable.

Differential Revision: https://phabricator.services.mozilla.com/D19744

--HG--
extra : moz-landing-system : lando
2019-02-15 01:30:48 +00:00
Kartikaya Gupta
e5c19300b2 Bug 1516568 - Allow run-task jobs on docker-worker to use internal tooltool downloads. r=ahal
This code already exists for other (non-run-task jobs) on docker worker,
so this patch just reuses the existing code but adds a bit to the
run-task schema to allow the task to opt in.

Differential Revision: https://phabricator.services.mozilla.com/D19365

--HG--
extra : moz-landing-system : lando
2019-02-15 01:30:39 +00:00
Steve Fink
c0bbfe2ca1 Bug 1526676 - demote SM(msan) back to tier 3; it is getting run via ridealongs, r=catlee
Differential Revision: https://phabricator.services.mozilla.com/D19698

--HG--
extra : moz-landing-system : lando
2019-02-14 23:03:40 +00:00
Thomas Daede
7c61a6cedc Bug 1528077 - Add win64-nasm to static-analysis-autotest. r=glandium
The configure check was failing, breaking this test.

Differential Revision: https://phabricator.services.mozilla.com/D19866

--HG--
extra : moz-landing-system : lando
2019-02-14 22:42:31 +00:00
Mike Hommey
0cc94ca5a1 Backout changeset d9b2f663c85b (bug 1528155) to leave time to toolchain jobs to run. 2019-02-16 08:00:29 +09:00
Mike Hommey
c76df24e8c Bug 1528155 - Use sparse profiles in Windows toolchain tasks. r=tomprince
Also fix support_vcs_checkout call for docker-image based toolchain
tasks.

Differential Revision: https://phabricator.services.mozilla.com/D19912
2019-02-16 07:58:09 +09:00