Commit Graph

5494 Commits

Author SHA1 Message Date
championshuttler
677714a968 Bug 1536103 - Fix Sphinx Warning - Title Underline too short in 'mach doc'. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D24536

--HG--
extra : moz-landing-system : lando
2019-03-22 19:30:34 +00:00
Tom Prince
dafb7d27e6 Bug 1536882: Stop specifying installer to download in windows L10n jobs; r=Callek
The code that actually downloads it is behind a condition that isn't set
anywhere.

Differential Revision: https://phabricator.services.mozilla.com/D24215

--HG--
extra : moz-landing-system : lando
2019-03-22 13:44:05 +00:00
Tom Prince
3cd07d3160 No bug: [diffoscope] Output an empty diff if the files do not differ; r=glandium
Currently, if the files match and you try to look at the diff, you get

   {
       "reason": "file-missing-on-worker",
       "message": "Artifact \"public/diff.html\" not found at \"/builds/worker/diff.html\""
   }

which makes it hard to tell if there was an error generating a diff, or if the files matched.
This changes things to ask diffoscope to always output a diff, to remedy that confusion.

Differential Revision: https://phabricator.services.mozilla.com/D24316

--HG--
extra : moz-landing-system : lando
2019-03-22 13:23:23 +00:00
Kartikaya Gupta
741672fb85 Bug 1538198 - Trigger a bugzilla-components job along with the searchfox indexing jobs. r=emilio
Searchfox relies on the bugzilla component job running on the same push
as the indexing jobs, but there's nothing that actually guarantees that.
Thus far pushes to m-c pretty much always have source changes so the
bugzilla component job gets run, but on beta/release branches it's
possible to get pushes with just tag changes and no source changes, so
the bugzilla component job would get optimized away. This patch ensures
that the job gets run along with the other indexing jobs that searchfox
needs.

Differential Revision: https://phabricator.services.mozilla.com/D24507

--HG--
extra : moz-landing-system : lando
2019-03-22 14:53:01 +00:00
Andreea Pavel
ca2f9536a8 No Bug - fix leftover from the merge conflict on a CLOSED TREE
--HG--
extra : rebase_source : 4ec06e78b9940e077b880426d28139d91da59a96
2019-03-22 15:47:18 +02:00
Andreea Pavel
9bdad35860 No bug - delete conflict marker 2019-03-22 12:46:22 +02:00
Andreea Pavel
74a4769236 Merge mozilla-central to autoland 2019-03-22 12:37:25 +02:00
Andreea Pavel
c1f948c75f Backed out 2 changesets (bug 1527463) for bustages a=backout
Backed out changeset 74b3bf36f5e8 (bug 1527463)
Backed out changeset 235af3330b73 (bug 1527463)
2019-03-22 12:09:57 +02:00
Andreea Pavel
94df8050c7 Bug 1352113 - fix duplicate key on a CLOSED TREE
--HG--
extra : rebase_source : 5da1b1f465af0259b805f4ab495c468c5e1baa74
2019-03-22 11:26:58 +02:00
Justin Wood
52cc42455b Bug 1352113 - Shippable Builds - Consolidate raptor-chrome options up to job-defaults to reduce boilerplate spread throughout. r=jmaher
This does not change the substance of what is passed down to transforms.

Differential Revision: https://phabricator.services.mozilla.com/D22831

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:46 +00:00
Justin Wood
2befe5e75b Bug 1352113 - Shippable Builds - add shippable index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22240

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:44 +00:00
Justin Wood
bef2e172d1 Bug 1352113 - Shippable Builds - Add more new/old conversions for SETA. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22239

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:42 +00:00
Justin Wood
a9599e47f4 Bug 1352113 - Shippable Builds - Significantly speedup SETA computation by using sets. r=jmaher
Without this the shippable builds take >20 seconds to compute the prune through new_as_old_is_high_value, locally. With this it is near instant.

Differential Revision: https://phabricator.services.mozilla.com/D22711

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:40 +00:00
Justin Wood
cc220848b6 Bug 1352113 - Shippable Builds - Refactor SETA old->new handling a bit, to make it clearer. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22238

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:38 +00:00
Justin Wood
d23a3c5b36 Bug 1352113 - Shippable Builds - add shippable qr variants for osx, linux and windows. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22237

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:36 +00:00
Justin Wood
cc86da7584 Bug 1352113 - Shippable Builds - Win10 Tests. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22236

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:34 +00:00
Justin Wood
04ae5a13a1 Bug 1352113 - Shippable Builds - Win7 Tests. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22235

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:32 +00:00
Justin Wood
de08c2e3fb Bug 1352113 - Shippable Builds - Linux64 Tests. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22234

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:30 +00:00
Justin Wood
353bc8db92 Bug 1352113 - Shippable Builds - Linux32 Tests. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22233

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:28 +00:00
Justin Wood
186ee7963d Bug 1352113 - Shippable Builds - OSX tests. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22232

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:26 +00:00
Justin Wood
170f7747b6 Bug 1352113 - Shippable Builds - Add test run-on-projects to avoid scheduling shippable just yet. r=jmaher
This sets all of the shippable tests to not run in the places where they would otherwise.
This patch will be effectively undone later in the patchset.

Differential Revision: https://phabricator.services.mozilla.com/D22710

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:24 +00:00
Justin Wood
6b114e430f Bug 1352113 - Shippable Builds - Make sure we sign shippable builds. r=aki
When we set the nightly attribute the tasks don't run on-push, so we use a new attribute.

Differential Revision: https://phabricator.services.mozilla.com/D22709

--HG--
extra : moz-landing-system : lando
2019-03-22 03:24:22 +00:00
Justin Wood
2fed95e853 Bug 1352113 - Shippable Builds - Add linux64 shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22230

--HG--
extra : moz-landing-system : lando
2019-03-22 03:23:12 +00:00
Justin Wood
6c9f30beab Bug 1352113 - Shippable Builds - Add Linux32 shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22229

--HG--
extra : moz-landing-system : lando
2019-03-22 03:23:10 +00:00
Justin Wood
e382f881c1 Bug 1352113 - Shippable Builds - Add windows64 aarch64 shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22228

--HG--
extra : moz-landing-system : lando
2019-03-22 03:23:08 +00:00
Justin Wood
465c92a23d Bug 1352113 - Shippable Builds - Add windows64 shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22227

--HG--
extra : moz-landing-system : lando
2019-03-22 03:23:01 +00:00
Justin Wood
4d76c197fe Bug 1352113 - Shippable Builds - Add windows32 shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22226

--HG--
extra : moz-landing-system : lando
2019-03-22 03:22:59 +00:00
Justin Wood
8d22d54e8c Bug 1352113 - Shippable Builds - OSX Build. r=aki
This commit adds a new build for OSX since there is no current PGO build type for OSX.
And calls it shippable, this mirrors that of the nightly.

Differential Revision: https://phabricator.services.mozilla.com/D22225

--HG--
extra : moz-landing-system : lando
2019-03-22 03:22:51 +00:00
Justin Wood
224d0be3ef Bug 1352113 - Shippable Builds - Add index builder, but don't do any index's yet. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D22224

--HG--
extra : moz-landing-system : lando
2019-03-22 03:22:49 +00:00
Justin Wood
94d4e53251 Bug 1352113 - Shippable Builds - Do not run merge on by-* values. r=tomprince
This was needed since when we have job-defaults and later on a test set for
``
run-on-projects:
    by-test-platform:
        ...
``
We were ending up with both the list of by-* being extended but also
any array in that list also being extended (like `default: ['a', 'b']`
was getting extended to also have the new values for default)

This is not only usually wrong but very very likely not what the author wanted.

Differential Revision: https://phabricator.services.mozilla.com/D22708

--HG--
extra : moz-landing-system : lando
2019-03-22 03:22:42 +00:00
Tom Prince
b7b0abc340 Bug 1491371: [comm-task-env] Pass wrapped command name as argv[0]; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D24415

--HG--
rename : taskcluster/scripts/comm-task-env => taskcluster/docker/decision/comm-task-env
extra : moz-landing-system : lando
2019-03-21 20:05:56 +00:00
shindli
987aa4b78c Merge autoland to mozilla-central. a=merge 2019-03-21 06:33:42 +02:00
Mike Hommey
52462938e1 Bug 1527463 - Enable EME on win64-aarch64 nightlies. r=tomprince, a=CristianB
Bug 1534522 added win64-aarch64-eme/opt builds, which are artifact builds
that glue together a win64-aarch64/opt build and a win32/opt build.

This enables EME on the corresponding nightlies in a slightly different
way:
- this adds a no-eme build that corresponds to win64-aarch64/opt.
- this turns the existing nightly into an artifact build that glues
  together that no-eme build and the win32 nightly.

The no-eme build cannot have the nightly attribute set, first because
the beetmover transform fails in that case, and because that would imply
shipping those builds, but they're not meant to be shipped this way.

It also has run-on-projects set to an empty list so that it doesn't
appear by default in `mach try fuzzy`, while still being triggered when
needed due to being a dependency of the nightly build.

It is preferable to keep the win64-aarch64{,-eme}/opt builds untouched
to make things easier for try (the win64-aarch64 ones being the main
ones to try; also, the -eme builds currently fail with --artifacts).

Ideally, like in bug 1534522, we'd add a diffoscope build to ensure
the variations between the nightly and its base no-eme build are within
control, but currently, that would trigger nightlies on every push,
which is not desirable. Ideally, they'd trigger whenever both their
dependencies are in the target task graph. We leave that to a followup.

Differential Revision: https://phabricator.services.mozilla.com/D23640
2019-03-21 09:11:19 +09:00
Bastien Abadie
9e0cc34738 Bug 1535355 - Add clang-tidy & clang-format in CI for code-review, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D23524

--HG--
extra : moz-landing-system : lando
2019-03-19 14:42:32 +00:00
Mike Shal
28e60232f7 Bug 632954 - Enable tests on Android PGO; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D22827

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:38 +00:00
Mike Shal
d07bfb450e Bug 632954 - Add final Android PGO task; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D22826

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:31 +00:00
Mike Shal
de76c53a4e Bug 632954 - Add Android profile generation task; r=tomprince,gbrown
This introduces a mozharness script, android_emulator_pgo.py, to run the
profileserver suite with the PGO-instrumented Android build, and collect
the profile data and jarlog.

The mozharness script contains some redundancy with
build/pgo/profileserver.py, but the additional requirements for Android
to use adb and existing mozharness classes to control the emulator made
it difficult to share the desktop profileserver implementation.

Differential Revision: https://phabricator.services.mozilla.com/D22825

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:29 +00:00
Mike Shal
9a90619e08 Bug 632954 - Add Android PGO-instrumented build task; r=tomprince
This is the first stage of the Android PGO task pipeline to generate an
instrumented build.

Differential Revision: https://phabricator.services.mozilla.com/D22824

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:19 +00:00
Mike Shal
b63bf70e42 Bug 632954 - Add support for MOZHARNESS_OPTIONS to test-linux.sh; r=tomprince
The mozharness.py transform passes in "options" parameters through the
MOZHARNESS_OPTIONS environment variable. This will allow the Android PGO
run task to pass in the mozharness script name to test-linux.sh

Differential Revision: https://phabricator.services.mozilla.com/D22822

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:06 +00:00
Mike Shal
3729df6ca6 Bug 632954 - Add execute bit to test-linux.sh; r=tomprince
In order to call test-linux.sh with the job-script parameter, it needs
to have executable permissions.

Differential Revision: https://phabricator.services.mozilla.com/D22821

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:01 +00:00
Mike Shal
9b049d4cdf Bug 632954 - Explicitly set NEED_XVFB to false if need-xvfb isn't set; r=tomprince
test-linux.sh defaults to true for NEED_XVFB, while build-linux.sh
defaults to false. If we are using test-linux.sh from mozharness (rather
than mozharness-test), we need to explicitly set NEED_XVFB to false in
order to not use xvfb.

Differential Revision: https://phabricator.services.mozilla.com/D22820

--HG--
extra : moz-landing-system : lando
2019-03-18 23:52:52 +00:00
Ian Moody
167f623a3e Bug 1246594 - Enable ESLint rule no-throw-literal by default. r=Standard8
Differential Revision: https://phabricator.services.mozilla.com/D24088

--HG--
extra : moz-landing-system : lando
2019-03-19 22:02:42 +00:00
Tom Prince
a26c770a67 Bug 1535132: Add worker types for running instrumented builds; r=dustin
This adds worker-type alias that has dedicated workers at level-3 for running
instrumented builds, but uses a test worker type at other levels.

Differential Revision: https://phabricator.services.mozilla.com/D23576

--HG--
extra : moz-landing-system : lando
2019-03-19 19:14:03 +00:00
Tom Prince
a4c16d10ba Bug 1532783: Implement worker aliases; r=aki,glandium,jmaher,dustin
There are a number of ways we want to vary workers over time and jobs, including

 - we are working on migrating to gce
 - pgo builds have a dedicated worker-type for running the instrumented build
   at level 3 but not level 1

Rather than have all tasks know about how the machines are provisioned, this
moves to using short-names for the worker types, and then has a config mapping
those to the actual worker types.

This adds support for aliases, and an initial set of them. Follow up work will
switch the existing uses of these worker types to using the aliases.

Differential Revision: https://phabricator.services.mozilla.com/D22549

--HG--
extra : moz-landing-system : lando
2019-03-19 19:13:56 +00:00
Jesse Schwartzentruber
3905101073 Bug 1519851 - Create --enable-fuzzing debug build job for MacOSX. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D19862

--HG--
extra : moz-landing-system : lando
2019-03-19 17:01:38 +00:00
Rob Lemley
fd2b496ad9 Bug 1491371 - Update decision task image to support comm-task-env. r=dustin
comm-task-env runs before run-task and updates the environment with GECKO_*
variables that are defined in a file at the root of a subproject's repository,
such as "comm-central".

Updates:
- add comm-task-env
- add python 3.5 (run-task dependency)
- add pyyaml

Differential Revision: https://phabricator.services.mozilla.com/D16934

--HG--
extra : moz-landing-system : lando
2019-03-18 22:19:08 +00:00
Rob Lemley
d7db4546d1 Bug 1491371 - Pin comm branches to mozilla revs without .taskcluster.yml. r=tomprince,dustin
comm-task-env runs before run-task and updates the environment with GECKO_*
variables that are defined in a file at the root of the comm repository,
".gecko_rev.yml". run-task needs these variables to be set to find the
correct mozilla repository to check out for a particular TB build.

The current pinning method of updating ".taskcluster.yml" with the mozilla
repository and revision to pin tois no longer supported.

Differential Revision: https://phabricator.services.mozilla.com/D16783

--HG--
extra : moz-landing-system : lando
2019-03-18 22:19:38 +00:00
Gurzau Raul
b0e75ab0e1 Merge mozilla-central to autoland. a=merge CLOSED TREE 2019-03-18 23:44:31 +02:00
Gurzau Raul
9db9a7e707 Merge inbound to mozilla-central. a=merge 2019-03-18 23:38:05 +02:00
Ionut Goldan
c6c5c7bd09 Bug 1535016 - Don't treat any Android job as new job r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D23674

--HG--
extra : moz-landing-system : lando
2019-03-18 10:32:12 +00:00