Commit Graph

2413 Commits

Author SHA1 Message Date
Nick Alexander
0b1169a83d Bug 1411688 - Part 2: Include secrets in Android single-locale repacks. r=aki
Single-locale repacks need to run aapt (--without-gradle) or Gradle
(--with-gradle).  When running --with-gradle, they need to compile the
Java source code again (in order to produce a fresh R.java with
correct IDs).  That compile will be part of the shipping APK, so it
needs to be configured "the same" as the underlying repacked.  *This
is a significant change in behaviour, but necessary to support newer
Gradle/aapt versions, which do not maintain R.java ID mappings across
invocations.*

Part of the configuration are the secret keys and features that are
gated on them.  This commit makes those secrets available to
single-locale repacks.

MozReview-Commit-ID: 4REPsIb5TgN

--HG--
extra : rebase_source : 2d23e0e0c51a61e50acf24123b316bdbb0b579ff
extra : source : a721890f7573140ca6a926e722bd3538c732dae7
2017-11-02 10:03:01 -07:00
Sebastian Hengst
07b805d165 Backed out 5 changesets (bug 1411688) for flake8 linting failure at testing/mozharness/scripts/mobile_l10n.py. r=backout on a CLOSED TREE
Backed out changeset 8ddf3257a8db (bug 1411688)
Backed out changeset c313d76f2aa5 (bug 1411688)
Backed out changeset 3df83a3b7e9c (bug 1411688)
Backed out changeset 133417cefdab (bug 1411688)
Backed out changeset a8fd33d8a2af (bug 1411688)
2017-11-04 00:49:47 +01:00
Nick Alexander
68167070f8 Bug 1411688 - Part 2: Include secrets in Android single-locale repacks. r=aki
Single-locale repacks need to run aapt (--without-gradle) or Gradle
(--with-gradle).  When running --with-gradle, they need to compile the
Java source code again (in order to produce a fresh R.java with
correct IDs).  That compile will be part of the shipping APK, so it
needs to be configured "the same" as the underlying repacked.  *This
is a significant change in behaviour, but necessary to support newer
Gradle/aapt versions, which do not maintain R.java ID mappings across
invocations.*

Part of the configuration are the secret keys and features that are
gated on them.  This commit makes those secrets available to
single-locale repacks.

MozReview-Commit-ID: 4REPsIb5TgN

--HG--
extra : rebase_source : 9a74ea5f6633d1a4bd52d6116b60edaf974d11eb
extra : source : a721890f7573140ca6a926e722bd3538c732dae7
2017-11-02 10:03:01 -07:00
Andrew Halberstadt
d92b629dc4 Bug 1408352 - Add 'always_target' to lint and python unittest tasks, r=dustin
The mochitest and reftest selftest tasks are excluded because they also
schedule several builds as dependencies which is likely going to be unexpected
behaviour.

MozReview-Commit-ID: 9eoVJ5qpAMO

--HG--
extra : rebase_source : 469521feff3ba42506ffb54bfe8f009bf9ab9da6
2017-10-30 09:43:52 -04:00
Andrew Halberstadt
7e8349c9a0 Bug 1408352 - [taskgraph] Implement 'always_target' attribute, r=dustin
Tasks that have the 'always_target' attribute set will be always be included
in the target_task_graph, regardless of target task filtering.

Furthermore, if they were only added because of this attribute (i.e, the
filters would have excluded the task), then the task will be a candidate for
optimization even if the 'optimize_target_tasks' parameter is False.

MozReview-Commit-ID: 9eoVJ5qpAMO

--HG--
extra : rebase_source : 9635002720d088ca9870649f3143d6293c666610
2017-10-30 09:41:51 -04:00
Nick Alexander
2662541c7e Bug 1405396 - Post: Make it easier to debug l10n builds. r=maliu
This adds the R.txt files produced by the build -- timestamped, so
they are kept in order -- to the Task Cluster artifacts, for later
comparison.

MozReview-Commit-ID: 3hj6XjFDIE4

--HG--
extra : rebase_source : 04c1bcd2bf62fd193541fa92dd8841db102f6b5a
extra : source : 5a00c3642c972385cd212fe8b15240bce6acef50
2017-10-20 11:07:21 -07:00
Nick Alexander
99d78dc8bc Bug 1405396 - Post: Run geckoview tests on all but non-Gradle Android builds. r=gbrown
As we transition to Gradle (and only Gradle) Fennec builds, we're
turning the Gradle builds (Bg) into non-Gradle builds (Bng).  It's not
worth the effort to rename "gradle" to "non-gradle", so this is a
confusing looking patch that turns on GeckoView tests for everything
but Bng (which has kept the "gradle" name).

MozReview-Commit-ID: C1PlsehRwJf

--HG--
extra : rebase_source : f8bfc730ab963833f43d2f19b11027db8e49a06a
extra : source : 50006730ade8dd1a12ec0eec7113f802e6b8497d
2017-10-19 13:58:44 -07:00
Nick Alexander
260954c89b Bug 1405396 - Build with Gradle by default; turn Bg (Gradle) into Bng (non-Gradle). r=maliu
This also turns the tier 2 job B(n)g into tier 1, since moz.build is
still tier 1.  It also pushes a lot of GeckoView related tasks into
the main builds, since they should run as part of Gradle builds.

This also removes unused tooltool manifests; the jobs that used these
manifests use only toolchain tasks now.

MozReview-Commit-ID: 2GmnJ7joCTT

--HG--
extra : rebase_source : 75cd2dfb51e0e1b510f5e618c2dc881cf5f22bf2
extra : source : 6b95b09d6afbb83ba89c47b237dfce6e15587bbe
2017-10-18 13:05:54 -07:00
Nick Alexander
0436784ef8 Bug 1405396 - Pre: Configure geckoview test for x86. r=gbrown
MozReview-Commit-ID: BITEuWnJPUK

--HG--
extra : rebase_source : dcf5c06f97dea682e29c46b8e7f7cd9f3ee58888
extra : source : 11b7ab2c3c206915179080be13777e0d5a8d4c98
2017-10-20 18:07:01 -07:00
Wander Lairson Costa
9ebefdadc5 Bug 1413225: Do not apply remove_executables to talos-g5. r=jmaher
mdc1 Linux machines can't find tooltool with this config.

MozReview-Commit-ID: 3CnfqcSbO0K

--HG--
extra : rebase_source : 13d4b76bafda17a82659927afee38320f91d0f93
2017-10-31 13:52:45 -02:00
Sebastian Hengst
ca88e3c4c5 Merge mozilla-central to autoland. r=merge a=merge 2017-11-01 22:58:44 +01:00
Sebastian Hengst
4ff29d14f8 merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: GSDYk9wLOAM

--HG--
rename : browser/base/content/test/general/browser_bug561636.js => browser/modules/test/browser/formValidation/browser_form_validation.js
rename : browser/base/content/test/general/browser_bug595507.js => browser/modules/test/browser/formValidation/browser_validation_iframe.js
rename : browser/modules/test/browser/browser_bug1319078.js => browser/modules/test/browser/formValidation/browser_validation_invisible.js
2017-11-01 22:55:12 +01:00
alex
40f03f9f5e Bug 1393788 - Compress all JSDcov artifacts (.json files) into zip files after all tests are completed. r=gmierz,jmaher.
Building with "Linux x64 JSDCov", each suite of tests will produce a list of JSDCov artifacts (.json). This patch compresses all JSDCov artifacts into 1 zip file for each suite upon tests completion.
MozReview-Commit-ID: DaNLOQuW2lc

--HG--
extra : rebase_source : cceb912d0fe16f9921e1d13fe85d53af2abcb29c
2017-10-26 17:01:12 -04:00
Phil Ringnalda
b12e853fb0 Bug 1400280 - Mark OS X tests on nightlies and devedition builds as tier-1, r=kmoir
MozReview-Commit-ID: 9pgbbBCZxFq
2017-10-31 22:44:44 -07:00
Csoregi Natalia
991f959ae4 Merge mozilla-central to mozilla-autoland. r=merge a=merge on a CLOSED TREE 2017-11-01 12:23:01 +02:00
Csoregi Natalia
423b2522c4 Merge inbound to mozilla-central r=merge a=merge 2017-11-01 12:14:00 +02:00
Sebastian Hengst
2181970726 merge mozilla-central to mozilla-inbound. r=merge a=merge 2017-11-01 00:39:58 +01:00
Rok Garbas
aa1343961f Bug 1413196 - Almost permafailing gecko decision tasks on Try: TypeError: argument of type 'NoneType' is not iterable during Generating tasks for release-bouncer-sub fennec r=rail a=bustage
MozReview-Commit-ID: 54FykvKXUEw

--HG--
extra : source : 8b8e9e2e62439714840b2e5d266fb7ab6e8947e0
extra : amend_source : 7eabfa12620b8c203b9fab04b311f60f23a3ed0c
2017-10-31 15:01:23 +01:00
Margareta Eliza Balazs
a63fdbeabb Merge inbound to mozilla-central r=merge a=merge 2017-10-31 12:46:19 +02:00
Ethan Lin
51ea45ca9b Bug 1408822 - Enable talos svg test for webrender. r=kats
MozReview-Commit-ID: BlutVqdbsUX

--HG--
extra : rebase_source : 539b6baf81784f567e67a841033af69efbf51a5e
2017-10-31 18:00:03 +08:00
Ben Hearsum
b9f1abc30e bug 1391983: add docker image for update verify. r=rail 2017-10-31 11:08:38 -04:00
Gregory Szorc
1269329adb Bug 1413254 - Establish dedicated mach command for Bugzilla metadata validation; r=jmaher
Previously, the CI task invoked 2 mach commands and performed manual
gzip compressed. This was sub-optimal for a few reasons:

* Redundant moz.build evaluation made execution slower
* Potential for shell expansion to interfere with wildcards
* Made it harder to change exit code

By moving all logic into a mach command, we eliminate all the issues
around using shell.

Behavior of the new command and the CI task should be backwards
compatible.

MozReview-Commit-ID: HUFvLteKLOO

--HG--
extra : rebase_source : 85a49fc45eeaaac71dfb97fc22900a81ca9efa4b
2017-10-31 10:30:15 -07:00
Sebastian Hengst
2c835e29c4 merge mozilla-central to mozilla-inbound. r=merge a=merge 2017-10-31 00:00:54 +01:00
Sebastian Hengst
f07fc93141 merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: 4PW6ESqLL73
2017-10-30 23:52:23 +01:00
Geoff Brown
8c5655f380 Bug 1412953 - Increase number of test chunks for Android 4.3 opt plain reftests; r=jmaher 2017-10-30 15:13:40 -06:00
Nathan Froyd
055fd17b85 Bug 1412888 - fix for super-flexible data formats; r=me
When your CLOSED TREE fix can't even start jobs, it's a little embarrassing.
2017-10-30 14:15:22 -04:00
Nathan Froyd
369357c3ce Bug 1412888 - increase the sccache idle timeout for Android/x86 jobs; r=ted.mielczarek
When innocent sccache updates break builds, you have to land on a CLOSED TREE.
2017-10-30 14:10:23 -04:00
Nathan Froyd
c32f61a4c3 Bug 1412888 - bump the sccache revision to include argument parsing fixes; r=ted.mielczarek 2017-10-30 12:31:07 -04:00
Andrew Halberstadt
4747b91a36 Bug 1412136 - [taskgraph] Don't assume all tasks have a 'tags' attribute in artifact template, r=dustin
MozReview-Commit-ID: IbiD2zbCeh

--HG--
extra : rebase_source : d6d1d8388ba722c47069c1b6906309d4535220f4
2017-10-27 16:04:04 -04:00
Andrew Halberstadt
7bd17db52b Bug 1412136 - [taskgraph] Use 'mergeDeep' in templates, r=dustin
MozReview-Commit-ID: 2foWko3i4NK

--HG--
extra : rebase_source : 8f985d336ced73ad74a857a07af00b66b88776d8
2017-10-27 11:48:23 -04:00
Dustin J. Mitchell
1897df4f74 Bug 1405750 - limit symbol and group names; r=nalexander
MozReview-Commit-ID: 4nEXX2Z4Kbx

--HG--
extra : rebase_source : 2bca8edf1675ccc65924fd73fee73f0e36a40059
2017-10-12 20:03:32 +00:00
Sebastian Hengst
6979ea37b4 merge mozilla-central to autoland. r=merge a=merge 2017-10-30 23:58:16 +01:00
Wander Lairson Costa
d5be25f9c1 Bug 1357753: Fix try branch name. r=jlund
"Try" with capital T is causing bustage with Taskcluster test jobs.

MozReview-Commit-ID: BNNW4nFf0Ro
2017-10-29 13:57:41 -07:00
Phil Ringnalda
bd249af085 Bug 1412690 followup, add missing file
MozReview-Commit-ID: 49by1OEmGoO
2017-10-30 13:54:45 -07:00
Mihai Tabara
c9a7b22bb6 bug 1412690 - Fix staging bouncer configs.r=aki
MozReview-Commit-ID: 9PJAFoWOqcH

--HG--
extra : rebase_source : fb99c29deefcff9c365f0394624d44cd8c83aee2
2017-10-30 16:50:32 +00:00
Aki Sasaki
5f54aa1f52 bug 1412690 - address review comments. r=mtabara
MozReview-Commit-ID: JKeqeF1hC30

--HG--
extra : rebase_source : 7dc1800dd872a4d60d09856ba2dd92814aa65b13
2017-10-30 11:57:59 -07:00
Aki Sasaki
d16d2d20cb bug 1412690 - add task dependencies. r=rail
This patch adds the `release_deps` transform, which adds every
kind-dependency task that has the same product as a task dependency
(with some exceptions).

This patch made it clear that we need a standard way of defining
product.

MozReview-Commit-ID: 4xOJRQSCTgF

--HG--
extra : rebase_source : 4b98b040ac5d8777394cff6f3249ab354fff641b
2017-10-29 17:40:50 -07:00
Rok Garbas
a81412addb Bug 1412690 - fennec release driver emails. r=aki
This patch adds the `release-notify-promote` and `release-notify-publish` kinds. It also genericizes all the notifications, and updates the kinds that use those notifications.

MozReview-Commit-ID: 9ymXKzthVF4

--HG--
extra : rebase_source : 6d7db48afa14e4124834321784da65e8d1e84c98
2017-10-29 17:35:03 -07:00
Aki Sasaki
6abeef4e00 bug 1412690 - beetmover-cdns. r=rail
This patch adds the beetmover-cdns kind, and adds it to
`publish_fennec`.

This was the first non-buildbot-bridge, non-dummy relpro task, so this
needed a new transform.

This patch also updates the `previous_graph_kinds` and updates the
beetmover scopes in scriptworker.py.

MozReview-Commit-ID: 3rpkjuLjjXz

--HG--
extra : rebase_source : d491f1ce5d10ee8f2602698236106007e203c358
2017-10-29 17:32:22 -07:00
Rok Garbas
ea820a99db Bug 1412690 - fennec per task notifications. r=garbas
This patch adds per-task pulse notifications, as well as general support
to handle them.

Longer term we may move away from pulse-notifications, but this allows
us to proceed with pulse-notifications until that time.

MozReview-Commit-ID: 1uB4X682yLT

--HG--
extra : rebase_source : 360938e4682e3d7ae0874b4a50e41d5f97bf98bb
2017-10-29 17:31:45 -07:00
Rail Aliiev
04db73b08e Bug 1412690 - add release-bouncer-sub to publish_fennec's previous_graph_kinds. r=aki
We currently use `previous_graph_kinds` as a pointer to use a previously
built graph's task instead of generating a new task. We were re-running
`release-bouncer-sub` in the `publish_fennec` release promotion flavor
because we hadn't specified `release-bouncer-sub` as a
`previous_graph_kind`; this patch fixes that error.

MozReview-Commit-ID: 92MAVsG8Jrk

--HG--
extra : rebase_source : cf8411d017de20ef05ba9ac547e94797c88901dd
2017-10-29 17:30:56 -07:00
Aki Sasaki
7011795eaa bug 1412690 - stop building android nightlies on push. r=rail
We were building some Android nightly platforms on push, because we
didn't add them explicitly to the remove list.

I think longer term, we'll want to have `product` and
`release_promotion_action` attributes set in a standard manner, that we
can use to filter these things more intelligently.

MozReview-Commit-ID: KNZ7vxc3gRo

--HG--
extra : rebase_source : dd0c87fe8d050b226db6ba97d22c9089f7bb9430
2017-10-29 17:30:05 -07:00
Rok Garbas
5ef4a1dd30 Bug 1412690 - fennec version bump in-tree task. r=aki
This patch adds the initial `release-version-bump` kind, and adds it to
the `publish_fennec` `target_tasks_method`.

It also adds support for `next_version`.

MozReview-Commit-ID: 9YRswddeuZ3

--HG--
extra : rebase_source : 991cbf89b40c4ef980c42251001e81be5cedaf00
2017-10-29 17:25:01 -07:00
Rail Aliiev
1538ea94d6 Bug 1412690 - Fennec uptake monitoring in-tree task. r=aki
This patch adds the initial `release-uptake-monitoring` kind, and adds
it to the `publish_fennec` `target_tasks_method`.

MozReview-Commit-ID: 3RDMNGrbBwD

--HG--
extra : rebase_source : f504c8e173337d45bc9f374bd0349c6823b50ffb
2017-10-29 17:23:12 -07:00
Rail Aliiev
530a285ff2 Bug 1412690 - Fennec bouncer aliases in-tree task. r=aki
This patch adds the initial `release-bouncer-aliases` kind, and adds it
to the `publish_fennec` `target_tasks_method`.

It also adds the ability to specify the `tuxedo_server_url`
`by-project`.

MozReview-Commit-ID: 9I4IaUlbCCD

--HG--
extra : rebase_source : d0ed88a687ef6fb9f97dc67c0f04742bbfeb201d
2017-10-29 17:18:46 -07:00
Rail Aliiev
9fe373f8ea Bug 1412690 - Fennec mark release as shipped in-tree task. r=aki
This patch adds the initial `release-mark-as-shipped` kind, and adds it to
the `publish_fennec` `target_tasks_method`.

MozReview-Commit-ID: F8AYscJQWlh

--HG--
extra : rebase_source : 9522b95f65b5b373a54bc0fc01a20c72adbee0cb
2017-10-29 17:16:37 -07:00
Aki Sasaki
98dd2a1e7a bug 1412690 - add fennec release bouncer sub. r=rail
This patch adds the first releasetask as a new kind. To support this, we
added a new `release-promotion` flag in the buildbot job. If this is
set, we use the new `bb_release_worker` function; otherwise we fall back
to the `bb_ci_worker` function (this is the old behavior, factored out
into a separate function).

We also added `build_number` and `release_promotion` attributes in the
task definition.  Finally, `build_number` now defaults to 1, allowing us
to create the task graph locally without forcing us to set
`BUILD_NUMBER` in the environment.

MozReview-Commit-ID: 8vNMHJemqAG

--HG--
extra : rebase_source : c8816d3e7b2f5358ea51ee8d5fb12585e67e9853
2017-10-29 17:11:41 -07:00
Aki Sasaki
c7f7311793 bug 1412690 - add {promote,publish}_{fennec,firefox} target task methods. r=rail
This hooks up the `target_tasks_method`s and the
`release_promotion_flavor`s for these four release promotion flavors.

We also add some maple support and add `version_display.txt` to the
decision task sparse checkout so we can read the version number during
decision/action task time.

MozReview-Commit-ID: CdxUUXZtXO0

--HG--
extra : rebase_source : 99e4f060a964d34a377aea6a6e36fbcef66c6aec
2017-10-29 17:10:42 -07:00
Aki Sasaki
778c4efb0c bug 1412690 - allow for relpro target_tasks_method. r=rail
This patch creates a new `filter_beta_release_tasks` function. By
pulling this logic out of `mozilla_beta_tasks`, we can reuse it in the
release promotion `target_tasks_method`s.

MozReview-Commit-ID: Kwk3jgtooCS

--HG--
extra : rebase_source : f932f56c40afb39c23233ef885fe7ed45d350e7a
2017-10-29 17:08:54 -07:00
Rok Garbas
664957b022 Bug 1413196 - Almost permafailing gecko decision tasks on Try: TypeError: argument of type 'NoneType' is not iterable during Generating tasks for release-bouncer-sub fennec r=rail
MozReview-Commit-ID: 54FykvKXUEw

--HG--
extra : rebase_source : d8dc0702020261d16f98a3b70eefb07cc32123c8
2017-10-31 15:01:23 +01:00