Commit Graph

85 Commits

Author SHA1 Message Date
Alexandre Lissy
00d0eac6d3 Bug 1201540 - Add support for multiple OTA/FOTA types. r=catlee
B2G updates can be of multiple types:
 - OTA, applied without rebooting the device,
 - FOTA with only Gecko/Gaia,
 - FOTA with whole system partition files,
 - FOTA dumping partitions images.

Each type of updates has its advantages and drawbacks. There is an
extensive documentation maintained on MDN about each and the options:
https://developer.mozilla.org/en-US/Firefox_OS/Building_and_installing_Firefox_OS/Firefox_OS_update_packages

All those updates are being packaged as a MAR file that gets injected
into the classical Firefox update mechanism, submitted to Balrog and
downloaded by the client. The content of the MAR will however depend on
the type of update: an OTA update will packate a Gecko and Gaia set of
files to update those parts; while any FOTA package is just an
update.zip that will get applied in recovery mode on the device.

So one fundamental difference is that OTA will not reboot your device
(just Gecko) while FOTA requires a working recovery mode and will reboot
your device. But OTA needs more system partition space to get applied,
and it can only update files that are within the /system/b2g/ directory.
FOTA on the other hand can update anything since the payload will
contain an update script written in Edify (Android recovery update
scripting language).

For each device we might need to produce several types of updates that
will be pushed to users depending on the context: for some users we want
to push just a Gecko/Gaia update, for some we know that we need to
update more content and thus we need to send some partitions.
Previously, the b2g_build.py script would only allow one kind of update
payload to be produced for each device available: we would need to have
a device "flame-kk-ota" and "flame-kk-fota" just to produce the OTA and
FOTA packages for the same device, thus resulting in a waste of
computing power and storage.

This commit introduces a new field "update_types" that can take an array
of values:
 - ota, to produce an OTA package as before
 - fota, to produce a FOTA package with only Gecko/Gaia
 - fota:full, to produce a FOTA package of all files of the system
   partition
 - fota:fullimg, to produce a FOTA package dumping partitions

The old "update_type" will be used in the absence of "update_types". And
if none are present, we will keep defaulting to generating OTA as
previously.
2015-11-03 10:25:00 +01:00
Alexandre Lissy
8a1e0d9024 Bug 1221645 - Make Nexus 4 KK and Nexus 5 L full images public. r=wcosta 2015-11-04 11:51:00 +01:00
Alexandre Poirot
2fd0a07485 Bug 1198877 - Tweak simulator build script to accept any platform package. r=jryans 2015-11-03 13:35:11 -08:00
Wander Lairson Costa
c43a4bf584 Backout "Bug 1144808 part 2: Harden phone-builder image."
Things just got too hard for B2G people to change build scripts, so we
are backing out this.

--HG--
extra : commitid : 16CKTLSAi3B
2015-10-28 11:17:58 -02:00
Alexandre Poirot
0fe6353498 Bug 1213011 - Use stable file name for simulator xpi in TC. r=garndt 2015-10-26 10:45:47 -07:00
Andrew Halberstadt
1848e92d30 Bug 1171033 - Add taskcluster linux64 test configs (but not scheduled anywhere yet), r=dustin
This adds test configs for desktop linux64 unittests, including: mochitest-plain,
mochitest-browser-chrome, mochitest-devtools-chrome, reftest and xpcshell. It
also does a minor refactor of the b2g configs to remove some b2g-specific logic
from the base 'test.yml' config.

This does *not* schedule these tests anywhere just yet.

--HG--
extra : commitid : HdWat17LZNb
extra : rebase_source : 456b0261fc06131e22d8d5a37adf12f090abe5bd
2015-10-15 15:35:45 -04:00
Andrew Halberstadt
139c78dcfa Backout 11ba4c03d205 for gecko decision bustage
--HG--
extra : commitid : 9EAoXaksr4K
2015-10-23 11:20:48 -04:00
Andrew Halberstadt
f686f5b310 Bug 1171033 - Add taskcluster linux64 test configs (but not scheduled anywhere yet), r=dustin
This adds test configs for desktop linux64 unittests, including: mochitest-plain,
mochitest-browser-chrome, mochitest-devtools-chrome, reftest and xpcshell. It
also does a minor refactor of the b2g configs to remove some b2g-specific logic
from the base 'test.yml' config.

This does *not* schedule these tests anywhere just yet.

--HG--
extra : commitid : 3wjUmgfi1se
extra : rebase_source : 1369d5b3fcfb5e6e351c8384187772dae52f341f
extra : amend_source : 47f9574b013bfb892713a52d9377655eb9040608
2015-10-15 15:35:45 -04:00
Wes Kocher
5ba2dcfe5c Merge b2ginbound to central, a=merge 2015-10-22 16:50:22 -07:00
Wander Lairson Costa
de42aec50d Bug 1144808 part 2: Harden phone-builder image. r=garndt
We don't run free commands from tasks, we now allow only scripts shipped
in the phone-builder image.

We also added support to an allowed whitelist of github and bitbucket
users to run tasks from their respective private repositories.

--HG--
extra : commitid : 6NA1M4JKjCQ
2015-10-22 11:40:22 -02:00
Dustin J. Mitchell
fd5fc65ac0 Bug 1214809: use 'sudo' instead of 'su' to drop root privs; r=ted
--HG--
extra : commitid : AcpLVAV7DV3
extra : rebase_source : 831bd4a4948231b0f23dccbd48220850674c1ea9
2015-10-20 18:12:09 -04:00
Ehsan Akhgari
61b07632ad Bug 1214948 - Add a script to build Linux clang using TaskCluster; r=ted
DONTBUILD
2015-10-19 16:14:12 -04:00
Dustin J. Mitchell
d9655822db Bug 1213325: refactor desktop-test to use an in-tree script; r=ahal
This generally makes the approach look more like that for desktop-build.  The
major difference is that `bin/test.sh` takes arguments which are passed on to
the mzoharness script (MOZHARNESS_SCRIPT) with the addition of config
arguments (MOZHARNESS_CONFIG)

--HG--
rename : testing/docker/desktop-build/bin/build.sh => testing/docker/desktop-test/bin/test.sh
rename : testing/docker/desktop-test/mozharness_configs/remove_executables.py => testing/mozharness/remove_executables.py
extra : commitid : GyMeTBpCwm8
extra : rebase_source : 1a61f9bc32066ad6f9fce504d3e8ac67e39b105d
2015-10-13 14:20:34 -04:00
Wes Kocher
dd2362b623 Backed out changeset e58169d5f96a (bug 1204800) for flame-kk build failures 2015-10-06 17:51:12 -07:00
Dustin J. Mitchell
106d89e80b Bug 1209494: remove refs to RELENGAPI_TOKEN, TOOLTOOL_CACHE; r=jlund
RELENGAPI_TOKEN is no longer needed, with the advent of the relengapi proxy.

TOOLTOOL_CACHE has a reasonable default (and why would you want to change
that, anyway?)

--HG--
extra : commitid : 9Gn9KVVehsc
extra : rebase_source : edb6e3ec5a14baeab8146d890595cafcacdb4d03
2015-10-02 11:37:28 -04:00
John Dai
43f3f27e22 Bug 1204800 - Add tooltool dependencies to phone builds. r=wcosta
--HG--
extra : rebase_source : ea7bfcf753e7ca371b248b56961dabffb4f0bdd3
2015-10-05 22:57:00 +02:00
Mike Hommey
f4de6bfe91 Bug 1210642 - s/APP_BUILDID/MOZ_APP_BUILDID/ to use the same variable name across products. r=gps 2015-10-06 11:15:05 +09:00
Wander Lairson Costa
04287f1203 Bug 1210467: Exit script if aws fails to list backup file. r=garndt
Make a dummy call to aws client to make sure credentials are ok.

--HG--
extra : commitid : 5Fdf9QXe5Oy
2015-10-02 11:30:08 -03:00
Wander Lairson Costa
5064006a8e Backed out changeset 19db5133d27c
--HG--
extra : commitid : AGddXss3Ds2
extra : rebase_source : 44fc02a5a87b108a76309e7eaa73c0b8fc26084b
2015-10-01 16:10:16 -03:00
Wander Lairson Costa
3204290bef Bug 1210467: Exit script if aws fails to list backup file. r=garndt
As the aws command line tool call is piped, its status is lost, but the
net result is an empty variable assigment. We take advantage of this to
detect errors in the aws tool.

--HG--
extra : commitid : 8eTLV5FXxdp
2015-10-01 15:29:46 -03:00
Jordan Lund
520f9b8623 Bug 1199720 - Setup builds for b2gdroid, taskcluster and mozharness bits, r=dustin 2015-09-30 13:57:52 -07:00
Alexandre Poirot
039093bc70 Bug 1207653 - Build simulator from mulet. r=garndt,jryans 2015-09-29 03:02:48 -07:00
Carsten "Tomcat" Book
774fe78402 Merge mozilla-central to b2g-inbound 2015-09-23 12:35:32 +02:00
Alexandre Lissy
056fdaf710 Bug 1206379 - Fix blobfree distribution collect for nexus-5-l. r=wcosta 2015-09-22 04:13:00 +02:00
Jordan Lund
9950603342 Bug 1206106 - Create a java tarball that works on CentOS 6, taskcluster task template, CLOSED TREE NPOTB r=testing
--HG--
extra : source : 520103c26e0c757ce307f18e4d0becfa2f76868f
extra : amend_source : c1d32ba99d53cde3a614af0bd3d96b084ef0f641
2015-09-22 11:34:15 -07:00
Wes Kocher
02fd124a0c Backed out changeset 520103c26e0c (bug 1206106) for apparently breaking b2g device builds CLOSED TREE
--HG--
rename : testing/taskcluster/scripts/misc/repackage-jdk-ubuntu.sh => testing/taskcluster/scripts/misc/repackage-jdk.sh
2015-09-22 11:56:01 -07:00
Jordan Lund
80b590d642 Bug 1206106 - Create a java tarball that works on CentOS 6, taskcluster task template, NPOTB r=testing
--HG--
rename : testing/taskcluster/scripts/misc/repackage-jdk.sh => testing/taskcluster/scripts/misc/repackage-jdk-ubuntu.sh
2015-09-22 11:34:15 -07:00
Edgar Chen
b087d54062 Bug 1188330 - Use intree mozharness for taskcluster tests. r=dustin,garndt,wcosta 2015-09-04 17:01:36 +08:00
Edgar Chen
f9e05b82db Bug 1205934 - Switch Taskcluster Dolphin builds to in-tree mozharness. r=wcosta 2015-09-18 10:44:51 +08:00
Dustin J. Mitchell
c9eaaa7832 Bug 1198179: in taskcluster, have 'make upload' just copy; r=ted.mielczarek
--HG--
extra : commitid : C1f3kiibCXn
extra : rebase_source : ed715e77014b91fb19c7a6bc7a0a04134f1e69cc
extra : amend_source : 46abf6b9bfc0f7993da9814d8f6e3959379c434f
2015-09-11 11:35:00 -04:00
Ted Mielczarek
ff534cda9b Tweak cctools build script (No bug, NPOTB)
--HG--
extra : commitid : EQOXbwEbNwn
extra : rebase_source : db5fe3e1b3bb26eee9add5e7398a755869524b12
extra : histedit_source : e475bb97007494745514f3264fd9edf67278d7fd
2015-09-09 11:36:28 -04:00
Ted Mielczarek
ec3d4b5464 bug 1202811 - Invoke mozharness with python 2.7 from build-linux.sh. r=dustin
--HG--
extra : commitid : u7xc9weelJ
extra : rebase_source : f30090d095c674cce9258ac16d5eb2536d62eaf6
2015-09-08 15:32:38 -04:00
Wander Lairson Costa
7d6eae6c28 Bug 1201179: Use custom branch gecko objdir for emulator and phone builds. r=garndt
Messing up with shared cached object directories for different branches
often triggers build bustage. Make the object directory unique for each
branch.
2015-09-10 11:40:21 -03:00
Carsten "Tomcat" Book
1f920abbdd Backed out 1 changesets (bug 1201179) for bustage on a CLOSED TREE
Backed out changeset aa3cbda42b11 (bug 1201179)
2015-09-10 14:25:24 +02:00
Wander Lairson Costa
a039da58a2 Bug 1203144: Add tooltool dependencies to emulator builds. r=garndt,dustin 2015-09-10 08:26:33 -03:00
Wander Lairson Costa
caaa7e5bf1 Bug 1201179: Use custom branch gecko objdir for emulator and phone builds. r=garndt
Messing up with shared cached object directories for different branches
often triggers build bustage. Make the object directory unique for each
branch.

--HG--
extra : rebase_source : cf9b2f774133b17731c0bd125eccd1dbe8295d4e
2015-09-09 11:28:06 -03:00
Ted Mielczarek
75abc602da bug 1201012 - Update minidump_stackwalk taskcluster build script to build stackwalk-http as the minidump_stackwalk for testing (NPOTB)
--HG--
extra : commitid : 7LmWeqI5K8A
extra : rebase_source : c2614dce72dd7582e824f6a87c4026ae7bec74ef
2015-09-02 12:19:23 -04:00
Carsten "Tomcat" Book
c781ec5bbc Backed out 1 changesets (bug 1204800) for b2g build bustages
Backed out changeset e244ce56e745 (bug 1204800)
2015-09-21 10:06:38 +02:00
John Dai
673f245950 Bug 1204800 - Add tooltool dependencies to phone builds. r=wcosta 2015-09-16 01:59:00 +02:00
Dustin J. Mitchell
5ea62063a6 Bug 1199379: drop root before beginning the build r=ted.mielczarek
This requires doing some cleanup of permissions on the cache mounts first;
eventually, this should be done by the docker-worker.

--HG--
extra : commitid : 6pnyoQeGrRX
extra : rebase_source : caa1dc4df3f0fc9ab26a55088749d85f5a52145a
2015-08-27 14:13:32 -04:00
Dustin J. Mitchell
ae5f44c67b Bug 1185643: use in-tree mozharness for builds; r=wander
This required moving the custom mozharness configs out of the builder image
(which puts them in ~, where mozharness no longer looks) and moving them into
mozharness itself.

--HG--
rename : testing/docker/desktop-build/configs/disable_signing.py => testing/mozharness/configs/disable_signing.py
rename : testing/docker/desktop-build/configs/platform_supports_post_upload_to_latest.py => testing/mozharness/configs/platform_supports_post_upload_to_latest.py
extra : commitid : 8FSj0uwFfbE
extra : rebase_source : 949bb94ca58324444981b81e9e9640ab00d63196
extra : amend_source : 40152e06e587728500800de02a437389038fe6ea
extra : source : e3c15b9f89b3c331805b4f1a83f62805f32bbb9a
2015-07-27 15:21:15 -04:00
Ted Mielczarek
c38d4e6e13 Fix minidump_stackwalk build script to produce working WinXP binaries. No bug, NPOTB.
--HG--
extra : rebase_source : 24448b3ca7cc7f3cecaefe0ca0663536c83cde19
2015-08-14 14:01:20 -04:00
Wander Lairson Costa
b1e44f1c8c Bug 1175934 part 2: Support blobfree images.
When we ./build.sh blobfree, we have a new zip file called
<target>.blobfree-dist.zip which contains a blobfree image. We copy this
file to public artifact.

We also refactor the build scripts a little bit to deduplicate the post
build code.

--HG--
extra : commitid : JU2n5YDGBfa
2015-07-31 17:24:46 -03:00
Wander Lairson Costa
994db0bfb1 Bug 1187706 part 3: Small optimization on repo cloning. r=garndt
checkout-gecko already clones gecko, tell mozharness to clone from it.

--HG--
extra : commitid : w0KlGHRSpF
extra : rebase_source : 2a80c203120085271a3bdfe4f7a1fa38d0eb1d30
2015-07-26 15:58:57 -03:00
Wander Lairson Costa
641d80edfc Bug 1187706 part 1: Switch B2G builds to in tree mozharness. r=garndt
Mozharness now lives inside gecko tree, so switch B2G builds to use it.

--HG--
extra : commitid : JZLuGcu0RRM
extra : rebase_source : 06dbe78a6ad86e77f52f2f19f7c1be9133ea4f9d
2015-07-26 15:58:57 -03:00
Mike Hommey
fe229c6366 Bug 1177951 - Use tooltool on b2g desktop and mulet taskcluster builds. r=wcosta,r=garndt 2015-07-26 06:46:44 +09:00
Carsten "Tomcat" Book
dd5a9ed71e Backed out changeset a9241b319f14 (bug 1177951) on request per garndt in #taskcluster
--HG--
extra : rebase_source : 307d50170829294e641b8a2193da4fcd3a46bb7d
2015-07-24 16:15:07 +02:00
Mike Hommey
cc94d65dda Bug 1177951 - Use tooltool on b2g desktop and mulet taskcluster builds. r=wcosta,r=garndt 2015-07-24 16:51:57 +09:00
Chris Manchester
e9f8c6b635 Bug 1179687 - Fix TC emulator builds to upload test packages and test_packages.json correctly. r=garndt
--HG--
extra : commitid : FjQZoLbcubJ
2015-07-18 18:19:11 -07:00
Ted Mielczarek
c5b6c24366 bug 1176229 - build script for building cctools with crosstool-ng. r=mshal
--HG--
extra : commitid : 2H64iWcGbHO
extra : rebase_source : 7949387fb669114a1381ef11c07ac52a5611942d
2015-06-19 09:45:42 -04:00