gecko-dev/taskcluster/taskgraph
Mike Hommey 951d78513a Bug 1486071 - Retry docker-image and packages tasks that fail during apt-get. r=dustin
When apt-get fails, it has a distinctive error code (100). Most of the
time, when apt-get fails, it's because of some network error, or
possibly some problem unpacking archives. When that happens, retrying
the task usually "fixes" the issue.

One of the (currently) most common causes of problems is
snapshot.debian.org not being available to some of the EC2 instances.

It would be possible to only set things up so that we only retry when we
detect such setup (checking the public IP of the instance is not in the
known list of problematic IPs), but that would require possibly wrapping
apt-get, or something along those line, which is not entirely trivial to
do for the packages tasks, because they don't rely on docker images.

However, since there aren't many apt-get failures other than these,
and since there have been, historically, some intermittent apt-get
failures of a different nature that were solved by re-running the tasks,
it seems fair to just retry wheneven apt-get fails.

One downside of the approach is that if for some reason a change to a
Dockerfile ends up mentioning a package that doesn't exist, that too
will result in multiple retries ; which might be inconvenient, but
that's not something that's going to happen often.

Differential Revision: https://phabricator.services.mozilla.com/D11420

--HG--
extra : moz-landing-system : lando
2018-11-13 22:17:14 +00:00
..
actions Bug 1500119 - Allow for retrigger adjustment when backfilling perf jobs and remove old geckoProfile support. r=ahal 2018-11-05 21:17:03 +00:00
cron Bug 1500897 - geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH r=dustin,tomprince 2018-10-29 11:11:46 +00:00
loader Bug 1501776: [taskgraph] Fix flake8 error; rs=bustage-fix 2018-10-25 01:32:07 +00:00
templates Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal 2018-10-30 15:15:32 +00:00
test Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal 2018-10-30 15:15:32 +00:00
transforms Bug 1486071 - Retry docker-image and packages tasks that fail during apt-get. r=dustin 2018-11-13 22:17:14 +00:00
util Bug 1486071 - Retry docker-image and packages tasks that fail during apt-get. r=dustin 2018-11-13 22:17:14 +00:00
__init__.py Bug 1491907 - Get comm/ version from comm/mail/*version.txt r=dustin 2018-09-29 20:53:10 +00:00
config.py Bug 1494415: [taskgraph] Remove ignored default from graph config; r=dustin 2018-10-02 21:17:07 +00:00
create.py
decision.py Bug 1500897 - Follow-up: Get hg_branch from GECKO repo. r=jorgk 2018-10-30 00:15:23 +00:00
docker.py Bug 1460475 - Use stream_reader API; r=dustin 2018-05-11 10:10:41 -07:00
files_changed.py Bug 1490119 - Bump timeout for automationrelevance. r=tomprince 2018-09-19 20:01:27 +00:00
filter_tasks.py No bug: [taskgraph] Remove check_servo filter; r=dustin 2018-10-25 18:32:09 +00:00
generator.py No bug: [taskgraph] Log which kind had an error; r=dustin 2018-10-25 21:02:05 +00:00
graph.py
morph.py Bug 1502749: [taskgraph] Use the correct index rank for index-tasks morphs; r=bstack 2018-10-28 21:54:12 +00:00
optimize.py Bug 1477706: [test-verify] Only look at locally changed files on try and in try-select; r=ahal 2018-08-03 10:26:17 -06:00
parameters.py Bug 1500897 - geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH r=dustin,tomprince 2018-10-29 11:11:46 +00:00
target_tasks.py No bug: [try-staging] Filter out appropriate tasks for staging release on non-beta branches; r=nthomas 2018-11-09 19:42:38 +00:00
task.py Bug 1481121: [release] Add support for tasks declaring the release-relevant artifacts, for downstream tasks to inspect; r=Callek 2018-08-20 12:29:15 -06:00
taskgraph.py Bug 1398277: special-case retriggering of tasks not in the taskgraph; r=bstack 2018-07-04 02:46:59 +00:00
try_option_syntax.py Bug 1486554 - Enable static analysis on normal Windows CI builds r=ted 2018-10-17 22:45:06 +00:00