Commit Graph

7841 Commits

Author SHA1 Message Date
Mike Hommey
43a2e97c21 Bug 1634605 - Stop retrying on apt-get errors. r=tomprince
We starting doing that because snapshot.debian.org would ban some AWS IP
ranges, and we would get random failures, but that's not the case
anymore. OTOH, when more "normal" errors happen, like when you change a
Dockerfile to add a package, and that package actually doesn't exist,
the image build is tried 5 times, with no chance it will succeed, and
treeherder doesn't link to the log because it's purple, so you need to
manually go to taskcluster.

Removing the autoretry will make things smoother.

Differential Revision: https://phabricator.services.mozilla.com/D73392
2020-05-02 06:18:13 +00:00
Nicholas Nethercote
d1320d8780 Bug 1632928 - Update fix-stacks. r=erahm
This pulls in:
- https://github.com/mozilla/fix-stacks/pull/24, which removes some junk from
  Breakpad file names;
- https://github.com/mozilla/fix-stacks/pull/25, which avoids having two
  different versions of the goblin crate.

Differential Revision: https://phabricator.services.mozilla.com/D73407
2020-05-01 19:22:47 +00:00
Edwin Takahashi
f2f63e6f32 Bug 1627085 - apply mach try task blacklist filter to mach try auto r=jmaher,marco
Changes:

Apply the `filter_tasks_by_blacklist` filter on `mach try auto` pushes.

Differential Revision: https://phabricator.services.mozilla.com/D73376
2020-05-01 10:26:48 +00:00
Joel Maher
3099238bf8 Bug 1634230 - prevent backlog tests from running in variants, increase debug timeout. r=gbrown
prevent backlog tests from running in variants, increase debug timeout.

Differential Revision: https://phabricator.services.mozilla.com/D73226
2020-04-30 13:09:06 +00:00
Edwin Takahashi
e1fc47fa66 Bug 1631990 - additional filters on mach try selectors r=jmaher
Changes:

Add several build types to the blacklist, so that for `try fuzzy/try chooser` users, these will not show unless `--full` is applied. For `try syntax` users, these will become non-schedulable.

Differential Revision: https://phabricator.services.mozilla.com/D72068
2020-04-30 22:55:50 +00:00
Joel Maher
64226c82d8 Bug 1608388 - reduce frequency of mingw* builds. r=bc
reduce frequency of mingw* builds.

Differential Revision: https://phabricator.services.mozilla.com/D73316
2020-04-30 19:58:54 +00:00
Andrew Halberstadt
984515c753 Bug 1633866 - [taskgraph.optimize] Move logic to query 'bugbug' service to a utility file, r=marco
With dynamic-test-selection, we'll also need to query the bugbug service from
the transforms. Let's move the querying logic to a utility file to share it
more easily.

Differential Revision: https://phabricator.services.mozilla.com/D73088
2020-04-30 13:53:01 +00:00
Andrew Halberstadt
49a25c7035 Bug 1633866 - [taskgraph] Move logic to set test-verify chunks to a new transform, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D73143
2020-04-30 14:03:10 +00:00
Jamie Nicol
1af6f33ce1 Bug 1634275 - Update glslopt to 0.1.2 to remove dependency on bindgen. r=jrmuizel,kats
Differential Revision: https://phabricator.services.mozilla.com/D73198
2020-04-30 12:25:17 +00:00
Mike Hommey
0d618c2eb1 Bug 1633907 - Upgrade sccache to current master. r=rstewart
There were a fair number of changes, but the main ones are the switch to
a faster hash (blake3), and to tokio 0.2's faster scheduler.

Differential Revision: https://phabricator.services.mozilla.com/D72960
2020-04-29 21:18:49 +00:00
Edwin Takahashi
098fa2f275 Bug 1633536 - remove suite attribute from web-platform.yml r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D72739
2020-04-29 10:05:04 +00:00
Andrew Halberstadt
826ab27049 Bug 1633866 - [taskgraph] Call tasks 'tasks' rather than 'tests' in tests.py transforms, r=jmaher
We use the term 'tests' to refer to 'tasks' in the tests.py transforms.  Imo,
this makes things very hard to follow as the term 'test' is also used for all
kinds of other contexts in that file. Let's just call them what they are:
tasks.

I decided to land this as part of this series as I will be adding further uses
of the word 'test' later on.

Differential Revision: https://phabricator.services.mozilla.com/D73063
2020-04-29 16:03:06 +00:00
Bob Clary
38ad6a8124 Bug 1621754 - run mochitest-remote shippable but not opt on autoland, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D73038
2020-04-29 15:13:32 +00:00
Joel Maher
3aeadff8f0 Bug 1631882 - mark worker module tests to run as backlog (tier-2). r=ckerschb
mark worker module tests to run as backlog (tier-2)

Differential Revision: https://phabricator.services.mozilla.com/D72834
2020-04-29 12:10:01 +00:00
Narcis Beleuzu
c8025dc6a4 Backed out 2 changesets (bug 1633907) for Fetch bustage. CLOSED TREE
Backed out changeset 83035fee55ac (bug 1633907)
Backed out changeset f35a66e23f3b (bug 1633907)
2020-04-29 04:10:15 +03:00
Mike Hommey
90d2298d89 Bug 1633907 - Switch sccache back to the mozilla repo.
The repo switch was an oversight from when testing, it wasn't meant to
land this way.

Differential Revision: https://phabricator.services.mozilla.com/D72986
2020-04-29 00:33:14 +00:00
Mike Hommey
9f7c85f8c8 Bug 1633907 - Upgrade sccache to current master. r=rstewart
There were a fair number of changes, but the main ones are the switch to
a faster hash (blake3), and to tokio 0.2's faster scheduler.

Differential Revision: https://phabricator.services.mozilla.com/D72960
2020-04-29 00:18:16 +00:00
Aaron Klotz
78c73bc94f Bug 1622060: Add test transform for gv e10s-multi; r=gbrown
This adds a multi-e10s variant for geckoview-junit tests. With bug 1622944
resolved, the test suite passes, so we allow this variant to be tier-1.

Differential Revision: https://phabricator.services.mozilla.com/D66676
2020-04-28 15:06:42 +00:00
Marian Raiciof
37cad3c37a Bug 1609373 - Update raptor branch for upstream changes on 2020 branch r=perftest-reviewers,whimboo,sparky,Bebe,AlexandruIonescu
- changed test URL to match the dev server
- changed output.py in several places to fix new test names, dict keys, to cover all tests
- added amazonaws.com to manifest.json file to fix the loading issue for benchmark.js file
- added all raptor tests
- changed the constants for measure and alert_on

Differential Revision: https://phabricator.services.mozilla.com/D62546
2020-04-28 19:49:41 +00:00
Andrew Halberstadt
3891724437 Bug 1629642 - [ci] Add a shadow-scheduler for the 'bugbug.disperse' scheduling algorithm, r=marco
Depends on D72465

Differential Revision: https://phabricator.services.mozilla.com/D72466
2020-04-25 10:51:07 +00:00
Andrew Halberstadt
45c245a6e3 Bug 1629642 - [taskgraph] Implement a 'disperse' platform optimization strategy r=marco
Differential Revision: https://phabricator.services.mozilla.com/D72465
2020-04-28 15:05:31 +00:00
Andrew Halberstadt
85fdc991a0 Bug 1629642 - [taskgraph] Split 'test' optimization strategy arg into two r=marco
The default way to split the 'arg' parameter for CompositeStrategies, is to
duplicate it across all substrategies. By setting 'split_arg=tuple', we instead
break the arg up so the first index goes to the first substrategy, the second
index goes to the second substrategy, etc.

This means that the length of the 'test' arg must be at least as long as the
number of substrategies.

Differential Revision: https://phabricator.services.mozilla.com/D72464
2020-04-28 14:53:20 +00:00
Bob Clary
a3fa043bbb Bug 1626962 - Adjust Optimization to run raptor-gve.yml tests every 25 pushes, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D72855
2020-04-28 14:27:30 +00:00
Gregory Mierzwinski
d84ec8ca2c Bug 1633513 - Prevent browsertime tests from running on opt android builds. r=perftest-reviewers,AlexandruIonescu
This patch prevents speedometer tests from running on all android builds and also prevents chrome tests from running there.

Differential Revision: https://phabricator.services.mozilla.com/D72727
2020-04-28 12:47:55 +00:00
Gregory Mierzwinski
c909a79d87 Bug 1632616 - Download and install google chrome through tooltool. r=aerickson,perftest-reviewers,Bebe
This patch changes how Google Chrome for Android is deployed. Rather than relying on automatic updates, we will use tooltool to download the APK and install it ourselves. Some changes were done in taskcluster to remove a hack that was put in place to disable interal tooltool downloads (the issue is resolved now).

A tooltool manifest is added for this, and to keep ourselves organized, all manifests (including the playback ones) are moved into a folder called `tooltool-manifests`.

Differential Revision: https://phabricator.services.mozilla.com/D72198
2020-04-28 09:23:21 +00:00
Bob Clary
97fb2dd803 Bug 1633296 - mochitest-{plain,chrome}-gpu support --test-suite not --mochitest-suite, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D72574
2020-04-27 18:48:26 +00:00
Nick Thomas
945ba650bb Bug 1630154 - Add dummy certificate to Windows full installers, r=catlee
Differential Revision: https://phabricator.services.mozilla.com/D71245
2020-04-17 15:48:49 +00:00
Bob Clary
6cbaa3e5a6 Bug 1619233 - run js-bench tests every 10th push, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D72638
2020-04-27 18:02:41 +00:00
Andrew Halberstadt
fb956306b3 Bug 1629642 - [ci] Fix wrong strategy name in bugbug_combined_high shadow-scheduler, DONTBUILD, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D72702
2020-04-27 17:14:42 +00:00
Joel Maher
18ac0dd2f1 Bug 1632822 - create webrender list of crashtests to have focused tests on android phones. r=bc
create webrender list of crashtests to have focused tests on android phones

Differential Revision: https://phabricator.services.mozilla.com/D72570
2020-04-27 18:06:47 +00:00
Ken VanDine
61d5f61899 Bug 1623627 - Updated to use the gnome-3-34 snapcraft extension r=rail
Differential Revision: https://phabricator.services.mozilla.com/D68252
2020-04-27 15:52:01 +00:00
Mihai Alexandru Michis
9517d84009 Backed out changeset e5a553590394 (bug 1623627) for causing snap failures.
CLOSED TREE
2020-04-27 18:14:29 +03:00
Ken VanDine
bd366c3ae6 Bug 1623627 - Updated to use the gnome-3-34 snapcraft extension r=rail
Differential Revision: https://phabricator.services.mozilla.com/D68252
2020-04-27 14:32:15 +00:00
Mike Hommey
9c03a7015d Bug 1632348 - Convert mach artifact to python 3. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D72114
2020-04-26 21:53:57 +00:00
Mike Hommey
340788143e Bug 1632693 - Upgrade wine to 5.0. r=rstewart
It requires a newer version of bison to build, which we get by using a
more recent version of Debian for the toolchain build (Debian 9 being
the version we use for the builds that depend on wine, so it will work
there).

Differential Revision: https://phabricator.services.mozilla.com/D72254
2020-04-25 21:02:23 +00:00
Bob Clary
ecd63e101e Bug 1621764 - Apply push-interval strategies for linux, windows plain and aarch64 builds, r=jmaher.
This patch uses the new push-interval-10 to schedule the linux, windows plain and aarch64
builds on autoland every 10th push.

Tested locally with a local checkout whose pushlog_id was not divisible
by 10 using parameters.yml downloaded from the Gecko Decision Task using

./mach taskgraph optimized --verbose --parameters /tmp/parameters.yml

parameters.yml from autoland showed the following optimizations.

 0:56.13 PushIntervalStrategy: Removing task build-linux64-aarch64/opt interval 10
 0:56.13 PushIntervalStrategy: Removing task build-linux64-plain/debug interval 10
 0:56.13 PushIntervalStrategy: Removing task build-signing-win64-aarch64/opt interval 10
 0:56.13 PushIntervalStrategy: Removing task build-win64-aarch64/debug interval 10
 0:56.13 PushIntervalStrategy: Removing task build-win64-plain/debug interval 10
 0:56.18 PushIntervalStrategy: Removing task valgrind-linux64-valgrind/opt interval 10

while parameters.yml from mozilla-central did not show any PushIntervalStrategy
optimizations.

Differential Revision: https://phabricator.services.mozilla.com/D70182
2020-04-24 19:08:40 +00:00
Joel Maher
f8875234b3 Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 18:54:51 +00:00
Axel Hecht
ae0ed9bfbd Bug 1629893, add graphviz to lint image to fix docs, r=sylvestre
The `sphinx.ext.graphviz` extension requires `dot` to be installed.
That's default on rtd, which is why we use it in the docs.
Adding this to the lint image as we use that for document building,
and it shouldn't hurt.

Differential Revision: https://phabricator.services.mozilla.com/D72395
2020-04-24 16:25:59 +00:00
Geoff Brown
4bd7a919c3 Bug 1631085 - Increase windows ccov jittest chunks to avoid intermittent task timeouts; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D72403
2020-04-24 16:12:34 +00:00
Geoff Brown
5ad94f631b Bug 1612345 - Restrict custom retrigger to docker-worker tasks; r=bc
The custom retrigger actions work well on linux and android-em, but fail
on windows, osx, and android-hw. At least part of the problem seems to be
the worker implementation, but I am not entirely clear on what goes wrong.
It looks like I won't have much more time for retrigger improvements in the
near future, so I'd prefer to "turn off" the actions on tasks known to fail.
I found helpful examples for the 'context' parameter in
https://searchfox.org/mozilla-central/source/taskcluster/docs/actions.rst

Differential Revision: https://phabricator.services.mozilla.com/D72233
2020-04-24 10:09:54 +00:00
Bogdan Tara
a5112d03db Backed out changeset 97280448a042 (bug 1621095) for test_ext_test.html failures CLOSED TREE 2020-04-24 17:09:37 +03:00
Bob Clary
145ac575a5 Bug 1621764 - Define push-interval-{10,25} Backstop optimization strategies, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D72020
2020-04-24 12:58:06 +00:00
Andrew Halberstadt
542d9d9bb9 Bug 1629642 - [taskgraph] Add an option to sum confidence thresholds of manifests in bugbug scheduler, r=marco
This adds a parameter that will cause a task to sum all the confidence
thresholds of the relative manifests it contains to gather a larger overall
task confidence.

This also adds a new strategy + shadow-scheduler to go along with it.

Differential Revision: https://phabricator.services.mozilla.com/D71314
2020-04-24 10:20:06 +00:00
Joel Maher
b9a6e9d31c Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 12:35:12 +00:00
Simon Fraser
75aa0c6d1b Bug 1632531 Remove spurious override of make_incremental_update.sh r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D72358
2020-04-24 11:37:56 +00:00
Mihai Tabara
505379c036 Bug 1628407 - Backed out changeset 91d0340d9856. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D72306
2020-04-24 09:02:41 +00:00
Julien Cristau
b1c3df025a Bug 1623032 - upload flatpak in the "ship" phase, and push RCs to flathub beta. r=mtabara
Doing this in the ship phase instead of push lets us avoid shipping on
flathub before the actual release.

And, upload flatpaks for firefox release candidates to flathub's "beta"
channel so we can get feedback on them and QA can also get at them.

Differential Revision: https://phabricator.services.mozilla.com/D71919
2020-04-24 08:33:44 +00:00
Gregory Mierzwinski
5b8e43c99f Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe
This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday.

Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
Simon Fraser
815925ab00 Bug 1632531 - Ensure unique working directory for parallel use. r=mtabara
Bug 1632531 Refactor funsize/partials to remove unused code, add safer checks

Differential Revision: https://phabricator.services.mozilla.com/D72162
2020-04-23 21:37:44 +00:00
Mihai Tabara
3b6afcca6f Bug 1632584 - publish snaps as part of RC week. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72190
2020-04-23 18:34:21 +00:00