Commit Graph

7929 Commits

Author SHA1 Message Date
Tarek Ziadé
e5c6044cc3 Bug 1636179 - switch mpu to perftest-test r=sparky
This patch will use perftest-test on any code change in python/mozperftest

Differential Revision: https://phabricator.services.mozilla.com/D75080
2020-05-14 13:01:59 +00:00
Tarek Ziadé
c84c8756b8 Bug 1637231 - add applink tests r=acreskey
Adds tests for applink for gve/fenix on p2/g5

Differential Revision: https://phabricator.services.mozilla.com/D75097
2020-05-14 13:01:59 +00:00
Bartłomiej Piotrowski
f2b4908786 Bug 1637213 - generate static delta for flatpak r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D74831
2020-05-14 11:08:55 +00:00
Sylvestre Ledru
713c6207e3 no bug - Fix a rst mistake, causing the note to be displayed r=marco DONTBUILD
Depends on D75260

Differential Revision: https://phabricator.services.mozilla.com/D75261
2020-05-14 11:05:45 +00:00
Ricky Stewart
a81b5319d3 Bug 1636797 - Don't include .pyc, .pyd, or .pyo files in hash in taskgraph r=tomprince,glandium
These files are ALWAYS ignored and are never relevant when hashing the state of a working tree. It would be better overall to not consult the filesystem directly and go through the VCS to ensure we never try to hash any ignored files, but these files seem to be the main stumbling block and the primary cause of bugs like bug 1636797, so this is a fine stopgap in the meantime.

Differential Revision: https://phabricator.services.mozilla.com/D75126
2020-05-14 00:15:40 +00:00
Narcis Beleuzu
abc58ec081 Backed out changeset 4123014cf744 (bug 1633101) for Linting failure on runtests.py . CLOSED TREE 2020-05-14 02:14:18 +03:00
egao
e29bcc19ec Bug 1633101 - consolidate pulseaudio initialization process on linux and migrate to x64 fontconfig package r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-13 21:46:55 +00:00
Andrew Halberstadt
b44a553dac Bug 1637718 - [taskgraph] Make sure bugbug optimizers only run on autoland or try, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D75181
2020-05-13 19:55:07 +00:00
Csoregi Natalia
e8e832322d Backed out changeset efc42c73c3be (bug 1637383) for breaking decision task. CLOSED TREE 2020-05-13 17:02:53 +03:00
Andrew Halberstadt
54c18a94dd Bug 1637383 - [taskgraph.optimize] Simply run fuzzing builds every 10th push on autoland, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D74933
2020-05-13 12:26:15 +00:00
Sylvestre Ledru
e1332c6207 Bug 1636494 - Move the codespell, file-perm and file-whitespace linting jobs to tier-2 r=linter-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D74435
2020-05-13 09:32:40 +00:00
Andrew Halberstadt
0137dde722 Bug 1637343 - [taskgraph] Replace the SETA optimization with 'bugbug_reduced' on autoland, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D74932
2020-05-13 08:51:52 +00:00
Razvan Maries
e218f74304 Backed out 2 changesets (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE
Backed out changeset b85aebbd6fcc (bug 1633101)
Backed out changeset fd6537bc153f (bug 1633101)
2020-05-13 03:47:10 +03:00
Edwin Takahashi
a5cebeaa21 Bug 1608837 - perform task chunking in decision task for web-platform-tests r=ahal,jgraham
Changes:

Perform chunking of the web-platform-test in the decision task, using a runtime-weighted strategy.

Valid web-platform-tests will have its here attribute extracted to build a dictionary of test paths keyed by the top-level directory of the test path.

Once the dictionary is built, the keys are compared against test runtime data extracted from ActiveData in descending order. For all keys where test runtime information exists, chunk from the longest running key.

For remaining keys, equally distribute among all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D71417
2020-05-12 22:38:48 +00:00
egao
190591ef8f Bug 1633101 - update base ubuntu1804 docker image and install fontconfig:x64 instead of fontconfig:i386 r=whimboo,jmaher
Changes:

Discontinues the installation of `fontconfig:i386` package in favor of the x64 variant.

Also, use a newer base image for ubuntu1804.

Depends on D74809.

Differential Revision: https://phabricator.services.mozilla.com/D74810
2020-05-12 17:39:16 +00:00
Edwin Takahashi
eea3ca3ae8 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 20:59:43 +00:00
Tarek Ziadé
080870795e Bug 1635136 - add a --push-to-try option r=aerickson
This patch is adding an option to push a perftest run in the CI.

It's based on :
- sparse profiles
- push_to_try
- options passed through try_task_config.json

Differential Revision: https://phabricator.services.mozilla.com/D74115
2020-05-12 21:19:48 +00:00
Razvan Maries
7bb5a72350 Backed out changeset ce270ccc8290 (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE 2020-05-12 23:55:42 +03:00
Edwin Takahashi
fe77d08974 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 12:20:45 +00:00
Razvan Maries
a9b2e6dd6f Backed out changeset 58cbc2929fb3 (bug 1616692) for reftests perma failures. CLOSED TREE 2020-05-12 21:05:56 +03:00
Razvan Maries
6740f8e47d Backed out 2 changesets (bug 1616692, bug 1635933) for reftests perma failures. CLOSED TREE
Backed out changeset 7340fb8c2297 (bug 1616692)
Backed out changeset 5695aa933c38 (bug 1635933)
2020-05-12 20:59:06 +03:00
David Major
ab03279627 Bug 1616692: followup, fix sccache task bustage. CLOSED TREE 2020-05-12 11:57:35 -04:00
Calixte Denizet
d26662bb72 Bug 1623299 - Update grcov to 0.5.14 r=marco
Update grcov and replace use of '--ignore-dir' by '--ignore'

Differential Revision: https://phabricator.services.mozilla.com/D74819
2020-05-12 09:19:49 +00:00
David Major
50334d3714 Bug 1616692 - Update to clang 10.0.0 r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D74768
2020-05-12 14:02:30 +00:00
Mihai Tabara
7d9078bede Bug 1636929 - fix rendering in Firefox Flathub homepage. r=rail
Differential Revision: https://phabricator.services.mozilla.com/D74711
2020-05-12 00:42:34 +00:00
Simon Fraser
e121833b24 Bug 1636697 Stop ASAN partial generation r=catlee
Due to the resource usage (over 8Gb memory per libxul), cost and low impact, stop generating partials for asan builds

Differential Revision: https://phabricator.services.mozilla.com/D74710
2020-05-11 17:20:40 +00:00
Mitchell Hentges
b8108d6064 Bug 1632429: Migrate |./mach try| to python 3; r=rstewart,ahal
|./mach try| subcommands are now compatible with both python 2 and 3.

Hand-tested with many combinations of subcommand and subcommand flags.

Updates tryselect unit tests to use Python 3.

Differential Revision: https://phabricator.services.mozilla.com/D73398
2020-05-06 22:17:14 +00:00
Wander Lairson Costa
8e66e30a42 Bug 1637000: Increase the maximum runtime for xpcshell in android emulator r=gbrown
Since we now run those tests in baremetal (which runs more parallel jobs
than packet.net), the variance of the time it takes to execute xpcshell
tests increased.

Differential Revision: https://phabricator.services.mozilla.com/D74703
2020-05-11 16:58:44 +00:00
Andrew Halberstadt
287e69131c Bug 1633866 - [taskgraph] Take 'ancestor-manifest' into account when computing skipped manifests, r=egao
In the 'chunk_by_runtime' algorithm a 'get_manifest' helper function is used to
determine what "manifest" a test belongs to. The logic is basically, if
'ancestor-manifest' exists then use that. Otherwise use 'manifest_relpath'.

We need to do this because in some cases a "shared" manifest can be included
multiple times from parent manifests, each with a different configuration.

However, when we calculate the "skipped" manifests in chunking.py, we were
simply using 'manifest_relpath' and ignoring 'ancestor-manifest'. I believe
this meant we were mis-reporting which manifests were skipped in the task logs.
It possibly even meant we were double-scheduling some tests (i.e, if the
'skip-if' was in the ancestor, not the shared one). I'm not sure if the double
scheduling was actually happening in practice, but it's certainly theoretically
possible.

Afaict, this only affected a handful of xpcshell manifests on Windows and
Android.

Depends on D74449

Differential Revision: https://phabricator.services.mozilla.com/D74451
2020-05-11 16:34:34 +00:00
Andrew Halberstadt
07b4a29672 Bug 1633866 - [manifestparser] Modify 'chunk_by_runtime.get_chunked_manifests' to accept a list of manifests, r=egao
This is instead of tests and will make it easier to re-use in the taskgraph.
This commit is a straight refactor and results in zero differences in the
taskgraph.

Depends on D74448

Differential Revision: https://phabricator.services.mozilla.com/D74449
2020-05-08 21:25:18 +00:00
Andrew Halberstadt
2132398f79 Bug 1633866 - [taskgraph] Pull logic to determine test manifests into its own transform, r=egao
Small improvement with respect to the single responsibility principle. The
taskgraph diff is identical.

Differential Revision: https://phabricator.services.mozilla.com/D74448
2020-05-08 21:14:57 +00:00
Gregory Mierzwinski
2f4810de2e Bug 1636504 - Re-enable Fenix browsertime cron tasks. r=perftest-reviewers,AlexandruIonescu
This patch re-enables the Fenix browsertime tasks in mozilla-central that run through a cron job.

Differential Revision: https://phabricator.services.mozilla.com/D74421
2020-05-11 12:55:09 +00:00
Marian Raiciof
bdc71cf0b1 Bug 1626917 - Run talos and js-bench tests only on shippable builds r=perftest-reviewers,igoldan,ahal,sparky
Differential Revision: https://phabricator.services.mozilla.com/D69892
2020-05-07 21:10:49 +00:00
Tarek Ziadé
1c3d120187 Bug 1636684 - deactivate complex condprofs r=sparky
deactivate complex condprofs

Differential Revision: https://phabricator.services.mozilla.com/D74532
2020-05-09 15:15:45 +00:00
Chris AtLee
d08430e9aa Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-08 18:03:50 +00:00
Julian Descottes
dfdca5ac67 Bug 1619681 - Run DevTools node tests during phabricator code reviews r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D74326
2020-05-08 16:52:28 +00:00
Mitchell Hentges
2e71833471 Bug 1636209: resolves tests that were incorrectly marked as xfail r=tomprince
When handling bug 1632429, I found some tests that worked on Python 2, but not Python 3.
They were marked accordingly as "expected failures". However, my system version of Python
is 3.8, while CI (and a non-trivial number of devs, probably) use 3.6.

Some of these tests marked as xfail were actually still working on versions of Python until 3.8.

The failure of this test was due to a change in default tarfile format. Explicitly setting this
format makes the tests pass in all relevant python versions.

Differential Revision: https://phabricator.services.mozilla.com/D74337
2020-05-07 23:41:35 +00:00
Joel Maher
5e6f06d6f5 Bug 1636120 - don't run timeouts on autoland. r=jgraham
don't run expected TIMEOUT web-platform-tests on autoland.

Differential Revision: https://phabricator.services.mozilla.com/D74283
2020-05-08 13:12:16 +00:00
Sylvestre Ledru
5cea4f4d3c Bug 1635826 - Fix mozlint codespell. r=fix CLOSED TREE 2020-05-08 14:39:10 +03:00
Sylvestre Ledru
4d135ea624 Bug 1635826 - Document all platforms, who" owns" it and why we run it r=marco
Differential Revision: https://phabricator.services.mozilla.com/D74116
2020-05-08 11:20:43 +00:00
Mihai Alexandru Michis
e9131060a0 Merge autoland to mozilla-central. a=merge 2020-05-08 12:34:44 +03:00
Andreea Pavel
dbd1462996 Backed out changeset b76e3e988fdd (bug 1577110) for breaking geckodriver signin toolchains a=backout 2020-05-08 06:51:23 +03:00
Wander Lairson Costa
ea1c1973c0 Bug 1635877: move all android-em tests to AWS baremetal r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D74166
2020-05-08 01:56:55 +00:00
Marco Castelluccio
89ec5820c9 Bug 1608421 - Only run the bugzilla-components task on mozilla-central. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D74329
2020-05-07 22:38:13 +00:00
Chris AtLee
d746c3123f Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-07 20:52:48 +00:00
Marco Castelluccio
8c86cc7f1a Bug 1635940 - Add an optional fallback for the bugbug optimizer and define a new strategy using it. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D74257
2020-05-07 19:36:22 +00:00
Mitchell Hentges
95310794d0 Bug 1632429: Improve py3-compatiblity of taskgraph; r=tomprince,ahal
As |./mach| commands are migrated to python3, "taskgraph" needs to be compatible while still working with python2.

This patch migrates several iter*() calls and python2-specific imports to work with "six" instead.

Note that there's still python2-specific parts of taskgraph, I'm just modifying the pieces that are affecting
the code paths that I'm currently migrating (in this case, |./mach try|

Differential Revision: https://phabricator.services.mozilla.com/D73397
2020-05-07 04:47:17 +00:00
Gregory Mierzwinski
631c2f879c Bug 1627026 - Use Fenix nightly build variant in perftests. r=perftest-reviewers,davehunt
This patch changes the build variant we use for performance testing in raptor and browsertime from performance-test to the fennec-nightly build which is more representative of what a user might experience.

Depends on D68190

Differential Revision: https://phabricator.services.mozilla.com/D72886
2020-05-07 15:03:26 +00:00
Gregory Mierzwinski
f0f846338c Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe
This patch does a few things:
(1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push.
(2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task).
(3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push.
(4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant.
(5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant.

Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
Tom Prince
dc655024c6 Bug 1635732: Use a worker alias for t-linux-metal workers; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D74188
2020-05-07 14:06:15 +00:00