Commit Graph

748 Commits

Author SHA1 Message Date
Mike Hommey
670494e7d5 Bug 1623010 - Separate out the diffing of generated-files. r=dmajor
The diff jobs currently take a Firefox package and compares against the
one from another build. When that fails, it also makes the diff of the
generated files, which can be useful when there are differences, but
can also be useful on its own. Also, because sometimes, like right now,
there are differences in generated files that have no impact on Firefox
itself, when differences do show up for Firefox, the differences in
generated files are added noise that sheriffs can't work around.

Differential Revision: https://phabricator.services.mozilla.com/D67113

--HG--
extra : moz-landing-system : lando
2020-03-17 22:03:01 +00:00
Edwin Takahashi
9a9768f77e Bug 1607713 - set GDM3 custom.conf to force use of X11 on linux1804 r=jmaher
Changes:

Add a new configuration file for GDM that forces the use of X11 instead of Wayland.

This may help with reducing the number of crashes due to window managers.

Differential Revision: https://phabricator.services.mozilla.com/D67006

--HG--
extra : moz-landing-system : lando
2020-03-16 20:27:46 +00:00
Ken VanDine
7b5a22d7e2 Bug 1622282 - Find files provided by the base and platform snap and ensure they aren't duplicated in this snap r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D66778

--HG--
extra : moz-landing-system : lando
2020-03-13 16:28:08 +00:00
Max
28f97ef5eb Bug 1621066 - Compress flatpak tars with xz instead of gzip. r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D66696

--HG--
extra : moz-landing-system : lando
2020-03-13 18:39:55 +00:00
Bartłomiej Piotrowski
ef7b8c2b72 Bug 1621074 - flatpak symlinks l10n fix and other improvements. r=jcristau
Bug 1621074 - install Flatpak policy properly..

Bug 1621074 - use dictionaries provided-by-runtime

Bug 1621074 - disable defaultbrowsercheck as being useless on flatpaks

Differential Revision: https://phabricator.services.mozilla.com/D66761

--HG--
extra : moz-landing-system : lando
2020-03-13 16:12:10 +00:00
Edwin Takahashi
c7e8b475ec Bug 1621483 - set up separate enviornment for linux1804 marionette and web-platform-tests-wdspec r=jmaher,marionette-reviewers,whimboo
Changes:

As documented in bug 1621483, `marionette` experiences a non-trivial amount of issues when run on ubuntu1804 docker image with GTK/GNOME desktop environment enabled.

GTK/GNOME has a higher degree of asynciness when manipulating window size/position and this leads to `marionette` and the derived suite `web-platform-tests-wdspec` reporting intermittent oranges for a number of tests.

While attempts were made to incorporate a fix for the marionette driver itself, the best attempts have only been able to achieve a ~50% reliability in green runs.

This patch reintroduces the use of bare `compiz` window manager exclusively for these two problematic test suites so that at least the tests are running on non-legacy software.

Differential Revision: https://phabricator.services.mozilla.com/D66482

--HG--
extra : moz-landing-system : lando
2020-03-12 21:43:56 +00:00
Bartłomiej Piotrowski
557ef7c61c Bug 1621074 - fix Flatpak l10n properly. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D66625

--HG--
extra : moz-landing-system : lando
2020-03-12 18:09:38 +00:00
Simon Fraser
dfdd97e607 Bug 1621658 Update |mach try fuzzy| fzf version check r=ahal
Add filename support for plain display

Update fzf version in tests

Update tooltool url for fzf

Differential Revision: https://phabricator.services.mozilla.com/D66571

--HG--
extra : moz-landing-system : lando
2020-03-12 12:56:35 +00:00
Mike Hommey
244fd3bd68 Bug 1620936 - Avoid creating a virtualenv when running unpack for diffoscope. r=froydnj
Creating the virtualenv prints an error message in the diffoscope docker
image because it doesn't have a compiler or the python development
headers, and that triggers an error setting up psutil after bug 1620513,
which in turn leads to a noisy and unrelated error message appearing in
the diffoscope jobs when they fail.

We don't need psutil set up really in those jobs, let alone a full
fledged virtualenv, so we can avoid the psutil error message by
disabling the virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D66361

--HG--
extra : moz-landing-system : lando
2020-03-11 12:05:46 +00:00
Edwin Takahashi
79a1af5af5 Bug 1598055 - remove valgrind from ubuntu1804 dockerfile and prevent scheduling of mochitest-valgrind r=jmaher
Changes:

Remove the unnecessary setup phase of `valgrind` on the docker image, given that we are not scheduling `mochitest-valgrind` [anywhere](https://searchfox.org/mozilla-central/source/taskcluster/ci/test/mochitest.yml#300) in the CI system.

Also, clean up `test-sets.yml` by renaming the `linux-common-tests` to `linux1604-legacy-tests` to better reflect that the set holds tests that haven't been migrated over to linux1804 yet.

Differential Revision: https://phabricator.services.mozilla.com/D65832

--HG--
extra : moz-landing-system : lando
2020-03-11 19:55:01 +00:00
Mihai Tabara
fcaa28d7c7 Bug 1621053 - set proper branch when building Flatpaks. r=rail DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D66276

--HG--
extra : moz-landing-system : lando
2020-03-10 20:29:52 +00:00
Mihai Tabara
ef4303686b Bug 1621083 - open more ports for Flatpak. r=rail DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D66277

--HG--
extra : moz-landing-system : lando
2020-03-10 19:27:28 +00:00
Mihai Tabara
5b93938c31 Bug 1621074 - fix l10n in Flatpaks. r=rail DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D66290

--HG--
extra : moz-landing-system : lando
2020-03-10 20:35:42 +00:00
Mihai Tabara
f6462fdfc3 Bug 1591387 - add flatpak release automation. r=rail
Adjust runme to be executable

Rm sdk/pltf install.Manually add meta

Enforce firefox run instead of notify

Add policy to disable updates

Temp hack to default to firefox instead of notify-send

Fix mach linters

Remove firefox command hack. Proper fix

Remove duplicate cmd in runme

Fix indentantion in kind

Fix more linters

Differential Revision: https://phabricator.services.mozilla.com/D59561

--HG--
extra : moz-landing-system : lando
2020-03-09 12:16:51 +00:00
Gijs Kruitbosch
03b081f658 Bug 1618188 - stop updating the mozilla-central copy of blocklist.xml, r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D64932

--HG--
extra : moz-landing-system : lando
2020-03-09 11:58:32 +00:00
Mark Banner
15cfe23b88 Bug 1620542 - Automatically fix ESLint errors in .eslintrc.js files. r=mossop
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D65703

--HG--
extra : moz-landing-system : lando
2020-03-07 10:09:44 +00:00
Edwin Takahashi
6e0e6a4c13 Bug 1598055 - further trim packages from ubuntu1804-test docker image r=jmaher
Changes:

Pin the source docker image to a specific tag from canonical.

Remove unneeded packages that are either installed as part of the setup, or come preinstalled.

Silence the `dbus` startup message by redirecting the output to `2&>1`.

Remove unnecessary `locale-gen` call at the end of setup.

Differential Revision: https://phabricator.services.mozilla.com/D65434

--HG--
extra : moz-landing-system : lando
2020-03-05 23:10:08 +00:00
Simon Fraser
ae80827888 Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-update/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-05 13:49:24 +00:00
Ciure Andrei
6fb6ae2327 Backed out changeset 7e16fe72804a (bug 1619944) for causing gecko decision bustage CLOSED TREE
--HG--
rename : taskcluster/ci/python-dependency-updates/kind.yml => taskcluster/ci/pipfile-update/kind.yml
rename : taskcluster/docker/python-dependency-update/Dockerfile => taskcluster/docker/pipfile-updates/Dockerfile
rename : taskcluster/docker/python-dependency-update/README.md => taskcluster/docker/pipfile-updates/README.md
rename : taskcluster/docker/python-dependency-update/runme.sh => taskcluster/docker/pipfile-updates/runme.sh
rename : taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh => taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh
rename : taskcluster/docker/python-dependency-update/setup.sh => taskcluster/docker/pipfile-updates/setup.sh
rename : taskcluster/taskgraph/transforms/python_update.py => taskcluster/taskgraph/transforms/pipfile_update.py
2020-03-05 13:05:34 +02:00
Simon Fraser
c8f4578a7f Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-updates/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-04 17:47:49 +00:00
Rob Lemley
27ef39e646 Bug 1615932 - Support building Thunderbird Snap packages with firefox-snap. r=jlorenzo
Changes to the firefox-snap Docker image to support building Thunderbird Snap
packages as well.
Replaced hardcoded "firefox" instances in runme.sh with $PRODUCT variable and
renamed "snapcraft.yaml.in" to "firefox.snapcraft.yaml.in".

Differential Revision: https://phabricator.services.mozilla.com/D63035

--HG--
rename : taskcluster/docker/firefox-snap/snapcraft.yaml.in => taskcluster/docker/firefox-snap/firefox.snapcraft.yaml.in
extra : moz-landing-system : lando
2020-03-03 14:48:49 +00:00
Kartikaya Gupta
d86f663351 Bug 1619284 - Remove obsolete dockerfile. r=kvark
Differential Revision: https://phabricator.services.mozilla.com/D64952

--HG--
extra : moz-landing-system : lando
2020-03-02 17:23:22 +00:00
ffxbld
4ed5d9375b No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D64926

--HG--
extra : moz-landing-system : lando
2020-03-02 14:12:29 +00:00
Simon Fraser
f1bedbea94 Bug 1617642 Remove pip version restriction & force Python 3.8 for funsize r=jlorenzo
backports.lzma couldn't cleanly be installed because we were now using Python3.8 but hadn't specified that in the Pipfile. Also took the opportunity to remove the pip version restriction which is no longer needed.

Differential Revision: https://phabricator.services.mozilla.com/D63892

--HG--
extra : moz-landing-system : lando
2020-02-25 16:03:16 +00:00
shindli
7f8e8c8d1a Backed out changeset 0e5de9eade9c (bug 1617642) for causing docker image build bustages CLOSED TREE 2020-02-25 12:11:57 +02:00
Simon Fraser
d8d05838b7 Bug 1617642 Remove pip version restriction & force Python 3.8 for funsize r=jlorenzo
backports.lzma couldn't cleanly be installed because we were now using Python3.8 but hadn't specified that in the Pipfile. Also took the opportunity to remove the pip version restriction which is no longer needed.

Differential Revision: https://phabricator.services.mozilla.com/D63892

--HG--
extra : moz-landing-system : lando
2020-02-25 09:43:28 +00:00
Johan Lorenzo
fe9163f160 Bug 1616048 - Fix firefox-snap docker image r=rail
Differential Revision: https://phabricator.services.mozilla.com/D63077

--HG--
extra : moz-landing-system : lando
2020-02-18 22:18:01 +00:00
Simon Fraser
dc0f16344a Bug 1616006 Update Python version in pipfile-update task, and fix deps. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D63059

--HG--
extra : moz-landing-system : lando
2020-02-18 14:14:58 +00:00
Dan Mosedale
86c563adcd Bug 1547823 - Upgrade NodeJS from 8.x to 10.19.0 r=froydnj
NodeJS 8.x is End-of-Lifed and is no longer receiving security fixes.  10.19.0 is now the oldest Long Term Support version of NodeJS, and it has just been released with several HTTP security fixes.

Differential Revision: https://phabricator.services.mozilla.com/D62781

--HG--
extra : moz-landing-system : lando
2020-02-14 15:28:40 +00:00
Simon Fraser
f4644623d2 Bug 1615371 Update partials/funsize-update-generator to Python 3.8 r=mtabara
Runs cleanly on a local docker image

Differential Revision: https://phabricator.services.mozilla.com/D62780

--HG--
extra : moz-landing-system : lando
2020-02-14 14:14:17 +00:00
Mike Hommey
a9be7e5ac6 Bug 1615150 - Drive-by fix error reporting in diffoscope tasks failure summary. r=dmajor
As opposed to what was intended, the directories weren't eliminated
correctly.

Differential Revision: https://phabricator.services.mozilla.com/D62700

--HG--
extra : moz-landing-system : lando
2020-02-13 22:11:03 +00:00
Mike Hommey
8eb5b272db Bug 1615150 - Fix the logic that skips generated-files diffing when there aren't generated-files to compare. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D62696

--HG--
extra : moz-landing-system : lando
2020-02-13 22:11:03 +00:00
Sylvestre Ledru
186dd63672 Bug 1578058 - Add clippy in the mozlint docker image r=ahal
Depends on D58250

Differential Revision: https://phabricator.services.mozilla.com/D58251

--HG--
extra : moz-landing-system : lando
2020-02-12 21:11:38 +00:00
Barret Rennie
9e2ba441a1 Bug 1613743 - Always use browsertime-results tarball from MOZ_FETCHES r=tarek,tomprince
Accepting an argument to specify a tarball of browsertime results was an
artifact of the previous split between the (now removed) visual-metrics and
visual-metrics-dep job kinds. Now that we are always providing the browsertime
results as a fetch task, can retrieve it directly from `MOZ_FETCHES` directory.

Differential Revision: https://phabricator.services.mozilla.com/D62364

--HG--
extra : moz-landing-system : lando
2020-02-11 20:04:05 +00:00
Barret Rennie
d181041431 Bug 1613743 - Merge application.json and jobs.json r=tarek,perftest-reviewers,sparky
Raptor was previously generating two artifacts for the `run-visual-metrics.py`
script to consume: `jobs.json` and `application.json`. These artifacts have
been merged.

Differential Revision: https://phabricator.services.mozilla.com/D62363

--HG--
extra : moz-landing-system : lando
2020-02-11 20:03:30 +00:00
Barret Rennie
f8b352500b Bug 1613743 - Do not use the same variable name for both a path and the contents of the file at that path r=tarek
This is strictly an improvement in code clarity.

Differential Revision: https://phabricator.services.mozilla.com/D62362

--HG--
extra : moz-landing-system : lando
2020-02-11 20:03:00 +00:00
Barret Rennie
782eac7b48 Bug 1613743 - Raise an error instead of returning 1 when failing to parse json r=tarek
In bug 1601414, the JSON parsing and validating code was refactored into a
single method. However, the `return 1` in case of error was carried over. That
was correct in the previous version because that 1 was being passed to `exit()`
later on. However, we were now returning 1 to callers of `read_json` when the
schema did not match, resulting in an opaque unrelated error (`TypeError: 'int'
object is not subscriptable`).

Now `read_json` is correctly raising an exception so its callers know when it
fails.

Differential Revision: https://phabricator.services.mozilla.com/D62361

--HG--
extra : moz-landing-system : lando
2020-02-11 20:02:45 +00:00
Barret Rennie
3be06c6f4e Bug 1613743 - Remove extraOptions from Perfherder output in run-visual-metrics.py r=tarek
The `extraOptions` key in the Perfherder output was only required until Bug
1593198 landed.

Differential Revision: https://phabricator.services.mozilla.com/D62360

--HG--
extra : moz-landing-system : lando
2020-02-11 20:02:43 +00:00
Barret Rennie
d8f4277299 Bug 1613743 - Run black on run-visual-metrics.py r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D62359

--HG--
extra : moz-landing-system : lando
2020-02-11 20:01:29 +00:00
Barret Rennie
d9766a8b08 Bug 1612005 - Do not specifiy individual videos in jobs.json r=tarek,perftest-reviewers,sparky
The `run-visual-metrics.py` script was intended to consume a `jobs.json` file
containing one `browsertime.json` per video. However it was not being used as
such and was continuously re-processing the first video specified in the
`browsertime.json` file. If a job were submitted with a `browsertime.json`
containing 15 videos and 15 different videos, only the first would be
processed. This leads to us having incorrect metrics because over all runs all
the metrics will be identical.

Now we only specify the `browsertime.json` in the `jobs.json` file and extract
the paths to videos from there. Also because we are never downloading inputs
this way, we get to remove some dead code and our dependency on `requests`.

Differential Revision: https://phabricator.services.mozilla.com/D62320

--HG--
extra : moz-landing-system : lando
2020-02-11 19:59:58 +00:00
ffxbld
cffd63aba1 No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=sfraser
Differential Revision: https://phabricator.services.mozilla.com/D62195

--HG--
extra : moz-landing-system : lando
2020-02-10 10:11:39 +00:00
ffxbld
a5b9f2b330 No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=sfraser
Differential Revision: https://phabricator.services.mozilla.com/D61443

--HG--
extra : moz-landing-system : lando
2020-02-03 10:20:14 +00:00
Daniel Varga
3d8a78a06f Backed out changeset 6851f568b173 (bug 1611006) for causing nightly bustages a=backout 2020-01-31 03:30:45 +02:00
Mike Shal
3fe87081bf Bug 1611006 - Convert python/mozbuild/mozbuild/test/action to python3; r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D60769

--HG--
extra : moz-landing-system : lando
2020-01-30 09:52:25 +00:00
Edwin Takahashi
976a24cffb Bug 1611339 - trim debian10-test docker image r=jmaher
Changes:

Since the image `debian10-test` is not being used to run unittests on CI, a lot of the dependencies installed can be removed.

Differential Revision: https://phabricator.services.mozilla.com/D60945

--HG--
extra : moz-landing-system : lando
2020-01-29 13:48:43 +00:00
ffxbld
82f2863c98 No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D61105

--HG--
extra : moz-landing-system : lando
2020-01-27 14:01:38 +00:00
Justin Wood
b627a90bcf No Bug - Remove taskcluster.net references in the tree. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D58297

--HG--
extra : moz-landing-system : lando
2020-01-24 15:52:50 +00:00
Noemi Erli
8c4ff0fb12 Backed out changeset cf3d74d0cf82 per Callek's request DONTBUILD CLOSED TREE 2020-01-24 17:48:10 +02:00
Justin Wood
19e5f06716 No Bug - Remove taskcluster.net references in the tree.
Differential Revision: https://phabricator.services.mozilla.com/D58297
2020-01-24 00:16:37 +02:00
Andreea Pavel
38dd93c9be Backed out changeset c5a138a88095 on request on a CLOSED TREE 2020-01-24 00:29:17 +02:00