Commit Graph

914 Commits

Author SHA1 Message Date
Tooru Fujisawa
a2591607d9 Bug 1641369 - Part 5: Make sure the workspace is clean in SM package build. r=sfink
Differential Revision: https://phabricator.services.mozilla.com/D77643
2020-06-03 05:34:20 +00:00
Tooru Fujisawa
34aa7e8d55 Bug 1641369 - Part 3: Move objdir of SpiderMonkey jobs outside of checkouts directory. r=tomprince
Depends on D77642

Differential Revision: https://phabricator.services.mozilla.com/D77991
2020-06-10 18:27:18 +00:00
Tooru Fujisawa
d2368696d6 Bug 1641369 - Part 1: Use GECKO_PATH instead of SRCDIR in SpiderMonkey jobs. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D77990
2020-06-10 18:21:20 +00:00
Mitchell Hentges
0bc6909185 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-10 16:10:08 +00:00
Mike Hommey
01f30cd88f Bug 1643504 - Fix WR bustage. r=fix CLOSED TREE 2020-06-10 00:41:49 +03:00
Noemi Erli
9017f973e3 Backed out 4 changesets (bug 1621960) for causing Android bustages CLOSED TREE
Backed out changeset f36a95234a5f (bug 1621960)
Backed out changeset 0e4661c9061d (bug 1621960)
Backed out changeset 3e2cbe4dd777 (bug 1621960)
Backed out changeset d7eb101e5df7 (bug 1621960)
2020-06-09 20:59:26 +03:00
Mitchell Hentges
4006a0890c Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-09 16:44:51 +00:00
Ed Lee
96ed60b4bd Bug 1641863 - Upgrade Node 10.x (in preparation for ESR 78) r=Standard8. CLOSED TREE
Node v10.21.0 (LTS) just released https://nodejs.org/en/blog/release/v10.21.0/

Differential Revision: https://phabricator.services.mozilla.com/D77904
2020-06-03 18:00:52 +00:00
Mitchell Hentges
658f5f0eeb Bug 1642411: Removes unused test-macosx.sh script r=ahal
A grep through the repository and a brief discussion with #releng seems to point towards this script not being used.

Differential Revision: https://phabricator.services.mozilla.com/D77689
2020-06-02 18:55:35 +00:00
Edwin Takahashi
3efe2edb5c Bug 1641395 - install amd64 variants of existing i386 packages and insert additional startup parameters for pulseaudio r=jmaher
Changes:
  - install the `amd64` variants of various packages alongside `i386` packages
  - install `amd64` version of `fontconfig` instead
  - additional command line arguments for pulseaudio initialization
  - do not add configuration files to `~/.pulse` in the docker image

Differential Revision: https://phabricator.services.mozilla.com/D77512
2020-06-01 20:44:47 +00:00
Gregory Mierzwinski
18cd0c676d Bug 1640429 - Run v8 fetch with --force. r=jmaher
This patch attempts to fix the long-running customv8 toolchain tasks by adding a --force to the `fetch v8` call. This additional option prevents `fetch` from checking for existing .gclient files (which should never exist) to help with the long delay we are seeing in this call.

Differential Revision: https://phabricator.services.mozilla.com/D76857
2020-05-26 15:42:22 +00:00
Chris AtLee
62f699319d Bug 1637381: Use zstd for clang toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74930
2020-05-21 13:31:55 +00:00
Chris AtLee
b1c32e06b2 Bug 1637381: Use zstd for rust toolchains r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D74929
2020-05-21 13:30:56 +00:00
Chris AtLee
72cc360dcd Bug 1637381: Use python3 for repack_rust.py r=glandium
repack_rust.py was the only toolchain build using a python script directly. we
don't need it to use the `mach python` wrapper, so remove that special casing
from the transform.

Differential Revision: https://phabricator.services.mozilla.com/D75702
2020-05-21 13:30:54 +00:00
Chris AtLee
d0a9a8b30b Bug 1637381: Use zstd for android toolchains r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D74928
2020-05-21 13:29:13 +00:00
Chris AtLee
3befa9e65b Bug 1637381: Add zstdpy script r=glandium
This is a simple command line utility for doing zstd compression/decompression
of stdin to stdout. It depends on python's zstandard module being available.

Differential Revision: https://phabricator.services.mozilla.com/D75358
2020-05-21 13:28:55 +00:00
Chris AtLee
ef685f3549 Bug 1637379: Optimize android toolchains r=gbrown
Create an emulator toolchain
Stop including mozboot/sdk-*.zip in our tarball

Differential Revision: https://phabricator.services.mozilla.com/D74931
2020-05-21 13:28:10 +00:00
Tom Ritter
ec109c0eed Bug 1619683 - Build CodeQL Databases r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D65170
2020-05-15 04:03:39 +00:00
Narcis Beleuzu
abc58ec081 Backed out changeset 4123014cf744 (bug 1633101) for Linting failure on runtests.py . CLOSED TREE 2020-05-14 02:14:18 +03:00
egao
e29bcc19ec Bug 1633101 - consolidate pulseaudio initialization process on linux and migrate to x64 fontconfig package r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-13 21:46:55 +00:00
Razvan Maries
e218f74304 Backed out 2 changesets (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE
Backed out changeset b85aebbd6fcc (bug 1633101)
Backed out changeset fd6537bc153f (bug 1633101)
2020-05-13 03:47:10 +03:00
Edwin Takahashi
eea3ca3ae8 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 20:59:43 +00:00
Razvan Maries
7bb5a72350 Backed out changeset ce270ccc8290 (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE 2020-05-12 23:55:42 +03:00
Edwin Takahashi
fe77d08974 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 12:20:45 +00:00
Chris AtLee
d08430e9aa Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-08 18:03:50 +00:00
Andreea Pavel
dbd1462996 Backed out changeset b76e3e988fdd (bug 1577110) for breaking geckodriver signin toolchains a=backout 2020-05-08 06:51:23 +03:00
Chris AtLee
d746c3123f Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D72754
2020-05-07 20:52:48 +00:00
Mike Hommey
696cb0cc9c Bug 1625696 - Update winchecksec and build/use it natively for Linux. r=dmajor
Now that upstream winchecksec builds and works natively on Linux, use
that. That should solve the random crashes under Wine. If random crashes
still happen, it will be easier to debug anyways.
We bump to the last version that doesn't use vcpkg because vcpkg makes
things more difficult.

Differential Revision: https://phabricator.services.mozilla.com/D73405
2020-05-07 00:34:36 +00:00
Ricky Stewart
2ce561dd99 Bug 1635514 - Delete tup CI/configure stuff r=froydnj
This includes scripts that involve `tup`, jobs that build `tup` in automation, `tup.configure`, and related infrastructure and documentation.

Differential Revision: https://phabricator.services.mozilla.com/D73921
2020-05-05 18:34:16 +00:00
Andreea Pavel
81629d9476 Backed out changeset fc265b3a728e (bug 1625696) for causing bug 1634877 and bug 1634916 2020-05-03 05:22:37 +03:00
Mike Hommey
137394d5a2 Bug 1625696 - Update winchecksec and build/use it natively for Linux. r=dmajor
Now that upstream winchecksec builds and works natively on Linux, use
that. That should solve the random crashes under Wine. If random crashes
still happen, it will be easier to debug anyways.
We bump to the last version that doesn't use vcpkg because vcpkg makes
things more difficult.

Differential Revision: https://phabricator.services.mozilla.com/D73405
2020-05-02 06:19:25 +00:00
Mike Hommey
a760600961 Bug 1634560 - Fix fetch-config for git repos with submodules. r=dmajor
There are cases where --recurse-submodules breaks things (e.g. when
newer versions of the repository remove a submodule). So don't
recurse-submodules at all at clone or checkout time, but instead
initialize and update submodules after the checkout.

Also don't checkout at clone time, because it's redundant with the
checkout, and we only really trust the explicit checkout anyways, so
it's better to not checkout during the clone.

Differential Revision: https://phabricator.services.mozilla.com/D73353
2020-05-02 06:18:33 +00:00
Jamie Nicol
1af6f33ce1 Bug 1634275 - Update glslopt to 0.1.2 to remove dependency on bindgen. r=jrmuizel,kats
Differential Revision: https://phabricator.services.mozilla.com/D73198
2020-04-30 12:25:17 +00:00
Mike Hommey
340788143e Bug 1632693 - Upgrade wine to 5.0. r=rstewart
It requires a newer version of bison to build, which we get by using a
more recent version of Debian for the toolchain build (Debian 9 being
the version we use for the builds that depend on wine, so it will work
there).

Differential Revision: https://phabricator.services.mozilla.com/D72254
2020-04-25 21:02:23 +00:00
Jamie Nicol
1d3a107541 Bug 1604615 - Fix wrench build issues on CI arising from glslopt. r=jrmuizel
* For wrench builds, the clang toolchain must now be fetched and be
  present in PATH for bindgen to work. When building OSMesa, we must
  therefore set `LLVM_CONFIG=no` so that it does not attempt to build
  llvmpipe.

* For wrench Mac cross-compiles, we must be careful to expose CFLAGS
  and similar variables using the target-specific variable names, so
  that host builds do not attempt to use flags intended for the
  target. When building OSMesa we must use the generic variable `CC`,
  so now we additionally set `HOST_CC`, so that host builds use the
  host variable rather than the generic one.

* Similarily, for wrench android builds we must use a fork of
  cargo-apk which sets the target-specific variables rather than the
  generic ones. Otherwise we would attempt to use the NDK toolchain
  for host builds.

Differential Revision: https://phabricator.services.mozilla.com/D70031
2020-04-21 10:31:56 +00:00
Geoff Brown
e245496607 Bug 1612345 - Ensure that most custom retriggers repeat the original task by default; r=bc
Various updates to the custom retrigger action so that, without any custom changes to
parameters, the retriggered task runs with the same parameters as the original task.
Several issues were found and corrected, notably:
 - parameters like --allow-software-gl-layers were ignored
 - MOZHARNESS_TEST_PATHS was ignored
 - many parameter customizations in the desktop mozharness configs were ignored
 - mochitest suite/subsuite/flavor selection was not always correct
 - using repeat=1 by default meant that each test ran twice

Differential Revision: https://phabricator.services.mozilla.com/D70457
2020-04-17 22:11:02 +00:00
Steve Fink
a521c1ead1 Bug 1626772 - Update hazard analysis to gcc 9 r=froydnj
Also requires modifying an annotation for altered gcc 9 output format.

Differential Revision: https://phabricator.services.mozilla.com/D69277

--HG--
extra : moz-landing-system : lando
2020-04-10 01:08:59 +00:00
Mihai Alexandru Michis
f2e4ef7d2a Backed out 3 changesets (bug 1626772) for causing bustages in DefineEnum.h
CLOSED TREE

Backed out changeset f42150bdee2b (bug 1626772)
Backed out changeset ab5b637f714a (bug 1626772)
Backed out changeset fd4026a9f380 (bug 1626772)
2020-04-10 03:49:33 +03:00
Steve Fink
fde9f2df8f Bug 1626772 - Update hazard analysis to gcc 9 r=froydnj
Also requires modifying an annotation for altered gcc 9 output format.

Differential Revision: https://phabricator.services.mozilla.com/D69277

--HG--
extra : moz-landing-system : lando
2020-04-02 17:15:20 +00:00
David Major
9caebd9642 Bug 1326486 - build-clang: Convert 3-stage builds to 4-stage PGO builds. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D69084

--HG--
extra : moz-landing-system : lando
2020-04-07 14:12:51 +00:00
Mihai Alexandru Michis
964773e27c Backed out 7 changesets (bug 1326486) for causing bpgo failures.
CLOSED TREE

Backed out changeset 810a84a18948 (bug 1326486)
Backed out changeset e04c57ed0c04 (bug 1326486)
Backed out changeset 493c338ad705 (bug 1326486)
Backed out changeset 96701b9815c2 (bug 1326486)
Backed out changeset 8adfc59eb3c5 (bug 1326486)
Backed out changeset 441282fd1fea (bug 1326486)
Backed out changeset a64593d4c645 (bug 1326486)
2020-04-07 17:08:08 +03:00
David Major
abffbe294c Bug 1326486 - build-clang: Convert 3-stage builds to 4-stage PGO builds. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D69084

--HG--
extra : moz-landing-system : lando
2020-04-07 08:32:59 +00:00
Mike Hommey
1db126b66a Bug 1450088 - Add a toolchain task building winchecksec. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D68155

--HG--
extra : moz-landing-system : lando
2020-03-27 07:39:18 +00:00
Mike Hommey
f8e37d2100 Bug 1621845 - Normalize fetch path in fetch-content. r=rstewart
The win64-aarch64 have a kind of a nasty trick that makes fetch-content
download artifacts of a dependent task directly as artifacts of the task
itself. For some reason, while this pattern works on native Windows
jobs, it doesn't on Linux. What happens is essentially that:

  `pathlib.Path(path).joinpath('../foo').mkdir(parents=True, exist=ok=True)`

fails when path doesn't exist first. I guess the fetches directory
already exists on Windows worker or something.

Unfortunately, os.path.normpath doesn't take `pathlib.Path`s in
still-supported python 3.5, so we have to convert to str first.

Differential Revision: https://phabricator.services.mozilla.com/D66518

--HG--
extra : moz-landing-system : lando
2020-03-19 08:18:37 +00:00
Mike Hommey
deaae0a9f3 Bug 1618781 - Add toolchains tasks for pdbstr. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D67085

--HG--
extra : moz-landing-system : lando
2020-03-18 03:34:44 +00:00
Ciure Andrei
19d8351b5f Backed out 2 changesets (bug 1618781) for toolchain bustages CLOSED TREE
Backed out changeset 83026834b242 (bug 1618781)
Backed out changeset ac168e956e3a (bug 1618781)
2020-03-18 05:32:00 +02:00
Mike Hommey
63fe0dbd12 Bug 1618781 - Add toolchains tasks for pdbstr. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D67085

--HG--
extra : moz-landing-system : lando
2020-03-17 21:24:11 +00:00
Lee Salzman
5c3cc16e78 Bug 1612941 - import glsl-to-cxx and swgl into Gecko tree. r=jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D65616

--HG--
extra : moz-landing-system : lando
2020-03-13 18:24:35 +00:00
Steve Fink
f77a8187af Bug 1618923 - Fix llvm-symbolizer filename on Windows r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D65383

--HG--
extra : moz-landing-system : lando
2020-03-13 09:19:18 +00:00
Edwin Takahashi
c7e8b475ec Bug 1621483 - set up separate enviornment for linux1804 marionette and web-platform-tests-wdspec r=jmaher,marionette-reviewers,whimboo
Changes:

As documented in bug 1621483, `marionette` experiences a non-trivial amount of issues when run on ubuntu1804 docker image with GTK/GNOME desktop environment enabled.

GTK/GNOME has a higher degree of asynciness when manipulating window size/position and this leads to `marionette` and the derived suite `web-platform-tests-wdspec` reporting intermittent oranges for a number of tests.

While attempts were made to incorporate a fix for the marionette driver itself, the best attempts have only been able to achieve a ~50% reliability in green runs.

This patch reintroduces the use of bare `compiz` window manager exclusively for these two problematic test suites so that at least the tests are running on non-legacy software.

Differential Revision: https://phabricator.services.mozilla.com/D66482

--HG--
extra : moz-landing-system : lando
2020-03-12 21:43:56 +00:00