Commit Graph

7792 Commits

Author SHA1 Message Date
Gerald Squelart
989ad20d1d Bug 1626837 - Add BlocksRingBuffer::IsInSession() - r=canaltinova
`ProfileBuffer` used to check if a `BlocksRingBuffer` was in session by looking
at its buffer size.
Now `IsInSession()` should be used, it is clearer in intent, and will make the
transition to `ProfileChunkedBuffer` slightly easier.

Differential Revision: https://phabricator.services.mozilla.com/D69492

--HG--
extra : moz-landing-system : lando
2020-04-15 03:20:51 +00:00
Edwin Takahashi
66ea42cb18 Bug 1627340 - separate filter for try selectors and apply them to try chooser r=bc,ahal,jmaher
Changes:

  - implement filtering of taskgraph items against a list of known task filters in `tasks.py`.
  - apply these filters to both `fuzzy` and `chooser` selectors, unless `--full` is specified.

Differential Revision: https://phabricator.services.mozilla.com/D70097

--HG--
extra : moz-landing-system : lando
2020-04-14 13:43:17 +00:00
Tarek Ziadé
2da872c93f Bug 1627623 - [mozperftest] Implement Andrew's tests r=acreskey
Implements https://github.com/acreskeyMoz/browsertime_on_android_scripts
changes to mach perftest and prototype

Differential Revision: https://phabricator.services.mozilla.com/D69801

--HG--
extra : moz-landing-system : lando
2020-04-14 07:46:51 +00:00
Nicholas Nethercote
8139b4051e Bug 1619840 - Remove fix_{linux,macosx}_stack.py and fix_stack_using_bpsyms.py. r=erahm
This commit removes `test_fix_stack_using_bpsyms.py`. That test can't easily be
modified to work with `fix_stacks.py` because it relies on internal
implementation details of `fix_stack_using_bpsym.py`. The unit testing done in
the `fix-stacks` repo provides test coverage that is as good or better.

Differential Revision: https://phabricator.services.mozilla.com/D66924

--HG--
extra : moz-landing-system : lando
2020-04-08 06:55:54 +00:00
Anurag Aggarwal
84f13a772a Bug 1628275 - Document how to run a try job for the in-tree documentation.r=firefox-source-docs-reviewers,sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D70589

--HG--
extra : moz-landing-system : lando
2020-04-13 21:24:43 +00:00
Andi-Bogdan Postelnicu
8731a55350 Bug 1612274 - Add checker readability-qualified-auto for clang-tidy static-analysis. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D70481

--HG--
extra : moz-landing-system : lando
2020-04-10 07:06:09 +00:00
Mihai Alexandru Michis
9a16882603 Backed out changeset c5907d661bb7 (bug 1627340) for causing lint failures in tryselect/selectors/chooser/__init__.py
CLOSED TREE
2020-04-10 04:48:08 +03:00
Edwin Takahashi
ae9fc8a3c6 Bug 1627340 - separate filter for try selectors and apply them to try chooser r=ahal,jmaher
Changes:

  - implement filtering of taskgraph items against a list of known task filters in `tasks.py`.
  - apply these filters to both `fuzzy` and `chooser` selectors, unless `--full` is specified.

Differential Revision: https://phabricator.services.mozilla.com/D70097

--HG--
extra : moz-landing-system : lando
2020-04-09 22:01:41 +00:00
Greg Tatum
5b83dca69f Bug 1612309 - Add an NS_WARNING for when nativeallocations are disabled by the bloat log; r=gerald
This makes it easier to debug when native allocations are turned on.

Differential Revision: https://phabricator.services.mozilla.com/D70075

--HG--
extra : moz-landing-system : lando
2020-04-09 21:05:08 +00:00
Mark Banner
7d3f1f3447 Bug 1626873 - Load xpcshell-test globals from the xpcshell head.js file rather than hard-code them. r=mossop
Differential Revision: https://phabricator.services.mozilla.com/D69612

--HG--
extra : moz-landing-system : lando
2020-04-09 19:20:34 +00:00
Andi-Bogdan Postelnicu
56a9802f89 Bug 1625884 - move clang-tidy and clang-format to clang-10. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D70065

--HG--
extra : moz-landing-system : lando
2020-04-09 14:16:44 +00:00
Andrew Halberstadt
7349bc85c9 Bug 1628810 - [tryselect] Use bugbug.debug optimization strategy by default in ./mach try auto, DONTBUILD, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D70419

--HG--
extra : moz-landing-system : lando
2020-04-09 18:31:24 +00:00
Cosmin Sabou
60934f9072 Backed out 3 changesets (bug 1625884) as requested by ANdi for causing build bustages. a=backout
Backed out changeset a35cfda6e271 (bug 1625884)
Backed out changeset 412c8c401196 (bug 1625884)
Backed out changeset 927ff250bc4b (bug 1625884)
2020-04-09 16:14:06 +03:00
Andi-Bogdan Postelnicu
ffe0a6a754 Bug 1625884 - move clang-tidy and clang-format to clang-10. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D70065

--HG--
extra : moz-landing-system : lando
2020-04-09 05:28:34 +00:00
Mike Hommey
ac5b6e6cd0 Bug 1628200 - Fix config/tests/test_mozbuild_reading.py. r=rstewart
Since the test goes through all moz.build files disregarding DIRS and
the conditions that may disable directories, in some cases, moz.builds
can fail to be evaluated properly because of missing variables in
config.status. This time (because it's not the first), it's
LLVM_DLLTOOL.

After fixing that, it turns out many of the files/directories pointed to
by Files() directives were removed or moved.

While here, make the test script python3-ready.

Differential Revision: https://phabricator.services.mozilla.com/D70157

--HG--
extra : moz-landing-system : lando
2020-04-09 00:24:29 +00:00
Chris Peterson
2834731dd4 Bug 1627490 - Replace MOZ_MUST_USE with [[nodiscard]] in tools/profiler. r=mstange
Also move MOZ_MUST_USE before function declarations' specifiers and return type. While clang and gcc's __attribute__((warn_unused_result)) can appear before, between, or after function specifiers and return types, the [[nodiscard]] attribute must precede the function specifiers.

Differential Revision: https://phabricator.services.mozilla.com/D69739

--HG--
extra : moz-landing-system : lando
2020-04-07 18:38:52 +00:00
Gerald Squelart
baa5044bbb Bug 1627097 - Profiler synchronously collect processor information - r=emalysz
Differential Revision: https://phabricator.services.mozilla.com/D69922

--HG--
extra : moz-landing-system : lando
2020-04-08 22:35:54 +00:00
Ricky Stewart
6805c2f318 Bug 1625285 - A few small fixes to prevent bustage under Python 3 in lint/resource monitor/testing r=marionette-reviewers,glandium,whimboo
Update code in a few places to work with Python 3, especially with regard to how we invoke subprocesses with text output. Note that the Marionette test harness code needs to be updated so that text is written out in the correct encoding (see bug 1615748).

Differential Revision: https://phabricator.services.mozilla.com/D69012

--HG--
extra : moz-landing-system : lando
2020-04-08 11:42:52 +00:00
Neil Deakin
8d97cadc7f Bug 1614713, add a remote page manager like object that uses JSWindowActor instead. Move access management into a separate module that can be used within a child or parent process. Ensure all RPM calls go through the access manager, r=mossop
Differential Revision: https://phabricator.services.mozilla.com/D63713

--HG--
rename : toolkit/components/remotepagemanager/MessagePort.jsm => toolkit/actors/RemotePageChild.jsm
extra : moz-landing-system : lando
2020-04-08 14:08:11 +00:00
MahakBansal
ee093cd087 Bug 1582666 - Enable more ESLint rules for netwerk/. r=Standard8,valentin
Differential Revision: https://phabricator.services.mozilla.com/D69257

--HG--
extra : moz-landing-system : lando
2020-04-07 16:00:03 +00:00
Bob Clary
770a924bf7 Bug 1627344 - Remove leading and trailing .* from mach try fuzzy.py's TARGET_TASK_FILTERS, r=ahal.
Differential Revision: https://phabricator.services.mozilla.com/D69622

--HG--
extra : moz-landing-system : lando
2020-04-06 14:48:46 +00:00
Andreas Farre
36eaf82163 Bug 1620594 - Part 2: Use SchedulerGroup::Dispatch instead of SystemGroup::Dispatch. r=nika
Depends on D67631

Differential Revision: https://phabricator.services.mozilla.com/D67632

--HG--
extra : moz-landing-system : lando
2020-04-07 15:16:33 +00:00
Bogdan Tara
7d56f86092 Backed out changeset 916894e8b8fc (bug 1626272) for frequent test_dmd.js failures CLOSED TREE 2020-04-07 03:52:49 +03:00
Nicholas Nethercote
ba62a51069 Bug 1626272 - Make fix-stacks initialization eager. r=erahm
Currently AWSY-with-DMD doesn't work on Windows. This is because `fix-stacks`
is initialized lazily, and by the time the initialization happens some file
descriptors for files are open, and that leads to some major Python2-on-Windows
sadness as described in the big comment in the commit.

To fix the problem, this commit adds an `init` function to `fix_stacks.py` so
that `fix-stacks` can be initialized eagerly, hopefully before any file
descriptors for files are open.

For `dmd.py`, other than fixing the AWSY problems, this has little effect,
because `fix-stacks` is always initialized.

For `utils.py`, which is used to process the output of most tests, this has a
more noticeable effect: the `fix-stacks` process is always spawned, rather than
being spawned only when needed. If no stack traces appear in the test output,
this means that `fix-stacks` is spawned unnecessarily. But it's cheap to spawn;
the expensive part only happens when stack traces start getting fixed. So I
think this change in behaviour is acceptable.

The commit also renames some things to more standard Python style, e.g.
`json_mode` instead of `jsonMode`.

Differential Revision: https://phabricator.services.mozilla.com/D69478

--HG--
extra : moz-landing-system : lando
2020-04-06 19:49:54 +00:00
Florian Quèze
67e60784ca Bug 1608556 - Expose to privileged JS an API to add markers with a start time and an associated text, r=gerald,mconley,baku.
Differential Revision: https://phabricator.services.mozilla.com/D68784

--HG--
extra : moz-landing-system : lando
2020-04-04 14:48:35 +00:00
Michael Forney
b81d8b0f5d Bug 1620549 - Set stack size of profiler sampler thread to 800 KiB r=gerald,mstange
N_STACK_BYTES are needed to store backtrace information, so use
that plus some extra as the minimum stack size for the sampler
thread to ensure that it doesn't overflow.

Differential Revision: https://phabricator.services.mozilla.com/D65705

--HG--
extra : moz-landing-system : lando
2020-04-04 00:51:48 +00:00
Eric Rahm
243dfaa07e Bug 1626453 - Remove nsAutoPtr usage from tools/fuzzing. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D69124

--HG--
extra : moz-landing-system : lando
2020-04-03 21:05:32 +00:00
Narcis Beleuzu
1aa55f1914 Backed out changeset 859ae92f4110 (bug 1608556) for bustages on ProfilerMarkerPayload.h. CLOSED TREE
--HG--
extra : histedit_source : 297a94849cc019db6bc32ecadfdd119347da4ac8
2020-04-03 21:58:02 +03:00
Andrew Halberstadt
367ad2118d Bug 1627074 - [tryselect] Make it more clear that 'mach try auto' is experimental, DONTBUILD, r=marco,sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D69445

--HG--
extra : moz-landing-system : lando
2020-04-02 20:43:13 +00:00
Florian Quèze
d10cae0789 Bug 1608556 - Expose to privileged JS an API to add markers with a start time and an associated text, r=gerald,mconley,baku.
Differential Revision: https://phabricator.services.mozilla.com/D68784

--HG--
extra : moz-landing-system : lando
2020-04-03 13:47:25 +00:00
Tarek Ziadé
5c0481ca70 Bug 1623321 - Add perftest r=sparky,perftest-reviewers,marionette-reviewers,whimboo,ahal
mach perftest

Differential Revision: https://phabricator.services.mozilla.com/D67342

--HG--
extra : moz-landing-system : lando
2020-04-02 13:04:41 +00:00
Andrew Halberstadt
ba40f078a0 Bug 1626393 - [tryselect] Catch OSError to check for file existence while invalidating task caches, r=gbrown
This prevents a race condition where the watchman hook can potentially
invalidate the cache in-between the call to 'isfile' and 'getmtime'.

Depends on D69189

Differential Revision: https://phabricator.services.mozilla.com/D69190

--HG--
extra : moz-landing-system : lando
2020-04-01 15:12:33 +00:00
Andrew Halberstadt
be64ef9701 Bug 1626393 - [tryselect] Remove logic to clean up old cache dirs, r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D69189

--HG--
extra : moz-landing-system : lando
2020-04-01 15:20:47 +00:00
Andrew Swan
4322e4d9e2 Bug 1625006 Add profiler markers for blocking webRequest listeners r=mixedpuppy,gerald
Differential Revision: https://phabricator.services.mozilla.com/D68278

--HG--
extra : moz-landing-system : lando
2020-04-01 16:23:53 +00:00
Andrew Halberstadt
d45b3cf7a4 Bug 1624902 - [taskgraph] Implement substrategies in the bugbug scheduler for dealing with platforms, r=marco
The bugbug scheduler currently chooses which manifests are important, and we
then run *every* task that contains those manifests. This is likely overkill
and we can reduce the number of configurations we run these manifests on.

Differential Revision: https://phabricator.services.mozilla.com/D68466

--HG--
extra : moz-landing-system : lando
2020-04-01 13:43:48 +00:00
Andrew Halberstadt
1ff013f0ca Bug 1624902 - [tryselect] Validate '--strategy' argument to ./mach try auto, r=marco
This ensures we fail with invalid module paths early. Otherwise users wouldn't
find out until the decision task fails.

Differential Revision: https://phabricator.services.mozilla.com/D68464

--HG--
extra : moz-landing-system : lando
2020-04-01 13:43:30 +00:00
Andrew Halberstadt
9359f4cba8 Bug 1624902 - [taskgraph] Move experimental strategies into a common namespace, r=marco
Small cleanup to help compartmentalize these strategies.

Differential Revision: https://phabricator.services.mozilla.com/D68463

--HG--
extra : moz-landing-system : lando
2020-04-01 13:43:17 +00:00
James Graham
5eba193cb7 Bug 1624280 - Allow specifying routes in mach try fuzzy, r=ahal
These routes are applied to all tasks except the decision task. There
is currently no validity checking in the frontend, so if the provided
routes aren't valid the decision task will fail.

Differential Revision: https://phabricator.services.mozilla.com/D67828

--HG--
extra : moz-landing-system : lando
2020-03-27 19:02:07 +00:00
James Graham
28b1ea3d10 Bug 1624280 - Add support for routes in try_task_config.json, r=ahal
This adds an optional routes key to the task_task_config schema,
 which is a list of strings. Anything in this key is added to the list
of routes for tasks scheduled by the decision task.

Differential Revision: https://phabricator.services.mozilla.com/D67827

--HG--
extra : moz-landing-system : lando
2020-04-01 09:18:37 +00:00
Csoregi Natalia
e1af17b6c1 Backed out 4 changesets (bug 1624902) for failures on test_optimize_strategies.py. CLOSED TREE
Backed out changeset b500403daa0c (bug 1624902)
Backed out changeset bf817363344e (bug 1624902)
Backed out changeset c7a62f2d9034 (bug 1624902)
Backed out changeset 08356d478d16 (bug 1624902)
2020-04-01 00:09:34 +03:00
Andrew Halberstadt
8787bbc73a Bug 1624902 - [taskgraph] Implement substrategies in the bugbug scheduler for dealing with platforms, r=marco
The bugbug scheduler currently chooses which manifests are important, and we
then run *every* task that contains those manifests. This is likely overkill
and we can reduce the number of configurations we run these manifests on.

Differential Revision: https://phabricator.services.mozilla.com/D68466

--HG--
extra : moz-landing-system : lando
2020-03-31 17:57:50 +00:00
Andrew Halberstadt
9d99e8d17f Bug 1624902 - [tryselect] Validate '--strategy' argument to ./mach try auto, r=marco
This ensures we fail with invalid module paths early. Otherwise users wouldn't
find out until the decision task fails.

Differential Revision: https://phabricator.services.mozilla.com/D68464

--HG--
extra : moz-landing-system : lando
2020-03-31 17:57:42 +00:00
Andrew Halberstadt
9a971df100 Bug 1624902 - [taskgraph] Move experimental strategies into a common namespace, r=marco
Small cleanup to help compartmentalize these strategies.

Differential Revision: https://phabricator.services.mozilla.com/D68463

--HG--
extra : moz-landing-system : lando
2020-03-31 18:06:58 +00:00
Jan-Erik Rediger
311c2d9ea7 Bug 1623300 - Replace fogotype with the actual FOG crate now. r=chutten
This also upgrades the vendored Glean version, which thanks to our
upstream work doesn't change anything else (except one small
Mozilla-developed dependency)

It's still feature-gated to nightly.
In C++ there's now a `MOZ_GLEAN` define.
For Rust it's behind the `glean` feature (enabled on nightly only).
The `fog` crate is empty, so no Glean is actually instantiated.

Differential Revision: https://phabricator.services.mozilla.com/D68539

--HG--
rename : third_party/rust/glean-preview/src/metrics/mod.rs => toolkit/components/glean/src/lib.rs
extra : moz-landing-system : lando
2020-03-31 08:24:40 +00:00
Razvan Maries
b243785ac5 Backed out 6 changesets (bug 1623300, bug 1623306) for build bustages. CLOSED TREE
Backed out changeset 5267e6e2015d (bug 1623300)
Backed out changeset 45fadf903140 (bug 1623300)
Backed out changeset 46949083a8c8 (bug 1623306)
Backed out changeset cbcb3bb23090 (bug 1623300)
Backed out changeset c04dbe8dd337 (bug 1623300)
Backed out changeset d2673451da54 (bug 1623300)

--HG--
rename : toolkit/components/glean/src/lib.rs => third_party/rust/glean-preview/src/metrics/mod.rs
2020-03-31 11:19:31 +03:00
Jan-Erik Rediger
1a47da3ae3 Bug 1623300 - Replace fogotype with the actual FOG crate now. r=chutten
This also upgrades the vendored Glean version, which thanks to our
upstream work doesn't change anything else (except one small
Mozilla-developed dependency)

It's still feature-gated to nightly.
In C++ there's now a `MOZ_GLEAN` define.
For Rust it's behind the `glean` feature (enabled on nightly only).
The `fog` crate is empty, so no Glean is actually instantiated.

Differential Revision: https://phabricator.services.mozilla.com/D68539

--HG--
rename : third_party/rust/glean-preview/src/metrics/mod.rs => toolkit/components/glean/src/lib.rs
extra : moz-landing-system : lando
2020-03-30 19:09:43 +00:00
Simon Fraser
5736cab8ce Bug 1625933 Only complain about unmanaged fzf if it was found r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D68792

--HG--
extra : moz-landing-system : lando
2020-03-30 13:49:57 +00:00
André Bargull
14ca007916 Bug 1625138 - Part 41: Remove no longer needed includes for mozilla/TypeTraits. r=froydnj
Also adds missing includes in some files, these were previously only transivitely
included through mozilla/TypeTraits.h.

Differential Revision: https://phabricator.services.mozilla.com/D68561

--HG--
extra : moz-landing-system : lando
2020-03-28 16:00:09 +00:00
André Bargull
13bfe75b97 Bug 1625138 - Part 40: Replace remaining mozilla::IsSame with std::is_same. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D68560

--HG--
extra : moz-landing-system : lando
2020-03-28 13:57:21 +00:00
André Bargull
ebec34a898 Bug 1625138 - Part 16: Replace mozilla::IsIntegral with std::is_integral. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D68371

--HG--
extra : moz-landing-system : lando
2020-03-28 13:57:15 +00:00