Commit Graph

5447 Commits

Author SHA1 Message Date
Kris Maglione
30b3a49bfd Bug 1431533: Part 5a - Auto-rewrite code to use ChromeUtils import methods. r=florian
MozReview-Commit-ID: 8V1ZT53ReiP

--HG--
extra : rebase_source : 12b5f8c3e125111db7382eb3d7d20a99fb2c35b3
extra : absorb_source : e99fa7f6eee02e7e6cadeb898c7fcf6dac9c902a
extra : histedit_source : d0dfc31fadc2b81d341c9d0cd1efec02923c003b
2018-01-24 15:48:47 -08:00
Kris Maglione
b78186b970 Bug 1431533: Part 4 - Add ESLint support for ChromeUtils import methods. r=florian
This adds support for detecting globals created by these helpers, as well as a
rule to enforce their use over the older XPConnect variants.

The latter rule also supports fixing code to use the newer variants, and will
be used in the next part to rewrite in-tree ESLint-enabled code that fails it.

MozReview-Commit-ID: 6Bgo6ohQA5j

--HG--
extra : rebase_source : feca0a0ed339420ea19faa1f6614e6253f0c840e
extra : absorb_source : d32d3d23fbd2c7dcae082375a1f9a61766b04b75
extra : histedit_source : 83cebb4f3eb66a79d38ee5412a5739d0c603425b
2018-01-18 12:53:01 -08:00
Narcis Beleuzu
9279994eae Merge inbound to mozilla-central. a=merge 2018-01-24 23:56:14 +02:00
Sebastian Hengst
78d2a3c1db Merge mozilla-central to mozilla-inbound 2018-01-24 14:24:05 +02:00
Edouard Oger
d149a0176b Bug 1426306 - Store only derived keys instead of storing kB/kA. r=glasserc,markh,rfkelly
MozReview-Commit-ID: Hgv5hxSH4qX

--HG--
extra : rebase_source : fa6d45480a2078e841c72b2c8c92541811633737
2018-01-05 15:56:00 -05:00
Simon Fraser
7ab95eccbd Bug 1432517 Add shellcheck support for mach lint r=ahal
MozReview-Commit-ID: 1Mzg6y3JKbn

--HG--
extra : rebase_source : ceb32257265952e173ff83434395acfabb001cb4
2018-01-23 16:32:04 +00:00
Bas Schouten
3143ad47f1 Bug 1429623: Report tracing events and thread registration to VTune when --enable-vtune is enabled. r=mstange r=ted
MozReview-Commit-ID: I47OIX16ibf
2018-01-19 17:19:29 +01:00
Christian Holler
8e72e4cc2f Bug 1431090 - Prepare tools/fuzzing/ to be used with JS_STANDALONE. r=froydnj
This patch adjusts tools/fuzzing/ in such a way that the relevant parts can be
reused in the JS engine. Changes in detail include:

* Various JS_STANDALONE checks to exclude parts that cannot be included in
  those builds.

* Turn LibFuzzerRegistry and LibFuzzerRunner into generic FuzzerRegistry and
  FuzzerRunner classes and use them for AFL as well. Previously, AFL was
  piggy-backing on gtests which was kind of an ugly solution anyway (besides
  that it can't work in JS). Now more code like registry and harness is
  shared between the two and they follow almost the same call paths and entry
  points. AFL macros in FuzzingInterface have been rewritten accordingly.
  This also required name changes in various places. Furthermore, this unifies
  the way, the fuzzing target is selected, using the FUZZER environment
  variable rather than LIBFUZZER (using LIBFUZZER in browser builds will give
  you a deprecation warning because I know some people are using this already
  and need time to switch). Previously, AFL target had to be selected using
  GTEST_FILTER, so this is also much better now.

* I had to split up FuzzingInterface* such that the STREAM parts are in a
  separate set of files FuzzingInterfaceStream* because they use nsStringStream
  which is not allowed to be included into the JS engine even in a full browser
  build (error: "Using XPCOM strings is limited to code linked into libxul.").
  I also had to pull FuzzingInterface.cpp (the RAW part only) into the header
  and make it static because otherwise, would have to make not only separate
  files but also separate libraries to statically link to the JS engine, which
  seemed overkill for a single small function. The streaming equivalent of the
  function is still in a cpp file.

* LibFuzzerRegister functions are now unique by appending the module name to
  avoid redefinition errors.

MozReview-Commit-ID: 44zWCdglnHr

--HG--
extra : rebase_source : fe07c557032fd33257eb701190becfaf85ab79d0
2018-01-17 15:20:35 +01:00
Coroiu Cristina
faa2f8c7da Backed out 2 changesets (bug 1431090) for Bf bustage at src/tools/fuzzing/interface/harness/FuzzerTestHarness.h
Backed out changeset 2e98bda3f397 (bug 1431090)
Backed out changeset eb6acc9e44ad (bug 1431090)

--HG--
rename : tools/fuzzing/registry/FuzzerRegistry.cpp => tools/fuzzing/libfuzzer/harness/LibFuzzerRegistry.cpp
rename : tools/fuzzing/registry/FuzzerRegistry.h => tools/fuzzing/libfuzzer/harness/LibFuzzerRegistry.h
rename : tools/fuzzing/interface/harness/FuzzerRunner.cpp => tools/fuzzing/libfuzzer/harness/LibFuzzerRunner.cpp
rename : tools/fuzzing/interface/harness/FuzzerRunner.h => tools/fuzzing/libfuzzer/harness/LibFuzzerRunner.h
rename : tools/fuzzing/interface/harness/FuzzerTestHarness.h => tools/fuzzing/libfuzzer/harness/LibFuzzerTestHarness.h
rename : tools/fuzzing/interface/harness/moz.build => tools/fuzzing/libfuzzer/harness/moz.build
2018-01-23 13:49:26 +02:00
Christian Holler
4ce6f81fee Bug 1431090 - Prepare tools/fuzzing/ to be used with JS_STANDALONE. r=froydnj
This patch adjusts tools/fuzzing/ in such a way that the relevant parts can be
reused in the JS engine. Changes in detail include:

* Various JS_STANDALONE checks to exclude parts that cannot be included in
  those builds.

* Turn LibFuzzerRegistry and LibFuzzerRunner into generic FuzzerRegistry and
  FuzzerRunner classes and use them for AFL as well. Previously, AFL was
  piggy-backing on gtests which was kind of an ugly solution anyway (besides
  that it can't work in JS). Now more code like registry and harness is
  shared between the two and they follow almost the same call paths and entry
  points. AFL macros in FuzzingInterface have been rewritten accordingly.
  This also required name changes in various places. Furthermore, this unifies
  the way, the fuzzing target is selected, using the FUZZER environment
  variable rather than LIBFUZZER (using LIBFUZZER in browser builds will give
  you a deprecation warning because I know some people are using this already
  and need time to switch). Previously, AFL target had to be selected using
  GTEST_FILTER, so this is also much better now.

* I had to split up FuzzingInterface* such that the STREAM parts are in a
  separate set of files FuzzingInterfaceStream* because they use nsStringStream
  which is not allowed to be included into the JS engine even in a full browser
  build (error: "Using XPCOM strings is limited to code linked into libxul.").
  I also had to pull FuzzingInterface.cpp (the RAW part only) into the header
  and make it static because otherwise, would have to make not only separate
  files but also separate libraries to statically link to the JS engine, which
  seemed overkill for a single small function. The streaming equivalent of the
  function is still in a cpp file.

* LibFuzzerRegister functions are now unique by appending the module name to
  avoid redefinition errors.

MozReview-Commit-ID: 44zWCdglnHr

--HG--
rename : tools/fuzzing/libfuzzer/harness/LibFuzzerRunner.cpp => tools/fuzzing/interface/harness/FuzzerRunner.cpp
rename : tools/fuzzing/libfuzzer/harness/LibFuzzerRunner.h => tools/fuzzing/interface/harness/FuzzerRunner.h
rename : tools/fuzzing/libfuzzer/harness/LibFuzzerTestHarness.h => tools/fuzzing/interface/harness/FuzzerTestHarness.h
rename : tools/fuzzing/libfuzzer/harness/moz.build => tools/fuzzing/interface/harness/moz.build
rename : tools/fuzzing/libfuzzer/harness/LibFuzzerRegistry.cpp => tools/fuzzing/registry/FuzzerRegistry.cpp
rename : tools/fuzzing/libfuzzer/harness/LibFuzzerRegistry.h => tools/fuzzing/registry/FuzzerRegistry.h
extra : rebase_source : 7d0511ca0591dbf4d099376011402e063a79ee3b
2018-01-17 15:20:35 +01:00
Dorel Luca
2f4f0ba72d Merge mozilla-central to autoland r=merge 2018-01-23 12:12:21 +02:00
Mark Banner
a773c73dbb Bug 1131491 - Remove old synchronous Place's transactions. r=mak
MozReview-Commit-ID: FNCijeajgeh

--HG--
extra : rebase_source : 4207cdd7b789fbbcce3b2117324ea22e1a313fe6
2018-01-22 15:41:12 +00:00
Tom Prince
946b7e38eb Bug 1430316: Lint the mozharness configs; r=jlund
Differential Revision: https://phabricator.services.mozilla.com/D385

--HG--
extra : rebase_source : c4c6e2a4c28c29cc6906d2b757063ef38ac2209a
2018-01-12 16:54:17 -07:00
Gurzau Raul
76ec8a476e Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-01-20 11:46:16 +02:00
Bas Schouten
16b11ce2ad Backout 9b3656db42a7 (Bug 1429623) for bustage.
MozReview-Commit-ID: 9Ar6Y8MKGB1
2018-01-20 08:15:57 +01:00
Bas Schouten
faf37620b4 Bug 1429623: Report tracing events and thread registration to VTune when --enable-vtune is enabled. r=mstange r=ted
MozReview-Commit-ID: I47OIX16ibf
2018-01-19 17:19:29 +01:00
iceman
5d31e3d10a Bug 1407763 - Enable py2 and py3 compat linters for testing/marionette. r=ahal
MozReview-Commit-ID: 4IYhPPGlJlo

--HG--
extra : rebase_source : a27b89c734082fc8acbc329ded75d7ef87d70dbe
2018-01-17 16:14:43 +01:00
Gijs Kruitbosch
d332684bb0 Bug 1431069 - allow eslint to deal with ChromeUtils imports, r=standard8
MozReview-Commit-ID: KHVewE1Rrov

--HG--
extra : rebase_source : 392ba268ec2b8851a5ef33a1e7ee8be83e83aa91
2018-01-17 13:20:59 +00:00
Rob Wood
71750314ca Bug 1426682 - Remove tcanvasmark from talos; r=jmaher
MozReview-Commit-ID: De1WBDevFay

--HG--
extra : rebase_source : 2d00b89e8791a026bdc168aef3010a2884af0573
2018-01-18 15:29:01 -05:00
Mark Banner
a501264a60 Bug 1431452 - Fix formatting of ESLint's docs. r=mossop
MozReview-Commit-ID: KUFa9ncqaxV

--HG--
extra : rebase_source : 4444037e785ca91d20179a1cf6ec1f936b65ad0d
2018-01-18 16:33:28 +00:00
Mark Banner
44d164f81d Bug 1431129 - Remove no-mixed-spaces-and-tabs from the ESLint config, since no-tabs disallows tabs anyway. r=mossop.
MozReview-Commit-ID: 395itqTz9T8

--HG--
extra : rebase_source : 744f1765e1ee41fcaca608a2821c6f0d7a76d608
2018-01-18 10:03:02 +00:00
Mark Banner
bc030d501e Bug 1430923 - Handle EXPORTED_SYMBOLS in ESLint to help define globals in jsm files, and disallow 'let EXPORTED_SYMBOLS = '. r=mossop
MozReview-Commit-ID: 5abfpM8EAEL

--HG--
extra : rebase_source : b266018a3754459aa8628217232f86e1a56c00b7
2018-01-16 23:07:25 +00:00
Mark Banner
893d64c0f9 Bug 1430615 - Remove ESLint rules duplicated in devtools/.eslintrc.js where they are already defined in recommended.js. r=jdescottes
MozReview-Commit-ID: 4wGkJjqzsoG

--HG--
extra : rebase_source : c78841f1b9d37c1ee3dc2077e2d41b2b16bbd26f
2018-01-15 16:46:49 +00:00
Dustin J. Mitchell
26d48b3202 Bug 1403519 - only build docs when necessary r=gps
This marks **/docs/** as exclusively docs, and code that is autodoc'd as
inclusively docs.

That means that a change that purely modifies documentation files will *only*
run `docs` tasks, while a change that modifies autodoc'd source code will
*additionaly* run `docs` tasks.  The tasks do not run by default.

MozReview-Commit-ID: G9tOK0AwtrI

--HG--
extra : rebase_source : 8dd971e5c9b0eb5f47895664a4ea49442f303ecb
extra : source : 0881de9b2b5e36ec37cc866f1d4af109da57a919
2017-10-02 18:22:56 +00:00
Andrew Halberstadt
3087b17a69 Bug 1413928 - [tryselect] Implement paths for |mach try fuzzy| r=maja_zf
This enables the syntax like:
./mach try fuzzy dom/indexedDB

This will open up the fzf interface like normal, except only tasks
that have tests under dom/indexedDB will be selectable (and there
will only be one chunk per configuration).

This can be combined with -q/--query like normal:
./mach try fuzzy dom/indexedDB -q "!pgo !cov !asan"

When the tasks get scheduled, only the tests under the specified
path(s) will run within the harness.

MozReview-Commit-ID: IHRXXi5mB4G

--HG--
extra : rebase_source : 8a89f255591e6dfa31b1420196c4698f2015d10c
2017-11-15 16:36:07 -05:00
Andrew Halberstadt
564efd2a35 Bug 1413928 - [tryselect] Create a new argument group for 'task' arguments r=maja_zf
This simply groups arguments related to generating the list of
tasks from taskgraph into their own argument group.

MozReview-Commit-ID: IHRXXi5mB4G

--HG--
extra : rebase_source : 6c746f0cb8d93f957f50ba12f77d63edb04b6d1e
2017-11-02 16:03:38 -04:00
Andrew Halberstadt
9b0698e9b6 Bug 1413928 - [tryselect] Add a new 'path' template r=maja_zf
This sets the MOZHARNESS_TEST_PATHS environment variables for all tasks.
When specifying paths, this will cause many test tasks to only run the
tests under that directory as opposed to the normal default.

MozReview-Commit-ID: IHRXXi5mB4G

--HG--
extra : rebase_source : e7132311641f4d36a5bff56424988fbb3ae87238
2018-01-15 16:05:37 -05:00
Andrew Halberstadt
28b0ebdf63 Bug 1413928 - [tryselect] Change templates to return an entire context dict instead of a single value r=maja_zf
This changes templates so they return an entire context dict instead of
only returning context based on their name. For example, now the 'path'
template can set context for 'env'.

A side effect of this is that there is no longer a 1-to-1 mapping of templates
in tryselect and taskgraph.

MozReview-Commit-ID: IHRXXi5mB4G

--HG--
extra : rebase_source : 4d7e398e60598a5de7961fb126f1d05a0b983681
2018-01-15 16:05:17 -05:00
Andrew Halberstadt
24922a65ba Bug 1413928 - [tryselect] Add python unittest for templates r=davehunt
This makes use of pytest's generation feature. To add a new
template test, just add a new entry containing the input and
expected output to the dict in test_templates.py

MozReview-Commit-ID: 4qMefYHMjAp

--HG--
extra : rebase_source : ba3049885d1a2485048e1ff9913be43317559376
2017-11-21 10:11:00 -05:00
Cosmin Sabou
1f9b4f0f06 Merge inbound to mozilla-central. a=merge 2018-01-17 11:46:53 +02:00
Nika Layzell
f5c4dc1b8f Bug 1430850 - Part 3: Expose profiler_add_marker_for_thread to add a marker for a specific thread, r=mstange
MozReview-Commit-ID: 2nyp98oBKHk
2018-01-16 14:07:28 -05:00
Nika Layzell
247e29f4fd Bug 1430850 - Part 2: Change ProfilerMarker to use an internal ThreadId property, rather than the ThreadId entry, r=mstange
MozReview-Commit-ID: J8Ckvmj4En0
2018-01-16 14:07:27 -05:00
Nika Layzell
702f6fd7cf Bug 1430850 - Part 1: Move mThreadId from ThreadInfo to RacyThreadInfo, r=mstange
MozReview-Commit-ID: LE6j8Fm38PK
2018-01-16 14:07:25 -05:00
Tom Prince
24b745390b Bug 1424967: Fix remaining lint error in upload_symbols.py; r=ted.mielczarek
MozReview-Commit-ID: LsvBXNy1SA6

--HG--
extra : rebase_source : a799e7907dd1fe21f3f5a4996b1ee83ba8f314e7
2017-12-12 22:42:23 -07:00
Noemi Erli
1c9bbfbebc Backed out 2 changesets (bug 1403519) for bustage on \python\mozbuild\mozbuild\test\frontend\test_reader.py on a CLOSED TREE
Backed out changeset f53f8adcd578 (bug 1403519)
Backed out changeset 5b293bcd3fc7 (bug 1403519)
2018-01-17 07:23:40 +02:00
Andi-Bogdan Postelnicu
48cbb200aa Bug 1430749 - Update the list of checkers in config.yaml to add some clang-analyzer-security checks. r=janx
MozReview-Commit-ID: BkccyEOktHS

--HG--
extra : rebase_source : 58193ed0350f2bb51474b02f824696fcc900ce6e
2018-01-16 14:43:05 +02:00
Csoregi Natalia
3ce27a72d5 Backed out 5 changesets (bug 1418425) requested per comment #83. on a CLOSED TREE
Backed out changeset 0ecc98bd0822 (bug 1418425)
Backed out changeset 7b7725d1d3c3 (bug 1418425)
Backed out changeset 2e95ebdcae6d (bug 1418425)
Backed out changeset 47fbcaf5ad05 (bug 1418425)
Backed out changeset 142001babb39 (bug 1418425)
2018-01-15 15:30:30 +02:00
Chris Peterson
37efe4d0e6 Bug 1428535 - Add missing override specifiers to overridden virtual functions. r=froydnj
MozReview-Commit-ID: DCPTnyBooIe

--HG--
extra : rebase_source : cfec2d96faeb11656d86d760a34e0a04cacddb13
extra : intermediate-source : 6176724d63788b0fe8caa3f91607c2d93dbaa7ec
extra : source : eebbb0600447f9b64aae3bcd47b4be66c02a51ea
2017-11-05 19:37:28 -08:00
Kris Maglione
9188b197f6 Bug 1323845: Part 1 - Support multiple schema root namespaces. r=aswan
MozReview-Commit-ID: DfOjHGzLJro

--HG--
extra : rebase_source : 9dcd2ff1c93e41eb9771068e65aad350d295ba18
extra : absorb_source : d43bc1bff19576fe07a4cd33efa3b6df63954570
extra : histedit_source : 4f1d31ab7b09a36b4e5d6220d71185becef47ea8%2Cad4b2eaa4d1535a67e41e6e379d13893f56d1eaf
2017-12-16 15:05:13 -06:00
Csoregi Natalia
b64306c51a Merge mozilla-central to inbound. r=merge a=merge CLOSED TREE 2018-01-13 00:04:06 +02:00
Sylvestre Ledru
b9a138ff91 Bug 1418425 - Remove libbz2 files as we were only using it for crc32 as the updater moved to lzma r=glandium
MozReview-Commit-ID: 8Sz8vtV0b5G

--HG--
extra : rebase_source : 8b239e9851c9e05a8df64068790b6b1984ff1732
2017-11-24 16:45:47 +01:00
Narcis Beleuzu
26be8043ca Backed out 5 changesets (bug 1418425) for windows build bustage "mbsdiff.exe : fatal error LNK1120". on a CLOSED TREE
Backed out changeset 8154486d3e00 (bug 1418425)
Backed out changeset d32ae48690a7 (bug 1418425)
Backed out changeset 772538a846cb (bug 1418425)
Backed out changeset 29fd023f999f (bug 1418425)
Backed out changeset 218077e82115 (bug 1418425)
2018-01-12 11:32:58 +02:00
Sylvestre Ledru
6c3b68c5e8 Bug 1418425 - Remove libbz2 files as we were only using it for crc32 as the updater moved to lzma r=glandium
MozReview-Commit-ID: 8Sz8vtV0b5G

--HG--
extra : rebase_source : 00ea1457bc84584bf272164570dda8a6e55ca4b6
2017-11-24 16:45:47 +01:00
Margareta Eliza Balazs
a331a849a4 Backed out changeset 6d539e4a02bd (bug 1403519) for lint failures on a CLOSED TREE 2018-01-11 22:32:27 +02:00
Kris Maglione
10f6c3bb88 Bug 1429898: Add active extension details to profiler metadata. r=mstange
MozReview-Commit-ID: CR64i73B4ys

--HG--
extra : rebase_source : cc455a45326921cd1cc60bfbaf1a39bcd18df314
2018-01-11 12:38:31 -08:00
Mark Banner
e11ad103d3 Bug 1429705 - Enable ESLint rule mozilla/use-services for tools/profiler. r=mstange
MozReview-Commit-ID: elODEiff9w

--HG--
extra : rebase_source : fb25e0a840f21a09759aca04f643aa74e78b1207
2018-01-10 19:16:17 +00:00
Andrew Halberstadt
14685fa5e9 Bug 1429223 - [lint] Obsolete the eslintvalidate hooks by printing error message with upgrade path, r=standard8
This replaces the eslintvalidate hooks with an error message
prompting the user to upgrade to tools/lint/hooks.py.

The reasons for deprecating eslintvalidate are twofold:

1) It only runs eslint, so developers might miss errors from
other linters.

2) It isn't as well maintained, and I've started to see
reports of problems in the wild. It doesn't make sense to
maintain two sets of hooks that do the same thing.

MozReview-Commit-ID: CseeVIof2om

--HG--
extra : rebase_source : e859c368d14cd1bf7e7d85f0de5bbb89e88402d9
2018-01-09 20:03:58 -05:00
Alexandre Poirot
f572e41c43 Bug 1423890 - Add markers for background hangs r=dthayer,mstange
MozReview-Commit-ID: 484UZEbbd12

--HG--
extra : rebase_source : f739ce23944205cb88e8ea40289c8de6f07d1034
2017-12-07 02:35:36 -08:00
James Graham
5080014924 Bug 1428585 - Fixup flake8 error, r=me ON A CLOSED TREE
MozReview-Commit-ID: HbmZzerSQUd
2018-01-09 15:47:06 +00:00
James Graham
4cf161480a Bug 1428585 - Fail the wpt lint if the lint process has a non-zero exit code, r=ahal
MozReview-Commit-ID: GiUewbmru37
2018-01-09 14:46:04 +00:00