5159 Commits

Author SHA1 Message Date
Andrey Konovalov
853595a523
Update setup_ubuntu-host_qemu-vm_x86-64-kernel.md 2020-06-19 12:45:27 +02:00
Dmitry Vyukov
03658df6d9 sys/syz-sysgen: be less verbose if no errors happened
There is little point in printing all targets if no errors happened.
Generation is fast, so this is not even working as a "progress bar".
Only print target if there are any errors.
2020-06-19 11:56:47 +02:00
Dmitry Vyukov
9d10abe406 Makefile: don't reset jobserver
Re-exporting -j resets make jobserver. Don't do that.
Only export -j in top level make invocation.
2020-06-19 11:56:47 +02:00
Dmitry Vyukov
b621d37e81 tools/syz-make: reduce number of make jobs
Ensure that we have at least 1GB per Go compiler/linker invocation.
Go compiler/linker can consume significant amount of memory
(observed to consume at least 600MB). See #1276 for context.
And we have parallelization both on make and on go levels,
this can severe oversubscribe RAM.
Note: the result can be significantly lower than the CPU number,
but this is fine because Go builds/tests are parallelized internally.
2020-06-19 11:56:47 +02:00
Dmitry Vyukov
f7a1d89892 Makefile: cosmetic fixes
1. Use --no-print-directory.
These "Entering directory"/"Leaving directory" messages are completely useless.

2. Use go build instead of go install.
This is just to test build and we don't install anything otherwise.
Don't mess with GOAPTH/bin unnecessarily.

3. Don't export MAKEFLAGS.
It is exported by default.

4. Suppress descriptions up-to-date check output.
It's cryptic and is not particularly useful.
2020-06-19 11:56:47 +02:00
Alexander Egorenkov
bc258b506d pkg: support compiler triple for 'nm' and 'addr2line'
In preparation to support big-endian architectures.
2020-06-18 19:31:40 +02:00
Jiaheng Hu
b1b22865fc sys/linux: add descriptions for new tipc crypto APIs
Added the TIPC_NLA_NODE_KEY and TIPC_NLA_NODE_ID fields in the
socket_tipc_netlink.txt file. Created a new struct to hold the key.
Created two new descriptions for TIPC_NL_KEY_SET and TIPC_NL_KEY_FLUSH.
The related kernel commits can be seen in
https://git.kernel.org/linus/134bdac39766 and
https://git.kernel.org/linus/e1f32190cf7d.
2020-06-18 09:38:16 -07:00
Jiaheng Hu
c4293ba092 CONTRIBUTORS: add Jiaheng Hu 2020-06-18 09:38:16 -07:00
Alexander Egorenkov
7c48e54f9c pkg/ipc: support C compiler in non-standard location
If C compiler is installed e.g. in /opt then
we have to import LD_LIBRARY_PATH.

Signed-off-by: Alexander Egorenkov <Alexander.Egorenkov@ibm.com>
2020-06-18 16:48:02 +02:00
Marco Elver
3ea11d3f9e docs/syzbot: Update KCSAN related information 2020-06-18 14:24:47 +02:00
Amit Cohen
d45a4d69d8 sys/linux: add support for devlink trap syscalls
Add support for set of devlink trap interface syscalls.

Signed-off-by: Amit Cohen <amitc@mellanox.com>
2020-06-17 18:13:33 +02:00
Amit Cohen
84586a4955 sys/linux/socket_netlink_generic_devlink: use template type for netlink msg
Add template type for netlink msg with CMD and POLICY as
arguments, it can be used for all sendmsg calls in this file.

Refactor the existing code.

Signed-off-by: Amit Cohen <amitc@mellanox.com>
2020-06-17 18:13:33 +02:00
Alexander Egorenkov
9466f7f96e executor: enable KVM generator only on AMD64 arch
Executor KVM generator works only on amd64 linux machines.

Signed-off-by: Alexander Egorenkov <Alexander.Egorenkov@ibm.com>
2020-06-17 17:43:56 +02:00
Andrey Konovalov
4d2d1ebee3 pkg/report: stop using questionable frames
Most likely reports without proper stack traces were caused by a bug in the
unwinder and are now fixed in 187b96db5ca7 "x86/unwind/orc: Fix
unwind_get_return_address_ptr() for inactive tasks".

Disable trying to use questionable frames for now.

Fixes #1834
2020-06-17 17:42:50 +02:00
Dmitry Vyukov
2e1749a138 CODEOWNERS: remove * entry
Github started adding me as reviewer on all PRs.
This is quite inconvinient because I can't figure out
if author really wants my review, or I was added just because of
the * entry. And then I can't remove myself.
Since I am looking at all PRs anyway, let's try without the * entry.
2020-06-17 17:22:57 +02:00
Dmitry Vyukov
5ee7e3e388 codecov.yml: switch to informational mode
Informational mode should always produce "pass" result:
https://docs.codecov.io/docs/commit-status#informational

I can't get anything useful of these notifications.
E.g. now we have patches that add 1 line,
which gives 0% patch coverage, which results in a failure.
But we have some packages/commands not tested at all,
so we can't require contributors to make that covered.

For overall project coverage I also have not seen
any useful pass/fail results. The criteria highly depends
on the nature of the change. If we set the threshold too low,
we will get lots of effectively false failures. The current 50%
setting effectively means "never fail" anyway.
2020-06-17 17:18:23 +02:00
Ayushi Sharma
b6c46f4351
sys/netbsd: adding filesystem and communication syscalls (#1826) 2020-06-17 02:40:05 -07:00
Andrey Konovalov
b9f3810bc5
Update external_fuzzing_usb.md 2020-06-17 00:35:00 +02:00
Dmitry Vyukov
559fbe2dbe syz-fuzzer: don't include disabled syscall name in panics
These checks still fire episodically [on gvisor instance only?].
I've done several attempts to debug this/extend checks.
But so far I have no glue and we are still seeing them.
They are rare enough to be directly debuggable and to be
something trivial. This may be some memory corruption
(kernel or our race), or some very episodic condition.
They are rare enough to be a problem, so don't include
syscall name so that they all go into a single bug bucket.
2020-06-16 16:10:59 +02:00
Andrey Konovalov
3674152277
Update external_fuzzing_usb.md 2020-06-16 15:36:50 +02:00
Andrey Konovalov
e161d77ee2
Update external_fuzzing_usb.md 2020-06-16 15:31:24 +02:00
Andrey Konovalov
6a34f5e831
Update syzbot.md 2020-06-16 15:17:49 +02:00
Jukka Kaartinen
4ea9d9646e tools/syz-crush: Add debug option
Signed-off-by: Jukka Kaartinen <jukka.kaartinen@unikie.com>
2020-06-16 12:43:23 +02:00
Dmitry Vyukov
baca261187 tools/syz-crush: use standard log package
We always use verbosity 0, there is no point in using
our custom package. Switch to the standard one instead.
2020-06-15 18:57:58 +02:00
Dmitry Vyukov
911738ed1f tools/syz-crush: simplify and tidy
As discussed in #1798.
2020-06-15 18:57:58 +02:00
Jukka Kaartinen
f56b572638 tools/syz-crush: Add feature to run C-program
usage:
  syz-crush -config=config.json creprog.c

Produced output is same as syz-manager produces.
New directory called reproduced_with is added that lists all the
reproducers that triggered the crash.

Example:

~/workdir/crashes  $ tree
.
├── 2a8fff76c6267ecfeaf3530a602ed48afbc4a151
│   ├── description
│   ├── log0
│   ├── log1
│   ├── log2
│   ├── report0
│   ├── report1
│   ├── report2
│   └── reproduced_with
│       └── 17a6ed226769660f3e5dad7b22b13466b938e290.c
├── 2b6b921457afe8cebd0a96ca40f8569e6ee95174
│   ├── description
│   ├── log0
│   ├── log1
│   ├── log2
│   ├── log3
│   ├── log4
│   ├── log5
│   ├── report0
│   ├── report1
│   ├── report2
│   ├── report3
│   ├── report4
│   ├── report5
│   └── reproduced_with
│       ├── 9fb2f5b37bf4428382334e336bbbb201634c7c4c.c
│       └── ab27002b46d19cafb1ebb8b040f0a3b0f8f88974.c

Signed-off-by: Jukka Kaartinen <jukka.kaartinen@unikie.com>
2020-06-15 18:41:13 +02:00
Marco Elver
8e3ab94116 executor: Improve used terminology
Improve used terminology by using better verbs to express the effect of
the whitelist/blacklist.

This also changes executor to exclusively show respectful log messages,
and as per recent conversion, converts the last such case.
2020-06-15 09:56:18 +02:00
Dmitry Vyukov
2a22c77acf .github: add CODEOWNERS
This should automatically assign reviewers/cc corresponding developers.
Add codeowners for OSes for which we have committers.

For details see:
https://help.github.com/en/github/creating-cloning-and-archiving-repositories/about-code-owners
2020-06-14 12:06:43 +02:00
Dmitry Vyukov
4ec126bcb7 syz-ci: report all build errors
Currently we are specifically picky about what errors
during build process are reported and what are not reported.
E.g. if we fail to create some temp file due to ENOSPSC,
we don't want to send email to all kernel developers.
However, we have not seen lots of infra failures and
we've seen silent errors which were unnoticed and/or
caused confusion as to what happens and why kernels
are not updated.

Report all errors.
If needed later we may explicitly ignore some errors instead.

Fixes #1777
2020-06-14 11:48:08 +02:00
Dmitry Vyukov
f5ba047583 pkg/build: extract "multiple definition" linker errors 2020-06-14 11:48:08 +02:00
TheOfficialFloW
2e9b5f5949 sys/linux/l2cap.txt: fix structs 2020-06-14 09:01:52 +02:00
Dmitry Vyukov
a61674a581 sys/linux: fix some warnings in descriptions
syz-check pointed to a new batch of bugs in descriptions.
Fix them.
2020-06-13 20:50:20 +02:00
Dmitry Vyukov
6378506674 tools: update ietf link to the latest version 2020-06-13 20:04:08 +02:00
Dmitry Vyukov
83af9a2cef sys/linux: regenerate .warn files
On latest kernel, with latest *.txt files and with kernels compiled with
-fno-eliminate-unused-debug-types -fno-eliminate-unused-debug-symbols flags.
2020-06-13 19:56:20 +02:00
Dmitry Vyukov
3637706c07 tools/syz-check: fix bug with struct name overwrite
We patched name in struct object, but the dwarf package
caches then and then can return in subsequent invocations.
This causes a struct name to be overwritten by typedef name.
Don't mutate returned struct objects.
2020-06-13 19:56:20 +02:00
Dmitry Vyukov
a9bc67ccc6 dashboard/config: update config to next-20200613 2020-06-13 19:30:12 +02:00
m00nbsd
dbce178a0e
sys/netbsd: support multiple vHCI buses (#1822) 2020-06-13 12:10:16 +02:00
Andrey Konovalov
205b2ba418 docs/syzbot.md: update notes on USB 2020-06-13 11:38:41 +02:00
Nicolas Lacasse
db5f1d07c3 vm/gvisor: Send debug logs to stderr so they can be read by syzkaller
The -alsologtostderr flag is a noop if -panic-log is also set. So before
this change, debug logs were not included in the syzkaller output logs.

By setting -debug-log=/dev/stderr, all debug logs are sent to stderr,
which syzkaller scrapes and includes in the output logs.
2020-06-13 11:27:59 +02:00
Andrey Konovalov
f4724dd308 sys/linux: move vhci stuff to dev_vhci.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
835efa70b0 sys/linux: rename vhci.txt to dev_vhci.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
4ece6be9e2 sys/linux: rename watch_queue.txt to dev_watch_queue.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
b798117396 sys/linux: rename trusty.txt to dev_trusty.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
ef27ba34a6 sys/linux: rename mptcp.txt to vnet_mptcp.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
af47d1d5c0 sys/linux: rename ipvs.txt to netfilter_ipvs.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
8ddccc2581 sys/linux: rename fsverity.txt to fs_ioctl_fsverity.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
2a2ff48439 sys/linux: rename fscrypt.txt to fs_ioctl_fscrypt.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
562406d573 sys/linux: rename fuse.txt to fs_fuse.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
9a5c775864 sys/linux: rename 9p.txt to fs_9p.txt 2020-06-12 18:42:12 +02:00
Andrey Konovalov
c94245053a sys/linux: rename fs_btrfs.txt to fs_ioctl_btrfs.txt 2020-06-12 18:42:12 +02:00