3742 Commits
Author SHA1 Message Date
bcoles 0f815a203a sfwebui: Update jQuery 3.6.0 to 3.7.1 (#1822) 2023-11-05 19:36:23 +01:00
bcoles 313b82a4ad sfwebui: Use user-defined doc root path for static JS (#1821) 2023-11-05 19:36:06 +01:00
bcoles e17b230f75 SpiderFootHelpers: buildGraphGexf: set color alpha channel to 1 (#1819) 2023-11-05 19:35:48 +01:00
bcoles 1a9bcd79ef sf: allow 60 seconds for post-scan correlations to complete (#1818) 2023-11-05 19:35:29 +01:00
bcoles e84db07ffa sfp_google_tag_manager: Add Google Tag Manager (GTM) module (#1817) 2023-10-30 08:10:59 +01:00
bcoles 0373676c39 sfp_webanalytics: Add match for Google Tag Manager (#1816) 2023-10-30 08:04:02 +01:00
bcoles f37b98eea9 sfcli: Add help for 'export' command (#1809) 2023-09-13 10:18:29 +02:00
smicallef 6e8e6a8277 sfp_accounts: Fix False comparison operator 2023-08-18 07:47:39 +02:00
smicallef 12ab8f2f8c sfp_accounts: Updated to handle https://github.com/WebBreacher/WhatsMyName/issues/738 2023-08-18 07:40:03 +02:00
RA80533 d8f628bf3c Improve type annotations in spiderfoot/target.py (#1777)
* Improve type annotations in target.py

* Create `TargetAlias` for better typing

* Annotate `alias`

* Update documented types

* Simplify `TargetAlias` definition

* Use `typing.Dict` instead of `dict`

* Use `typing.List` instead of `list`

* Refactor `TargetAlias` to not use `Literal`

`typing.Literal` is not available in Python 3.7.

* Conditionally use `TypedDict`

* Describe version check

* Remove `TYPE_CHECKING` check
2023-05-03 11:44:55 +02:00
RA80533 d7e91b03e8 Add type annotations to functions in spiderfoot/helpers.py (#1771)
Adds additional type annotations to a handful of functions in helpers.py in order to their improve clarity.
2023-05-03 11:44:27 +02:00
bcoles b0d2ccc54a sfcli: Add -f [file] option to export command (#1764) 2023-03-27 10:11:46 +02:00
bcoles 9746aa13a9 sflib: Move sslDerToPem to SpiderFootHelpers.sslDerToPem() (#1761) 2023-03-01 13:22:38 +01:00
bcoles 27ac7a3884 sfp_tool_dnstwist: Sanitize domain name before processing (#1758) 2023-02-22 19:44:41 +01:00
smicallef 0ca99aaced sfp_tool_dnstwist: Check for wildcard DNS before testing. 2023-02-21 20:05:46 +01:00
smicallef d780b7f618 sfp_similar: Check for wildcard DNS on TLDs before checking. 2023-02-21 20:05:20 +01:00
smicallef 5572ddec8e sfp_hostio: Handle multiple email addresses returned. 2023-02-21 13:14:55 +01:00
bcoles b546f9bc45 Tests: Run flake8 lint test before pytest (#1757)
* Tests: Add Python version 3.10 to GitHub tests workflow

* Tests: Run flake8 lint test before pytest
2023-02-21 13:08:01 +01:00
bcoles 4251bd54ca flake8: resolve flake8 violations (#1756) 2023-02-20 20:12:21 +01:00
bcoles c6d7afb640 requirements: Update requirements (#1755) 2023-02-19 08:42:19 +01:00
bcoles 8557c2cd52 test: unit: modules: Ensure each module dataSource has a description (#1754) 2023-02-19 08:41:34 +01:00
bcoles 9a56510dc2 sfp_fsecure_riddler: Check for login failure (#1753) 2023-02-19 08:41:13 +01:00
smicallef c8a91b22b4 sfp_tool_testsslsh: Generate IP address events for netblocks. 2023-02-15 10:58:30 +01:00
smicallef 87e49991a3 sfp_tool_testsslsh: Added ability to filter on criticality. 2023-02-14 13:37:28 +01:00
smicallef d97d4de102 sfp_shodan: Add missing IP_ADDRESS event being reported. 2023-02-14 13:02:05 +01:00
smicallef a8a7e7a124 Merge branch 'master' of https://github.com/smicallef/spiderfoot 2023-02-07 13:07:52 +01:00
smicallef 6517c50da8 sfp_tool_whatweb: Enforce a timeout to prevent being blocked. 2023-02-07 13:07:28 +01:00
smicallef a5ac79a8eb sfp_tool_testsslsh: Enforce a timeout to prevent being blocked. 2023-02-07 13:07:06 +01:00
smicallef d8b02b1ce3 sfp_tool_trufflehog: Enforce a timeout to prevent being blocked. 2023-02-07 13:06:45 +01:00
smicallef 38a417e8af sfp_tool_wafw00f: Enforce a timeout to prevent being blocked. 2023-02-07 13:06:28 +01:00
smicallef 935ff33760 sfp_tool_snallygaster: Enforce a timeout to prevent being blocked. 2023-02-07 13:06:08 +01:00
smicallef f8adb5b2ea sfp_tool_onesixtyone: Enforce a timeout to prevent being blocked. 2023-02-07 13:05:44 +01:00
smicallef 75fbbacb96 sfp_tool_nbtscan: Enforce a timeout to prevent being blocked. 2023-02-07 13:05:19 +01:00
smicallef 959f50c1be sfp_dnstwist: Enforce a timeout to prevent being blocked. 2023-02-07 13:04:16 +01:00
Marcus Chong 00d7515938 bugfix for nist cve data parsing (#1746) 2023-01-16 17:09:22 +01:00
smicallef f91054ee40 sfp_names: Update trusted list of modules. 2022-12-15 21:02:56 +01:00
smicallef 5e23bc4c57 sfp_names: Update list of trusted modules for processing RAW_RIR_DATA. 2022-12-15 15:49:43 +01:00
smicallef 2666900a3d sfp_venmo: Report HUMAN_NAME events directly, not relying on sfp_names. 2022-12-15 15:47:51 +01:00
smicallef 4d8f551006 sfp_arin: Report HUMAN_NAME directly rather than relying on sfp_names. 2022-12-15 15:39:57 +01:00
smicallef 01956788d9 Removed associated sfp_instagram references. 2022-12-15 15:39:37 +01:00
smicallef dcae5ae82a sfp_instagram: Removed as this doesn't appear to work anymore. 2022-12-15 15:38:35 +01:00
smicallef 204e74ecf8 sfp_dnscommonsrv: Add a timeout to DNS queries. 2022-12-15 13:29:39 +01:00
smicallef e21cbac8a8 Add missing RAW_RIR_DATA producedEvents() declarations. 2022-11-25 20:28:05 +01:00
smicallef 74419c2e4b sfp_dnsresolve: Remove SEARCH_ENGINE_WEB_CONTENT. 2022-11-25 19:56:18 +01:00
smicallef 47ac54d22e Remove SEARCH_ENGINE_WEB_CONTENT events since they are redundant. 2022-11-25 19:55:11 +01:00
smicallef c7016af429 sfp_spider & helpers: Reduce false positive links and clean content
type reported.
2022-11-10 13:10:35 +01:00
smicallef 138130c29d sfp_leakix: Link events to more appropriate source events. 2022-11-09 14:23:48 +01:00
smicallef 9f8ebc38c0 sfp_leakix: Use correct hostname field in API response. 2022-11-09 11:45:02 +01:00
smicallef 3ce4bd6d10 sfp_greynoise & sfp_greynoise_community: Remove reporting of
non-malicious entities.
2022-11-09 11:30:37 +01:00
smicallef 71822ca281 README.md: Removed Bad Packets. 2022-11-09 11:08:55 +01:00