10727 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nicolai Søborg	a44191a9b1	Add --show-ignored-hosts (#6720) ... * Add `--show-ignored-hosts` Maybe a bit counterintuitive, but mitmproxy is very nice even without the MITM part. When doing `--ignore-hosts '.*'` it is not possible to see SNI's, so add new flag to show the raw TCP/UDP streams. Fixes #6421 * Add tests for `--show-ignored-hosts` * Changelog for `--show-ignored-hosts` * [autofix.ci] apply automated fixes * fixups --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <github@maximilianhils.com>	2024-10-01 15:28:28 +00:00
Rūdolfs Bundulis	72a0448566	Propogate end_stream from downstream http/2 requests (#7196) ... * Propogate end_stream from downstream http/2 requests * [autofix.ci] apply automated fixes * add test, simply patch *) add test to check if end_stream is propogated on request / response *) simplify the patch * [autofix.ci] apply automated fixes * fix linting in is_websocket * adjust websocket test * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-09-30 18:49:25 +00:00
Matteo Luppi	e1ea491ad7	expose available web columns to Python (#7205) ... * add script to generate all possible web columns * remove test for now * Make web_columns.py executable * [autofix.ci] apply automated fixes * add back tests * [autofix.ci] apply automated fixes * update changelog * update changelog and add coauthor Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Abhishek-Bohora <abhishek.bohora16@gmail.com>	2024-09-22 19:21:41 +02:00
kennytm	48c096ff13	allow custom content view to refer to the current websocket message (#7204)	2024-09-22 19:20:09 +02:00
Maximilian Hils	badb2e52dd	ruff: make mitmproxy_rs first party (#7203)	2024-09-22 07:27:00 +02:00
Maximilian Hils	f8b742753b	Enable HTTP/3 in transparent mode by default (#7202) ... * fixup raw quic handling * enable HTTP/3 in transparent mode by default * fix nits	2024-09-21 14:29:31 +00:00
Maximilian Hils	358fca3e72	tls_version: QUIC -> QUICv1 (#7201) ... * tls_version: QUIC -> QUICv1 this aligns us with what OpenSSL is returning * tests: add quic dumpfile	2024-09-21 16:22:09 +02:00
Maximilian Hils	8964deda8a	strip HTTPS records ALPN if http3 is disabled (#7185) ... * strip HTTPS records ALPN if http3 is disabled * Update strip_dns_https_records.py * Update strip_dns_https_records.py * [autofix.ci] apply automated fixes * Update strip_dns_https_records.py * [autofix.ci] apply automated fixes * Update strip_dns_https_records.py --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-19 17:42:35 +00:00
Blake Burkhart	8ff173a0aa	Support empty string as marker in flow.mark (#7192) ... * Support empty string in flow.mark "Un-set all marks" is implemented as `flow.mark @all false` _MarkerType() coerces False into "", but this was previously unsupported.	2024-09-19 16:03:08 +02:00
Alexander Prinzhorn	ccb3ae5abe	Fix concepts-filters.md docs	2024-09-19 07:52:47 +00:00
Thomas Kriechbaumer	2c1802692d	options: add request_client_cert to enable mutual TLS (#7175) ... * options: add request_client_cert to enable mutual TLS This capability was already built-in but hard-coded to be disabled. Making it configurable as option (defaulting to off) enables mTLS connections between clients and mitmproxy. If true, mitmproxy will send a TLS `CertificateRequest` message to the client during the TLS handshake, upon which a client needs to present a client certificate to mitmproxy to successfully establish an mTLS connection. This option can be used together with the `client_certs` option to also establish an mTLS connection between mitmproxy and the upstream server. In this case, mitmproxy needs to have a full client cert, including matching private key, that is trusted and accepted by the upstream server. This is a common scenario with MQTT or IoT connections. Example usage: $ mitmproxy --set request_client_cert=True --set client_certs=some_directory/ With `some_directory/` containing a `mqtt.example.com.pem` x509 certificate file (including private key). This allows a client connecting using mTLS, to be intercepted by mitmproxy, which is itself establishing an mTLS connection to the `mqtt.example.com` upstream server. Restricting the client_certs using a directory and PEM files named after the upstream domain, narrows down the mTLS requirement to this single domain, while leaving all other traffic through mitmproxy untouched (normal TLS without client certs). * add CHANGELOG entry * docs++ * swap section order, re-add example --------- Co-authored-by: Maximilian Hils <git@maximilianhils.com> Co-authored-by: Maximilian Hils <github@maximilianhils.com>	2024-09-18 19:48:41 +02:00
Maximilian Hils	b53d2bd19a	Split mitmproxy.proxy.layers.quic into subpackages (#7187) ... * individual coverage: skip logic-free __init__ files * split quic layer into subpackages this commit should not introduce any functional changes	2024-09-18 22:52:51 +05:30
Maximilian Hils	e7d1ad69b9	Individual coverage: skip logic-free __init__ files (#7186) ... individual coverage: skip logic-free __init__ files	2024-09-18 22:37:12 +05:30
Maximilian Hils	68c4e9ff35	proxy server: skip modes without listen_port when calculating conflicts (#7177) ... * proxy server: skip modes without listen_port when calculating conflicts * lint! * docs++	2024-09-16 17:01:49 +05:30
Denis Stanishevsky	eec3214dfc	Fix of duration in import from HAR (#7179) ... * Fix of measurement unit in HAR import, duration is in milliseconds * Update CHANGELOG.md * Fixes of "timestamp_end" in test samples * [autofix.ci] apply automated fixes --------- Co-authored-by: Denis Stanishevskiy <> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-16 13:12:39 +02:00
Gaurav Jain	9369bc8d76	Fix error while changing string-based options (#7183) ... Fix widget text access	2024-09-16 13:12:07 +02:00
Maximilian Hils	65db82f4cf	mitmweb: cache executable icons (#7178) ... web: cache executable icons	2024-09-11 22:03:17 +02:00
Jason S	4087b2105d	added chown for .mitmproxy volume (#7168) ... * added chown for .mitmproxy volume * corrected chown I think * one more try, this time with some feeling	2024-09-09 14:08:03 +02:00
Matteo Luppi	9740477e8b	Feature/local applications selector (#7141) ... * add refresh icon * first draft drop down * create logic to store and display current applications + fix old tests * [autofix.ci] apply automated fixes * filter applications based on the input * add classname prop to popover * add icon classname to popover * change design local dropdown and applications list * adjust focus popover and dropdown * fetch all current processes * [autofix.ci] apply automated fixes * add icon while fetching * adjust icon rendering * remove icon from interface * add possibility to remove application * remove checkmarks popover * fix icon application * [autofix.ci] apply automated fixes * move popover to the bottom * fix clasname test * loading lazy img * move processes to a redux state * change naming variables * [autofix.ci] apply automated fixes * leftover * adjust naming style * update snapshot * move the current processes in a dedicated redux state * not use display_name anymore for spec * [autofix.ci] apply automated fixes * add comments * add tests local dropdown --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-09 13:38:35 +02:00
Maximilian Hils	4be97958cf	bump mitmproxy_rs (#7165) ... * bump mitmproxy_rs * Update pyproject.toml * don't build github web ui branches	2024-09-06 10:07:45 +00:00
Matteo Luppi	8195d686ce	improve UX reverse dropdown (#7164) ... * use select * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-06 11:00:44 +02:00
Maximilian Hils	9a8f761cf7	Upgrade to mitmproxy_rs 0.8 (#7162) ... * upgrade to mitmproxy_rs 0.8 * [autofix.ci] apply automated fixes * Update pyproject.toml --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-04 23:36:55 +02:00
Matteo Luppi	59129de1fb	Improve design capture page (#7160) ... * improve style capture page * use left-border * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-04 16:23:06 +02:00
Matteo Luppi	401b5c0198	add popover to reverse mode (#7161)	2024-09-04 15:23:37 +02:00
Matteo Luppi	d18e21fb76	Click on mode's label to activate it (#7153) ... * add click event on label to activate mode * use <label> tag instead of <span>	2024-09-04 15:01:09 +02:00
dependabot[bot]	a5b5963d8c	Bump the github-actions group across 1 directory with 2 updates (#7151) ... * Bump the github-actions group across 1 directory with 2 updates Bumps the github-actions group with 2 updates in the / directory: [mhils/workflows](https://github.com/mhils/workflows) and [docker/build-push-action](https://github.com/docker/build-push-action). Updates `mhils/workflows` from 8 to 10 - [Release notes](https://github.com/mhils/workflows/releases) - [Commits](https://github.com/mhils/workflows/compare/v8...v10) Updates `docker/build-push-action` from 6.5.0 to 6.7.0 - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](5176d81f87...5cd11c3a4c) --- updated-dependencies: - dependency-name: mhils/workflows dependency-type: direct:production update-type: version-update:semver-major dependency-group: github-actions - dependency-name: docker/build-push-action dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <support@github.com> * Update main.yml --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-09-01 23:22:10 +02:00
dependabot[bot]	f054e38467	Update tox requirement from <=4.16.0,>=4.15.1 to >=4.15.1,<=4.18.0 (#7150) ... Updates the requirements on [tox](https://github.com/tox-dev/tox) to permit the latest version. - [Release notes](https://github.com/tox-dev/tox/releases) - [Changelog](https://github.com/tox-dev/tox/blob/main/docs/changelog.rst) - [Commits](https://github.com/tox-dev/tox/compare/4.15.1...4.18.0) --- updated-dependencies: - dependency-name: tox dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:58:10 +00:00
dependabot[bot]	c8b03ca89d	Update pdoc requirement from <=14.6.0,>=14.5.1 to >=14.5.1,<=14.6.1 (#7146) ... Updates the requirements on [pdoc](https://github.com/mitmproxy/pdoc) to permit the latest version. - [Changelog](https://github.com/mitmproxy/pdoc/blob/main/CHANGELOG.md) - [Commits](https://github.com/mitmproxy/pdoc/compare/v14.5.1...v14.6.1) --- updated-dependencies: - dependency-name: pdoc dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:56:57 +00:00
dependabot[bot]	c064046823	Update pyparsing requirement from <=3.1.2,>=2.4.2 to >=2.4.2,<=3.1.4 (#7149) ... Updates the requirements on [pyparsing](https://github.com/pyparsing/pyparsing) to permit the latest version. - [Release notes](https://github.com/pyparsing/pyparsing/releases) - [Changelog](https://github.com/pyparsing/pyparsing/blob/master/CHANGES) - [Commits](https://github.com/pyparsing/pyparsing/compare/pyparsing_2.4.2...3.1.4) --- updated-dependencies: - dependency-name: pyparsing dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:56:49 +00:00
dependabot[bot]	657ebd17c2	Update ruff requirement from <=0.5.5,>=0.5.0 to >=0.5.0,<=0.6.3 (#7147) ... Updates the requirements on [ruff](https://github.com/astral-sh/ruff) to permit the latest version. - [Release notes](https://github.com/astral-sh/ruff/releases) - [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md) - [Commits](https://github.com/astral-sh/ruff/compare/0.5.0...0.6.3) --- updated-dependencies: - dependency-name: ruff dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:56:45 +00:00
dependabot[bot]	17d424fdc3	Update protobuf requirement from <=5.27.3,>=5.27.2 to >=5.27.2,<=5.28.0 (#7148) ... Updates the requirements on [protobuf](https://github.com/protocolbuffers/protobuf) to permit the latest version. - [Release notes](https://github.com/protocolbuffers/protobuf/releases) - [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl) - [Commits](https://github.com/protocolbuffers/protobuf/compare/v5.27.2...v5.28.0) --- updated-dependencies: - dependency-name: protobuf dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:43:24 +00:00
dependabot[bot]	5ac3c9a11e	Update wheel requirement from <=0.43,>=0.36.2 to >=0.36.2,<=0.44.0 (#7145) ... Updates the requirements on [wheel](https://github.com/pypa/wheel) to permit the latest version. - [Release notes](https://github.com/pypa/wheel/releases) - [Changelog](https://github.com/pypa/wheel/blob/main/docs/news.rst) - [Commits](https://github.com/pypa/wheel/compare/0.36.2...0.44.0) --- updated-dependencies: - dependency-name: wheel dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:43:15 +00:00
dependabot[bot]	256fc2e94c	Update mypy requirement from <=1.11.1,>=1.10.1 to >=1.10.1,<=1.11.2 in the mypy group (#7144) ... Update mypy requirement in the mypy group Updates the requirements on [mypy](https://github.com/python/mypy) to permit the latest version. Updates `mypy` to 1.11.2 - [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md) - [Commits](https://github.com/python/mypy/compare/v1.10.1...v1.11.2) --- updated-dependencies: - dependency-name: mypy dependency-type: direct:production dependency-group: mypy ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:42:44 +00:00
dependabot[bot]	917697126d	Bump the pytest group with 2 updates (#7143) ... Updates the requirements on [hypothesis](https://github.com/HypothesisWorks/hypothesis) and [pytest-asyncio](https://github.com/pytest-dev/pytest-asyncio) to permit the latest version. Updates `hypothesis` to 6.111.2 - [Release notes](https://github.com/HypothesisWorks/hypothesis/releases) - [Commits](https://github.com/HypothesisWorks/hypothesis/compare/hypothesis-python-6.104.2...hypothesis-python-6.111.2) Updates `pytest-asyncio` to 0.24.0 - [Release notes](https://github.com/pytest-dev/pytest-asyncio/releases) - [Commits](https://github.com/pytest-dev/pytest-asyncio/compare/v0.23.6...v0.24.0) --- updated-dependencies: - dependency-name: hypothesis dependency-type: direct:production dependency-group: pytest - dependency-name: pytest-asyncio dependency-type: direct:production dependency-group: pytest ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2024-09-01 20:42:21 +00:00
Matteo Luppi	46c10c030e	add 2 new endpoints for processes extraction and process image (#7136) ... * add 2 new endpoints for processes extraction and process image * [autofix.ci] apply automated fixes * add review changes * add tests * [autofix.ci] apply automated fixes * nit * update tests * [autofix.ci] apply automated fixes * add fallback image and update tests * [autofix.ci] apply automated fixes * fix lint error * fix tests * [autofix.ci] apply automated fixes * try to use base64 * still trying to fix test on win * [autofix.ci] apply automated fixes * nit * [autofix.ci] apply automated fixes * TRANSPARENT_PNG: use raw bytes to avoid base64 step * tests: use feature-based detection * hardening: prevent mime type sniffing * fixup feature detection --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-09-01 20:22:51 +00:00
Maximilian Hils	f2500dd0ae	Warn if TLS version is unsupported by OpenSSL (#7139) ... * warn if TLS version is unsupported by OpenSSL fix #7138 * [autofix.ci] apply automated fixes * coverage++ --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-08-31 12:32:12 +05:30
Kirill A. Korinsky	36df8c8fac	Use loop.add_signal_handler on supported platforms (#7130) ... * Use loop.add_signal_handler on supported platforms The root cause is fixing #7128 * simplify --------- Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-08-28 22:33:08 +02:00
Maximilian Hils	343ad7aa72	DNS resolver: add getaddrinfo fallback, fix test duration (#7122) ... * dns addon: add getaddrinfo fallback, fix test duration * fix docstring * fix tests * [autofix.ci] apply automated fixes * tests++ * [autofix.ci] apply automated fixes * debug windows * add Windows workaround --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-08-29 00:06:58 +05:30
Matteo Luppi	92faf3959f	Feature/dns and upstream (#7110) ... * move reverse row into reverse component * add upstream mode * update test state * add dns mode * add tests * [autofix.ci] apply automated fixes * review changes * [autofix.ci] apply automated fixes * wording nits * nit --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-08-28 19:20:49 +02:00
Michele Russo	332f222994	optimize tnetstring parsing (#7121) ... * Use memoryview to represent tnetstring * Allow :data: in pop to be bytes | memory view to accomodate test * Update CHANGELOG.md * [autofix.ci] apply automated fixes * Use str() instead of decode() to avoid one copy Co-authored-by: Maximilian Hils <github@maximilianhils.com> * Keep diff minimal Co-authored-by: Maximilian Hils <github@maximilianhils.com> * Make pop only accept argument of type memory view * cache `ord()` --------- Co-authored-by: Michele Russo <michele.russo@huawei.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <github@maximilianhils.com>	2024-08-20 19:55:47 +00:00
Gaurav Jain	499e8e8742	Merge https and http3 reverse-proxy modes (#7114) ... * Merge https and http3 reverse-proxy modes * Fix existing tests * [autofix.ci] apply automated fixes * mypy * Preserve http3 reverse-proxy mode * [autofix.ci] apply automated fixes * Add tests * [autofix.ci] apply automated fixes * Add CHANGELOG entry * Remove None from transport_protocol type annotations --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-08-20 14:44:38 +00:00
Maximilian Hils	ecf5132e71	QUIC: Support STOP_SENDING frames (#7119) ... * handle QUIC `STOP_SENDING` frames * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-08-20 16:35:10 +02:00
Maximilian Hils	a81a1d3555	StopQuicStream -> StopSendingQuicStream	2024-08-19 22:42:43 +02:00
Maximilian Hils	3464842a13	fix quic stream event repr in playbooks	2024-08-19 22:42:43 +02:00
Maximilian Hils	b488c40f81	start_h3_client -> start_h3_proxy ... the previous naming managed to confuse me once, so it shall not do that again	2024-08-19 22:42:43 +02:00
Maximilian Hils	5b10a8aebe	testing: integrate MultiPlaybook into Playbook	2024-08-19 22:42:43 +02:00
Maximilian Hils	9c6a9d06a1	http3: remove push support	2024-08-19 22:42:43 +02:00
Gaurav Jain	6bb536e0ff	add addon to update the ports in alt-svc header in reverse mode (#7093) ... * Add addon to update the ports in alt-svc header to the port that we're listening on * [autofix.ci] apply automated fixes * Add suggested changes * Add tests * [autofix.ci] apply automated fixes * mypy * style * [autofix.ci] apply automated fixes * Add CHANGELOG entry * [autofix.ci] apply automated fixes * nits * [autofix.ci] apply automated fixes * nit: improve option wording --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com>	2024-08-17 16:20:31 +00:00
Matteo Luppi	be4ba1153c	add popover to socks and transparent (#7108) ... add popover	2024-08-15 19:35:24 +02:00
Matteo Luppi	aa7a912d89	Feature/popover modes (#7078) ... * create UI popover for mode configurations * add listen_host support to regular mode * add listen_host, port and path to wireguard mode * leftover * [autofix.ci] apply automated fixes * adapt popover to new rtk logic * update snapshots * use popover api * [autofix.ci] apply automated fixes * popovers: simplify css, make popover render ok on browsers without anchor support * fix tests * [autofix.ci] apply automated fixes * coverage++ * doc++ * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Maximilian Hils <git@maximilianhils.com> Co-authored-by: Maximilian Hils <github@maximilianhils.com>	2024-08-15 11:30:41 +02:00