https://github.com/piercefreeman/grooveproxy

Groove, a crawling and unit test optimized MITM proxy server.
https://github.com/piercefreeman/grooveproxy

golang http-proxy mitm mitmproxy nodejs proxy python tls

Last synced: about 1 month ago
JSON representation

Groove, a crawling and unit test optimized MITM proxy server.

• Host: GitHub
• URL: https://github.com/piercefreeman/grooveproxy
• Owner: piercefreeman
• License: mit
• Created: 2022-10-07T20:57:20.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2022-12-24T18:36:38.000Z (almost 2 years ago)
• Last Synced: 2024-04-02T13:19:45.788Z (8 months ago)
• Topics: golang, http-proxy, mitm, mitmproxy, nodejs, proxy, python, tls
• Language: Python
• Homepage:
• Size: 501 KB
• Stars: 14
• Watchers: 4
• Forks: 0
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Groove

Groove is an opinionated proxy server built for web crawling and unit test mocking. It's based on [goproxy](https://github.com/elazarl/goproxy), a well supported proxy implementation written in Go. It builds on this foundation to include:

- HTTP and HTTPs support over HTTP/1 and HTTP/2.

- Local CA certificate generation and installation on Mac and Linux to support system curl and Chromium.

- Different tiers of caching support. Standard caching will respect server-driven "Cache-Control" HTTP response headers. Aggressive caching will always cache a page regardless of headers. Disabling caching will always fetch new contents regardless of server preference.

- Limit outbound requests of the same URL to 1 concurrent request to save on bandwidth if requests are already inflight.

- Record and replay requests made to outgoing servers. Recreate testing flows in unit tests while separating them from crawling business logic.

- 3rd party proxy support for commercial proxies.

- Custom TLS Hello Client support to maintain a Chromium-like TLS handshake while intercepting requests and re-forwarding on packets.

- API clients for Python and Node.

## Proxy Benchmarks

Before settling on goproxy, we benchmarked a variety of MITM proxy servers across Python, Go, and Node. To view the benchmarking code and results see [proxy-benchmarks](./proxy-benchmarks/).