{"id":26641169,"url":"https://github.com/xxxbrian/mcp-rquest","last_synced_at":"2025-07-04T21:04:29.317Z","repository":{"id":283146774,"uuid":"950863558","full_name":"xxxbrian/mcp-rquest","owner":"xxxbrian","description":"A MCP server providing realistic browser-like HTTP request capabilities with accurate TLS/JA3/JA4 fingerprints for bypassing anti-bot measures. It also supports converting PDF and HTML documents to Markdown for easier processing by LLMs.","archived":false,"fork":false,"pushed_at":"2025-03-22T17:36:06.000Z","size":413,"stargazers_count":31,"open_issues_count":2,"forks_count":6,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-07-04T21:04:27.469Z","etag":null,"topics":["ai","claude","http-requests","mcp","mcp-server"],"latest_commit_sha":null,"homepage":"https://pypi.org/project/mcp-rquest","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/xxxbrian.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-03-18T19:51:50.000Z","updated_at":"2025-06-23T14:03:22.000Z","dependencies_parsed_at":null,"dependency_job_id":"343a1ecc-4114-4dc9-b123-03a69b23ef79","html_url":"https://github.com/xxxbrian/mcp-rquest","commit_stats":null,"previous_names":["xxxbrian/mcp-rquest"],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/xxxbrian/mcp-rquest","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xxxbrian%2Fmcp-rquest","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xxxbrian%2Fmcp-rquest/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xxxbrian%2Fmcp-rquest/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xxxbrian%2Fmcp-rquest/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/xxxbrian","download_url":"https://codeload.github.com/xxxbrian/mcp-rquest/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xxxbrian%2Fmcp-rquest/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263619744,"owners_count":23489558,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","claude","http-requests","mcp","mcp-server"],"created_at":"2025-03-24T18:20:01.650Z","updated_at":"2025-07-04T21:04:29.305Z","avatar_url":"https://github.com/xxxbrian.png","language":"Python","funding_links":[],"categories":["Developer Tools","Cloud \u0026 Devops Mcp Servers","Community Servers","Browser Automation","APIs and HTTP Requests","🤖 AI/ML","Table of Contents","🗂️ Extensions by Category"],"sub_categories":["API Tools","How to Submit","Other Tools and Integrations","🌐 Web Services"],"readme":"# mcp-rquest\n\n[![PyPI Version](https://img.shields.io/pypi/v/mcp-rquest.svg?style=flat-square\u0026logo=pypi\u0026logoColor=white)](https://pypi.org/project/mcp-rquest/) [![Python Versions](https://img.shields.io/pypi/pyversions/mcp-rquest?style=flat-square\u0026logo=python\u0026logoColor=white)](https://pypi.org/project/mcp-rquest/) [![GitHub Stars](https://img.shields.io/github/stars/xxxbrian/mcp-rquest?style=flat-square\u0026logo=github)](https://github.com/xxxbrian/mcp-rquest) [![License](https://img.shields.io/github/license/xxxbrian/mcp-rquest?style=flat-square)](https://github.com/xxxbrian/mcp-rquest)\n\nA Model Context Protocol (MCP) server that provides advanced HTTP request capabilities for Claude and other LLMs. Built on [rquest](https://github.com/0x676e67/rquest), this server enables realistic browser emulation with accurate TLS/JA3/JA4 fingerprints, allowing models to interact with websites more naturally and bypass common anti-bot measures. It also supports converting PDF and HTML documents to Markdown for easier processing by LLMs.\n\n## Features\n\n- **Complete HTTP Methods**: Support for GET, POST, PUT, DELETE, PATCH, HEAD, OPTIONS, and TRACE\n- **Browser Fingerprinting**: Accurate TLS, JA3/JA4, and HTTP/2 browser fingerprints\n- **Content Handling**:\n  - Automatic handling of large responses with token counting\n  - HTML to Markdown conversion for better LLM processing\n  - PDF to Markdown conversion using the Marker library\n  - Secure storage of responses in system temporary directories\n- **Authentication Support**: Basic, Bearer, and custom authentication methods\n- **Request Customization**:\n  - Headers, cookies, redirects\n  - Form data, JSON payloads, multipart/form-data\n  - Query parameters\n- **SSL Security**: Uses BoringSSL for secure connections with realistic browser fingerprints\n\n## Available Tools\n\n- **HTTP Request Tools**:\n\n  - `http_get` - Perform GET requests with optional parameters\n  - `http_post` - Submit data via POST requests\n  - `http_put` - Update resources with PUT requests\n  - `http_delete` - Remove resources with DELETE requests\n  - `http_patch` - Partially update resources\n  - `http_head` - Retrieve only headers from a resource\n  - `http_options` - Retrieve options for a resource\n  - `http_trace` - Diagnostic request tracing\n\n- **Response Handling Tools**:\n  - `get_stored_response` - Retrieve stored large responses, optionally by line range\n  - `get_stored_response_with_markdown` - Convert HTML or PDF responses to Markdown format for better LLM processing\n  - `get_model_state` - Get the current state of the PDF models loading process\n  - `restart_model_loading` - Restart the PDF models loading process if it failed or got stuck\n\n## PDF Support\n\nmcp-rquest now supports PDF to Markdown conversion, allowing you to download PDF files and convert them to Markdown format that's easy for LLMs to process:\n\n1. **Automatic PDF Detection**: PDF files are automatically detected based on content type\n2. **Seamless Conversion**: The same `get_stored_response_with_markdown` tool works for both HTML and PDF files\n3. **High-Quality Conversion**: Uses the [Marker](https://github.com/VikParuchuri/marker) library for accurate PDF to Markdown transformation\n4. **Optimized Performance**: Models are pre-downloaded during package installation to avoid delays during request processing\n\n## Installation\n\n### Using uv (recommended)\n\nWhen using [`uv`](https://docs.astral.sh/uv/) no specific installation is needed. We will\nuse [`uvx`](https://docs.astral.sh/uv/guides/tools/) to directly run _mcp-rquest_.\n\n### Using pip\n\nAlternatively you can install `mcp-rquest` via pip:\n\n```bash\npip install mcp-rquest\n```\n\nAfter installation, you can run it as a script using:\n\n```bash\npython -m mcp_rquest\n```\n\n## Configuration\n\n### Configure for Claude.app\n\nAdd to your Claude settings:\n\nUsing `uvx`:\n\n```json\n{\n  \"mcpServers\": {\n    \"http-rquest\": {\n      \"command\": \"uvx\",\n      \"args\": [\"mcp-rquest\"]\n    }\n  }\n}\n```\n\nUsing `pip`:\n\n```json\n{\n  \"mcpServers\": {\n    \"http-rquest\": {\n      \"command\": \"python\",\n      \"args\": [\"-m\", \"mcp_rquest\"]\n    }\n  }\n}\n```\n\nUsing `pipx`:\n\n```json\n{\n  \"mcpServers\": {\n    \"http-rquest\": {\n      \"command\": \"pipx\",\n      \"args\": [\"run\", \"mcp-rquest\"]\n    }\n  }\n}\n```\n\n\u003c/details\u003e\n\n## Browser Emulation\n\nmcp-rquest leverages rquest's powerful browser emulation capabilities to provide realistic browser fingerprints, which helps bypass bot detection and access content normally available only to standard browsers. Supported browser fingerprints include:\n\n- Chrome (multiple versions)\n- Firefox\n- Safari (including iOS and iPad versions)\n- Edge\n- OkHttp\n\nThis ensures that requests sent through mcp-rquest appear as legitimate browser traffic rather than bot requests.\n\n## Development\n\n### Setting up a Development Environment\n\n1. Clone the repository\n2. Create a virtual environment using uv:\n   ```bash\n   uv venv\n   ```\n3. Activate the virtual environment:\n   ```bash\n   # Unix/macOS\n   source .venv/bin/activate\n   # Windows\n   .venv\\Scripts\\activate\n   ```\n4. Install development dependencies:\n   ```bash\n   uv pip install -e \".[dev]\"\n   ```\n\n## Acknowledgements\n\n- This project is built on top of [rquest](https://github.com/0x676e67/rquest), which provides the advanced HTTP client with browser fingerprinting capabilities.\n- rquest is based on a fork of [reqwest](https://github.com/seanmonstar/reqwest).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxxxbrian%2Fmcp-rquest","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fxxxbrian%2Fmcp-rquest","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxxxbrian%2Fmcp-rquest/lists"}