{"id":29113421,"url":"https://github.com/deventerprisesoftware/scrapi-mcp","last_synced_at":"2026-01-16T03:46:15.317Z","repository":{"id":286645829,"uuid":"961963606","full_name":"DevEnterpriseSoftware/scrapi-mcp","owner":"DevEnterpriseSoftware","description":"MCP server for using ScrAPI to scrape web pages.","archived":false,"fork":false,"pushed_at":"2025-04-13T09:37:53.000Z","size":317,"stargazers_count":3,"open_issues_count":1,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-06-06T17:52:17.386Z","etag":null,"topics":["ai","mcp","mcp-server","scraper-api","web-scraping","webscraper"],"latest_commit_sha":null,"homepage":"https://scrapi.tech","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DevEnterpriseSoftware.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-04-07T12:50:23.000Z","updated_at":"2025-04-14T12:10:42.000Z","dependencies_parsed_at":"2025-04-07T17:23:07.888Z","dependency_job_id":"92ea05df-8a57-421c-ba0e-15bb419cc62f","html_url":"https://github.com/DevEnterpriseSoftware/scrapi-mcp","commit_stats":null,"previous_names":["deventerprisesoftware/scrapi-mcp"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/DevEnterpriseSoftware/scrapi-mcp","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DevEnterpriseSoftware%2Fscrapi-mcp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DevEnterpriseSoftware%2Fscrapi-mcp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DevEnterpriseSoftware%2Fscrapi-mcp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DevEnterpriseSoftware%2Fscrapi-mcp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DevEnterpriseSoftware","download_url":"https://codeload.github.com/DevEnterpriseSoftware/scrapi-mcp/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DevEnterpriseSoftware%2Fscrapi-mcp/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262581351,"owners_count":23331912,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","mcp","mcp-server","scraper-api","web-scraping","webscraper"],"created_at":"2025-06-29T11:05:31.520Z","updated_at":"2026-01-16T03:46:15.304Z","avatar_url":"https://github.com/DevEnterpriseSoftware.png","language":"JavaScript","funding_links":[],"categories":["Search \u0026 Data Extraction"],"sub_categories":["How to Submit"],"readme":"![ScrAPI logo](https://raw.githubusercontent.com/DevEnterpriseSoftware/scrapi-sdk-dotnet/master/icon_small.png)\n\n# ScrAPI MCP Server\n\n[![License: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](https://opensource.org/licenses/MIT)\n[![NPM Downloads](https://img.shields.io/npm/dm/@deventerprisesoftware/scrapi-mcp)](https://www.npmjs.com/package/@deventerprisesoftware/scrapi-mcp)\n[![Docker Pulls](https://img.shields.io/docker/pulls/deventerprisesoftware/scrapi-mcp)](https://hub.docker.com/r/deventerprisesoftware/scrapi-mcp)\n[![smithery badge](https://smithery.ai/badge/@DevEnterpriseSoftware/scrapi-mcp)](https://smithery.ai/server/@DevEnterpriseSoftware/scrapi-mcp)\n\nMCP server for using [ScrAPI](https://scrapi.tech) to scrape web pages.\n\nScrAPI is your ultimate web scraping solution, offering powerful, reliable, and easy-to-use features to extract data from any website effortlessly.\n\n\u003ca href=\"https://glama.ai/mcp/servers/@DevEnterpriseSoftware/scrapi-mcp\"\u003e\n  \u003cimg width=\"380\" height=\"200\" src=\"https://glama.ai/mcp/servers/@DevEnterpriseSoftware/scrapi-mcp/badge\" alt=\"ScrAPI Server MCP server\" /\u003e\n\u003c/a\u003e\n\n## Tools\n\n1. `scrape_url_html`\n   - Use a URL to scrape a website using the ScrAPI service and retrieve the result as HTML.\n     Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.\n     The result will be in HTML which is preferable if advanced parsing is required.\n   - Inputs:\n     - `url` (string, required): The URL to scrape\n     - `browserCommands` (string, optional): JSON array of browser commands to execute before scraping\n   - Returns: HTML content of the URL\n\n2. `scrape_url_markdown`\n   - Use a URL to scrape a website using the ScrAPI service and retrieve the result as Markdown.\n     Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.\n     The result will be in Markdown which is preferable if the text content of the webpage is important and not the structural information of the page.\n   - Inputs:\n     - `url` (string, required): The URL to scrape\n     - `browserCommands` (string, optional): JSON array of browser commands to execute before scraping\n   - Returns: Markdown content of the URL\n\n## Browser Commands\n\nBoth tools support optional browser commands that allow you to interact with the page before scraping. This is useful for:\n- Clicking buttons (e.g., \"Accept Cookies\", \"Load More\")\n- Filling out forms\n- Selecting dropdown options\n- Scrolling to load dynamic content\n- Waiting for elements to appear\n- Executing custom JavaScript\n\n### Available Commands\n\nCommands are provided as a JSON array string. All commands are executed with human-like behavior (random mouse movements, variable typing speed, etc.):\n\n| Command | Format | Description |\n|---------|--------|-------------|\n| **Click** | `{\"click\": \"#buttonId\"}` | Click an element using CSS selector |\n| **Input** | `{\"input\": {\"input[name='email']\": \"value\"}}` | Fill an input field |\n| **Select** | `{\"select\": {\"select[name='country']\": \"USA\"}}` | Select from dropdown (by value or text) |\n| **Scroll** | `{\"scroll\": 1000}` | Scroll down by pixels (negative values scroll up) |\n| **Wait** | `{\"wait\": 5000}` | Wait for milliseconds (max 15000) |\n| **WaitFor** | `{\"waitfor\": \"#elementId\"}` | Wait for element to appear in DOM |\n| **JavaScript** | `{\"javascript\": \"console.log('test')\"}` | Execute custom JavaScript code |\n\n### Example Usage\n\n```json\n[\n  {\"click\": \"#accept-cookies\"},\n  {\"wait\": 2000},\n  {\"input\": {\"input[name='search']\": \"web scraping\"}},\n  {\"click\": \"button[type='submit']\"},\n  {\"waitfor\": \"#results\"},\n  {\"scroll\": 500}\n]\n```\n\n### Finding CSS Selectors\n\nNeed help finding CSS selectors? Try the [Rayrun browser extension](https://chromewebstore.google.com/detail/rayrun/olljocejdgeipcaompahmnfebhkfmnma) to easily select elements and generate selectors.\n\nFor more details, see the [Browser Commands documentation](https://scrapi.tech/docs/api_details/v1_scrape/browser_commands).\n\n## Setup\n\n### API Key (optional)\n\nOptionally get an API key from the [ScrAPI website](https://scrapi.tech).\n\nWithout an API key you will be limited to one concurrent call and twenty free calls per day with minimal queuing capabilities.\n\n### Cloud Server\n\nThe ScrAPI MCP Server is also available in the cloud over SSE at https://api.scrapi.tech/mcp/sse and streamable HTTP at https://api.scrapi.tech/mcp\n\nCloud MCP servers are not widely supported yet but you can access this directly from your own custom clients or use [MCP Inspector](https://github.com/modelcontextprotocol/inspector) to test it. There is currently no facility to pass through your API key when connecting to the cloud MCP server.\n\n![MCP-Inspector](https://raw.githubusercontent.com/DevEnterpriseSoftware/scrapi-mcp/master/img/mcp-inspector.jpg)\n\n### Usage with Claude Desktop\n\nAdd the following to your `claude_desktop_config.json`:\n\n#### Docker\n\n```json\n{\n  \"mcpServers\": {\n    \"ScrAPI\": {\n      \"command\": \"docker\",\n      \"args\": [\n        \"run\",\n        \"-i\",\n        \"--rm\",\n        \"-e\",\n        \"SCRAPI_API_KEY\",\n        \"deventerprisesoftware/scrapi-mcp\"\n      ],\n      \"env\": {\n        \"SCRAPI_API_KEY\": \"\u003cYOUR_API_KEY\u003e\"\n      }\n    }\n  }\n}\n```\n\n#### NPX\n\n```json\n{\n  \"mcpServers\": {\n    \"ScrAPI\": {\n      \"command\": \"npx\",\n      \"args\": [\n        \"-y\",\n        \"@deventerprisesoftware/scrapi-mcp\"\n      ],\n      \"env\": {\n        \"SCRAPI_API_KEY\": \"\u003cYOUR_API_KEY\u003e\"\n      }\n    }\n  }\n}\n```\n\n![Claude-Desktop](https://raw.githubusercontent.com/DevEnterpriseSoftware/scrapi-mcp/master/img/claude-desktop.jpg)\n\n## Build\n\nDocker build:\n\n```bash\ndocker build -t deventerprisesoftware/scrapi-mcp -f Dockerfile .\n```\n\n## License\n\nThis MCP server is licensed under the MIT License. This means you are free to use, modify, and distribute the software, subject to the terms and conditions of the MIT License. For more details, please see the LICENSE file in the project repository.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeventerprisesoftware%2Fscrapi-mcp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdeventerprisesoftware%2Fscrapi-mcp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeventerprisesoftware%2Fscrapi-mcp/lists"}