https://github.com/brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
https://github.com/brightdata/brightdata-mcp
ai-agents ai-integrations anti-bot-detection browser-automation data-collection data-extraction llm mcp mcp-server modelcontextprotocol scraping scraping-tools structured-data web-crawling web-data web-scraping
Last synced: about 2 months ago
JSON representation
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
- Host: GitHub
- URL: https://github.com/brightdata/brightdata-mcp
- Owner: brightdata
- License: mit
- Created: 2025-04-15T10:55:56.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2026-01-15T07:53:52.000Z (about 2 months ago)
- Last Synced: 2026-01-15T14:36:36.708Z (about 2 months ago)
- Topics: ai-agents, ai-integrations, anti-bot-detection, browser-automation, data-collection, data-extraction, llm, mcp, mcp-server, modelcontextprotocol, scraping, scraping-tools, structured-data, web-crawling, web-data, web-scraping
- Language: JavaScript
- Homepage: https://brightdata.com/
- Size: 63.7 MB
- Stars: 1,898
- Watchers: 10
- Forks: 244
- Open Issues: 16
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
- awesome-mcp - brightdata/brightdata-mcp - in-one public web access solution ☆`1,851` (Web Scraping / SIEM & SecOps)
- awesome-mcp-servers - brightdata-mcp - An MCP server by Bright Data that lets AI assistants discover, extract, and interact with the web via a unified interface for automated access across the public internet. ([Read more](/details/brightdata-mcp.md)) `web-scraping` `data-extraction` `web` (Content Extraction & Summarization Mcp Servers)
- awesome-mcp-servers - Bright Data - Discover, extract, and interact with the web - one interface powering automated access across the public internet. (Official Servers)
- awesome-mcp-registry - brightdata/brightdata-mcp
- toolsdk-mcp-registry - ❌ @brightdata/mcp - time access to public web data through specialized tools for search engine scraping, webpage extraction, and structured data retrieval from popular websites. (node) (Search & Data Extraction / How to Submit)
- metorial-index - Bright Data - Access and extract structured data from public web sources without captcha challenges, enabling real-time market information retrieval and web searches. Supports ethical web scraping techniques for various applications like weather forecasting and decision-making. (Cloud Services)
- best-of-mcp-servers - GitHub - 15% open · ⏱️ 21.02.2026) (Search & Data Extraction)
- awesome-mcp-servers - **Bright Data** - Discover, extract, and interact with the web - one interface powering automated access across the public internet. `web` `http` `git` `github` (📦 Other)
- awesome-mcp - brightdata/brightdata-mcp - Bright Data MCP is a Model Context Protocol server that enables AI agents and applications to access and extract real-time web data seamlessly, enhancing their capabilities with live information. (MCP Servers / Browser Automation)
- awesome-ai-agents - brightdata/brightdata-mcp - Bright Data MCP is a powerful Model Context Protocol server that enables AI agents and applications to access and extract real-time web data seamlessly, bypassing geo-restrictions and bot protections for enhanced web scraping and navigation. (Web Automation and UI Interaction / Browser Automation)
README
The Web MCP
🌐 Give your AI real-time web superpowers
Seamlessly connect LLMs to the live web without getting blocked
Quick Start •
Features •
Pricing •
Demos •
Docs •
Support
🎉 Free Tier Available! 🎉
5,000 requests/month FREE
Perfect for prototyping and everyday AI workflows
🚀 Launch Week - January 2026 🚀
5 Days of Major Releases!
📦 Tool Groups
🧙 Setup Wizard
⚡ Token Efficiency
🏢 Enterprise Integrations
📊 Observability
---
## 🌟 Overview
**The Web MCP** is your gateway to giving AI assistants true web capabilities. No more outdated responses, no more "I can't access real-time information" - just seamless, reliable web access that actually works.
Built by [Bright Data](https://brightdata.com), the world's #1 web data platform, this MCP server ensures your AI never gets blocked, rate-limited, or served CAPTCHAs.
✅ Works with Any LLM
Claude, GPT, Gemini, Llama
🛡️ Never Gets Blocked
Enterprise-grade unblocking
🚀 5,000 Free Requests
Monthly
⚡ Zero Config
Works out of the box
---
## 🎯 Perfect For
- 🔍 **Real-time Research** - Get current prices, news, and live data
- 🛍️ **E-commerce Intelligence** - Monitor products, prices, and availability
- 📊 **Market Analysis** - Track competitors and industry trends
- 🤖 **AI Agents** - Build agents that can actually browse the web
- 📝 **Content Creation** - Access up-to-date information for writing
- 🎓 **Academic Research** - Gather data from multiple sources efficiently
---
## ⚡ Quick Start
**Use the configuration wizard:**
📡 Use our hosted server - No installation needed!
Perfect for users who want zero setup. Just add this URL to your MCP client:
```
https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE
```
**Setup in Claude Desktop:**
1. Go to: Settings → Connectors → Add custom connector
2. Name: `Bright Data Web`
3. URL: `https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN`
4. Click "Add" and you're done! ✨
Run locally on your machine
```json
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": ""
}
}
}
}
```
---
## 🚀 Pricing & Modes
⚡ Rapid Mode (Free tier)
💎 Pro Mode
🔧 Custom Mode
$0/month
5,000 requests
✅ Web Search
✅ Scraping with Web unlocker
❌ Browser Automation
❌ Web data tools
Default Mode
Pay-as-you-go
Everything in rapid plus 60+ tools
✅ Browser Control
✅ Web Data APIs
PRO_MODE=true
Usage-based
Pick the tools you need
✅ Combine tool groups
✅ Add individual tools
❌ Overrides Pro eligibility
GROUPS="browser"
TOOLS="scrape_as_html"
> **💡 Note:** Pro mode is **not included** in the free tier and incurs
> additional charges based on usage.
---
## 🧠 Advanced Tool Selection
- `GROUPS` lets you enable curated tool bundles. Use comma-separated group
IDs such as `ecommerce,browser`.
- `TOOLS` adds explicit tool names on top of the selected groups.
- Mode priority: `PRO_MODE=true` (all tools) → `GROUPS` / `TOOLS`
(whitelist) → default rapid mode (base toolkit).
- Base tools always enabled: `search_engine`, `search_engine_batch`,
`scrape_as_markdown`, `scrape_batch`.
- Group ID `custom` is reserved; use `TOOLS` for bespoke picks.
Group ID
Description
Featured tools
ecommerce
Retail and marketplace datasets
web_data_amazon_product,
web_data_walmart_product,
web_data_google_shopping
social
Social, community, and creator insights
web_data_linkedin_posts,
web_data_tiktok_posts,
web_data_youtube_videos
browser
Bright Data Scraping Browser automation tools
scraping_browser_snapshot,
scraping_browser_click_ref,
scraping_browser_screenshot
finance
Financial intelligence datasets
web_data_yahoo_finance_business
business
Company and location intelligence datasets
web_data_crunchbase_company,
web_data_zoominfo_company_profile,
web_data_zillow_properties_listing
research
News and developer data feeds
web_data_github_repository_file,
web_data_reuter_news
app_stores
App store data
web_data_google_play_store,
web_data_apple_app_store
travel
Travel information
web_data_booking_hotel_listings
advanced_scraping
Batch and AI-assisted extraction helpers
search_engine_batch,
scrape_batch,
extract
### Claude Desktop example
```json
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "",
"GROUPS": "browser,advanced_scraping",
"TOOLS": "extract"
}
}
}
}
```
---
## ✨ Features
### 🔥 Core Capabilities
🔍 Smart Web Search
Google-quality results optimized for AI
📄 Clean Markdown
AI-ready content extraction
🌍 Global Access
Bypass geo-restrictions automatically
🛡️ Anti-Bot Protection
Never get blocked or rate-limited
🤖 Browser Automation
Control real browsers remotely (Pro)
⚡ Lightning Fast
Optimized for minimal latency
### 🎯 Example Queries That Just Work
```yaml
✅ "What's Tesla's current stock price?"
✅ "Find the best-rated restaurants in Tokyo right now"
✅ "Get today's weather forecast for New York"
✅ "What movies are releasing this week?"
✅ "What are the trending topics on Twitter today?"
```
---
## 🎬 Demos
> **Note:** These videos show earlier versions. New demos coming soon! 🎥
View Demo Videos
### Basic Web Search Demo
https://github.com/user-attachments/assets/59f6ebba-801a-49ab-8278-1b2120912e33
### Advanced Scraping Demo
https://github.com/user-attachments/assets/61ab0bee-fdfa-4d50-b0de-5fab96b4b91d
[📺 More tutorials on YouTube →](https://github.com/brightdata-com/brightdata-mcp/blob/main/examples/README.md)
---
## 🔧 Available Tools
### ⚡ Rapid Mode Tools (Default - Free)
| Tool | Description | Use Case |
|------|-------------|----------|
| 🔍 `search_engine` | Web search with AI-optimized results | Research, fact-checking, current events |
| 📄 `scrape_as_markdown` | Convert any webpage to clean markdown | Content extraction, documentation |
### 💎 Pro Mode Tools (60+ Tools)
Click to see all Pro tools
| Category | Tools | Description |
|----------|-------|-------------|
| **Browser Control** | `scraping_browser.*` | Full browser automation |
| **Web Data APIs** | `web_data_*` | Structured data extraction |
| **E-commerce** | Product scrapers | Amazon, eBay, Walmart data |
| **Social Media** | Social scrapers | Twitter, LinkedIn, Instagram |
| **Maps & Local** | Location tools | Google Maps, business data |
[📚 View complete tool documentation →](https://github.com/brightdata-com/brightdata-mcp/blob/main/assets/Tools.md)
---
## 🎮 Try It Now!
### 🧪 Online Playground
Try the Web MCP without any setup:
---
## 🔧 Configuration
### Basic Setup
```json
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "your-token-here"
}
}
}
}
```
### Advanced Configuration
```json
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "your-token-here",
"PRO_MODE": "true", // Enable all 60+ tools
"RATE_LIMIT": "100/1h", // Custom rate limiting
"WEB_UNLOCKER_ZONE": "custom", // Custom unlocker zone
"BROWSER_ZONE": "custom_browser" // Custom browser zone
}
}
}
}
```
---
## 📚 Documentation
---
## 🚨 Common Issues & Solutions
🔧 Troubleshooting Guide
### ❌ "spawn npx ENOENT" Error
**Solution:** Install Node.js or use the full path to node:
```json
"command": "/usr/local/bin/node" // macOS/Linux
"command": "C:\\Program Files\\nodejs\\node.exe" // Windows
```
### ⏱️ Timeouts on Complex Sites
**Solution:** Increase timeout in your client settings to 180s
### 🔑 Authentication Issues
**Solution:** Ensure your API token is valid and has proper permissions
### 📡 Remote Server Connection
**Solution:** Check your internet connection and firewall settings
[More troubleshooting →](https://github.com/brightdata-com/brightdata-mcp#troubleshooting)
---
## 🤝 Contributing
We love contributions! Here's how you can help:
- 🐛 [Report bugs](https://github.com/brightdata-com/brightdata-mcp/issues)
- 💡 [Suggest features](https://github.com/brightdata-com/brightdata-mcp/issues)
- 🔧 [Submit PRs](https://github.com/brightdata-com/brightdata-mcp/pulls)
- ⭐ Star this repo!
Please follow [Bright Data's coding standards](https://brightdata.com/dna/js_code).
---
## 📞 Support
🐛 GitHub Issues
Report bugs & features
📚 Documentation
Complete guides
✉️ Email
support@brightdata.com
---
## 📜 License
MIT © [Bright Data Ltd.](https://brightdata.com)
---
