Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

https://github.com/brightdata/brightdata-mcp

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
https://github.com/brightdata/brightdata-mcp

ai-agents ai-integrations anti-bot-detection browser-automation data-collection data-extraction llm mcp mcp-server modelcontextprotocol scraping scraping-tools structured-data web-crawling web-data web-scraping

Last synced: 8 days ago
JSON representation

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Awesome Lists containing this project

README 

          


  

    Bright Data Logo

  



  
The Web MCP


  

  


    🌐 Give your AI real-time web superpowers


    Seamlessly connect LLMs to the live web without getting blocked

  



  


    

      npm version

    

    

      npm downloads

    

    

      License

    

  



  


    Quick Start •

    Features •

    Pricing •

    Demos •

    Docs •

    Support

  



  


    
🎉 Free Tier Available! 🎉


    
5,000 requests/month FREE 


    Perfect for prototyping and everyday AI workflows


  





  


  

  


    
🚀 Launch Week - January 2026 🚀


    
5 Days of Major Releases!


    

      

        📦 Tool Groups

        🧙 Setup Wizard

        ⚡ Token Efficiency

        🏢 Enterprise Integrations

        📊 Observability

      

    

  



---



## 🌟 Overview



**The Web MCP** is your gateway to giving AI assistants true web capabilities. No more outdated responses, no more "I can't access real-time information" - just seamless, reliable web access that actually works.



Built by [Bright Data](https://brightdata.com), the world's #1 web data platform, this MCP server ensures your AI never gets blocked, rate-limited, or served CAPTCHAs.





  

    

      ✅ Works with Any LLM
Claude, GPT, Gemini, Llama

      🛡️ Never Gets Blocked
Enterprise-grade unblocking

      🚀 5,000 Free Requests
Monthly

      ⚡ Zero Config
Works out of the box

    

  




---



## 🎯 Perfect For



- 🔍 **Real-time Research** - Get current prices, news, and live data

- 🛍️ **E-commerce Intelligence** - Monitor products, prices, and availability  

- 📊 **Market Analysis** - Track competitors and industry trends

- 🤖 **AI Agents** - Build agents that can actually browse the web

- 📝 **Content Creation** - Access up-to-date information for writing

- 🎓 **Academic Research** - Gather data from multiple sources efficiently



---



## ⚡ Quick Start



**Use the configuration wizard:** 



![GIF for day2](https://github.com/user-attachments/assets/b3917553-6cf9-4264-bc7a-9b8b74df0a17)



📡 Use our hosted server - No installation needed!



Perfect for users who want zero setup. Just add this URL to your MCP client:



```

https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE

```



**Setup in Claude Desktop:**

1. Go to: Settings → Connectors → Add custom connector

2. Name: `Bright Data Web`

3. URL: `https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN`

4. Click "Add" and you're done! ✨



Run locally on your machine



```json

{

  "mcpServers": {

    "Bright Data": {

      "command": "npx",

      "args": ["@brightdata/mcp"],

      "env": {

        "API_TOKEN": ""

      }

    }

  }

}

```



---



## 🚀 Pricing & Modes





  

    

      ⚡ Rapid Mode (Free tier)

      💎 Pro Mode

      🔧 Custom Mode

    

    

      

        
$0/month


        
5,000 requests


        


        
✅ Web Search


        ✅ Scraping with Web unlocker


        ❌ Browser Automation


        ❌ Web data tools


        


        Default Mode

      

      

        
Pay-as-you-go


        
Everything in rapid plus 60+ tools


        


        
✅ Browser Control


        ✅ Web Data APIs


        


        


        


        PRO_MODE=true

      


      

        
Usage-based


        
Pick the tools you need


        


        
✅ Combine tool groups


        ✅ Add individual tools


        ❌ Overrides Pro eligibility


        


        GROUPS="browser"


        TOOLS="scrape_as_html"

      

    

  




> **💡 Note:** Pro mode is **not included** in the free tier and incurs

> additional charges based on usage.



---



## 🧠 Advanced Tool Selection



- `GROUPS` lets you enable curated tool bundles. Use comma-separated group

  IDs such as `ecommerce,browser`.

- `TOOLS` adds explicit tool names on top of the selected groups.

- Mode priority: `PRO_MODE=true` (all tools) → `GROUPS` / `TOOLS`

  (whitelist) → default rapid mode (base toolkit).

- Base tools always enabled: `search_engine`, `search_engine_batch`,

  `scrape_as_markdown`, `scrape_batch`.

- Group ID `custom` is reserved; use `TOOLS` for bespoke picks.



  

    Group ID

    Description

    Featured tools

  

  

    ecommerce

    Retail and marketplace datasets

    web_data_amazon_product,

    web_data_walmart_product,

    web_data_google_shopping

  

  

    social

    Social, community, and creator insights

    web_data_linkedin_posts,

    web_data_tiktok_posts,

    web_data_youtube_videos

  

  

    browser

    Bright Data Scraping Browser automation tools

    scraping_browser_snapshot,

    scraping_browser_click_ref,

    scraping_browser_screenshot

  

  

    finance

    Financial intelligence datasets

    web_data_yahoo_finance_business

  

  

    business

    Company and location intelligence datasets

    web_data_crunchbase_company,

    web_data_zoominfo_company_profile,

    web_data_zillow_properties_listing

  

  

    research

    News and developer data feeds

    web_data_github_repository_file,

    web_data_reuter_news

  

  

    app_stores

    App store data

    web_data_google_play_store,

    web_data_apple_app_store

  

  

    travel

    Travel information

    web_data_booking_hotel_listings

  

  

    advanced_scraping

    Batch and AI-assisted extraction helpers

    search_engine_batch,

    scrape_batch,

    extract

  



### Claude Desktop example



```json

{

  "mcpServers": {

    "Bright Data": {

      "command": "npx",

      "args": ["@brightdata/mcp"],

      "env": {

        "API_TOKEN": "",

        "GROUPS": "browser,advanced_scraping",

        "TOOLS": "extract"

      }

    }

  }

}

```



---



## ✨ Features



### 🔥 Core Capabilities



  

    🔍 Smart Web Search
Google-quality results optimized for AI

    📄 Clean Markdown
AI-ready content extraction

  

  

    🌍 Global Access
Bypass geo-restrictions automatically

    🛡️ Anti-Bot Protection
Never get blocked or rate-limited

  

  

    🤖 Browser Automation
Control real browsers remotely (Pro)

    ⚡ Lightning Fast
Optimized for minimal latency

  



### 🎯 Example Queries That Just Work



```yaml

✅ "What's Tesla's current stock price?"

✅ "Find the best-rated restaurants in Tokyo right now"

✅ "Get today's weather forecast for New York"

✅ "What movies are releasing this week?"

✅ "What are the trending topics on Twitter today?"

```



---



## 🎬 Demos



> **Note:** These videos show earlier versions. New demos coming soon! 🎥



View Demo Videos



### Basic Web Search Demo

https://github.com/user-attachments/assets/59f6ebba-801a-49ab-8278-1b2120912e33



### Advanced Scraping Demo

https://github.com/user-attachments/assets/61ab0bee-fdfa-4d50-b0de-5fab96b4b91d



[📺 More tutorials on YouTube →](https://github.com/brightdata-com/brightdata-mcp/blob/main/examples/README.md)



---



## 🔧 Available Tools



### ⚡ Rapid Mode Tools (Default - Free)



| Tool | Description | Use Case |

|------|-------------|----------|

| 🔍 `search_engine` | Web search with AI-optimized results | Research, fact-checking, current events |

| 📄 `scrape_as_markdown` | Convert any webpage to clean markdown | Content extraction, documentation |



### 💎 Pro Mode Tools (60+ Tools)



Click to see all Pro tools



| Category | Tools | Description |

|----------|-------|-------------|

| **Browser Control** | `scraping_browser.*` | Full browser automation |

| **Web Data APIs** | `web_data_*` | Structured data extraction |

| **E-commerce** | Product scrapers | Amazon, eBay, Walmart data |

| **Social Media** | Social scrapers | Twitter, LinkedIn, Instagram |

| **Maps & Local** | Location tools | Google Maps, business data |



[📚 View complete tool documentation →](https://github.com/brightdata-com/brightdata-mcp/blob/main/assets/Tools.md)



---



## 🎮 Try It Now!



### 🧪 Online Playground

Try the Web MCP without any setup:





  

    Playground

  




---



## 🔧 Configuration



### Basic Setup

```json

{

  "mcpServers": {

    "Bright Data": {

      "command": "npx",

      "args": ["@brightdata/mcp"],

      "env": {

        "API_TOKEN": "your-token-here"

      }

    }

  }

}

```



### Advanced Configuration

```json

{

  "mcpServers": {

    "Bright Data": {

      "command": "npx",

      "args": ["@brightdata/mcp"],

      "env": {

        "API_TOKEN": "your-token-here",

        "PRO_MODE": "true",              // Enable all 60+ tools

        "RATE_LIMIT": "100/1h",          // Custom rate limiting

        "WEB_UNLOCKER_ZONE": "custom",   // Custom unlocker zone

        "BROWSER_ZONE": "custom_browser" // Custom browser zone

      }

    }

  }

}

```



---



## 📚 Documentation





  

    

      

        

          API Docs

        

      

      

        

          Examples

        

      

      

        

          Changelog

        

      

      

        

          Tutorial

        

      

    

  




---



## 🚨 Common Issues & Solutions



🔧 Troubleshooting Guide



### ❌ "spawn npx ENOENT" Error

**Solution:** Install Node.js or use the full path to node:

```json

"command": "/usr/local/bin/node"  // macOS/Linux

"command": "C:\\Program Files\\nodejs\\node.exe"  // Windows

```



### ⏱️ Timeouts on Complex Sites

**Solution:** Increase timeout in your client settings to 180s



### 🔑 Authentication Issues

**Solution:** Ensure your API token is valid and has proper permissions



### 📡 Remote Server Connection

**Solution:** Check your internet connection and firewall settings



[More troubleshooting →](https://github.com/brightdata-com/brightdata-mcp#troubleshooting)



---



## 🤝 Contributing



We love contributions! Here's how you can help:



- 🐛 [Report bugs](https://github.com/brightdata-com/brightdata-mcp/issues)

- 💡 [Suggest features](https://github.com/brightdata-com/brightdata-mcp/issues)

- 🔧 [Submit PRs](https://github.com/brightdata-com/brightdata-mcp/pulls)

- ⭐ Star this repo!



Please follow [Bright Data's coding standards](https://brightdata.com/dna/js_code).



---



## 📞 Support





  

    

      

        

          🐛 GitHub Issues


          Report bugs & features

        

      

      

        

          📚 Documentation


          Complete guides

        

      

      

        

          ✉️ Email


          support@brightdata.com

        

      

    

  




---



## 📜 License



MIT © [Bright Data Ltd.](https://brightdata.com)



---





  


    Built with ❤️ by


    

      Bright Data

    

  


  


    The world's #1 web data platform

  


  

  


  

  


    ⭐ Star us on GitHub • 

    Read our Blog