https://github.com/yokingma/one-search-mcp
π OneSearch MCP Server: Web Search & Scraper & Extract, Support Firecrawl, SearXNG, Tavily, DuckDuckGo, Bing, etc.
https://github.com/yokingma/one-search-mcp
bing-mcp duckduckgo-mcp firecrawl-mcp mcp-server modelcontextprotocol searxng-mcp tavily-mcp
Last synced: 4 months ago
JSON representation
π OneSearch MCP Server: Web Search & Scraper & Extract, Support Firecrawl, SearXNG, Tavily, DuckDuckGo, Bing, etc.
- Host: GitHub
- URL: https://github.com/yokingma/one-search-mcp
- Owner: yokingma
- License: mit
- Created: 2025-03-18T02:06:27.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2026-01-31T09:27:06.000Z (4 months ago)
- Last Synced: 2026-01-31T22:17:37.375Z (4 months ago)
- Topics: bing-mcp, duckduckgo-mcp, firecrawl-mcp, mcp-server, modelcontextprotocol, searxng-mcp, tavily-mcp
- Language: TypeScript
- Homepage:
- Size: 266 KB
- Stars: 61
- Watchers: 4
- Forks: 15
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- toolsdk-mcp-registry - β one-search-mcp
- metorial-index - OneSearch - Enables web search, scraping, and content extraction from various websites using multiple search engines and scrapers. It supports local browser searches and integrates with tools like SearXNG, DuckDuckGo, and Bing for enhanced data retrieval. (Data Analytics)
README
# π OneSearch MCP Server: Web Search & Crawl & Scraper & Extract
A Model Context Protocol (MCP) server implementation that integrates with multiple search providers for web search, local browser search, and scraping capabilities with agent-browser.
## Features
- Web Search, scrape, crawl and extract content from websites.
- Support multiple search engines and web scrapers: **SearXNG**, **Tavily**, **DuckDuckGo**, **Bing**, **Google**, **Zhipu (ζΊθ°±)**, **Exa**, **Bocha (εζ₯)**, etc.
- **Local web search** (browser search), support multiple search engines: **Bing**, **Google**, **Baidu**, **Sogou**, etc.
- Use `agent-browser` for browser automation.
- Free, no API keys required.
- **Enabled tools:** `one_search`, `one_scrape`, `one_map`, `one_extract`
## Migration from v1.1.0 and Earlier
**Breaking Changes in v1.1.0:**
- **Firecrawl Removed**: The Firecrawl integration has been removed in favor of `agent-browser`, which provides similar functionality without requiring external API services.
- **New Browser Requirement**: You must install Chromium browser (see Prerequisites section).
- **Environment Variables**: `FIRECRAWL_API_URL` and `FIRECRAWL_API_KEY` are no longer used.
**What Changed:**
- `one_scrape` and `one_map` now use `agent-browser` instead of Firecrawl
- `one_extract` tool is now fully implemented for structured data extraction from multiple URLs
- All browser-based operations are now handled locally, providing better privacy and no API costs
**Migration Steps:**
1. Install Chromium browser (see Prerequisites)
2. Remove `FIRECRAWL_API_URL` and `FIRECRAWL_API_KEY` from your environment variables
3. Update to the latest version: `npm install -g one-search-mcp@latest`
## Prerequisites
**Browser Requirement**: This server uses `agent-browser` for web scraping and local search, which requires a Chromium-based browser.
**Good News**: The server will automatically detect and use browsers already installed on your system:
- β
Google Chrome
- β
Microsoft Edge
- β
Chromium
- β
Google Chrome Canary
**If you don't have any of these browsers installed**, you can:
```bash
# Option 1: Install Google Chrome (Recommended)
# Download from: https://www.google.com/chrome/
# Option 2: Install Microsoft Edge
# Download from: https://www.microsoft.com/edge
# Option 3: Install Chromium via agent-browser
npx agent-browser install
# Option 4: Install Chromium directly
# Download from: https://www.chromium.org/getting-involved/download-chromium/
```
## Installation
### Using Claude Code CLI (Recommended)
```bash
# Add to Claude Code with default settings (local search)
claude mcp add one-search-mcp -- npx -y one-search-mcp
# Add with custom search provider (e.g., SearXNG)
claude mcp add -e SEARCH_PROVIDER=searxng -e SEARCH_API_URL=http://127.0.0.1:8080 one-search-mcp -- npx -y one-search-mcp
# Add with Tavily API
claude mcp add -e SEARCH_PROVIDER=tavily -e SEARCH_API_KEY=your_api_key one-search-mcp -- npx -y one-search-mcp
```
### Manual Installation
```bash
# Install globally (Optional)
npm install -g one-search-mcp
# Or run directly with npx
npx -y one-search-mcp
```
## Environment Variables
**Search Engine:**
- **SEARCH_PROVIDER** (Optional): The search provider to use, supports `searxng`, `duckduckgo`, `bing`, `tavily`, `google`, `zhipu`, `exa`, `bocha`, `local`, default is `local`.
- **SEARCH_API_URL** (Optional): The URL of the SearxNG API, or Google Custom Search Engine ID for `google`.
- **SEARCH_API_KEY** (Optional): The API key for the search provider, required for `tavily`, `bing`, `google`, `zhipu`, `exa`, `bocha`.
```ts
// supported search providers
export type SearchProvider = 'searxng' | 'duckduckgo' | 'bing' | 'tavily' | 'google' | 'zhipu' | 'exa' | 'bocha' | 'local';
```
### Search Provider Configuration
| Provider | API Key Required | API URL Required | Notes |
|----------|-----------------|------------------|-------|
| `local` | No | No | Free, uses browser automation |
| `duckduckgo` | No | No | Free, no API key needed |
| `searxng` | Optional | Yes | Self-hosted meta search engine |
| `bing` | Yes | No | [Bing Search API](https://learn.microsoft.com/en-us/previous-versions/bing/search-apis/bing-web-search/create-bing-search-service-resource) |
| `tavily` | Yes | No | [Tavily API](https://tavily.com/) |
| `google` | Yes | Yes (Search Engine ID) | [Google Custom Search](https://developers.google.com/custom-search/v1/overview) |
| `zhipu` | Yes | No | [ζΊθ°± AI](https://bigmodel.cn/dev/api/search-tool/web-search) |
| `exa` | Yes | No | [Exa AI](https://exa.ai/) |
| `bocha` | Yes | No | [εζ₯ AI](https://open.bochaai.com/) |
## Configuration for Other MCP Clients
### Claude Desktop
Add to your Claude Desktop configuration file:
**macOS**: `~/Library/Application Support/Claude/claude_desktop_config.json`
**Windows**: `%APPDATA%\Claude\claude_desktop_config.json`
```json
{
"mcpServers": {
"one-search-mcp": {
"command": "npx",
"args": ["-y", "one-search-mcp"],
"env": {
"SEARCH_PROVIDER": "local"
}
}
}
}
```
### Cursor
Add to your `mcp.json` file:
```json
{
"mcpServers": {
"one-search-mcp": {
"command": "npx",
"args": ["-y", "one-search-mcp"],
"env": {
"SEARCH_PROVIDER": "local"
}
}
}
}
```
### Windsurf
Add to your `./codeium/windsurf/model_config.json` file:
```json
{
"mcpServers": {
"one-search-mcp": {
"command": "npx",
"args": ["-y", "one-search-mcp"],
"env": {
"SEARCH_PROVIDER": "local"
}
}
}
}
```
## Self-hosting SearXNG (Optional)
If you want to use SearXNG as your search provider, you can deploy it locally using Docker:
**Prerequisites:**
- Docker installed and running (version 20.10.0 or higher)
- At least 4GB of RAM available
**Quick Start:**
```bash
# Clone SearXNG Docker repository
git clone https://github.com/searxng/searxng-docker.git
cd searxng-docker
# Start SearXNG
docker compose up -d
```
After deployment, SearXNG will be available at `http://127.0.0.1:8080` by default.
**Configure OneSearch to use SearXNG:**
```bash
# Set environment variables
export SEARCH_PROVIDER=searxng
export SEARCH_API_URL=http://127.0.0.1:8080
```
For more details, see the [official SearXNG Docker documentation](https://github.com/searxng/searxng-docker).
## Troubleshooting
### Browser not found error
If you see an error like "Browser not found", the server couldn't detect any installed Chromium-based browser. Please install one of the following:
- **Google Chrome**:
- **Microsoft Edge**:
- **Chromium**:
Or install via agent-browser:
```bash
npx agent-browser install
```
## License
MIT License - see [LICENSE](./LICENSE) file for details.