https://github.com/firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
https://github.com/firecrawl/firecrawl
ai ai-agents ai-crawler ai-scraping ai-search crawler data-extraction html-to-markdown llm markdown scraper scraping web-crawler web-data web-data-extraction web-scraper web-scraping web-search webscraping
Last synced: 17 days ago
JSON representation
The API to search, scrape, and interact with the web at scale. 🔥
- Host: GitHub
- URL: https://github.com/firecrawl/firecrawl
- Owner: firecrawl
- License: agpl-3.0
- Created: 2024-04-15T21:02:29.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-06-30T03:05:32.000Z (24 days ago)
- Last Synced: 2026-06-30T03:08:28.199Z (24 days ago)
- Topics: ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler, data-extraction, html-to-markdown, llm, markdown, scraper, scraping, web-crawler, web-data, web-data-extraction, web-scraper, web-scraping, web-search, webscraping
- Language: TypeScript
- Homepage: https://firecrawl.dev
- Size: 89.8 MB
- Stars: 141,579
- Watchers: 381
- Forks: 8,152
- Open Issues: 374
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
- Agents: AGENTS.md
Awesome Lists containing this project
- stargazer - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 \[*GNU AGPLv3*\] (⭐️153901) (TypeScript)
- awesome-scrapers - Firecrawl - ready markdown or structured data via API. | (🤖 AI-Powered Scraping)
- awesome - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- awesome-ai-agents - Firecrawl - ready markdown or structured data | (🚀 Specialized Agents / 🌐 Web & Computer Use Agents)
- awesome - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- AiTreasureBox - firecrawl/firecrawl - 11-09_66957_68](https://img.shields.io/github/stars/firecrawl/firecrawl.svg)|The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥| (Repos)
- awesome - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- awesome-ccamel - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- awesome-github-projects - firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 ⭐145,243 `TypeScript` 🔥 (🤖 AI & Machine Learning)
- awesome-github-repos - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- awesome-opensource-ai - Firecrawl - Web Data API for AI - search, scrape, and interact with the web at scale. Clean markdown/JSON output with proxy rotation and JS-blocking handled automatically.  (5. Retrieval-Augmented Generation (RAG) & Knowledge)
- Awesome-RAG-Production - Firecrawl
- awesome-ai-agents - firecrawl/firecrawl - Firecrawl is an advanced web data API that crawls and scrapes entire websites to convert content into clean, LLM-ready markdown or structured data for AI applications. (Web Automation and UI Interaction / Browser Automation)
- awesome-x-ops - Firecrawl - ready Markdown and structured outputs. (AI Infrastructure)
- awesome-local-llms - firecrawl
- awesome-data-analysis - firecrawl - Web crawling and data extraction service for AI applications. (🧠 AI Applications & Platforms / Tools)
- awesome - firecrawl/firecrawl - The API to search, scrape, and interact with the web at scale. 🔥 (TypeScript)
- definitive-opensource - Firecrawl
- awesome-agent-frameworks - Firecrawl - Firecrawl has grown to become one of the primary web data ingestion tools for AI pipelines, with a clean REST API and SDK that converts any website to clean, LLM-ready markdown. (Data / ingestion / MLOps substrate)
- awesome-agentic-engineering - Firecrawl - Open-source web context API for agents; searches, scrapes, crawls, and converts live web content into clean Markdown or structured data, with MCP support for agent workflows.  (Browser, Web & Computer Use Agents / Commercial Offering)
- my-awesome-list - firecrawl
- awesome-ai-agents - Firecrawl - ready markdown or structured data. (Agent Infrastructure / Data Extraction)
- Awesome-GitHub-Repo - firecrawl - "把网站变成 LLM-ready 数据"的 API，支持 Scrape / Search / Browse / Crawl / Map / Batch 等操作。 (信息获取 / 爬虫与抓取框架)
- awesome-side-quests - firecrawl/firecrawl - ready data — scraping, crawling, and structured extraction as a service (AI & LLM / Agents & Orchestration)
- awesome-ai-200 - firecrawl/firecrawl