Projects in Awesome Lists tagged with firecrawl
A curated list of projects in awesome lists tagged with firecrawl .
https://github.com/firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
batch-processing claude content-extraction data-collection firecrawl firecrawl-ai javascript-rendering llm-tools mcp mcp-server model-context-protocol search-api web-crawler web-scraping
Last synced: 07 Apr 2026
https://github.com/firecrawl/open-scouts
AI-powered web monitoring platform. Create automated scouts that search the web and send email alerts when they find what you're looking for.
ai-agents alerts automation email-notifications firecrawl nextjs open-source openai posthog react resend supabase tailwindcss typescript vercel web-monitoring web-scraping
Last synced: 11 Feb 2026
https://github.com/yokingma/search_with_ai
Open AI Search, Support DeepResearch, DeepSeek R1, Ollama/LMStudio, SearXNG, Docker. AI搜索引擎，支持DeepResearch, 本地模型、深度思考模型（DeepSeek R1）、聚合搜索引擎SearXNG，支持Docker一键部署。
deep-research deepresearch deepseek-r1 firecrawl perplexity rag search searxng tavily
Last synced: 13 Sep 2025
https://github.com/essamamdani/search-result-scraper-markdown
This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.
ai browserless exa exaai fastapi firecrawl groq httpx jina markdown metasearch openai proxy python reader requests scrape searxng
Last synced: 28 Oct 2025
https://github.com/mendableai/firegraph
📈 Create beautiful graphs in seconds. Plot github stars or your own csvs. Think ray.so for graphs. Built by the Firecrawl team.
csv firecrawl firegraph github github-stars graph visualization
Last synced: 10 Apr 2025
https://github.com/us/crw
Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
ai ai-agents crawler data-extraction docker firecrawl firecrawl-alternative html-to-markdown llm markdown mcp mcp-server rust scraping-api self-hosted tavily-alternative web-crawler web-scraper web-scraping web-search-api
Last synced: 09 May 2026
https://github.com/rokbenko/crew-news
CrewNews is an AI news generator that delivers an unbiased version of the news for a given topic, using Streamlit for the GUI, Llama 3.1 as the LLM (inferenced via the AIML API), CrewAI for building AI agents, AgentOps for testing AI agents, and Exa & Firecrawl as tools
agentops aiml crewai crewai-tools exa firecrawl llama-3-1 python streamlit
Last synced: 06 Oct 2025
https://github.com/ibz-04/seeker
Your personal deep research ai agent
agentic-ai ai-agents autonomous-agents deep-research deepresearch deepseek-r1 firecrawl fireworksai langchain llm nlp o3-mini open-deep-research open-source openai research-agent research-ai research-assistant research-tool typescript
Last synced: 14 Oct 2025
https://github.com/mendableai/openai-structured-outputs-with-firecrawl
This repository demonstrates how to leverage OpenAI's GPT-4 models with JSON Strict Mode to extract structured data from web pages. It combines web scraping capabilities from Firecrawl with OpenAI's advanced language models to create a powerful data extraction pipeline.
firecrawl json llm openai structured-output
Last synced: 14 Apr 2025
https://github.com/cameronking4/nextjs-firecrawl-starter
Nextjs 15 Firecrawl app to scrape doc links for an LLM. Use it as a starter kit to build your Firecrawl app. Turn any developer documentation into a GPT knowledge base. Pre-made Github Action to crawl and commit markdown responses to repo.
docs firecrawl github-actions llm nextjs rombo shadcn-ui web-scraping
Last synced: 04 Sep 2025
https://github.com/paperfoot/search-cli
Multi-provider web search CLI for AI agents — Brave, Serper, Exa, Jina, Firecrawl, Perplexity, xAI in one Rust binary
ai-agent-tools brave-search cli-tool command-line-tool developer-tools exa firecrawl jina mcp meta-search multi-provider-search perplexity rust-cli search-cli search-engine serper tavily web-scraping web-search-api xai
Last synced: 18 Apr 2026
https://github.com/iBz-04/Seeker
Your personal deep research ai agent, a free & open source alternative to open-ai deep research
ai-agents deep-research deepresearch deepseek-r1 firecrawl fireworksai o3-mini open-deep-research open-source openai research-agent research-ai research-assistant research-tool typescript
Last synced: 07 Apr 2025
https://github.com/extrawest/fastapi-langgraph-chatbot-with-vector-store-memory-mcp-tools-and-voice-mode
A scalable AI chatbot platform built with FastAPI and LangGraph, featuring multi-agent orchestration, multi-tenant vector storage, cross-chat memory, and voice call capabilities through LiveKit integration.
fastapi firecrawl langchain langraph livekit mcp mem0 multiagent python qdrant tavily voice-assistant
Last synced: 05 Apr 2026
https://github.com/gurpreetkaurjethra/ai-lead-generation-agent
AI Lead Generation Agent that automatically discovers and qualifies potential leads from Quora. Using Firecrawl for intelligent web scraping, Phidata for agent orchestration, and Composio for Google Sheets integration, you'll create a system that can continuously generate and organize qualified leads with minimal human intervention!
aiagent aiagents aiagentsframework aidevelopment artificial-intelligence composio firecrawl generative-ai googlesheets gpt4 largelanguagemodel leadgeneration llm openai phidata quora sales web-scraping
Last synced: 19 May 2026
https://github.com/obeone/firecrawl-ui
Firecrawl UI interact with the Firecrawl API. It allows you to scrape pages, launch crawls and extract structured data through a simple web interface.
firecrawl firecrawl-api firecrawl-ui
Last synced: 18 Jan 2026
https://github.com/mendableai/firecrawl-docs
Documentation for Firecrawl.
docs firecrawl firecrawl-ai firecrawl-mcp
Last synced: 12 Jun 2025
https://github.com/alexsmedile/firecrawl-lean
Firecrawl Skill: Scrape, Search, Crawl, Browse. Token-efficient scraping skill, optimized for Claude Code, Codex, Gemini.
claude-code-skill firecrawl firecrawl-alternative skills
Last synced: 16 May 2026
https://github.com/tryagi/firecrawl
Generated C# SDK based on official Firecrawl OpenAPI specification
ai crawler crawling dotnet firecrawl generated generator langchain langchain-dotnet net8 netframework netstandard openapi scrape scraping sdk
Last synced: 12 Apr 2025
https://github.com/dylan-gluck/freecrawl-mcp
A production-ready mcp server for web scraping and document processing. Drop-in replacement for FireCrawl.
claude-code firecrawl freecrawl mcp mcp-scraper mcp-server scrape scraper
Last synced: 07 May 2026
https://github.com/symfony/ai-firecrawl-tool
Firecrawl AI tool bridge for Symfony applications.
agent ai bridge firecrawl llm symfony symfony-ai tool
Last synced: 10 Apr 2026
https://github.com/vikas-kashyap97/market-intelligence-agent
An AI-powered Market Intelligence Agent that analyzes live market data, extracts insights using LLMs, generates strategic recommendations, and visualizes trends with interactive charts — built with Streamlit, LangChain, Firecrawl, and Plotly.
agents ai aiworkflow database firecrawl google groq llm newsapi notion plotly tavily
Last synced: 20 May 2026
https://github.com/petermartens98/firecrawl-llm-website-info-finder-python-streamlit-app-
Streamlit app for scraping multiple websites with Firecrawl. Define custom schemas dynamically, input URLs, and get JSON output. Simple and robust.
firecrawl llm pydantic python streamlit
Last synced: 03 Sep 2025
https://github.com/theanh130124/medical_news
An academic project on a medical news system, developed using Spring Boot and ReactJS with TSX, implementing RAG to build a disease diagnosis chatbot and X-Rays based on data crawled using Selenium.
cloudinary docker firebase firecrawl langchain mae n8n-workflow oauth2 phobert pineconedb rag-chatbot reactjs selenium-python sentence-transformers spring-boot springsecurity vision-transformer web-rtc x-ray-images
Last synced: 13 Apr 2026
https://github.com/rs-labhub/secret-scraper
A powerful web scraping application that aggregates trending products from GitHub and ProductHunt.
firecrawl github-api github-scraper producthunt-scraper python scraper typescript
Last synced: 09 Oct 2025
https://github.com/smaranjitghose/devtooloracle
An intelligent developer assistant that helps you discover and compare developer tools based on your query
agent ai-agent firecrawl gpt-4o-mini langchain langgraph python
Last synced: 24 Apr 2026
https://github.com/bjornmelin/linkedin-saved-posts-ai
Scrape, classify & chat over your LinkedIn Saved Posts with Supabase, pgvector, Vercel Edge Functions, Playwright MCP and OpenRouter + OpenAI LLMs.
ai ai-agents browser-use firecrawl gemini linkedin nextjs openai openai-agents-sdk openrouter pgvector playwright rag saved-posts supabase typescript vector-search vercel
Last synced: 11 Apr 2026
https://github.com/ibtisamafzal/voyance
AI visual web research agent — natural language → Gemini vision navigates live sites → spoken briefing + comparison table. UI Navigator @ Gemini Live Agent Challenge.
ai-agent cloud-run elevenlabs fastapi firecrawl gemini google-cloud hackathon perplexity playwright react ui-navigator vite web-research
Last synced: 08 Apr 2026
https://github.com/junfanz1/llm-documentation-chatbot
A sophisticated chatbot application that helps users navigate and understand LangChain documentation through an interactive, user-friendly interface.
chatbot firecrawl langchain llm openai pinecone streamlit vector-database
Last synced: 05 May 2026
https://github.com/ahmadjamil888/ahmadgpt
Ahmad GPT is a powerful generative AI built by Ahmad Jamil, capable of creating text, code, images, and speech using advanced NLP and multimodal capabilities.
agent ahmad ai ai-assistant app artificial-intelligence assistant botpress demo firecrawl gen generative gpt jamil prompt wikipedia
Last synced: 25 Jan 2026
https://github.com/dwain-barnes/dria-livekit-agent-deep-research
DRIA (Deep Research and Intelligence Agent) is a fully local voice assistant that can hold real-time conversations while performing deep research in the background — powered by Firecrawl, Mistral AI, Perplexica, and LiveKit.
deep-research docker firecrawl kokoro-tts livekit llm-agent local-ai mistral-ai offline-assistant ollama open-source perplexica real-time-ai-deep-research speech-to-text voice-assistant
Last synced: 09 May 2026
https://github.com/04bhavyaa/developer-tools-research-agent
ai-agents firecrawl langchain langchain-google-genai langgraph mcp python
Last synced: 20 Apr 2026
https://github.com/hmshb/scraping-agent-ai
AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. 🚀
agentic-ai ai ai-agent ai-agents anthropic-claude bots firecrawl generative-ai langchain langgraph llms nlp scraper scrapping-php scrapping-python web web-scraper web-scraping workflow
Last synced: 28 Jul 2025
https://github.com/ourahma/web-search-ai-agent
An AI-powered application that searches, analyzes, and recommends developer tools using web scraping and a Large Language Model (LLM).
firecrawl firecrawl-mcp mcp-server
Last synced: 17 Aug 2025
https://github.com/rmncldyo/firecrawl-toolkit
The Firecrawl Toolkit is the easiest way for developers to interact with web content through crawling, scraping, and mapping capabilities.
ai-batch-scrape ai-crawler ai-scraper ai-toolkit batch-scrape crawl fire-crawl firecrawl firecrawl-ai map scrape sitemap sitemap-crawler sitemap-scraper web-crawler web-scraper
Last synced: 17 Aug 2025
https://github.com/jezweb/n8n-nodes-firecrawl-tool
n8n community node for Firecrawl v2 API - Web scraping, crawling, and data extraction tool for workflows and AI agents
ai-tool firecrawl n8n n8n-node web-scraping workflow-automation
Last synced: 20 Jan 2026
https://github.com/bjornmelin/openai-agents-travel-graph
🧳 A state-of-the-art multi-agent travel planning system powered by OpenAI Agents SDK and LangGraph orchestration. Leverages Stagehand/Playwright for browser automation, Supabase for data persistence, and Firecrawl/Tavily for intelligent research.
ai-travel-planning autonomous-planning browser-automation budget-optimization firecrawl itinerary-planning langchain langgraph multi-agent-system openai openai-agents playwright stagehand supabase tavily-api travel-recommendations
Last synced: 29 Apr 2026
https://github.com/smaranjitghose/websage
AI agent that can scrape websites, crawl pages, and extract structured data in real-time to answer your complex queries
agent ai-agent firecrawl gpt-4o-mini gpt-o4-mini langchain langgraph mcp mcp-server python
Last synced: 07 May 2026
https://github.com/asheint/advanced-research-agent
Advanced AI Agent for developer tool research using LangGraph, OpenAI GPT-4, and Firecrawl
ai-agent automation developer-tools firecrawl langchain langgraph pydantic python research-tool
Last synced: 20 Jun 2025
https://github.com/federicodeponte/openjobs
AI-powered job scraper - extract listings from any careers page in 3 lines of code
ai careers firecrawl gemini job-scraper python scraping web-scraping
Last synced: 15 Jan 2026
https://github.com/agarwalvishal/markdownify
Convert websites to LLM ready markdown format
ai firecrawl html-to-markdown llm markdown rag
Last synced: 16 Apr 2026
https://github.com/rahulsamant37/agentic_rag_crewai
A powerful Retrieval-Augmented Generation (RAG) system built with CrewAI that intelligently searches through documents and falls back to web search when needed. Features local LLM support with deep-seek-r1 or llama 3.2!
agentic-rag crewai deepseek firecrawl llama3 retrieval-augmented-generation serperapi uv
Last synced: 17 Apr 2026
https://github.com/asheint/langgraph-advanced-research-agent
Advanced AI Agent for developer tool research using LangGraph, OpenAI GPT-4, and Firecrawl
ai-agent automation developer-tools firecrawl langchain langgraph pydantic python research-tool
Last synced: 14 May 2026
https://github.com/soenneker/soenneker.firecrawl.openapiclientutil
A thread-safe utility for obtaining Firecrawl's OpenApiClient singleton.
api client csharp dotnet firecrawl firecrawlopenapiclientutil kiota openapi openapiclientutil singleton util
Last synced: 11 Jun 2026
https://github.com/soenneker/soenneker.firecrawl.httpclients
A thread-safe singleton HttpClient for Firecrawl's OpenAPI integration.
api csharp dotnet firecrawl firecrawlopenapihttpclient httpclient httpclients openapi singleton
Last synced: 07 Jun 2026