Projects in Awesome Lists tagged with firecrawl
A curated list of projects in awesome lists tagged with firecrawl .
https://github.com/mendableai/firecrawl-mcp-server
Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM clients.
batch-processing claude content-extraction data-collection firecrawl firecrawl-ai javascript-rendering llm-tools mcp-server model-context-protocol search-api web-crawler web-scraping
Last synced: 13 May 2025
https://github.com/yokingma/search_with_ai
Open AI Search, Support DeepResearch, DeepSeek R1, Ollama/LMStudio, SearXNG, Docker. AI搜索引擎，支持DeepResearch, 本地模型、深度思考模型（DeepSeek R1）、聚合搜索引擎SearXNG，支持Docker一键部署。
deep-research deepresearch deepseek-r1 firecrawl perplexity rag search searxng tavily
Last synced: 15 May 2025
https://github.com/essamamdani/search-result-scraper-markdown
This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.
ai browserless exa exaai fastapi firecrawl groq httpx jina markdown metasearch openai proxy python reader requests scrape searxng
Last synced: 04 Apr 2025
https://github.com/mendableai/firegraph
📈 Create beautiful graphs in seconds. Plot github stars or your own csvs. Think ray.so for graphs. Built by the Firecrawl team.
csv firecrawl firegraph github github-stars graph visualization
Last synced: 10 Apr 2025
https://github.com/rokbenko/crew-news
CrewNews is an AI news generator that delivers an unbiased version of the news for a given topic, using Streamlit for the GUI, Llama 3.1 as the LLM (inferenced via the AIML API), CrewAI for building AI agents, AgentOps for testing AI agents, and Exa & Firecrawl as tools
agentops aiml crewai crewai-tools exa firecrawl llama-3-1 python streamlit
Last synced: 10 Apr 2025
https://github.com/mendableai/openai-structured-outputs-with-firecrawl
This repository demonstrates how to leverage OpenAI's GPT-4 models with JSON Strict Mode to extract structured data from web pages. It combines web scraping capabilities from Firecrawl with OpenAI's advanced language models to create a powerful data extraction pipeline.
firecrawl json llm openai structured-output
Last synced: 14 Apr 2025
https://github.com/vrknetha/mcp-server-firecrawl
FireCrawl MCP Server is a powerful web scraping integration for Claude and other LLMs. It provides JavaScript rendering, batch processing, and search capabilities through a Model Context Protocol (MCP) interface. Now with support for self-hosted instances and advanced features like parallel processing, automatic retries, and content filtering
batch-processing claude content-extraction data-collection firecrawl firecrawl-ai javascript-rendering llm-tools mcp-server model-context-protocol search-api web-crawler web-scraping
Last synced: 20 Jan 2025
https://github.com/iBz-04/Seeker
Your personal deep research ai agent, a free & open source alternative to open-ai deep research
ai-agents deep-research deepresearch deepseek-r1 firecrawl fireworksai o3-mini open-deep-research open-source openai research-agent research-ai research-assistant research-tool typescript
Last synced: 07 Apr 2025
https://github.com/tryagi/firecrawl
Generated C# SDK based on official Firecrawl OpenAPI specification
ai crawler crawling dotnet firecrawl generated generator langchain langchain-dotnet net8 netframework netstandard openapi scrape scraping sdk
Last synced: 12 Apr 2025
https://github.com/petermartens98/firecrawl-llm-website-info-finder-python-streamlit-app-
Streamlit app for scraping multiple websites with Firecrawl. Define custom schemas dynamically, input URLs, and get JSON output. Simple and robust.
firecrawl llm pydantic python streamlit
Last synced: 07 Mar 2025
https://github.com/bjornmelin/linkedin-saved-posts-ai
Scrape, classify & chat over your LinkedIn Saved Posts with Supabase, pgvector, Vercel Edge Functions, Playwright MCP and OpenRouter + OpenAI LLMs.
ai ai-agents browser-use firecrawl gemini linkedin nextjs openai openai-agents-sdk openrouter pgvector playwright rag saved-posts supabase typescript vector-search vercel
Last synced: 27 Apr 2025
https://github.com/junfanz1/llm-documentation-chatbot
A sophisticated chatbot application that helps users navigate and understand LangChain documentation through an interactive, user-friendly interface.
chatbot firecrawl langchain llm openai pinecone streamlit vector-database
Last synced: 03 Mar 2025
https://github.com/dwain-barnes/dria-livekit-agent-deep-research
DRIA (Deep Research and Intelligence Agent) is a fully local voice assistant that can hold real-time conversations while performing deep research in the background — powered by Firecrawl, Mistral AI, Perplexica, and LiveKit.
deep-research docker firecrawl kokoro-tts livekit llm-agent local-ai mistral-ai offline-assistant ollama open-source perplexica real-time-ai-deep-research speech-to-text voice-assistant
Last synced: 13 Apr 2025
https://github.com/tuantailtt/linkedin-saved-posts-ai
Scrape, classify & chat over your LinkedIn Saved Posts with Supabase, pgvector, Vercel Edge Functions, Playwright MCP and OpenRouter + OpenAI LLMs.
ai ai-agents browser-use firecrawl gemini linkedin openai-agents-sdk openrouter pgvector playwright saved-posts supabase vector-search vercel
Last synced: 30 Apr 2025
https://github.com/bjornmelin/openai-agents-travel-graph
🧳 A state-of-the-art multi-agent travel planning system powered by OpenAI Agents SDK and LangGraph orchestration. Leverages Stagehand/Playwright for browser automation, Supabase for data persistence, and Firecrawl/Tavily for intelligent research.
ai-travel-planning autonomous-planning browser-automation budget-optimization firecrawl itinerary-planning langchain langgraph multi-agent-system openai openai-agents playwright stagehand supabase tavily-api travel-recommendations
Last synced: 09 May 2025
https://github.com/rmncldyo/firecrawl-toolkit
The Firecrawl Toolkit is the easiest way for developers to interact with web content through crawling, scraping, and mapping capabilities.
ai-batch-scrape ai-crawler ai-scraper ai-toolkit batch-scrape crawl fire-crawl firecrawl firecrawl-ai map scrape sitemap sitemap-crawler sitemap-scraper web-crawler web-scraper
Last synced: 23 Feb 2025
https://github.com/hmshb/scraping-agent-ai
AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. 🚀
agentic-ai ai ai-agent ai-agents anthropic-claude bots firecrawl generative-ai langchain langgraph llms nlp scraper scrapping-php scrapping-python web web-scraper web-scraping workflow
Last synced: 27 Mar 2025
