Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with ai-scraping
A curated list of projects in awesome lists tagged with ai-scraping .
https://github.com/mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
ai ai-scraping crawler data html-to-markdown llm markdown rag scraper scraping web-crawler
Last synced: 25 Sep 2024
https://github.com/spider-rs/spider
The fastest web crawler written in Rust. Maintained by @a11ywatch.
ai-scraping crawler headless-chrome indexer llm-crawler rust scraping spider web-crawler
Last synced: 31 Jul 2024
https://github.com/madeindjs/spider
The fastest web crawler written in Rust. Maintained by @a11ywatch.
ai-scraping crawler headless-chrome indexer llm-crawler rust scraping spider web-crawler
Last synced: 03 Aug 2024