Projects in Awesome Lists tagged with concurrent-web-crawler
A curated list of projects in awesome lists tagged with concurrent-web-crawler .
https://github.com/dineshsprabu/concurrent-web-crawler
Flexible and concurrent web crawler implemented in 'go'
concurrent-web-crawler crawler go-crawler spider web-crawler
Last synced: 12 Jan 2026
https://github.com/lokesh-loky/concurrent-web-crawler
The Concurrent Web Crawler is a Go-based application designed to crawl web pages efficiently using Go's powerful concurrency features.
aiohttp async-python asyncio concurrent-web-crawler graph-generation html-parsing java multithreading pluggable-modules scraper spider warc web-spider webcrawler
Last synced: 30 Apr 2026