Projects in Awesome Lists tagged with url-crawler
A curated list of projects in awesome lists tagged with url-crawler .
https://github.com/kevincobain2000/email_extractor
Yes it works! God Speed. Email Extractor by Full Url Crawl. Extract emails and web urls from a website with full crawl or option limit, depth of urls to crawl using terminal.
crawl-all-urls email email-extraction email-extractor email-marketing online-email-extractor url-crawler
Last synced: 06 Apr 2025
https://github.com/komodoooo/some-things
Scripts, POCs & bullshit
adb-android bugbounty compromised-emails cve-poc cybersec-resources deauthentication-attack dorks network-sniffing scripts shell-shoveling shellcode sqli-scanner ssh-bruteforce ssl-scanner url-crawler utilities xss-payloads youtube-views
Last synced: 24 Apr 2025
https://github.com/cyclone-github/spider
URL Spider - web crawler and wordlist / ngram generator
cewl crawler cyclone generator gramify n-gram ngram ngram-generator scaping scraper spider url url-crawler url-spider web web-crawler web-scraping wordlist wordlist-generator
Last synced: 07 Apr 2025
https://github.com/elektrostudios/google-search-url-crawler
Desktop app that crawls urls from Google's search engine results
crawl crawler crawlers crawling dotnet google google-crawler google-search googlesearch hacking search search-engine searcher tool tools url url-crawler vbnet windows winforms
Last synced: 25 Jul 2025
https://github.com/limit-zero/url-juicer
🍊🔗 Squeeze some juice from URLs: A URL crawler/extraction library.
nodejs url-crawler url-extractor
Last synced: 27 Apr 2025
https://github.com/iampukar/url_crawler
A Python library to crawl the details of a URL.
page-crawler python-crawler python-webcrawler url-crawler webpage-crawler
Last synced: 12 Apr 2025
https://github.com/mdigger/urlinfo
Rich Content API (URL Content Info)
rich-content url-crawler url-info
Last synced: 12 Feb 2026
