https://github.com/cyclone-github/spider

URL Spider - web crawler and wordlist / ngram generator

cewl crawler cyclone generator gramify n-gram ngram ngram-generator scaping scraper spider url url-crawler url-spider web web-crawler web-scraping wordlist wordlist-generator

Last synced: 07 Apr 2025

https://github.com/brandenc40/safer

An API to scrape data from the Department of Transportation's Safety and Fitness Electronic Records (SAFER) System.

company dot fmcsa golang mc mx safer scaping scrape scraper snapshot usdot webscraping

Last synced: 11 Apr 2025

https://github.com/akifcan/covid-19-asi-api-turkiye

cheerio scaping web

Last synced: 16 May 2025

https://github.com/giuliacassara/realtimetherapyfinder

Use SciSpacy to retrieve medical knowledge from PubMed and build a real-time platform for disease-therapy associations.

bio pubmed scaping scispacy

Last synced: 09 Jun 2026

https://github.com/miskler/human-requests

Asynchronous library for browser‑like HTTP scenarios with controlled offline rendering and two‑way state transfer.

anti-bot antibot asyncio curl-cffi playwright python3 scaping scraper

Last synced: 18 May 2026