Projects in Awesome Lists tagged with scraping-data

https://github.com/pavlovtech/WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

crawler datamining parser parsing scraper scraping scraping-api scraping-data scraping-tool scraping-web scraping-websites webcrawler webscraping

Last synced: 08 Apr 2025

https://github.com/ScrapingAnt/amazon_scraper

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

amazon amazon-scraper amazon-scraping-library data-mining js node-js price-scraper price-scraping scrape-products scraper scraping scraping-api scraping-data scraping-python scraping-web scraping-websites web-crawler web-crawlers web-crawling

Last synced: 06 Apr 2025

https://github.com/scrapingant/amazon_scraper

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

amazon amazon-scraper amazon-scraping-library data-mining js node-js price-scraper price-scraping scrape-products scraper scraping scraping-api scraping-data scraping-python scraping-web scraping-websites web-crawler web-crawlers web-crawling

Last synced: 20 Dec 2024

https://github.com/lspahija/torchestrator

Spin up Tor containers and then proxy HTTP requests via these Tor instances

data-scraping docker free-proxies kotlin privoxy proxies proxies-generator proxies-https-traffic proxy proxy-checker proxy-list proxy-scraper proxy-server proxypool scraping scraping-data scraping-tool scraping-websites scrapy tor

Last synced: 30 Apr 2025

https://github.com/scrapingant/zoominfo_scraper

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

datamining leadgen leadgeneration python scraper scraping scraping-api scraping-data scraping-tool scraping-websites web-crawler web-crawler-python web-crawling web-harvesting zoominfo-client

Last synced: 11 Jun 2025

https://github.com/scrapingant/alibaba_scraper

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

alibaba-scraper datamining price-scraper price-scraping python scraper scraping scraping-api scraping-data scraping-tool scraping-web scraping-websites web-crawler web-crawler-python web-crawling

Last synced: 16 Dec 2024

https://github.com/tortuc/python-scrapying-toexcel

Python Scraping Script made using python/ Scrapy and Selenium to extract data and export data as an Excel. main features are Auto-Search and extract in multi-section, Auto pagination clicking. Possibility of the store to databases including MySQL, SQLite, MongoDB

excel excel-export export-to-excel python python-scrapying-toexcel scraping-data scraping-python scraping-websites scrapy selenium web-scraping