Projects in Awesome Lists tagged with python-web-scraping
A curated list of projects in awesome lists tagged with python-web-scraping .
https://github.com/omkarcloud/botasaurus
The All in One Framework to Build Undefeatable Scrapers
anti-bot anti-detect anti-detect-browser anti-detection antidetect-browser bot-detection bypass-cloudflare cloudflare-bypass cloudflare-scrape python-scraper python-web-scraper python-web-scraping scraping-framework scraping-python scraping-tool undetectable undetected undetected-chromedriver web-crawling web-scraping-python
Last synced: 13 May 2025
https://github.com/thewebscraping/tls-requests
TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.
anti-bot anti-bot-detection anti-bot-page cf-clearance cloudflare-bypass cloudflare-scraper crawling-python python-crawler python-scraper python-spider python-tls-client python-web-crawler python-web-scraper python-web-scraping scraping-python tls-client web-crawler-python web-scraping-api web-scraping-python web-spider
Last synced: 09 Apr 2025
https://github.com/oxylabs/how-to-make-web-scraping-faster
How to Make Web Scraping Faster - Python Tutorial
github-python python python-web-scraping web-scraping web-scraping-api web-scraping-tutorials web-scraping-with-python
Last synced: 23 Apr 2025
https://github.com/ayemunhossain/scrapy-web-crawler-projects
Python crawler with Scrapy framework, which may help you to learn webscrapping.
python-web-scraping python-webscraping-application scrapy scrapy-crawler scrapy-python scrapy-spider webscraping
Last synced: 24 Mar 2025
https://github.com/oxylabs/how-to-build-web-scraper
Step by step guide to building a web scraper with Python
build-a-web-scraper github-python parser python python-web-scraper python-web-scraping python3 url-scraper web-scraping
Last synced: 11 Mar 2025
https://github.com/mohnish88/web-scrapping
In this project, I used web scraping tools to extract data from daraz.pk, a popular e-commerce platform. Utilizing the BeautifulSoup and Selenium libraries in Python, I was able to efficiently navigate the website, extract valuable information on product listings, prices, and reviews, and store the data for further analysis.
beautifulsoup beautifulsoup4 html-parsing python-web-scraping scrapping-python selenium selenium-python selenium-webdriver web-scraping
Last synced: 23 Feb 2025
https://github.com/maxinexiong/music-events-web-scraper
A web scraping program built to extract attribute data on music events from a popular event ticketing website. The program collects event data based on the specified country and city, which is then exported to a CSV file for marketing emails and stored efficiently in a local PostgreSQL database.
beautifulsoup4 csv-export data-migration email-sender pandas-dataframe postgresql postgresql-database psycopg2 python python-web-scraper python-web-scraping requests-python smtplib web-scraping
Last synced: 08 Apr 2025
https://github.com/oxylabs/python-cache-tutorial
A guide to caching web scraping scripts in Python.
api-python cache caching jason-database-python json-database python python-ecommerce python-image-scraper python-web-crawler python-web-scraper python-web-scraping scraper web-scraping-python
Last synced: 11 Mar 2025