Projects in Awesome Lists by oxylabs
A curated list of projects in awesome lists by oxylabs .
https://github.com/oxylabs/amazon-scraper
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
amazon-aip amazon-api amazon-api-data amazon-price-tracker amazon-product-scraper amazon-products-api amazon-scrape-api amazon-scraper amazon-scraper-api amazon-scraping amazon-scraping-library e-commerce-api how-to-scrape-amazon price-scraper price-scraper-api python scrape-amazon scraping-amazon scraping-api web-scraping
Last synced: 14 May 2025
https://github.com/oxylabs/google-news-scraper
Use Google News API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
api-for-google-news api-google-news api-stock-news free-google-news-api google-news-api google-news-scraper google-scraper google-scraper-api google-search-scraper news-scraper news-scraper-api scraper-api
Last synced: 14 May 2025
https://github.com/oxylabs/google-maps-scraper
Google Maps Scraper for collecting data from various Google Maps listings, including business profiles.
google-map-scraper google-maps google-maps-api google-maps-data-scraper google-maps-reviews-scraper-python google-maps-scrape google-maps-scraper google-maps-scraper-python google-maps-scraping google-scraper google-search-scraper googlemaps-api googlemaps-scraper scrap-google scraping-reviews-from-googlemaps
Last synced: 14 Apr 2025
https://github.com/oxylabs/free-proxy-list
Claim Free proxy list with United States IP addresses and use it for your projects.
free-proxies free-proxies-for-web-scraping free-proxy free-proxy-ip free-proxy-list proxies proxies-http proxies-https proxies-list proxies-socks5 proxy proxy-list proxy-server proxypool web-scraping
Last synced: 02 Aug 2025
https://github.com/oxylabs/how-to-scrape-google-flights
Scrapes flight data from Google Flights and analyzes flight prices with Python and Oxylabs’ Google Flights API.
google-flight-api google-flights-api google-flights-api-python google-flights-python google-flights-scraper how-to-scrape-google-flights scrape-google-flights
Last synced: 15 May 2025
https://github.com/oxylabs/how-to-scrape-google-images
Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.
google-image-api google-image-scraper google-image-scraper-api google-image-search google-images-crawler google-search-scraper image-scrape image-scraper image-scraping scrape-google-image scrape-images
Last synced: 15 May 2025
https://github.com/oxylabs/how-to-scrape-google-scholar
A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.
google-scholar google-scholar-scraper google-scholar-scrapper google-search-scraper python python-scraper scraper-api web-scraper web-scraping
Last synced: 15 May 2025
https://github.com/oxylabs/quick-start-guide
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
oxylabs scraper scraper-api scraper-python scrapers scraping scraping-websites web-scraper web-scraping
Last synced: 06 Jul 2025
https://github.com/oxylabs/how-to-scrape-amazon-prices
A code for extracting best-selling items, search results, and currently available deals from Amazon using Python and Oxylabs E-Commerce Scraper API.
amazon amazon-scraper api python python-scraper scraper-api web-scraper web-scraping
Last synced: 16 May 2025
https://github.com/oxylabs/google-shopping-scraper
Google Shopping Scraper can scrape and parse various Google Shopping page types to collect structured e-commerce data.
e-commerce-scraper ecommerce-scraper ecommerce-website google-news-api google-news-scraper google-search-scraper google-shopping google-shopping-api google-shopping-scraper google-trends-api url-scraper
Last synced: 15 May 2025
https://github.com/oxylabs/how-to-bypass-amazon-captcha
The process of bypassing CAPTCHA when extracting public data from Amazon with Oxylabs Amazon Scraper API.
amazon amazon-scraper amazon-scraper-api captcha captcha-solver captcha-solving scraper-api
Last synced: 16 May 2025
https://github.com/oxylabs/web-unblocker
Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated anti-bot systems.
amazon-captcha bypass bypasscaptcha captcha captcha-breaking captcha-bypass captcha-solving rotate-captcha school-unblocker unblocked-websites unblocker unblocker-website unblocker-websites web-proxy-server web-scraper web-scraping-api web-unblocker webiste-unblocker-github website-unblocker website-unlocker
Last synced: 08 Apr 2025
https://github.com/oxylabs/python-web-scraping-tutorial
In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.
amazon-scraper-python crawler github-python json-database-python python python-projects python-web-crawler python-web-scraper scraper-python scraping web-crawler-python web-scraping web-scraping-api web-scraping-python webscraping
Last synced: 16 May 2025
https://github.com/oxylabs/amazon-review-scraper
Amazon Review Scraper for hassle-free review data extraction, including authors, titles, descriptions, ratings, dates, and more.
amazon amazon-api amazon-product-scraper amazon-review-scraper amazon-reviews amazon-scraper amazon-scraping amazon-scraping-library amazon-web-scraper url-scraper
Last synced: 12 Apr 2025
https://github.com/oxylabs/google-play-scraper
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
google google-news-api google-news-scraper google-play google-play-api google-play-scraper google-play-store google-search-scraper google-trends-api movies-api scraper
Last synced: 24 Oct 2025
https://github.com/oxylabs/amazon-asin-scraper
Amazon ASIN Scraper for effortless product ASIN extraction.
amazon amazon-asin amazon-price-tracker amazon-product-scraper amazon-scraper amazon-scraper-api asin scraper-api scraper-api-github url-scraper
Last synced: 12 Apr 2025
https://github.com/oxylabs/how-to-scrape-google-jobs
Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs
google-scraping google-search-api google-search-scraper python scraper scraper-api scraper-python serp-scraper-api serp-scraping web-scraping
Last synced: 24 Oct 2025
https://github.com/oxylabs/aliexpress-scraper
Easily collect public AliExpress data like prices, product details, and ratings with AliExpress Scraper API
ali-scraper alibaba-api aliexpress aliexpress-api aliexpress-crawler aliexpress-scraper aliexpress-spider e-commerce-api e-commerce-scraper email-crawler github-python python-web-scraper scraper-api
Last synced: 16 May 2025
https://github.com/oxylabs/youtube-scraper
YouTube Scraper for effortless public YouTube data collection, including video and channel information.
scrape-youtube scrape-youtube-videos scraper youtube youtube-api youtube-channel youtube-comment-scraper youtube-crawler youtube-data-api-v3 youtube-scraper
Last synced: 13 Apr 2025
https://github.com/oxylabs/how-to-scrape-indeed
A tutorial for collecting job postings from Indeed using Python and Oxylabs Web Scraper API.
api job-posting python scraper-api web-scraper web-scraping
Last synced: 05 Apr 2025
https://github.com/oxylabs/curl-get-requests
Learn to send GET requests with cURL and utilize request arguments for your specific case.
curl curl-commands curl-get curl-get-request curl-requests curlrequest get-request
Last synced: 05 Apr 2025
https://github.com/oxylabs/curl-post-requests
Learn how to send POST requests with cURL.
curl curl-library post post-requests scraping web-scraping
Last synced: 10 Sep 2025
https://github.com/oxylabs/playwright-web-scraping
A tutorial for web scraping using Playwright headless browser
playwright web-scraper web-scraping
Last synced: 06 Apr 2025
https://github.com/oxylabs/bypass-captcha-puppeteer
A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.
captcha puppeteer web-scraping
Last synced: 06 Apr 2025
https://github.com/oxylabs/chatgpt-web-scraping
Learn to create ChatGPT prompts that generate a web scraping code with proper CSS selectors.
chatgpt chatgpt-scraping gpt-scraping web-scraper web-scraping
Last synced: 09 Apr 2025
https://github.com/oxylabs/etsy-scraper
Etsy Scraper for collecting prices, titles, descriptions, specifications, reviews, and other product information from etsy.com
etsy etsy-api etsy-api-v3 etsy-csv etsy-scraper etsy-scraping-api etsy-seo etsy-tools etsy-web-scraping url-scraper
Last synced: 05 Apr 2025
https://github.com/oxylabs/web-scraping-excel-web-query
Guide to Scraping Data from Website to Excel with Web Query
excel-get-data-from-web excel-web-scraping get-data-from-web-excel web-query-excel web-scraping-excel
Last synced: 14 Aug 2025
https://github.com/oxylabs/how-to-scrape-google-trends
Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.
google google-trend google-trend-api google-trend-strategy google-trends google-trends-api google-trends-crawler google-trends-scraper python scraper scraper-api scraping scraping-api web-scraping
Last synced: 14 Apr 2025
https://github.com/oxylabs/web-scraping-tutorials
Web scraping, data parsing and automation tutorials. Suited for both beginners and intermediate/advanced programmers.
csharp curl github-python golang javascript python r-language ruby web-proxies web-scraping wikipedia-scraper
Last synced: 12 Oct 2025
https://github.com/oxylabs/craigslist-scraper
Gather public Craigslist data like jobs, items, services, and ads with Craigslist Scraper.
craigslist craigslist-api craigslist-javascript craigslist-scraper craigslist-search craigslist-web-scraper scrape-craigslist scraper scraping-craigslist
Last synced: 09 Apr 2025
https://github.com/oxylabs/scraping-dynamic-javascript-ajax-websites-with-beautifulsoup
A guide on how to scrape JavaScript rendered websites with Python and BeautifulSoup.
ajax beautiful-soup github-python javascript python scraping web-scraping
Last synced: 11 Jun 2025
https://github.com/oxylabs/scrape-google-python
In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.
google python python-scraping python-web-scraper scrape scrape-google scraper-api scraping scraping-api web-scraping
Last synced: 21 Sep 2025
https://github.com/oxylabs/zara-scraper
The Zara Scraper API is a powerful tool designed for developers. It enables swift and easy extraction of product details, price, and availability from Zara's online store for various applications.
api-zara zara zara-api zara-scraper zara-scraper-api zara-scraping zara-web-scraper
Last synced: 27 Sep 2025
https://github.com/oxylabs/rotating-proxies-with-python
Learn about how to rotate proxies by using Python.
json-database-python proxies proxy proxy-list proxy-list-github proxy-rotator python python-image-scraper python-web-crawler rotating-proxy scraper-python scraping socks5-proxy socks5-proxy-list socks5-server web-proxies web-proxy web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/how-to-scrape-amazon-product-data
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
amazon amazon-scraper python web-scraper web-scraping web-scraping-python
Last synced: 14 Apr 2025
https://github.com/oxylabs/oxylabs-sdk-go
Go SDK for the Oxylabs Scraper APIs.
api mslm oxylabs oxylabs-library proxy scrape scraper sdk sdk-oxylabs serp-api serp-api-go
Last synced: 31 Aug 2025
https://github.com/oxylabs/ebay-scraper
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
ebay ebay-api ebay-apis ebay-scraper ebay-search ebay-searches python-web-scraper scrape-ebay url-scraper
Last synced: 20 Aug 2025
https://github.com/oxylabs/trivago-scraper
Trivago Scraper API provides an efficient tool for fetching real-time data from Trivago. Ideal for developers & businesses seeking hotel data for various usage.
trivago trivago-scraper trivago-scraper-api trivago-scraping trivago-web-scraper
Last synced: 10 Aug 2025
https://github.com/oxylabs/web-scraping-with-selenium
In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6
dataextraction dataextractor github-python python scraper scrapers webscraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/pagination-with-python
A guide on how to deal with pagination via Python.
amazon-scraper-python github-python json-database-python pagination python python-ecommerce python-image-scraper python-web-crawler scraper-python serp-api-python webscraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/backlink-monitoring
Backlink checker is a simple tool, which checks backlink quality, identifies problematic backlinks, and outputs them to a specific Slack channel
backlinks backlinks-checker python screen-scraping web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/adidas-scraper
The Adidas Scraper API is a unique tool that allows developers to seamlessly extract and manipulate data from Adidas' online platforms.
adidas adidas-scraper adidas-scraper-api adidas-scraping adidas-web-scraper
Last synced: 27 Sep 2025
https://github.com/oxylabs/product-integrations
Code examples and general information
crawling datacenter-proxy dc-proxy github-proxy-list integration ipv4 proxy proxy-list-github proxy-rotator scraping socks5-proxy-list socks5-server
Last synced: 23 Apr 2025
https://github.com/oxylabs/selenium-proxy-integration-python
Tutorial for integrating Oxylabs' Residential Proxies with Selenium in Python
antidetect-browser github-python proxy proxy-list proxy-list-github proxy-rotator proxy-server proxy-site python python-ecommerce python-web-crawler residential-proxy rotating-proxy scraper-python selenium serp-api-python socks5-proxy-list socks5-server web-proxy webproxy
Last synced: 23 Apr 2025
https://github.com/oxylabs/oxycon2021-active-fingerprinting-pyppeteer
OxyCon 2021 Active Fingerprinting with Pyppeteer Code Samples
Last synced: 11 Jun 2025
https://github.com/oxylabs/news-scraping
A tutorial for scraping news
news news-scraper web-scraping
Last synced: 30 Jul 2025
https://github.com/oxylabs/curl-with-proxy
A tutorial on using cURL command with proxies
curl curl-library curl-proxy curl-with-proxy github-proxy-list proxy proxy-list proxy-site rotating-proxy shell socks5-proxy socks5-proxy-list socks5-server web-proxy web-proxy-server webproxy
Last synced: 23 Apr 2025
https://github.com/oxylabs/news-article-scraper
Learn about web scraping news articles using Python and JavaScript.
github-python javascript python scraping url-scraper web-scraping
Last synced: 21 Jul 2025
https://github.com/oxylabs/how-to-build-a-price-tracker
How to Build a Price Tracker With Python
github-python pandas-python price-drop price-monitoring price-tracker price-tracker-website python scraper screen-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/golang-web-scraper
A tutorial for building a web scraper in Golang
go golang url-scraper web-scraper web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/coinmarketcap-scraper
This Github repo houses the Coinmarketcap Scraper API, a tool designed to extract and gather cryptocurrency data from Coinmarketcap.
coinmarketcap coinmarketcap-scraper coinmarketcap-scraper-api coinmarketcap-scraping coinmarketcap-web-scraper
Last synced: 23 Apr 2025
https://github.com/oxylabs/price-parsing-tutorial
Everything you need to know about parsing prices in Python.
data-parsing price-parser python
Last synced: 23 Apr 2025
https://github.com/oxylabs/web-scraping-powershell
A comprehensive guide on using PowerShell and PowerHTML for designing reliable web scrapers.
powershell powershell-core web-scraping
Last synced: 19 Jun 2025
https://github.com/oxylabs/proxy-chrome-extension
Oxy Proxy Manager for Chrome is a free Chrome browser proxy extension that has all of the essential proxy session features in your browser.
chrome-extension chrome-proxy chrome-proxy-extension proxy proxy-extension proxy-for-chrome proxy-generator proxy-list proxy-list-github proxy-rotator proxy-site proxy-switcher proxy-tool rotating-proxy socks5-proxy socks5-proxy-list socks5-server socks5-server-java web-proxy webproxy
Last synced: 17 Oct 2025
https://github.com/oxylabs/aiohttp-proxy-integration
Python tutorial for implementing Residential Proxies with AIOHTTP
aiohttp asyncio beautifulsoup bs4 github-python proxy-generator proxy-list proxy-list-github proxy-rotator proxy-site python python3 requests residential-proxy rotating-proxy scraping webproxy
Last synced: 23 Apr 2025
https://github.com/oxylabs/oxylabs-readme
Oxylabs repository collections' guide.
Last synced: 25 Oct 2025
https://github.com/oxylabs/web-scraping-php
A tutorial and code samples of web scraping with PHP
email-scraper email-scraper-with-proxy php screen-scraping url-scraper web-scraping website-crawler wikipedia-scraper
Last synced: 15 Jun 2025
https://github.com/oxylabs/date-parser-tutorial
Everything you need to know about parsing dates in Python.
dataparsing parser-date python python-date-parser
Last synced: 23 Apr 2025
https://github.com/oxylabs/proxy-integrations
Oxylabs proxy integration tutorials for Selenium, Playwright, Puppeteer, aiohttp and more.
aiohttp mechanicalsoup playwright proxy proxy-list-github proxy-rotator proxy-site puppeteer pyppeteer rotating-proxy selenium socks5-proxy-list socks5-server socks5-server-java web-proxy web-proxy-server
Last synced: 23 Apr 2025
https://github.com/oxylabs/puppeteer-proxy-integration-js
A tutorial for implementing Oxylabs` Residential and Datacenter proxies with Puppeteer using JavaScript
github-proxy-list headless javascript nodejs proxy proxy-list proxy-list-github proxy-rotator proxy-site puppeteer puppeteer-demo residential-proxy rotating-proxy socks5-proxy-list socks5-server socks5-server-java web-proxy webproxy
Last synced: 07 Sep 2025
https://github.com/oxylabs/selenium-bypass-captcha
See how to easily bypass CAPTCHA tests using Selenium in Python.
bypass-captcha captcha captcha-bypass python selenium selenium-python web-scraping
Last synced: 27 Sep 2025
https://github.com/oxylabs/scraping-real-estate-data-with-python
A guide for extracting public data from Redfin using Python and Oxylabs Web Scraper API. From using the API to processing data and saving the result.
e-commerce-scraper ecommerce-api ecommerce-scraper python python-scraper real-estate scraper-api web-scraping
Last synced: 09 Oct 2025
https://github.com/oxylabs/httpx-vs-requests-vs-aiohttp
See how HTTPX, Requests, and AIOHTTP libraries compare for sending network requests and find out which one may fit your case better.
aiohttp httpx httpx-client httpx-vs-aiohttp httpx-vs-requests python-requests requests requests-module requests-vs-aiohttp send-request
Last synced: 27 Sep 2025
https://github.com/oxylabs/crawlee-web-scraping-tutorial
This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.
browser-automation crawlee crawling javascript nodejs tutorial tutorial-code web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/selenium-proxy-integration-java
Oxylabsʼ Residential Proxies integration with Selenium using Java
java java-proxy proxy-list proxy-list-github proxy-site rotating-proxy selenium socks5-proxy socks5-proxy-list socks5-server socks5-server-java web-proxy
Last synced: 23 Apr 2025
https://github.com/oxylabs/seo-monitoring
Tutorial for building SEO Monitoring System using Python, Celery, and a SERP Scraper API
celery github-python google-search-api python redis screen-scraping seo seo-monitoring seo-tools serp-api
Last synced: 15 Jul 2025
https://github.com/oxylabs/how-to-make-web-scraping-faster
How to Make Web Scraping Faster - Python Tutorial
github-python python python-web-scraping web-scraping web-scraping-api web-scraping-tutorials web-scraping-with-python
Last synced: 23 Apr 2025
https://github.com/oxylabs/webscraping-with-ruby
A tutorial for web scraping with Ruby
Last synced: 07 Sep 2025
https://github.com/oxylabs/lxml-tutorial
A tutorial on parsing webpages with lxml
Last synced: 23 Apr 2025
https://github.com/oxylabs/playwright-proxy-integration-js
A tutorial for implementing Oxylabs` Residential and Datacenter proxies with Playwright using JavaScript
javascript nodejs playwright playwright-java proxies proxy-list proxy-list-github proxy-rotator proxy-site residential-proxy rotating-proxy web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/asynchronous-web-scraping-python
A comparison of asynchronous and synchronous web scraping methods with practical examples.
async asynchronous data-acquisition python synchronous tutorial web-scraping web-scraping-python web-scraping-tutorials
Last synced: 27 Sep 2025
https://github.com/oxylabs/web-scraping-data-parsing-beautiful-soup
Web Scraping and Data Parsing Using Beautiful Soup
beautifulsoup data-parsing github-python python web-scraping
Last synced: 27 Sep 2025
https://github.com/oxylabs/automate-competitors-benchmark-analysis
A tutorial for automating competitors’ & benchmark analysis using Python
analysis automation github-python python web-scraping
Last synced: 02 Sep 2025
https://github.com/oxylabs/rotating-proxies-javascript
Learn how to rotate proxies using JavaScript.
axios javascript node-scraper nodejs proxy puppeteer python rotating-proxy web-proxies web-proxy web-scraping
Last synced: 23 Apr 2025
https://github.com/oxylabs/curl-with-python
Master cURL in Python by using the PycURL library. Learn to send GET and POST requests, custom HTTP headers, and how to fix common problems.
curl-library curl-python pycurl web-scraping web-scraping-python
Last synced: 05 Sep 2025
https://github.com/oxylabs/walmart-scraper
Walmart Scraper for extracting product prices, titles, descriptions, specifications, ratings and reviews from walmart.com
url-scraper walmart walmart-api walmart-scraper
Last synced: 23 Apr 2025
https://github.com/oxylabs/how-to-scrape-airbnb
Learn how to scrape Airbnb search results and listings on a large scale without blocks.
airbnb-api airbnb-data airbnb-listings airbnb-prices airbnb-scraper airbnb-scraping scrape-airbnb scraper-api
Last synced: 27 Sep 2025
https://github.com/oxylabs/1688-scraper
The 1688 Scraper API is a powerful tool for extracting data from the 1688 e-commerce platform. It's ideal for e-commerce analytics, product comparison, and market research purposes.
1688 1688-scraper 1688-scraper-api 1688-scraping 1688-web-scraper api-1688
Last synced: 27 Sep 2025
https://github.com/oxylabs/redbubble-scraper
The Redbubble Scraper API allows users to extract data from the Redbubble platform efficiently. It's a tool ideal for e-commerce data analysis and research.
redbubble redbubble-scraper redbubble-scraper-api redbubble-scraping redbubble-web-scraper
Last synced: 27 Sep 2025
https://github.com/oxylabs/how-to-scrape-wayfair
A step-by-step tutorial on extracting data from Wayfair’s product pages at scale and in real time. The guide details actionable code and considers various aspects before and during the scraping process.
data-extraction how-to parsing python wayfair wayfair-scraper web-scraping
Last synced: 27 Sep 2025
https://github.com/oxylabs/web-scraping-google-sheets
Guide to Using Google Sheets for Basic Web Scraping
email-scraper google-news-api google-news-scraper google-search-scraper google-sheets-web-scraping google-trends-api python-web-scraper web-crawler-python web-scraping web-scraping-google-sheets web-scraping-python
Last synced: 11 Mar 2025
https://github.com/oxylabs/web-crawler
Web Crawler is a tool used to discover target URLs, select the relevant content, and have it delivered in bulk. It crawls websites in real-time and at scale to quickly deliver all content or only the data you need based on your chosen criteria.
api crawler github-python scraper web-crawler web-crawler-python web-scraping web-scraping-api webscraping
Last synced: 01 Aug 2025
https://github.com/oxylabs/web-scraping-machine-learning
Web Scraping for Machine Learning
ai-web-scraper github-python machine-learning machine-learning-web-scraper python
Last synced: 16 Dec 2025
https://github.com/oxylabs/playwright-captcha
A guide on how to use Playwright to bypass CAPTCHA challenges using Python.
captcha playwright playwright-python scraping-websites
Last synced: 08 May 2025
https://github.com/oxylabs/parse-html-pyquery
Learn to parse HTML using PyQuery, a Python library for web scraping and manipulating HTML.
parser parsing pyquery python web-scraping web-scraping-python
Last synced: 01 Nov 2025
https://github.com/oxylabs/web-scraping-r
A tutorial for web scraping with R
proxy-scraper r-language web-scraping wikipedia-scraper
Last synced: 01 Nov 2025
https://github.com/oxylabs/how-to-parse-xml-in-python
Follow this in-depth technical tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.
amazon-scraper-python json-database-python python python-ecommerce python-image-scraper python-parser scrape-news-articles-python scraper-python serp-api-python web-scraping-python-projects web-scraping-with-python-amazon xml-document xml-parser xml-parsing
Last synced: 14 Apr 2025
https://github.com/oxylabs/web-scraping-with-java
Web Scraping With Java. Let’s examine this library to create a Java website scraper.
java-web-scraper jsoup-library node-js node-scraper nodejs web-scraping-with-java
Last synced: 26 Dec 2025
https://github.com/oxylabs/mechanicalsoup-proxy-integration
Python tutorial for integrating Oxylabs' Residential Proxies with MechanicalSoup library
beautifulsoup bs4 github-python mechanicalsoup proxy-list proxy-list-github proxy-rotator proxy-site python requests rotating-proxy
Last synced: 14 May 2025
https://github.com/oxylabs/puppeteer-tutorial
Use this tutorial and learn how to perform web scraping using a headless browser.
headless-browser puppeteer web-scraping
Last synced: 22 Jun 2025
https://github.com/oxylabs/fingerprinting_tactics_webinar
Code used during the "Fingerprinting Tactics with Pyppeteer and Playwright" webinar
Last synced: 27 Sep 2025
https://github.com/oxylabs/concurrency-vs-parallelism
Learn the difference between concurrency and parallelism
concurrency paralelism-vs-concurrency parallel parallel-vs-concurent threading web-scraping-api
Last synced: 14 Apr 2025
https://github.com/oxylabs/scraping-ecommerce-websites
A guide to scraping e-commerce websites by overcoming bot protection and CAPTCHAs.
e-commerce-api e-commerce-scraper ecommerce-api ecommerce-scraper ecommerce-scraping marketplace-api marketplace-scraper marketplace-scraper-api scraper scraper-api scraper-python web-scraping
Last synced: 08 Jul 2025
https://github.com/oxylabs/wget-proxy
Learn how to use wget command with proxies
command-line curl downloader proxy-list proxy-list-github proxy-rotator proxy-site rotating-proxy socks5-proxy socks5-proxy-list socks5-server socks5-server-java web-proxy
Last synced: 05 Jul 2025
https://github.com/oxylabs/web-scraping-selenium-python
Web Scraping with Python Selenium: Tutorial for Beginners
github-python json-database-python python-ecommerce python-web-crawler scraper-python selenium-web-scraper serp-api-python web-scraping web-scraping-python
Last synced: 14 Apr 2025