An open API service indexing awesome lists of open source software.

Projects in Awesome Lists by oxylabs

A curated list of projects in awesome lists by oxylabs .

https://github.com/oxylabs/google-news-scraper

Use Google News API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.

api-for-google-news api-google-news api-stock-news free-google-news-api google-news-api google-news-scraper google-scraper google-scraper-api google-search-scraper news-scraper news-scraper-api scraper-api

Last synced: 14 May 2025

https://github.com/oxylabs/how-to-scrape-google-flights

Scrapes flight data from Google Flights and analyzes flight prices with Python and Oxylabs’ Google Flights API.

google-flight-api google-flights-api google-flights-api-python google-flights-python google-flights-scraper how-to-scrape-google-flights scrape-google-flights

Last synced: 15 May 2025

https://github.com/oxylabs/how-to-scrape-google-images

Real time google image scraper. The process is automated by sending HTTP requests to retrieve image data which is then parsed and saved.

google-image-api google-image-scraper google-image-scraper-api google-image-search google-images-crawler google-search-scraper image-scrape image-scraper image-scraping scrape-google-image scrape-images

Last synced: 15 May 2025

https://github.com/oxylabs/how-to-scrape-google-scholar

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

google-scholar google-scholar-scraper google-scholar-scrapper google-search-scraper python python-scraper scraper-api web-scraper web-scraping

Last synced: 15 May 2025

https://github.com/oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

oxylabs scraper scraper-api scraper-python scrapers scraping scraping-websites web-scraper web-scraping

Last synced: 06 Jul 2025

https://github.com/oxylabs/how-to-scrape-amazon-prices

A code for extracting best-selling items, search results, and currently available deals from Amazon using Python and Oxylabs E-Commerce Scraper API.

amazon amazon-scraper api python python-scraper scraper-api web-scraper web-scraping

Last synced: 16 May 2025

https://github.com/oxylabs/how-to-bypass-amazon-captcha

The process of bypassing CAPTCHA when extracting public data from Amazon with Oxylabs Amazon Scraper API.

amazon amazon-scraper amazon-scraper-api captcha captcha-solver captcha-solving scraper-api

Last synced: 16 May 2025

https://github.com/oxylabs/python-web-scraping-tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

amazon-scraper-python crawler github-python json-database-python python python-projects python-web-crawler python-web-scraper scraper-python scraping web-crawler-python web-scraping web-scraping-api web-scraping-python webscraping

Last synced: 16 May 2025

https://github.com/oxylabs/amazon-review-scraper

Amazon Review Scraper for hassle-free review data extraction, including authors, titles, descriptions, ratings, dates, and more.

amazon amazon-api amazon-product-scraper amazon-review-scraper amazon-reviews amazon-scraper amazon-scraping amazon-scraping-library amazon-web-scraper url-scraper

Last synced: 12 Apr 2025

https://github.com/oxylabs/google-play-scraper

Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.

google google-news-api google-news-scraper google-play google-play-api google-play-scraper google-play-store google-search-scraper google-trends-api movies-api scraper

Last synced: 24 Oct 2025

https://github.com/oxylabs/how-to-scrape-google-jobs

Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs

google-scraping google-search-api google-search-scraper python scraper scraper-api scraper-python serp-scraper-api serp-scraping web-scraping

Last synced: 24 Oct 2025

https://github.com/oxylabs/oxymouse

Mouse Movement Algorithms

Last synced: 08 May 2025

https://github.com/oxylabs/youtube-scraper

YouTube Scraper for effortless public YouTube data collection, including video and channel information.

scrape-youtube scrape-youtube-videos scraper youtube youtube-api youtube-channel youtube-comment-scraper youtube-crawler youtube-data-api-v3 youtube-scraper

Last synced: 13 Apr 2025

https://github.com/oxylabs/how-to-scrape-indeed

A tutorial for collecting job postings from Indeed using Python and Oxylabs Web Scraper API.

api job-posting python scraper-api web-scraper web-scraping

Last synced: 05 Apr 2025

https://github.com/oxylabs/curl-get-requests

Learn to send GET requests with cURL and utilize request arguments for your specific case.

curl curl-commands curl-get curl-get-request curl-requests curlrequest get-request

Last synced: 05 Apr 2025

https://github.com/oxylabs/curl-post-requests

Learn how to send POST requests with cURL.

curl curl-library post post-requests scraping web-scraping

Last synced: 10 Sep 2025

https://github.com/oxylabs/playwright-web-scraping

A tutorial for web scraping using Playwright headless browser

playwright web-scraper web-scraping

Last synced: 06 Apr 2025

https://github.com/oxylabs/bypass-captcha-puppeteer

A comprehensive tutorial with real code samples to learn how to bypass CAPTCHA with Puppeteer.

captcha puppeteer web-scraping

Last synced: 06 Apr 2025

https://github.com/oxylabs/chatgpt-web-scraping

Learn to create ChatGPT prompts that generate a web scraping code with proper CSS selectors.

chatgpt chatgpt-scraping gpt-scraping web-scraper web-scraping

Last synced: 09 Apr 2025

https://github.com/oxylabs/etsy-scraper

Etsy Scraper for collecting prices, titles, descriptions, specifications, reviews, and other product information from etsy.com

etsy etsy-api etsy-api-v3 etsy-csv etsy-scraper etsy-scraping-api etsy-seo etsy-tools etsy-web-scraping url-scraper

Last synced: 05 Apr 2025

https://github.com/oxylabs/oxyparser

Last synced: 10 Apr 2025

https://github.com/oxylabs/OxyParser

Last synced: 15 May 2025

https://github.com/oxylabs/how-to-scrape-google-trends

Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.

google google-trend google-trend-api google-trend-strategy google-trends google-trends-api google-trends-crawler google-trends-scraper python scraper scraper-api scraping scraping-api web-scraping

Last synced: 14 Apr 2025

https://github.com/oxylabs/web-scraping-tutorials

Web scraping, data parsing and automation tutorials. Suited for both beginners and intermediate/advanced programmers.

csharp curl github-python golang javascript python r-language ruby web-proxies web-scraping wikipedia-scraper

Last synced: 12 Oct 2025

https://github.com/oxylabs/scraping-dynamic-javascript-ajax-websites-with-beautifulsoup

A guide on how to scrape JavaScript rendered websites with Python and BeautifulSoup.

ajax beautiful-soup github-python javascript python scraping web-scraping

Last synced: 11 Jun 2025

https://github.com/oxylabs/scrape-google-python

In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.

google python python-scraping python-web-scraper scrape scrape-google scraper-api scraping scraping-api web-scraping

Last synced: 21 Sep 2025

https://github.com/oxylabs/zara-scraper

The Zara Scraper API is a powerful tool designed for developers. It enables swift and easy extraction of product details, price, and availability from Zara's online store for various applications.

api-zara zara zara-api zara-scraper zara-scraper-api zara-scraping zara-web-scraper

Last synced: 27 Sep 2025

https://github.com/oxylabs/how-to-scrape-amazon-product-data

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

amazon amazon-scraper python web-scraper web-scraping web-scraping-python

Last synced: 14 Apr 2025

https://github.com/oxylabs/ebay-scraper

eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay

ebay ebay-api ebay-apis ebay-scraper ebay-search ebay-searches python-web-scraper scrape-ebay url-scraper

Last synced: 20 Aug 2025

https://github.com/oxylabs/trivago-scraper

Trivago Scraper API provides an efficient tool for fetching real-time data from Trivago. Ideal for developers & businesses seeking hotel data for various usage.

trivago trivago-scraper trivago-scraper-api trivago-scraping trivago-web-scraper

Last synced: 10 Aug 2025

https://github.com/oxylabs/web-scraping-with-selenium

In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6

dataextraction dataextractor github-python python scraper scrapers webscraping

Last synced: 23 Apr 2025

https://github.com/oxylabs/backlink-monitoring

Backlink checker is a simple tool, which checks backlink quality, identifies problematic backlinks, and outputs them to a specific Slack channel

backlinks backlinks-checker python screen-scraping web-scraping

Last synced: 23 Apr 2025

https://github.com/oxylabs/adidas-scraper

The Adidas Scraper API is a unique tool that allows developers to seamlessly extract and manipulate data from Adidas' online platforms.

adidas adidas-scraper adidas-scraper-api adidas-scraping adidas-web-scraper

Last synced: 27 Sep 2025

https://github.com/oxylabs/oxycon2021-active-fingerprinting-pyppeteer

OxyCon 2021 Active Fingerprinting with Pyppeteer Code Samples

Last synced: 11 Jun 2025

https://github.com/oxylabs/news-scraping

A tutorial for scraping news

news news-scraper web-scraping

Last synced: 30 Jul 2025

https://github.com/oxylabs/news-article-scraper

Learn about web scraping news articles using Python and JavaScript.

github-python javascript python scraping url-scraper web-scraping

Last synced: 21 Jul 2025

https://github.com/oxylabs/golang-web-scraper

A tutorial for building a web scraper in Golang

go golang url-scraper web-scraper web-scraping

Last synced: 23 Apr 2025

https://github.com/oxylabs/coinmarketcap-scraper

This Github repo houses the Coinmarketcap Scraper API, a tool designed to extract and gather cryptocurrency data from Coinmarketcap.

coinmarketcap coinmarketcap-scraper coinmarketcap-scraper-api coinmarketcap-scraping coinmarketcap-web-scraper

Last synced: 23 Apr 2025

https://github.com/oxylabs/price-parsing-tutorial

Everything you need to know about parsing prices in Python.

data-parsing price-parser python

Last synced: 23 Apr 2025

https://github.com/oxylabs/web-scraping-powershell

A comprehensive guide on using PowerShell and PowerHTML for designing reliable web scrapers.

powershell powershell-core web-scraping

Last synced: 19 Jun 2025

https://github.com/oxylabs/oxylabs-readme

Oxylabs repository collections' guide.

Last synced: 25 Oct 2025

https://github.com/oxylabs/date-parser-tutorial

Everything you need to know about parsing dates in Python.

dataparsing parser-date python python-date-parser

Last synced: 23 Apr 2025

https://github.com/oxylabs/selenium-bypass-captcha

See how to easily bypass CAPTCHA tests using Selenium in Python.

bypass-captcha captcha captcha-bypass python selenium selenium-python web-scraping

Last synced: 27 Sep 2025

https://github.com/oxylabs/scraping-real-estate-data-with-python

A guide for extracting public data from Redfin using Python and Oxylabs Web Scraper API. From using the API to processing data and saving the result.

e-commerce-scraper ecommerce-api ecommerce-scraper python python-scraper real-estate scraper-api web-scraping

Last synced: 09 Oct 2025

https://github.com/oxylabs/httpx-vs-requests-vs-aiohttp

See how HTTPX, Requests, and AIOHTTP libraries compare for sending network requests and find out which one may fit your case better.

aiohttp httpx httpx-client httpx-vs-aiohttp httpx-vs-requests python-requests requests requests-module requests-vs-aiohttp send-request

Last synced: 27 Sep 2025

https://github.com/oxylabs/crawlee-web-scraping-tutorial

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

browser-automation crawlee crawling javascript nodejs tutorial tutorial-code web-scraping

Last synced: 23 Apr 2025

https://github.com/oxylabs/seo-monitoring

Tutorial for building SEO Monitoring System using Python, Celery, and a SERP Scraper API

celery github-python google-search-api python redis screen-scraping seo seo-monitoring seo-tools serp-api

Last synced: 15 Jul 2025

https://github.com/oxylabs/webscraping-with-ruby

A tutorial for web scraping with Ruby

ruby web-scraping

Last synced: 07 Sep 2025

https://github.com/oxylabs/lxml-tutorial

A tutorial on parsing webpages with lxml

lxml parser python

Last synced: 23 Apr 2025

https://github.com/oxylabs/playwright-proxy-integration-js

A tutorial for implementing Oxylabs` Residential and Datacenter proxies with Playwright using JavaScript

javascript nodejs playwright playwright-java proxies proxy-list proxy-list-github proxy-rotator proxy-site residential-proxy rotating-proxy web-scraping

Last synced: 23 Apr 2025

https://github.com/oxylabs/asynchronous-web-scraping-python

A comparison of asynchronous and synchronous web scraping methods with practical examples.

async asynchronous data-acquisition python synchronous tutorial web-scraping web-scraping-python web-scraping-tutorials

Last synced: 27 Sep 2025

https://github.com/oxylabs/automate-competitors-benchmark-analysis

A tutorial for automating competitors’ & benchmark analysis using Python

analysis automation github-python python web-scraping

Last synced: 02 Sep 2025

https://github.com/oxylabs/curl-with-python

Master cURL in Python by using the PycURL library. Learn to send GET and POST requests, custom HTTP headers, and how to fix common problems.

curl-library curl-python pycurl web-scraping web-scraping-python

Last synced: 05 Sep 2025

https://github.com/oxylabs/walmart-scraper

Walmart Scraper for extracting product prices, titles, descriptions, specifications, ratings and reviews from walmart.com

url-scraper walmart walmart-api walmart-scraper

Last synced: 23 Apr 2025

https://github.com/oxylabs/how-to-scrape-airbnb

Learn how to scrape Airbnb search results and listings on a large scale without blocks.

airbnb-api airbnb-data airbnb-listings airbnb-prices airbnb-scraper airbnb-scraping scrape-airbnb scraper-api

Last synced: 27 Sep 2025

https://github.com/oxylabs/1688-scraper

The 1688 Scraper API is a powerful tool for extracting data from the 1688 e-commerce platform. It's ideal for e-commerce analytics, product comparison, and market research purposes.

1688 1688-scraper 1688-scraper-api 1688-scraping 1688-web-scraper api-1688

Last synced: 27 Sep 2025

https://github.com/oxylabs/redbubble-scraper

The Redbubble Scraper API allows users to extract data from the Redbubble platform efficiently. It's a tool ideal for e-commerce data analysis and research.

redbubble redbubble-scraper redbubble-scraper-api redbubble-scraping redbubble-web-scraper

Last synced: 27 Sep 2025

https://github.com/oxylabs/how-to-scrape-wayfair

A step-by-step tutorial on extracting data from Wayfair’s product pages at scale and in real time. The guide details actionable code and considers various aspects before and during the scraping process.

data-extraction how-to parsing python wayfair wayfair-scraper web-scraping

Last synced: 27 Sep 2025

https://github.com/oxylabs/web-crawler

Web Crawler is a tool used to discover target URLs, select the relevant content, and have it delivered in bulk. It crawls websites in real-time and at scale to quickly deliver all content or only the data you need based on your chosen criteria.

api crawler github-python scraper web-crawler web-crawler-python web-scraping web-scraping-api webscraping

Last synced: 01 Aug 2025

https://github.com/oxylabs/playwright-captcha

A guide on how to use Playwright to bypass CAPTCHA challenges using Python.

captcha playwright playwright-python scraping-websites

Last synced: 08 May 2025

https://github.com/oxylabs/parse-html-pyquery

Learn to parse HTML using PyQuery, a Python library for web scraping and manipulating HTML.

parser parsing pyquery python web-scraping web-scraping-python

Last synced: 01 Nov 2025

https://github.com/oxylabs/web-scraping-r

A tutorial for web scraping with R

proxy-scraper r-language web-scraping wikipedia-scraper

Last synced: 01 Nov 2025

https://github.com/oxylabs/web-scraping-with-java

Web Scraping With Java. Let’s examine this library to create a Java website scraper.

java-web-scraper jsoup-library node-js node-scraper nodejs web-scraping-with-java

Last synced: 26 Dec 2025

https://github.com/oxylabs/mechanicalsoup-proxy-integration

Python tutorial for integrating Oxylabs' Residential Proxies with MechanicalSoup library

beautifulsoup bs4 github-python mechanicalsoup proxy-list proxy-list-github proxy-rotator proxy-site python requests rotating-proxy

Last synced: 14 May 2025

https://github.com/oxylabs/puppeteer-tutorial

Use this tutorial and learn how to perform web scraping using a headless browser.

headless-browser puppeteer web-scraping

Last synced: 22 Jun 2025

https://github.com/oxylabs/fingerprinting_tactics_webinar

Code used during the "Fingerprinting Tactics with Pyppeteer and Playwright" webinar

Last synced: 27 Sep 2025

https://github.com/oxylabs/oxylabs-mcp

Last synced: 07 Jul 2025