Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with apify

A curated list of projects in awesome lists tagged with apify .

https://github.com/apifytech/apify-js

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

apify automation crawler crawling headless headless-chrome javascript nodejs npm playwright puppeteer scraper scraping typescript web-crawler web-crawling web-scraping

Last synced: 06 Jul 2025

https://github.com/apify/crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

apify automation crawler crawling headless headless-chrome javascript nodejs npm playwright puppeteer scraper scraping typescript web-crawler web-crawling web-scraping

Last synced: 03 Nov 2025

https://github.com/apify/crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

apify automation beautifulsoup crawler crawling hacktoberfest headless headless-chrome pip playwright python scraper scraping web-crawler web-crawling web-scraping

Last synced: 06 Mar 2026

https://github.com/apify/apify-cli

Apify command-line interface helps you create, develop, build and run Apify Actors, and manage the Apify cloud platform.

apify command-line hacktoberfest headless-chrome puppeteer serveless

Last synced: 01 Apr 2026

https://github.com/apify/apify-sdk-python

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

apify automation python scraping sdk

Last synced: 25 Feb 2026

https://github.com/apify/actor-scraper

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

apify web-scraping

Last synced: 03 Nov 2025

https://github.com/apify/apify-client-python

Apify API client for Python

api apify client python scraping

Last synced: 30 Jan 2026

https://github.com/VaclavRut/actor-amazon-crawler

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.

amazon-com amazon-crawler amazon-de amazon-extractor apify apify-cli apify-proxy apify-sdk extract-items

Last synced: 06 Apr 2025

https://github.com/mrxujiang/crawel

基于Apify+node+react搭建的有点意思的爬虫平台

apify crawler node puppeteer react react-hooks umi umi3

Last synced: 13 Apr 2025

https://github.com/jurooravec/crawlee-one

Professional scrapers that provide full control to the users. Crawlee One builds on top of Crawlee and Apify and extends them with features for robust and highly configurable web scrapers.

actor apify crawlee crawler framework scraper scraping web

Last synced: 09 Feb 2026

https://github.com/apify/super-scraper

Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

api apify cheerio javascript nodejs playwright scraping typescript web-scraping

Last synced: 03 Nov 2025

https://github.com/apify/actor-content-checker

You can use this act to monitor any page's content and get a notification when content changes.

apify content-selector web-scraping

Last synced: 03 Nov 2025

https://github.com/crawlee-cloud/crawlee-cloud

Self-hosted, open-source platform for running Apify Actors. Drop-in compatible with the Apify SDK.

apify apify-actor apify-platform apify-sdk automation crawlee crawlee-framework crawlee-project docker open-source scraper scraping self-hosted web-scraping

Last synced: 03 May 2026

https://github.com/metalwarrior665/actor-google-sheets

No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.

apify apify-google google-sheets google-sheets-api spreadsheet

Last synced: 08 Oct 2025

https://github.com/apify/apify-zapier-integration

Apify integration for Zapier

api apify web-scraping zapier

Last synced: 03 Mar 2026

https://github.com/pocesar/actor-shopify-scraper

Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc

apify apify-sdk javascript scraper scraping shopify

Last synced: 06 Jul 2025

https://github.com/metalwarrior665/actor-rust-scraper

Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.

apify rust web-scraper

Last synced: 03 Sep 2025

https://github.com/metalwarrior665/actor-article-extractor-smart

Combines Apify's crawling system and article parsing with unfluff library.

actor apify article-extractor scraper web-scraper

Last synced: 03 Sep 2025

https://github.com/petrpatek/airbnb-scraper

Apify public actor for scraping Airbnb homes.

airbnb airbnb-api apify crawler data-extraction scrape

Last synced: 20 Mar 2025

https://github.com/apify/actor-scrapy-executor

Apify actor to run web spiders written in Python in the Scrapy library

apify scrapy scrapy-spiders

Last synced: 03 Nov 2025

https://github.com/pocesar/apify-login-session

Grab a session for any website for usage on your own actor

actors apify apify-sdk automation cookies form localstorage login puppeteer sessionstorage

Last synced: 13 Oct 2025

https://github.com/apify/actor-legacy-phantomjs-crawler

The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.

apify headless-browsers phantomjs web-crawler web-scraping

Last synced: 19 Feb 2026

https://github.com/Nikolay-Lysenko/servifier

An easy-to-use tool for making web service with API from your own Python functions.

api-maker apify ml-engineering model-to-production web-service

Last synced: 30 Apr 2025

https://github.com/ganevdev/actor-webdesignernews-scraper

Scraper for www.webdesignernews.com, using Apify.

actor apify scrap scraper scraping web-scraper

Last synced: 30 Oct 2025

https://github.com/systemfsoftware/youtube-autocomplete-scraper

YouTube AutoComplete Scraper - An Apify actor that scrapes YouTube's search suggestions with intelligent deduplication using pglite and trigram similarity matching. Perfect for content research, SEO, and trend analysis.

actor apify autocomplete crawler deduplication pglite scraper search similarity suggestions trigram youtube youtube-api

Last synced: 25 Jun 2025

https://github.com/pocesar/apify-covid19-brazil

Get Coronavirus epidemilogy data for Brazil in CSV

apify apify-sdk brazil coronavirus covid-19 covid19 scraper

Last synced: 21 Mar 2025

https://github.com/metalwarrior665/actor-keywords-extractor

Extract list of all keywords fro many website

apify keywords-extraction

Last synced: 11 Jun 2025

https://github.com/apify/actor-whitepaper-web

Documentation site for the Actor Programming Model – a fresh take on serverless microapps. Built with Astro.

actor-model apify astro website

Last synced: 03 Nov 2025

https://github.com/0xjgv/apify-code-base

Apify's best practices, creative solutions, error handling and more.

apify apify-api best-practices creative-coding error-handling faqs knowledge-base

Last synced: 22 Sep 2025

https://github.com/systemfsoftware/essentials

Essential TypeScript libraries and utilities for building production-ready AI SaaS applications

ai apify aws cloud-native developer-tools effect-ts functional-programming monorepo neon-database nodejs pnpm saas serverless typescript utilities

Last synced: 13 Apr 2025

https://github.com/redoper1/covid-sk-3

Apify.com actor for scraping data from website https://www.arcgis.com/apps/opsdashboard/index.html#/5fe83e34abc14349b7d2fcd5c48c6c85

actor apify coronavirus covid scraping

Last synced: 26 Feb 2025

https://github.com/bala-ceg/ai-travelassistant

AI Travel Assistant is a powerful AI-powered tool that helps users plan their trips effortlessly. It integrates flight search, hotel booking, and sightseeing recommendations to generate a structured travel itinerary using LangChain, Apify, and OpenAI

apify apify-actor langchain langgraph

Last synced: 30 Apr 2025

https://github.com/nicooprat/nicooprat

My own website, built with Nuxt 3, Vite 3, Tailwind 3, Puppeteer & Netlify

apify netlify nuxt tailwindcss vite vue

Last synced: 13 Apr 2026

https://github.com/apify/apify-haystack

The official integration for Apify and Haystack 2.0

apify haystack-ai rag

Last synced: 03 Nov 2025

https://github.com/apify/actor-scrapy-books-example

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

apify scrapy

Last synced: 03 Nov 2025

https://github.com/nicooprat/nicooprat-old

My previous website. Using Nuxt, Apify & Netlify.

apify netlify nuxt vue

Last synced: 18 Feb 2026

https://github.com/mstephen19/apify-global-store

Easily access, manage, and manipulate a global state/multiple global states for an Apify actor's run

apify apify-sdk state state-management typescript web-crawling web-scraping

Last synced: 15 Mar 2025

https://github.com/satyamvyas04/prizey

Prizey simplifies online shopping with real-time price tracking, comparisons, alerts, and insights, ensuring users get the best deals effortlessly.

apify mongodb nextauth nextjs prisma shadcn

Last synced: 12 Apr 2026

https://github.com/kalana99/web_scrapping

A news and web scraping project using React, Django and OpenAI

apify django firebase-hosting openai python3 react reactjs render text-scraping webscraping

Last synced: 13 Apr 2026

https://github.com/ctala/skool-api-docs

Docs, recipes & examples for the Skool All-in-One API — the most complete unofficial Skool API on Apify. Read AND write: posts, comments, members, classroom. Drop-in for n8n, Make.com, AI agents.

ai-agents apify apify-actor automation community-management make n8n n8n-workflow reverse-engineering skool skool-api skool-community typescript

Last synced: 28 May 2026

https://github.com/fauzaanu/maldives-business-registry-scraper

A crawler using crawlee-python to scrape business registry

apify crawlee maldives python

Last synced: 04 Oct 2025

https://github.com/redoper1/covid-who-sprinklr

Apify.com actor for scraping data from website https://covid19.who.int/

actor apify coronavirus covid scraping

Last synced: 08 Aug 2025

https://github.com/kaif11ali/insta-unfollow-automation

Insta Login and Unfollow Bot: A Node.js-powered automation tool to streamline Instagram account management. Automate login and unfollow actions with customizable settings using Puppeteer and Apify SDK.

apify dotenv es-modules insta-bot insta-unfollow insta-unfollow-bot instagram-automation instagram-bot instagram-unfollow instragram nodejs puppeteer social-media-automation unfollow-bot-instagram

Last synced: 09 Nov 2025

https://github.com/weblineindia/n8n-summarize-youtube-videos-with-gpt-4o-mini-and-apify-transcripts

This workflow automates summarizing YouTube videos by accepting a YouTube URL via a form, fetching the video transcript using Apify, and then generating a concise summary with OpenAI GPT.

apify apify-transcript chatgpt n8n n8n-automation n8n-nodes n8n-template n8n-workflow openai openai-chatgpt process-automation summarize-video summarizer-ai video-transcription workflow-automation youtube-video-summarizer

Last synced: 06 Oct 2025

https://github.com/mvolfik/hacker-news-keyword-alert

Actor for the Apify platform to notify you whenever a given keyword is mentioned in a Hacker News post or comment

apify hacker-news

Last synced: 02 Jan 2026

https://github.com/mstephen19/apify-click-events

Like TypeScript, but for clicking ;) Manage automated clicks, and ensure your Apify web-crawler is only clicking exactly what you allow it to

apify apify-sdk crawler scraper web-automation

Last synced: 23 Aug 2025

https://github.com/tomba-io/author-finder

Apify Actor that discovers and extracts author information from web pages using the Tomba Author Finder API

api apify author tomba

Last synced: 20 May 2026

https://github.com/tomba-io/technology-finder

Apify Actor that discovers and retrieves technologies used by specific domains using the Tomba Technology Finder API

apify technologies tomba

Last synced: 18 May 2026

https://github.com/yanis-git/php-apify-sdk

Unofficial SDK for Apify service

apify apify-sdk sdk-php

Last synced: 11 Jan 2026

https://github.com/shruagarwal/activeloop-langchain-coursebot

Ask questions related to langchain course brought by Activeloop.

apify apify-api cohere langchain llm-chatbot openai-api streamlit

Last synced: 10 Feb 2026

https://github.com/umran/apify

A tool to bootstrap a headless content management and delivery system using graphql, mongodb, redis and elasticsearch

apify backend bootstrap-modern-backends cms cms-backend elasticsearch graphql mongodb mongoosejs redis

Last synced: 03 Mar 2026

https://github.com/dairyfarmer23/trend-scout

Trend research → record-ready script → delivered to Telegram. Stop guessing what to film.

apify content-automation creator-tools openai python telegram-bot tiktok trend-analysis

Last synced: 04 Jun 2026

https://github.com/ivan-magda/blog-amplifier

CLI that finds existing X and LinkedIn conversations about a blog post or repo, ranks them, drafts comments, and routes them through a human-review gate. Posting stays manual.

apify blogging claude cli content-marketing developer-tools linkedin nodejs social-media twitter typescript web-scraping

Last synced: 18 Jun 2026

https://gitlab.com/hajnyon-projects/slichta/slichta-scraper

Scrapes various websites for daily meal menus. https://slichta.vercel.app/

apify menus puppeteer restaurants scraper

Last synced: 11 Mar 2025