Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists by Python3WebSpider

A curated list of projects in awesome lists by Python3WebSpider .

https://github.com/python3webspider/proxypool

An Efficient ProxyPool with Getter, Tester and Server

flask http proxy proxypool redis webspider

Last synced: 14 May 2025

https://github.com/Python3WebSpider/ProxyPool

An Efficient ProxyPool with Getter, Tester and Server

flask http proxy proxypool redis webspider

Last synced: 27 Mar 2025

https://github.com/python3webspider/python3webspider

Source File of My Book related to WebSpider

python3 webspider

Last synced: 15 May 2025

https://github.com/python3webspider/douyin

API of DouYin for Humans used to Crawl Popular Videos and Musics

crawler douyin spider videos

Last synced: 04 Apr 2025

https://github.com/python3webspider/cookiespool

Cookies Pool

Last synced: 05 Apr 2025

https://github.com/python3webspider/adslproxy

Adsl Proxy Pool

adsl redis

Last synced: 04 Apr 2025

https://github.com/python3webspider/taobaoproduct

Taobao Product Spider by Selenium

Last synced: 09 Apr 2025

https://github.com/python3webspider/scrapyredisbloomfilter

Scrapy Redis Bloom Filter

Last synced: 07 Apr 2025

https://github.com/Python3WebSpider/ScrapyRedisBloomFilter

Scrapy Redis Bloom Filter

Last synced: 28 Mar 2025

https://github.com/python3webspider/deeplearningslidecaptcha2

Deep LearningImage Captcha 2

Last synced: 20 Dec 2024

https://github.com/python3webspider/crackgeetest

Crack Geetest

Last synced: 11 May 2025

https://github.com/python3webspider/weibo

Weibo Spider Using Scrapy

Last synced: 12 Apr 2025

https://github.com/python3webspider/maoyan

MaoYan TOP 100 Movie

Last synced: 13 Apr 2025

https://github.com/python3webspider/jiepai

Jiepai Pictures of Toutiao

Last synced: 19 Dec 2024

https://github.com/python3webspider/weixin

Sougou Weixin Spider Using Proxy

Last synced: 12 Apr 2025

https://github.com/python3webspider/deeplearningslidecaptcha

Deep Learning Slide Captcha

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapyseleniumtest

Scrapy Selenium on Taobao Product

Last synced: 12 Apr 2025

https://github.com/python3webspider/weibolist

WeiboList of MaYun

Last synced: 12 Apr 2025

https://github.com/python3webspider/githublogin

Login Github with Requests

Last synced: 12 Apr 2025

https://github.com/Python3WebSpider/ScrapyUniversal

Scrapy Universal Spider

Last synced: 28 Mar 2025

https://github.com/python3webspider/scrapyuniversal

Scrapy Universal Spider

Last synced: 12 Apr 2025

https://github.com/python3webspider/crackweiboslide

Crack Weibo Slide Captcha

Last synced: 12 Apr 2025

https://github.com/python3webspider/moments

Wechat Friends Circle Spider

Last synced: 10 Dec 2024

https://github.com/python3webspider/recaptcharesolver

Recaptcha Resolver

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapytutorial

Scrapy Tutorial

Last synced: 22 Apr 2025

https://github.com/python3webspider/accountpool

Account Pool

Last synced: 12 Apr 2025

https://github.com/python3webspider/pyppeteertest

Pyppeteer Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/proxytunnel

Proxy Tunnel using Squid LoadBalancer

Last synced: 10 Dec 2024

https://github.com/python3webspider/images360

Download Images From 360 Using Scrapy

Last synced: 12 Apr 2025

https://github.com/python3webspider/proxysettings

Proxy Settings

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapestatic1

Spider for https://static1.scrape.cuiqingcai.com/

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapysplashtest

Scrapy Splash on Taobao Product

Last synced: 12 Apr 2025

https://github.com/python3webspider/mitmappiumjd

MitmProxy and Appium to Crawl Comments in JD APP

Last synced: 10 Dec 2024

https://github.com/python3webspider/ajaxhookspider

Ajax Hook Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/weibocrawler

Weibo Crawler for All Sites

Last synced: 10 Dec 2024

https://github.com/python3webspider/cracktouclick

Crack Touch Click

Last synced: 12 Apr 2025

https://github.com/python3webspider/deeplearningimagecaptcha

DeepLearning Image Captcha

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapessr1

Scrape Ssr1

Last synced: 12 Apr 2025

https://github.com/python3webspider/crackimagecaptcha

Crack Image Code by Tesserocr

Last synced: 12 Apr 2025

https://github.com/python3webspider/hcaptcharesolver

HCaptcha Resolver

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapypyppeteerdeprecated

Scrapy Pyppeteer Demo

Last synced: 22 Apr 2025

https://github.com/python3webspider/elasticsearchtest

Elastic Search Code

Last synced: 12 Apr 2025

https://github.com/python3webspider/crackslidecaptcha

Crack Slide Captcha

Last synced: 12 Apr 2025

https://github.com/python3webspider/playwrighttest

Playwright Test

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapycrawlspider

Scrapy Crawl Spider

Last synced: 12 Apr 2025

https://github.com/python3webspider/proxytest

Proxy Demo

Last synced: 10 Dec 2024

https://github.com/python3webspider/javascriptobfuscate

Demo of JavaScript Obfuscate

Last synced: 10 Dec 2024

https://github.com/python3webspider/urllibtest

Urllib Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapypyppeteer

Scrapy Pyppeteer Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/codeserver

Code Server

Last synced: 22 Apr 2025

https://github.com/python3webspider/igetget

IGetGet Books Spider by MitmDump

Last synced: 16 Jun 2025

https://github.com/python3webspider/seleniumtest

Selenium Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/deobfuscate

Deobfuscate Samples

Last synced: 12 Apr 2025

https://github.com/python3webspider/captchaplatform

Captcha Platform Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapyddocker

Docker for Scrapyd

Last synced: 22 Apr 2025

https://github.com/python3webspider/installation

Instructions for Installation of Software or Packages

Last synced: 29 Mar 2025

https://github.com/python3webspider/moviecrawler

Movie Crawler

Last synced: 12 Apr 2025

https://github.com/python3webspider/bookcrawler

Book Crawler

Last synced: 12 Apr 2025

https://github.com/Python3WebSpider/Universal

Universal Scrapy

Last synced: 28 Mar 2025

https://github.com/python3webspider/scrapedynamic1

Spider for Dynamic1

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapycompositedemo

Scrapy Composite Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapydocker

Docker for Scrapy Demo

Last synced: 10 Dec 2024

https://github.com/python3webspider/universal

Universal Scrapy

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapespa5

Spider for https://spa5.scrape.center/

Last synced: 10 Dec 2024

https://github.com/python3webspider/asynctest

Async HTTP Demo

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapespa1

Scrape Spa1

Last synced: 12 Apr 2025

https://github.com/python3webspider/testtess

Test Tesseract and Tesserocr

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapydownloadertest

Test Downloader Middleware of Scrapy

Last synced: 12 Apr 2025

https://github.com/python3webspider/qunar

Qunar Spider

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapespa6

Spider for https://spa6.scrape.center

Last synced: 19 Jun 2025

https://github.com/python3webspider/xposedtest

Xposed Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/filestoragetest

File Storage Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapespa2

Spider for https://spa2.scrape.center

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapeantispider5

Scrape Antispier5

Last synced: 12 Apr 2025

https://github.com/python3webspider/webdriverdetection

Detect WebDriver and Pretend Browser

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapecaptcha3

Spider for https://captcha3.scrape.cuiqingcai.com/

Last synced: 10 Dec 2024

https://github.com/python3webspider/beautifulsouptest

Beautiful Soup Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapycrawlspidertest

Scrapy Universal Spider

Last synced: 12 Apr 2025

https://github.com/python3webspider/rabbitmqtest

RabbitMQ Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/unidbgserver

Unidbg Server

Last synced: 29 Mar 2025

https://github.com/python3webspider/multiprocessingtest

Demo of Multiprocessing

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapyspidermiddlewaredemo

Scrapy Spider Middleware Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapelogin2

Spider for https://login2.scrape.cuiqingcai.com/

Last synced: 12 Apr 2025

https://github.com/python3webspider/appiumtest

Appium Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapelogin3

Spider for https://login3.scrape.cuiqingcai.com/

Last synced: 10 Dec 2024

https://github.com/python3webspider/parseltest

Parsel Test Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/playwrightintercepting

Playwright Intercepting

Last synced: 29 Mar 2025

https://github.com/python3webspider/browsermobproxytest

Browser Mob Proxy Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapyuniversaldemo

Scrapy Universal Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/learnast

AST Demo

Last synced: 12 Apr 2025

https://github.com/python3webspider/requeststest

Requests Test

Last synced: 10 Dec 2024

https://github.com/python3webspider/pyquerytest

PyQuery Demo

Last synced: 10 Dec 2024

https://github.com/python3webspider/mysqltest

MySQL Test Demo

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapyddeploy

Scrapyd Deploy Template for Azure

Last synced: 22 Apr 2025

https://github.com/python3webspider/airtesttest

Airtest Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/newscrawler

News Crawler

Last synced: 12 Apr 2025

https://github.com/python3webspider/scrapeantispider3

Scrape Antispider3

Last synced: 12 Apr 2025

https://github.com/python3webspider/mitmproxytest

Mitm Proxy Test

Last synced: 12 Apr 2025

https://github.com/python3webspider/xpathtest

XPath Test

Last synced: 10 Dec 2024

https://github.com/python3webspider/scrapyspiderdemo

Demo of Scrapy

Last synced: 29 Mar 2025