Projects in Awesome Lists tagged with bot-detection

https://github.com/ultrafunkamsterdam/undetected-chromedriver

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

anti-bot anti-detection automation bot-detection browser captcha chrome chromedriver cloudflare cloudflare-bypass distil navigator python3 scraping selenium testing webdriver

Last synced: 16 Dec 2024

https://github.com/faisalman/ua-parser-js

"Unmask Your Traffic" - UAParser.js: The Essential Web Development Tool for User-Agent Detection

analytics bot-detection browser-detection client-hints device-detection mobile-detection user-agent user-agent-parser

Last synced: 16 Dec 2024

https://github.com/seleniumbase/SeleniumBase

📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.

anti-detection behave bot-detection chromedriver cloudflare-bypass e2e-testing pytest pytest-plugin python python-scraper selenium selenium-python seleniumbase test-automation unittests web-automation web-scraping web-scraping-python webdriver webkit

Last synced: 29 Oct 2024

https://github.com/seleniumbase/seleniumbase

📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.

anti-detection behave bot-detection chromedriver cloudflare-bypass e2e-testing pytest pytest-plugin python python-scraper selenium selenium-python seleniumbase test-automation unittests web-automation web-scraping web-scraping-python webdriver webkit

Last synced: 16 Dec 2024

https://github.com/niespodd/browser-fingerprinting

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

automation bot bot-detection browser-fingerprinting chromedriver chromium chromium-browser crawler detection fingerprinting puppeteer recaptcha scraper spider stealth web webscraping

Last synced: 17 Dec 2024

https://github.com/matomo-org/device-detector

The Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.

bot-detection detection-library device-detector hacktoberfest mobile-detection php user-agent

Last synced: 16 Dec 2024

https://github.com/omkarcloud/botasaurus

The All in One Framework to build Awesome Scrapers.

anti-bot anti-detect anti-detect-browser anti-detection antidetect-browser bot-detection bypass-cloudflare cloudflare-bypass cloudflare-scrape python-scraper python-web-scraper python-web-scraping scraping-framework scraping-python scraping-tool undetectable undetected undetected-chromedriver web-crawling web-scraping-python

Last synced: 17 Dec 2024

https://github.com/hisorange/browser-detect

Browser Detection for Laravel by hisorange!

bot-detection crawler-detection laravel mobile-detection user-agent user-agent-parser

Last synced: 17 Dec 2024

https://github.com/fingerprintjs/botd

Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MIT license, no usage restrictions.

automation bot-detection bots headless-chrome playwright puppeteer selenium

Last synced: 17 Dec 2024

https://github.com/fingerprintjs/BotD

Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MIT license, no usage restrictions.

automation bot-detection bots headless-chrome playwright puppeteer selenium

Last synced: 29 Nov 2024

https://github.com/Ullaakut/astronomer

A tool to detect illegitimate stars from bot accounts on GitHub projects

bot-detection fraud-detection github github-api open-source

Last synced: 04 Nov 2024

https://github.com/ullaakut/astronomer

A tool to detect illegitimate stars from bot accounts on GitHub projects

bot-detection fraud-detection github github-api open-source

Last synced: 30 Sep 2024

https://github.com/rebrowser/rebrowser-patches

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.

automation bot bot-detection chrome chromedriver cloudflare crawler crawling datadome headless headless-chrome playwright puppeteer puppeteer-extra rebrowser scraping selenium stealth web-scraping webdriver

Last synced: 21 Dec 2024

https://github.com/totpero/DeviceDetector.NET

The Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.

bot-detection c-sharp detection-library dotnet mobile-detection user-agent

Last synced: 13 Nov 2024

https://github.com/kaliiiiiiiiii/brotector

An advanced antibot for webdrivers

antibot automation-detection bot-detection integrity-protection

Last synced: 16 Dec 2024

https://github.com/mkearney/tweetbotornot2

🔍🐦🤖 Detect Twitter Bots!

bot-detection bot-detector classification data-science machine-learning r r-package rstats rtweet twitter twitter-api twitter-bot-detection twitter-bots xgboost

Last synced: 15 Nov 2024

https://github.com/x-way/crawlerdetect

Golang module to detect bots and crawlers via the user agent

bot-detection crawler crawler-detection detect go spider user-agent

Last synced: 18 Dec 2024

https://github.com/prescience-data/puppeteer-botcheck

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

automation-testing bot-detection datadome puppeteer puppeteer-extra puppeteer-extra-plugin scraping

Last synced: 28 Oct 2024

https://github.com/prosopo/captcha

Protect your website from bots with Prosopo Procaptcha

antispam bot-detection captcha captcha-alternative ddos-mitigation ddos-protection frictionless-captcha hcaptcha human-verification invisible-captcha polkadot privacy procaptcha proof-of-work recaptcha security self-host spam spam-detection spam-protection

Last synced: 15 Nov 2024

https://github.com/niespodd/webrtc-local-ip-leak

Oh no, stop this. You can see my local IP address 😲! Use `foundation` attribute against CRC32 lookup table to reveal local IP address of a Chrome/Chromium visitor.

automation bot bot-detection crawler spider stealth webrtc

Last synced: 09 Nov 2024

https://github.com/rebrowser/rebrowser-playwright-python

A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless playwright playwright-python rebrowser rebrowser-patches scraping web-scraping

Last synced: 18 Dec 2024

https://github.com/fingerprintjs/botd-integrations

Botd integrations with popular cloud platforms and CDNs.

bot bot-detection bot-protection cloud cloud-integration cloudflare cloudflare-workers cloudfront cloudfront-lambda-at-edge fastly fastly-compute-at-edge

Last synced: 09 Nov 2024

https://github.com/lambtron/botson-extension

Detect twitter bots in your newsfeed.

bot bot-detection chrome-extension news-feed tweets twitter

Last synced: 14 Oct 2024

https://github.com/gnh1201/caterpillar

Caterpillar Proxy - The simple web debugging proxy (formerly, php-httpproxy)

aeiou bot-detection captcha firewall forward-proxy hijacking http-proxy https-proxy k-anonymity mastodon mitm network-filtering parasitic-computing proxy reverse-proxy spam-detection ssl tls waf web-debugging-proxy

Last synced: 07 Dec 2024

https://github.com/stephenafamo/isbot

Detect bots/crawlers/spiders using the user agent string.

bot-detection bot-detector crawler-detection golang oktoberfest user-agent

Last synced: 28 Oct 2024

https://github.com/rebrowser/rebrowser-bot-detector

Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.

anti-bot anti-bot-detection anti-detect automation bot-detection captcha datadome fingerprinting headless playwright puppeteer puppeteer-extra puppeteer-extra-plugin-stealth rebrowser recaptcha scraping selenium web-scraping

Last synced: 09 Oct 2024

https://github.com/acsiomatic/device-detector-bundle

Symfony Bundle for https://github.com/matomo-org/device-detector

bot-detection detection-library device-detector mobile-detection php symfony symfony-bundle user-agent

Last synced: 13 Oct 2024

https://github.com/bytexenon/undetected_geckodriver

A custom Firefox Selenium-based WebDriver. Passes all bot mitigation systems

anti-bot anti-detection automation bot-detection browser captcha cloudflare cloudflare-bypass distil firefox geckodriver navigator python3 scraping selenium testing webriver

Last synced: 27 Oct 2024

https://github.com/dedinc/pystealth

Python module for preventing detection of CDP in Selenium, Puppeteer, and Playwright.

antibot antidetect-browser automation bot-detection browser-automation bypass-detections cdp chrome-devtools-protocol playwright

Last synced: 07 Nov 2024

https://github.com/romis2012/is-bot

Detect bots/crawlers/spiders via user-agent string

bot-detection bots crawlers python user-agent user-agent-parser web-crawlers

Last synced: 20 Nov 2024

https://github.com/arcjet/example-nextjs

An example Next.js application protected by Arcjet.

arcjet bot-detection developer-tools javascript nextjs nodejs pii-detection rate-limiting security security-tools serverless typescript

Last synced: 09 Nov 2024

https://github.com/fingerprintjs/fingerprint-pro-akamai-proxy-integration

Fingerprint Pro Akamai Integration is responsible for proxying identification and JavaScript agent download requests that are performed on your Akamai infrastructure.

akamai akamai-property bot bot-detection botd browser browser-fingerprinting detection fingerprint fingerprintjs fingerprintjs-pro terraform visitor-identifier

Last synced: 09 Nov 2024

https://github.com/acuciureanu/spidertrap-rs

A simple trap for web crawlers

anti-bot anti-scraping bot-detection bot-trap crawler-trap cybersecurity data-privacy ethical-hacking intrusion-detection network-security rust server-defense spider-trap web-crawler web-monitoring web-robots web-scraping web-security web-spider website-protection

Last synced: 12 Oct 2024

https://github.com/dbrennand/twitter-stream-bot-data-gatherer

An application to watch the Twitter stream and send accounts to the Botometer API for analysis. The results are stored in a SQLite database.

bot-detection botometer data-gathering twitter-api twitter-bot-detection twitter-streaming-api

Last synced: 08 Dec 2024

https://github.com/damascenorafael/identify-bots-reddit-comment-network

Characterization and classification of bots using only structural characteristics of the network. Python development of network construction, component analysis and Neural Network for classification.

bot-detection complex-networks machine-learning network-analysis network-science networkx reddit reddit-bot

Last synced: 15 Nov 2024

https://github.com/stephanlensky/zendriver

A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver.

anti-bot anti-detection async bot-detection browser captcha chrome chrome-devtools-protocol chromedriver cloudflare cloudflare-bypass python selenium webdriver webscraping

Last synced: 28 Oct 2024

https://github.com/0x48piraj/bf-f

Browser Fingerprinting Framework in addition to bots and Ad blocking detection.

adblocker adblocker-detection bot-detection browser-detection browser-fingerprinting fraud-detection identification-engine incognito javascript javascript-library private-browsing

Last synced: 11 Oct 2024

https://github.com/dbrennand/final-year-project

An application that generates a report to identify potential bots that a Twitter user is following.

bot-detection report-generator twitter-api twitter-bot-detection

Last synced: 08 Dec 2024

https://github.com/rebrowser/rebrowser-puppeteer

A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha chrome headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 20 Oct 2024

https://github.com/rebrowser/rebrowser-playwright

A drop-in replacement for playwright patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless playwright rebrowser rebrowser-patches scraping web-scraping

Last synced: 14 Oct 2024

https://github.com/sexfrance/geetest-solver

A request based Python solution for solving Geetest v4 CAPTCHA challenges efficiently. The script provides both synchronous and asynchronous options to handle the challenges, with an API interface for integration.

async-captcha-solver automated-testing bot-detection captcha captcha-bypass captcha-solver geetest geetest-bypass geetest-captcha geetest-captcha-solver geetest-reverse geetest-v4 python sync-captcha-solver

Last synced: 28 Nov 2024

https://github.com/rebrowser/rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

automation bot bot-detection captcha headless puppeteer rebrowser rebrowser-patches scraping web-scraping

Last synced: 12 Oct 2024

https://github.com/dedinc/maehantibot

Smart AntiBot Detection for Minecraft Server.

antibot antibots bot-detection botdetector detection java minecraft minecraft-antibot proxy-detection spigot-plugin

Last synced: 13 Dec 2024

https://github.com/fingerprintjs/fingerprint-pro-fastly-vcl-integration

Fingerprint Pro Fastly VCL Integration is responsible for proxying identification and JavaScript agent download requests that are performed on your Fastly infrastructure.

bot bot-detection botd browser browser-fingerprinting detection fastly fastly-vcl fingerprint fingerprinting fingerprintjs fingerprintjs-pro identifier varnish vcl visitor visitor-identifier

Last synced: 09 Nov 2024

https://github.com/lukasdrews97/twitter_bot_detection

Twitter bot detection using graph neural networks.

bot-detection graph-neural-networks pytorch-geometric social-network twitter-bot-detection

Last synced: 06 Nov 2024

https://github.com/kianoushamirpour/intrusion_detection_with_unsupervised_learning

Using unsupervised learning methods to detect anomalies in a system based on logs collected in real-time from the log aggregation systems of an enterprise.

bot-detection unsupervised-learning

Last synced: 06 Nov 2024