{"id":27342400,"url":"https://github.com/priyamharsh14/prawler","last_synced_at":"2025-04-12T16:30:02.653Z","repository":{"id":57454563,"uuid":"200963522","full_name":"priyamharsh14/Prawler","owner":"priyamharsh14","description":"Advance Proxy Scraper written in Python3","archived":false,"fork":false,"pushed_at":"2020-09-03T07:11:45.000Z","size":376,"stargazers_count":27,"open_issues_count":2,"forks_count":10,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-08-09T03:53:14.472Z","etag":null,"topics":["anonymity","api","find-proxies","json","proxy-scraper","proxy-servers"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/priyamharsh14.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-08-07T03:16:26.000Z","updated_at":"2024-07-28T06:40:53.000Z","dependencies_parsed_at":"2022-09-04T19:10:32.021Z","dependency_job_id":null,"html_url":"https://github.com/priyamharsh14/Prawler","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/priyamharsh14%2FPrawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/priyamharsh14%2FPrawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/priyamharsh14%2FPrawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/priyamharsh14%2FPrawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/priyamharsh14","download_url":"https://codeload.github.com/priyamharsh14/Prawler/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248596364,"owners_count":21130691,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anonymity","api","find-proxies","json","proxy-scraper","proxy-servers"],"created_at":"2025-04-12T16:30:01.750Z","updated_at":"2025-04-12T16:30:02.627Z","avatar_url":"https://github.com/priyamharsh14.png","language":"Python","funding_links":["https://www.paypal.me/priyamharsh14"],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003e\n\t\u003cbr\u003e\n\t\u003cimg src=\"https://i.ibb.co/w7jx8Yg/prawler.png\" alt=\"prawler\"\u003e\n\u003c/h1\u003e\n\u003ch4 align=\"center\"\u003eAdvanced Proxy Scraper\u003c/h4\u003e\n\u003cp align=\"center\"\u003e\n\t\u003ca href=\"https://pypi.org/project/Prawler/\"\u003e\u003cimg src=\"https://img.shields.io/pypi/v/Prawler\"\u003e\u003c/a\u003e\n\u003ca href=\"https://raw.githubusercontent.com/priyamharsh14/Prawler/master/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/github/license/priyamharsh14/Prawler\"\u003e\u003c/a\u003e\n\u003cimg src=\"https://img.shields.io/pypi/pyversions/Prawler\"\u003e\n\u003c/p\u003e\n\u003cbr\u003e\n\n## What is Prawler ?\nPrawler finds best and working proxies from the internet in seconds. Proxies are used by developers, ethical hackers, pentesters and so on, in order to cover their tracks or bypass firewall restrictions. Prawler helps to find desired proxy in all possible formats.\n\n## Features:\n- Fast Proxy Server Scraping through multiple API's\n- Extracts various types of Proxy Servers (HTTP, SOCKS4, SOCKS5)\n- Scraps for Proxy Servers based on their Anonymity Level (Transparent, Anonymous, Elite)\n- Find proxies from a specific country (using Country Codes)\n- Various output formats available (List, JSON, TXT file)\n\n## Installation:\n\nNew Installation:\n```\npip install Prawler\n```\n\nUpdating the package:\n```\npip install --upgrade Prawler\n```\n\n## Usage:\n\nWe can use Prawler in several ways:\n- **Find a single random proxy server**\n\nSyntax:\n```\nPrawler.get_random_proxy(\u003cPROXY TYPE\u003e, \u003cPROXY ANONYMITY LEVEL\u003e)\n```\nExample:\n```\nimport Prawler\nproxy = Prawler.get_random_proxy(\"http\", \"elite\")\n```\n\u003cbr\u003e\n\n- **Find all proxies in list format**\n\nSyntax:\n```\nPrawler.get_proxy_list(\u003cNO. OF PROXIES\u003e, \u003cPROXY TYPE\u003e, \u003cPROXY ANONYMITY LEVEL\u003e, \u003cCOUNTRY CODE\u003e)\n```\nExample:\n```\nimport Prawler\nproxy_list = Prawler.get_proxy_list(5, \"http\", \"elite\")\n```\nor\n```\nimport Prawler\nproxy_list = Prawler.get_proxy_list(5, \"http\", \"elite\", \"US\")\n```\n\u003cbr\u003e\n\n- **Find all proxies in JSON format**\n\nSyntax:\n```\nPrawler.get_proxy_json(\u003cNO. OF PROXIES\u003e, \u003cPROXY TYPE\u003e, \u003cPROXY ANONYMITY LEVEL\u003e, \u003cCOUNTRY CODE\u003e)\n```\nExample:\n```\nimport Prawler\nproxy_list = Prawler.get_proxy_json(5, \"http\", \"elite\")\n```\nor\n```\nimport Prawler\nproxy_list = Prawler.get_proxy_json(5, \"http\", \"elite\", \"US\")\n```\n\u003cbr\u003e\n\n- **Find all proxies and save it into a text file**\n\nSyntax:\n```\nPrawler.get_proxy_txt(\u003cFILENAME\u003e, \u003cNO. OF PROXIES\u003e, \u003cPROXY TYPE\u003e, \u003cPROXY ANONYMITY LEVEL\u003e, \u003cCOUNTRY CODE\u003e)\n```\nExample:\n```\nimport Prawler\nPrawler.get_proxy_txt(\"proxy_list.txt\", 50, \"http\", \"elite\")\n```\nor\n```\nimport Prawler\nPrawler.get_proxy_txt(\"proxy_list.txt\", 50, \"http\", \"elite\", \"US\")\n```\n\n## Note:\n\n- **Valid Proxy Type:**\u003cbr\u003e\n```\nhttp, socks4, socks5\n```\n- **Valid Anonymity Level:**\u003cbr\u003e\n```\nall, elite, anonymous, transparent\n```\n- **Valid Country Codes:**\u003cbr\u003e\n```\nAF, AL, AM, AR, AT, AU, BA, BD, BG, BO, BR, BY, CA, CL, CM, CN, CO, CZ, DE, EC, EG, ES, FR, GB, GE, GN, GR, GT, HK, HN, HU, ID, IN, IQ, IR, IT, JP, KE, KG, KH, KR, KZ, LB, LT, LV, LY, MD, MM, MN, MU, MW, MX, MY, NG, NL, NO, NP, PE, PH, PK, PL, PS, PY, RO, RS, RU, SC, SE, SG, SK, SY, TH, TR, TW, TZ, UA, UG, US, VE, VN, ZA\n```\n\n## Donate:\n\nIf you feel this project was awesome, you can give me a cup of coffee :)\n\n[![paypal](https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif)](https://www.paypal.me/priyamharsh14)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpriyamharsh14%2Fprawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpriyamharsh14%2Fprawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpriyamharsh14%2Fprawler/lists"}