{"id":13845892,"url":"https://github.com/omarhashem123/venom","last_synced_at":"2025-07-12T03:32:50.869Z","repository":{"id":54861291,"uuid":"332211227","full_name":"omarhashem123/venom","owner":"omarhashem123","description":"Tool designed for fast crawl and extract endpoints","archived":false,"fork":false,"pushed_at":"2021-04-05T11:24:13.000Z","size":159,"stargazers_count":15,"open_issues_count":1,"forks_count":4,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-08-05T17:45:16.376Z","etag":null,"topics":["crawler","python","python3","spider"],"latest_commit_sha":null,"homepage":"https://eg.linkedin.com/in/omar-1-hashem ","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/omarhashem123.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-01-23T13:00:56.000Z","updated_at":"2024-02-11T18:37:24.000Z","dependencies_parsed_at":"2022-08-14T05:00:50.270Z","dependency_job_id":null,"html_url":"https://github.com/omarhashem123/venom","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omarhashem123%2Fvenom","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omarhashem123%2Fvenom/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omarhashem123%2Fvenom/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omarhashem123%2Fvenom/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/omarhashem123","download_url":"https://codeload.github.com/omarhashem123/venom/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225791438,"owners_count":17524783,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","python","python3","spider"],"created_at":"2024-08-04T17:03:39.787Z","updated_at":"2024-11-21T19:30:49.090Z","avatar_url":"https://github.com/omarhashem123.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# venom\nTool designed for fast crawl and extract endpoints\n\n\n\n# Features\n\n###### 1- Fast web crawler for endpoint or unlike other tools you can crawl big list of endpoints\n\n\n###### 2- Extract allowed and disallowed endpoints from robots.txt for big list of endpoints that you can use disallowed endpoints with other tools to bypass 403 Status_Code to get quick money easily\n\n###### 3- Fast extracting endpoints from sitemap.xml for list of endpoints \n \n###### 4- So if you faced any problem with tool or your machine have connection problem with internet or you closed tool you don't need to crawl all endpoints again but you can go to file that contain failed threads and complete your crawl where tool stopped from failed threads file\n\n###### 5- Any failed or lack threads you will find it in failed threads file so you can crawl it again\n\n###### 6- randomize User-Agent \n\n###### 7- Extract subdomains from crt.sh and certspotter.com and crawl it\n\n###### 8- Extract endpoints from Wayback Machine for subdomain or list of subdomain\n\n###### 9- if you used a lot of threads and WAF detect it you can bypass it by taking control of threads and time to delay between threads\n\n###### 10- Crawl enpoints authenticated or unauthenticated\n\n###### 11- You can use it in linux or windows\n\n\n\n# Installation\n\n#### 1- Install python3 \n#### 2- Run this commands\n\n    git clone https://github.com/omarhashem123/venom.git\n\n    pip install -r requirements.txt\n\n# Usage\n\n    $ python3 venom.py\n\n    usage: \n\n    to extract endpoints from crawl:\n\n    python3 venom.py -f \u003cfile\u003e -t \u003cthreads\u003e -o \u003coutput file\u003e -l \u003cdepth level\u003e -s \u003cscope\u003e -time \u003cdelay\u003e -spider\n\n    OR\n\n    python3 venom.py -f \u003cfile\u003e -t \u003cthreads\u003e -o \u003coutput file\u003e -l \u003cdepth level\u003e -s \u003cscope\u003e -time \u003cdelay\u003e -cookie \u003ccookie\u003e -spider\n\n    to extract disallowed endpoinds and allowed endpoints from robots.txt:\n\n    python3 venom.py -f \u003cfile\u003e -t \u003cthreads\u003e -o \u003coutput file\u003e -time \u003cdelay\u003e -robots\n\n    to extract endpoints from sitemap.xml:\n\n    python3 venom.py -f \u003cfile\u003e -t \u003cthreads\u003e -o \u003coutput file\u003e -time \u003cdelay\u003e -sitemap\n\n    to extract endpoints from wayback machine:\n\n    python3 venom.py -d \u003cdomain\u003e -o \u003coutput file\u003e -archive\n\n    OR\n\n    python3 venom.py -f \u003cfile\u003e -t \u003cthreads\u003e -o \u003coutput file\u003e -archive\n\n    to extract subdomains from crt.sh:\n\n    python3 venom.py -d \u003cdomain\u003e -o \u003coutput file\u003e -crtsh\n\n    to extract subdomains from certspotter:\n\n    python3 venom.py -d \u003cdomain\u003e -o \u003coutput file\u003e -certspotter\n\n\n    description:Tool that spider subdomains and extract endpoints\n\n\n    optional arguments:\n  \n    -h, --help            show this help message and exit\n  \n    -f F                  \u003cfile contain subdomains\u003e\n  \n    -d D                  \u003cdomain or subdomain\u003e\n  \n    -s S                  \u003cfile that contain only domains in scope to validate it and extract out of scope\u003e\n  \n    -time [TIME]          \u003ctime to sleep between threads\u003e\n  \n    -t [T]                \u003cthreads\u003e\n  \n    -l L                  \u003clevels of crawl\u003e\n  \n    -o [O]                \u003cfolder that contain results\u003e\n  \n    -spider [SPIDER]      \u003cextract endpoints from spider websites\u003e\n  \n    -cookie COOKIE        \u003ccrawl with Cookie\u003e\n  \n    -robots [ROBOTS]      \u003cextract allowed endpoints and extract disallowed endpoints\u003e\n  \n    -sitemap [SITEMAP]    \u003cextract endpoints from sitemap.xml\u003e\n  \n    -archive [ARCHIVE]    \u003cextract endpoints from Wayback Machine\u003e\n  \n    -crtsh [CRTSH]        \u003cextract subdomains from crt.sh\u003e\n  \n    -certspotter [CERTSPOTTER]\n                        \u003cextract subdomains from certspotter.com\u003e\n\n# Screenshot\n\n\n![](/Screenshot.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomarhashem123%2Fvenom","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fomarhashem123%2Fvenom","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomarhashem123%2Fvenom/lists"}