{"id":13539679,"url":"https://github.com/fcavallarin/htcap","last_synced_at":"2025-04-04T20:14:51.293Z","repository":{"id":34193233,"uuid":"38047137","full_name":"fcavallarin/htcap","owner":"fcavallarin","description":"htcap is a web application scanner able to crawl single page application (SPA) recursively by intercepting ajax calls and DOM changes.","archived":false,"fork":false,"pushed_at":"2021-10-11T12:35:57.000Z","size":528,"stargazers_count":611,"open_issues_count":7,"forks_count":114,"subscribers_count":41,"default_branch":"master","last_synced_at":"2024-10-13T22:29:59.936Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fcavallarin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-06-25T12:10:09.000Z","updated_at":"2024-09-27T17:17:37.000Z","dependencies_parsed_at":"2022-08-30T01:10:34.201Z","dependency_job_id":null,"html_url":"https://github.com/fcavallarin/htcap","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fcavallarin%2Fhtcap","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fcavallarin%2Fhtcap/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fcavallarin%2Fhtcap/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fcavallarin%2Fhtcap/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fcavallarin","download_url":"https://codeload.github.com/fcavallarin/htcap/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247242680,"owners_count":20907134,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T09:01:30.323Z","updated_at":"2025-04-04T20:14:51.273Z","avatar_url":"https://github.com/fcavallarin.png","language":"Python","funding_links":[],"categories":["\u003ca id=\"8f92ead9997a4b68d06a9acf9b01ef63\"\u003e\u003c/a\u003e扫描器\u0026\u0026安全扫描\u0026\u0026App扫描\u0026\u0026漏洞扫描","Python (1887)","Python","\u003ca id=\"132036452bfacf61471e3ea0b7bf7a55\"\u003e\u003c/a\u003e工具"],"sub_categories":["\u003ca id=\"de63a029bda6a7e429af272f291bb769\"\u003e\u003c/a\u003e未分类-Scanner"],"readme":"## HTCAP\n\nhtcap is a web application scanner able to crawl single page application (SPA) recursively by intercepting ajax calls and DOM changes.\n\n## KEY FEATURES\n\n- Recursive DOM crawling engine\n- Discovers ajax/fetch/jsonp/websocket requests\n- Supports cookies, proxy, custom headers, http auth and more\n- Heuristic page deduplication engine based on text similarities\n- Scriptable login sequences\n- All findings are saved to sqlite database and can be exported to an interactive html report\n- The built-in fuzzers can detect SQL-Injection, XSS, Command Execution, File disclosure and many more\n- Can be easly interfaced with Sqlmap, Arachni, Wapiti, Burp and many other tools\n- Fuzzers are built on top of a fuzzing framework so they can be easly created/customized\n- Fuzzers fully support REST and SOAP payloads (json and xml)\n- Both crawler and fuzzers run in a mulithreaded environment\n- The report comes with advanced filtering capabilities and workflow tools\n\n## BRIEF\n\nHtcap is not just another vulnerability scanner since it's focused on the crawling process and it's aimed to detect and intercept ajax/fetch calls, websockets, jsonp ecc. It uses its own fuzzers plus a set of external tools to discover vulnerabilities and it's designed to be a tool for both manual and automated penetration test of modern web applications.\n\nIt also features a small but powerful framework to quickly develop custom fuzzers with less than 60 lines of python.\nThe fuzzers can work with GET/POST data, XML and JSON payloads and switch between POST and GET. Of course, fuzzers run in parallel in a multi-threaded environment.\n\nThis is the very first release that uses headless chrome instead of phantomjs.\nHtcap’s Javascript crawling engine has been rewritten to take advantage of the new async/await features of ecmascript and has been converted to a nodjes module build on top of [Puppetteer](https://github.com/GoogleChrome/puppeteer).\n\nMore infos [here](http://www.fcvl.net/htcap).\n\n\n## DEMO\nThe video below shows htcap crawling gmail.  \nThe crawl lasted for many hours and about 3000 XHR request have been captured.  \n\n[![crawling gmail](https://www.fcvl.net/htcap/img/htcap-gmail-video.png)](https://www.youtube.com/watch?v=5FLmWjKE2JI \"HTCAP Crawling Gmail\")\n\n\n## SETUP\n\n### Requirements\n\n 1. Python 3.3\n 2. Nodejs and npm\n 3. Sqlmap (for sqlmap scanner module)\n 4. Arachni (for arachni scanner module)\n\n### Local Installation\n\nInstall the requirements and run the following:\n```console\n$ git clone https://github.com/fcavallarin/htcap.git htcap\n$ htcap/htcap.py\n```\n\n### Docker Installation\n\nInstall Docker and run the following:\n```console\n$ git clone https://github.com/fcavallarin/htcap.git htcap\n$ cd htcap\n$ docker build -t htcap --build-arg HTCAP_VERSION=master . # replace master by the desired htcap commit hash or branch\n$ mkdir -p htcap-out \u0026\u0026 docker run -v \"$(pwd)/htcap-out/\":/out/ --rm --name htcap htcap\n$ docker exec -it htcap bash\n$ htcap # now you can use htcap in the Docker container\n```\n\nYou can access services listening on the Docker host from within the Docker container using the hostname `host.docker.internal`.\nTo get the IP for `host.docker.internal`, run the following command inside the Docker container:\n```console\ngetent hosts host.docker.internal | awk '{print $1;}'\n```\n\n## DOCUMENTATION\n\nDocumentation, examples and demos can be found [here](http://www.fcvl.net/htcap)\n\n## LICENSE\n\nThis program is free software; you can redistribute it and/or modify it under the terms of the [GNU General Public License](https://www.gnu.org/licenses/gpl-2.0.html) as published by the Free Software Foundation; either version 2 of the License, or(at your option) any later version.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffcavallarin%2Fhtcap","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffcavallarin%2Fhtcap","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffcavallarin%2Fhtcap/lists"}