{"id":28391511,"url":"https://github.com/triotion/websleuth","last_synced_at":"2025-06-25T21:31:07.100Z","repository":{"id":288717932,"uuid":"968987026","full_name":"Triotion/Websleuth","owner":"Triotion","description":"WebSleuth - Advanced Website OSINT and Penetration Testing Tool","archived":false,"fork":false,"pushed_at":"2025-04-28T13:52:54.000Z","size":243,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-31T20:05:12.864Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Triotion.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-04-19T06:03:55.000Z","updated_at":"2025-04-28T13:52:57.000Z","dependencies_parsed_at":null,"dependency_job_id":"5e676fae-7950-4fdc-abcc-6fc01d200c08","html_url":"https://github.com/Triotion/Websleuth","commit_stats":null,"previous_names":["triotion/websleuth"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Triotion/Websleuth","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Triotion%2FWebsleuth","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Triotion%2FWebsleuth/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Triotion%2FWebsleuth/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Triotion%2FWebsleuth/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Triotion","download_url":"https://codeload.github.com/Triotion/Websleuth/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Triotion%2FWebsleuth/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261955864,"owners_count":23235966,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-31T09:39:25.974Z","updated_at":"2025-06-25T21:31:07.094Z","avatar_url":"https://github.com/Triotion.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# WebSleuth - Advanced Website OSINT and Penetration Testing Tool\r\n\r\n\u003cp align=\"center\"\u003e\r\n  \u003cimg src=\"assets/logo.png\" alt=\"WebSleuth Logo\" width=\"100%\"\u003e\r\n\u003c/p\u003e\r\n\r\n\u003cp align=\"center\"\u003e\r\n  \u003ca href=\"#features\"\u003eFeatures\u003c/a\u003e •\r\n  \u003ca href=\"#installation\"\u003eInstallation\u003c/a\u003e •\r\n  \u003ca href=\"#usage\"\u003eUsage\u003c/a\u003e •\r\n  \u003ca href=\"#modules\"\u003eModules\u003c/a\u003e •\r\n  \u003ca href=\"#legal-disclaimer\"\u003eLegal Disclaimer\u003c/a\u003e •\r\n  \u003ca href=\"#contributions\"\u003eContributions\u003c/a\u003e •\r\n  \u003ca href=\"#donations\"\u003eDonations\u003c/a\u003e\r\n\u003c/p\u003e\r\n\r\nWebSleuth is a comprehensive website reconnaissance and vulnerability assessment tool designed for security professionals, penetration testers, and bug bounty hunters. It combines multiple OSINT and security testing techniques into a unified, easy-to-use command-line tool.\r\n\r\n## Features\r\n\r\n- **Information Gathering**: Collect domain information, DNS records, IP addresses, WHOIS data\r\n- **Subdomain Enumeration**: Discover subdomains using brute force, certificate transparency logs, and other sources\r\n- **Web Technologies Analysis**: Identify frontend/backend technologies, frameworks, CMS, and libraries\r\n- **Content Discovery**: Find hidden files, directories, and endpoints, including backup files and sensitive information\r\n- **Security Headers Analysis**: Evaluate security header implementation and assign a security grade\r\n- **SSL/TLS Assessment**: Check certificates, protocols, ciphers, and vulnerabilities (BEAST, POODLE, etc.)\r\n- **Port Scanning**: Discover open ports and services with accurate detection\r\n- **WAF Detection**: Identify and fingerprint Web Application Firewalls with precision\r\n- **Vulnerability Scanning**: Check for XSS, SQL injection, LFI, and other web vulnerabilities\r\n- **Screenshot Capture**: Visualize target websites and subdomains using automated browsers\r\n- **DNS Security Analysis**: Check DNS configuration for vulnerabilities and misconfigurations\r\n- **Reporting**: Generate comprehensive reports in multiple formats (HTML, JSON, PDF) with interactive dashboards\r\n\r\n## Installation\r\n\r\n### From PyPI (Recommended)\r\n\r\n```bash\r\npip install websleuth\r\n```\r\n\r\n### From Source\r\n\r\n```bash\r\n# Clone the repository\r\ngit clone https://github.com/Triotion/websleuth.git\r\ncd websleuth\r\n\r\n# Install the package\r\npip install -e .\r\n```\r\n\r\n### Requirements\r\n\r\n- Python 3.8 or higher\r\n- Dependent Python libraries (automatically installed):\r\n  - requests, BeautifulSoup4, dns-python, python-whois\r\n  - cryptography, OpenSSL, rich, selenium\r\n  - and more (see requirements.txt)\r\n\r\n## Usage\r\n\r\n### Basic Usage\r\n\r\n```bash\r\n# Scan a website with all modules\r\nwebsleuth -u https://example.com -a\r\n\r\n# Only perform specific scans\r\nwebsleuth -u https://example.com -i -s -t -sh\r\n\r\n# Save report in specific format\r\nwebsleuth -u https://example.com -a -f json\r\n```\r\n\r\n### Command Line Options\r\n\r\n```\r\n-u, --url            Target URL (e.g., https://example.com)\r\n-a, --all            Run all scans\r\n-i, --info           Gather basic information\r\n-s, --subdomains     Enumerate subdomains\r\n-t, --technology     Detect web technologies\r\n-c, --content        Discover hidden content\r\n-sh, --security-headers  Check security headers\r\n-ssl, --ssl-check    Check SSL/TLS configuration\r\n-p, --ports          Scan for open ports\r\n-w, --waf            Detect WAF\r\n-v, --vuln           Scan for vulnerabilities\r\n-sc, --screenshot    Capture screenshots\r\n-dns, --dns-security Check DNS security configuration\r\n-o, --output         Output directory (default: output)\r\n-f, --format         Report format: html, json, pdf, all (default: html)\r\n-q, --quiet          Quiet mode\r\n-d, --debug          Debug mode\r\n-T, --threads        Number of threads (default: 50)\r\n-to, --timeout       Connection timeout in seconds (default: 5)\r\n--port-range         Port range to scan (e.g., 1-1000) (default: 1-1024)\r\n-h, --help           Show help message\r\n```\r\n\r\n## Modules\r\n\r\n### Information Gathering\r\nCollects basic information about the target website, including:\r\n- Domain information and IP addresses\r\n- DNS records (nameservers, MX, TXT)\r\n- WHOIS data including registrar, creation/expiration dates\r\n- HTTP headers analysis\r\n- Robots.txt and Sitemap.xml content\r\n\r\n### Subdomain Enumeration\r\nDiscovers subdomains using various techniques:\r\n- DNS brute force using customizable wordlists\r\n- Certificate Transparency logs (crt.sh)\r\n- DNS Dumpster and AlienVault OTX integration\r\n- Passive DNS sources\r\n\r\n### Technology Scanner\r\nDetects web technologies with comprehensive coverage:\r\n- Content Management Systems (WordPress, Joomla, Drupal, etc.)\r\n- Web frameworks (React, Angular, Vue, Django, Laravel, etc.)\r\n- Programming languages (PHP, Python, Ruby, etc.)\r\n- JavaScript libraries and frameworks\r\n- Analytics tools and tracking services\r\n- Content Delivery Networks (CDNs)\r\n- Server software and versions\r\n\r\n### Content Discovery\r\nFinds hidden files, directories, and sensitive information:\r\n- Common files and directories using extensive wordlists\r\n- Backup files and development leftovers\r\n- Configuration files and sensitive information\r\n- API endpoints and documentation\r\n- Custom wordlist support for targeted scanning\r\n\r\n### Security Headers Analyzer\r\nAnalyzes security headers with detailed scoring:\r\n- Strict-Transport-Security (HSTS)\r\n- Content-Security-Policy (CSP)\r\n- X-Content-Type-Options\r\n- X-Frame-Options\r\n- X-XSS-Protection\r\n- Referrer-Policy\r\n- Permissions-Policy\r\n- Detailed recommendations for improvement\r\n\r\n### SSL/TLS Checker\r\nPerforms comprehensive SSL/TLS security assessment:\r\n- Certificate validation and expiration checks\r\n- Supported protocols analysis (TLS 1.3, 1.2, 1.1, 1.0, SSL 3.0)\r\n- Cipher suite evaluation\r\n- Common vulnerabilities detection (BEAST, POODLE, Heartbleed, FREAK, etc.)\r\n- Security grading (A+ to F)\r\n\r\n### Port Scanner\r\nEfficiently scans for open ports and services:\r\n- Fast TCP connect scanning\r\n- Common port scanning\r\n- Custom port range specification\r\n- Service identification\r\n- Rate limiting to avoid detection\r\n\r\n### WAF Detector\r\nDetects and identifies Web Application Firewalls:\r\n- Signature-based detection for major WAFs (Cloudflare, AWS WAF, etc.)\r\n- Behavior-based detection using sophisticated probes\r\n- Evasion techniques testing\r\n- Confidence scoring for accuracy\r\n\r\n### Vulnerability Scanner\r\nScans for common web vulnerabilities:\r\n- Cross-Site Scripting (XSS)\r\n- SQL Injection (SQLi)\r\n- Local File Inclusion (LFI)\r\n- Cross-Site Request Forgery (CSRF)\r\n- Form-based vulnerability testing\r\n- Parameter-based vulnerability testing\r\n- Comprehensive reporting with severity ratings\r\n\r\n### Screenshot Capture\r\nCaptures high-quality screenshots of websites:\r\n- Main website screenshot\r\n- Subdomain visualization\r\n- Headless browser automation with Selenium\r\n- Customizable resolution and settings\r\n- Screenshot embedding in HTML reports\r\n\r\n### DNS Security Analysis\r\nAnalyzes DNS configuration for security issues:\r\n- SPF, DKIM, and DMARC record validation\r\n- DNSSEC configuration checking\r\n- Zone transfer attempts\r\n- DNS cache poisoning vulnerability assessment\r\n- Misconfigurations detection\r\n\r\n## Legal Disclaimer\r\n\r\nThis tool is provided for educational and ethical testing purposes only. Always obtain proper authorization before testing any systems that you do not own. Unauthorized scanning and testing is illegal and unethical.\r\n\r\nThe developers of WebSleuth are not responsible for any misuse, damage, or illegal activities performed using this tool.\r\n\r\n## Contributions\r\n\r\nContributions are welcome! Please feel free to submit a Pull Request.\r\n\r\n1. Fork the repository\r\n2. Create your feature branch (`git checkout -b feature/amazing-feature`)\r\n3. Commit your changes (`git commit -m 'Add some amazing feature'`)\r\n4. Push to the branch (`git push origin feature/amazing-feature`)\r\n5. Open a Pull Request\r\n\r\n## License\r\n\r\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\r\n\r\n## Donations\r\n\r\nIf you find this tool valuable, consider donating to support ongoing development:\r\n\r\n- BTC: bc1qtkm7dzjp76gx8t9c02pshfd8rzarj6gj9yzglu\r\n- ETH: 0x88Aa0E09a5A62919321f38Fb4782A17f4dc91A9B\r\n- XMR: 0x6730c52B3369fD22E3ACc6090a3Ee7d5C617aBE0\r\n\r\n## Author\r\n\r\n- [Triotion](https://github.com/Triotion) \r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftriotion%2Fwebsleuth","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftriotion%2Fwebsleuth","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftriotion%2Fwebsleuth/lists"}