https://github.com/workleap/secret-url-finder
Python script to find URLs that could contain secrets
https://github.com/workleap/secret-url-finder
Last synced: over 1 year ago
JSON representation
Python script to find URLs that could contain secrets
- Host: GitHub
- URL: https://github.com/workleap/secret-url-finder
- Owner: workleap
- License: other
- Archived: true
- Created: 2019-07-18T15:49:44.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2021-04-28T14:11:19.000Z (over 5 years ago)
- Last Synced: 2025-03-15T14:03:20.763Z (over 1 year ago)
- Language: Python
- Size: 59.6 KB
- Stars: 13
- Watchers: 1
- Forks: 6
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# secret-url-finder
Tool that finds URLs for a given domain by using different sources:
* [urlscan.io](https://urlscan.io/)
* [Alienvault OTX](https://otx.alienvault.com)
* [Wayback Machine](https://archive.org/web/)
* [Common Crawl](https://commoncrawl.org/)
* [Hybrid Analysis](https://www.hybrid-analysis.com) - Requires an API key.
* [VirusTotal](https://www.virustotal.com) - Requires an API key.
URLs that could contain secret values are highlighted in red.
## Setup
Install secret-url-finder
```
python3 setup.py install
```
## Usage
```
secret-url-finder [-h] --domain DOMAIN [-f] [-s] [-u] [--hybrid-analysis-key HYBRID_ANALYSIS_KEY] [--virus-total-key VIRUS_TOTAL_KEY] [--ignored-extensions IGNORED_EXTENSIONS]
required arguments:
--domain DOMAIN The domain to search
optional arguments:
-h, --help show this help message and exit
-f, --filter Only show URLs with secrets
-s, --sorted Sort results from newest to oldest
-u, --url-only Only displays the URLs
--urlscan-key URLSCAN_KEY
The API key for urlscan. Not mandatory, but helps with rate limiting
--hybrid-analysis-key HYBRID_ANALYSIS_KEY
The API key for hybrid analysis
--virus-total-key VIRUS_TOTAL_KEY
The API key for VirusTotal
--ignored-extensions IGNORED_EXTENSIONS
File extensions to ignore. Defaults to: "gif,jpg,png,css,svg,woff,woff2"
```
## License
Copyright © 2021, GSoft inc. This code is licensed under the Apache License, Version 2.0. You may obtain a copy of this license [here](https://github.com/gsoft-inc/gsoft-license/blob/master/LICENSE).