Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/LvMalware/waybackurls.pl
Search for urls of (sub)domains using the web archive database
https://github.com/LvMalware/waybackurls.pl
Last synced: about 1 month ago
JSON representation
Search for urls of (sub)domains using the web archive database
- Host: GitHub
- URL: https://github.com/LvMalware/waybackurls.pl
- Owner: LvMalware
- License: gpl-3.0
- Created: 2021-01-19T23:50:29.000Z (almost 4 years ago)
- Default Branch: master
- Last Pushed: 2022-10-08T18:22:36.000Z (over 2 years ago)
- Last Synced: 2024-08-16T16:22:32.391Z (5 months ago)
- Language: Perl
- Size: 46.9 KB
- Stars: 9
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# waybackurls.pl
> Search for urls of (sub)domains using the web archive databaseThis tool is mainly based on [waybackurls](https://github.com/tomnomnom/waybackurls) by tomnomnom.
The biggest difference between this tool and the one on which it is based is the ability to filter results based on status code, Mime-Type and file extension, which allows obtaining more relevant results within the context of a specific target.
In the current version, you can query results from the Wayback Machine, AlienVault and IntelligenceX (needs an API key).
## Usage
```
waybackurls.pl [option(s)] ...Options:
-h, --help Show this help message and exit
-v, --version Show program version and exit
-s, --silent Do not show status messages
-j, --json Output the urls in JSON format
-e, --extensions Comma-separated list of extensions to filter by
-m, --mime-types Comma-separated list of mime-types to filter by
-c, --status-codes Comma-separated list of status codes to filter by
-i, --input-file Read list of domains from file
-d, --subdomains Also search for subdomain urls (default)
-o, --output-file Save output to a file, don't print to stdout
-E, --exclude-exts Comma-separated list of extensions to be ignored
-M, --exclude-types Comma-separated list of mime-types to be ignored
-C, --exclude-codes Comma-separated list of status codes to be ignored
-g, --images Include image links
-k, --credentials JSON file with credentials/API keys for sources
--no-subdomains Don't search for subdomain urls
--no-images Don't include image links (default)
```## Examples
```
user@host:~$ waybackurls.pl -o output.txt -E css,jpg,jpeg,js,pdf,doc,docx -C 404 targetsite.com
user@host:~$ waybackurls.pl --no-subdomains -e php,txt,bkp -c 200 --json -i targets.txt
user@host:~$ waybackurls.pl -o output.txt -C 404,403,500 -i - < targets.txt
user@host:~$ waybackurls.pl -M text/html,image/jpeg,text/css targetsite.com --json > output.txt```
## Meta
[Lucas V. Araujo](https://github.com/LvMalware) – [email protected]
Distributed under the GNU GPL license. See ``LICENSE`` for more information.
[GitHub Repository](https://github.com/LvMalware/waybackurls.pl)
## Contributing
1. Fork it ()
2. Create your feature branch (`git checkout -b feature/fooBar`)
3. Commit your changes (`git commit -am 'Add some fooBar'`)
4. Push to the branch (`git push origin feature/fooBar`)
5. Create a new Pull Request### Foud a bug? Want some new feature? Open an issue and I will take a look.