https://github.com/cloudtracer/paskto

Paskto - Passive Web Scanner
https://github.com/cloudtracer/paskto

commoncrawl internet-of-things internetarchive nikto osint passive-vulnerability-scanner scanner

Last synced: 3 months ago
JSON representation

Paskto - Passive Web Scanner

• Host: GitHub
• URL: https://github.com/cloudtracer/paskto
• Owner: cloudtracer
• License: mit
• Created: 2017-09-27T11:51:48.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2018-12-28T04:01:06.000Z (almost 6 years ago)
• Last Synced: 2024-07-24T19:34:25.411Z (4 months ago)
• Topics: commoncrawl, internet-of-things, internetarchive, nikto, osint, passive-vulnerability-scanner, scanner
• Language: JavaScript
• Homepage:
• Size: 53.2 MB
• Stars: 151
• Watchers: 9
• Forks: 43
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Paskto - Passive Web Scanner

  Paskto will passively scan the web using the Common Crawl internet index either by downloading the indexes on request or parsing data from your local system. URLs are then processed through Nikto and known URL lists to identify interesting content. Hash signatures are also used to identify known default content for some IoT devices or web applications.                                                     

```

  Options

    -d, --dir-input directory      Directory with common crawl index files with .gz extension. Ex: -d "/tmp/cc/"

    -v, --ia-dir-input directory   Directory with internet archive index files with .gz extension. Ex: -v         "/tmp/ia/"                                                                    

    -o, --output-file file         Save test results to file. Ex: -o /tmp/results.csv                            

    -u, --update-db                Build/Update Paskto DB from Nikto databases.                                  

    -n, --use-nikto                Use Nikto DBs. Default: true                                                  

    -e, --use-extras               Use EXTRAS DB. Default: true                                                  

    -s, --scan domain name         Domain to scan. Ex: -s "www.google.ca" or -s "*.google.ca"                    

    -i, --cc-index index           Common Crawl index for scan. Ex: -i "CC-MAIN-2017-34-index"                   

    -a, --save-all-urls file       Save CSV List of all URLS. Ex: -a /tmp/all_urls.csv                           

    -h, --help                     Print this usage guide.                                                       

  Examples

    Scan domain, save results and URLs   $ node paskto.js -s "www.msn.com" -o /tmp/rest-results.csv -a /tmp/all-urls.csv                                                                       

    Scan domain with CC wildcards.       $ node paskto.js -s "*.msn.com" -o /tmp/rest-results.csv -a /tmp/all-urls.csv  

    Scan domain, only save URLs.         $ node paskto.js -s "www.msn.com" -o /tmp/rest-results.csv                     

    Scan dir with indexes.               $ node paskto.js -d "/tmp/CC-MAIN-2017-39-index/" -o /tmp/rest-results.csv -a  /tmp/all-urls.csv                                                              

```

## Create Custom Digest signatures

A quick way to create new digest signatures for default content is to use [WARCPinch](https://chrome.google.com/webstore/detail/warcpinch/aejhoiiddnmdjhkkdobbcnebajjcjdkl) which is a Chrome Extension I hacked together based off of WARCreate except it creates digital signatures as well as WARC files. (Also adds highlight and right click functionality, which is useful to just highlight any identifying text to use as the name of the signatures).

## News & Updates

Follow [@ThreatPinch](https://twitter.com/ThreatPinch) on twitter.

Make sure to check out [ThreatPinch Lookup](https://github.com/cloudtracer/ThreatPinchLookup) as well, our OSINT and Threat Intel Chrome / Firefox browser extension.