https://github.com/goolord/creepy

🐛 creepy web crawly
https://github.com/goolord/creepy

Last synced: 2 months ago
JSON representation

🐛 creepy web crawly

• Host: GitHub
• URL: https://github.com/goolord/creepy
• Owner: goolord
• Created: 2019-09-27T17:37:47.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-06-22T05:07:08.000Z (over 1 year ago)
• Last Synced: 2023-07-31T22:09:53.970Z (over 1 year ago)
• Language: Rust
• Homepage:
• Size: 321 KB
• Stars: 2
• Watchers: 4
• Forks: 1
• Open Issues: 6
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# 🐛 Creepy crawly web crawler

## Usage

```

creepy 1.0

Zachary Churchill 

🐛 Creepy crawly web crawler

USAGE:

    creepy [SUBCOMMAND]

FLAGS:

    -h, --help       Prints help information

    -V, --version    Prints version information

SUBCOMMANDS:

    configure    Configuration options

    crawly       Web crawling

    help         Prints this message or the help of the given subcommand(s)

```

```

creepy-configure

Configuration options

USAGE:

    creepy configure [FLAGS]

FLAGS:

        --default    generate a default configuration

        --full       generate a full default configuration

    -h, --help       Prints help information

    -V, --version    Prints version information

```

```

Web crawling

USAGE:

    creepy crawly --config 

FLAGS:

    -h, --help       Prints help information

    -V, --version    Prints version information

OPTIONS:

    -c, --config     Config file: domains, blacklist, etc

```