https://github.com/immannino/milton
https://github.com/immannino/milton
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/immannino/milton
- Owner: immannino
- Created: 2024-10-09T22:15:15.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-11-19T16:00:28.000Z (6 months ago)
- Last Synced: 2024-11-19T17:18:20.740Z (6 months ago)
- Language: Go
- Size: 590 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# milton - webcrawler
> got bored and wanted to track news SEO data over the course of the hurricane. This repo is a general purpose SEO meta tag crawler (super barebones) that crawls a site on demand.
## Usage
Go 1.23 Installed
**Build App**
```
go build
```
**Usage Text**
```
NAME:
milton - SEO Scraper
USAGE:
milton [global options] command [command options]
COMMANDS:
help, h Shows a list of commands or help for one command
GLOBAL OPTIONS:
--url value, -u value
--list value, -l value
--help, -h show help
```
## Resources
- gocolly/colly
- sqlite3
- urfave/cli