Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/fnkr/gocrawl
Simple web crawler.
https://github.com/fnkr/gocrawl
crawler http-client
Last synced: 23 days ago
JSON representation
Simple web crawler.
- Host: GitHub
- URL: https://github.com/fnkr/gocrawl
- Owner: fnkr
- License: mit
- Created: 2018-07-13T19:10:43.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2021-12-22T13:29:31.000Z (almost 3 years ago)
- Last Synced: 2024-06-20T12:06:41.413Z (5 months ago)
- Topics: crawler, http-client
- Language: Go
- Homepage:
- Size: 5.86 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# [gocrawl](https://github.com/fnkr/gocrawl)
Simple http crawler, written in Go.
## Usage example
```
$ gocrawl -url https://www.example.com -threads 10
```
Run `gocrawl -help` for help.