An open API service indexing awesome lists of open source software.

https://github.com/sermilrod/simple-webcrawler

Simple webcrawler implementation in Go
https://github.com/sermilrod/simple-webcrawler

algorithms algorithms-implemented docker go golang

Last synced: 4 months ago
JSON representation

Simple webcrawler implementation in Go

Awesome Lists containing this project

README

        

# Simple Webcrawler
A simple webcrawler written in go

# Building the artefact
```
$ docker build -t sermilrod/simple-webcrawler .
$ docker push sermilrod/simple-webcrawler
```

# How to use it
```
$ docker run --rm sermilrod/simple-webcrawler -url http://foo.bar
$ docker run --rm sermilrod/simple-webcrawler -url http://foo.bar -url http://bibidi.babidi.boo
```

# Running the tests
```
$ go test -v ./... --benchmem
```