Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/gschier/golang-link-fetcher

A CLI to crawl a list of URLs and print out the set of unique links discovered
https://github.com/gschier/golang-link-fetcher

Last synced: about 2 months ago
JSON representation

A CLI to crawl a list of URLs and print out the set of unique links discovered

Awesome Lists containing this project

README

        

# golang-link-fetcher
A CLI to crawl a list of URLs and print out the set of unique links discovered

## Usage

```bash
# Using the go cli
go run main.go http://schier.co http://blog.schier.co
```

## Development

If you want to play around with the code, here's how you make changes

```bash
# Fetch dependancies
go get

# Build a binary
go build main.go

# Run the binary
./main ...
```

## Info

This code goes with a [tutorial]() on my blog.