https://github.com/oglinuk/goccer

Go Concurrent Crawler Library
https://github.com/oglinuk/goccer

concurrency crawler go library

Last synced: 12 months ago
JSON representation

Go Concurrent Crawler Library

• Host: GitHub
• URL: https://github.com/oglinuk/goccer
• Owner: oglinuk
• License: apache-2.0
• Created: 2019-08-11T19:23:58.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2021-12-22T00:16:13.000Z (over 4 years ago)
• Last Synced: 2024-09-29T09:18:11.893Z (over 1 year ago)
• Topics: concurrency, crawler, go, library
• Language: Go
• Homepage:
• Size: 1.25 MB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Goccer

Go concurrent crawler(s) library

## Usage

```Go

package main

import (

	"log"

	"github.com/oglinuk/goccer"

)

func main() {

	wp := goccer.NewWorkerpool()

	collected := wp.Queue([]string{"https://fourohfournotfound.com"})

	for _, c := range collected {

		log.Println(c)

	}

}

```

## Examples

See [examples](examples) directory.