https://github.com/gocolly/redisstorage

Redis based storage backend for Colly
https://github.com/gocolly/redisstorage

Last synced: about 2 months ago
JSON representation

Redis based storage backend for Colly

• Host: GitHub
• URL: https://github.com/gocolly/redisstorage
• Owner: gocolly
• License: apache-2.0
• Created: 2018-02-09T23:00:35.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2022-10-21T14:22:24.000Z (over 2 years ago)
• Last Synced: 2024-11-04T17:47:49.157Z (4 months ago)
• Language: Go
• Homepage: https://godoc.org/github.com/gocolly/redisstorage
• Size: 13.7 KB
• Stars: 35
• Watchers: 6
• Forks: 11
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Redis Storage for Colly

This is a redis based storage backend for [Colly](https://github.com/gocolly/colly) collectors.

[![GoDoc](https://godoc.org/github.com/gocolly/redisstorage?status.svg)](https://godoc.org/github.com/gocolly/redisstorage)

## Install

```

go get -u github.com/gocolly/redisstorage

```

## Usage

```go

import (

	"github.com/gocolly/colly"

	"github.com/gocolly/redisstorage"

)

```

```go

c := colly.NewCollector()

storage := &redisstorage.Storage{

    Address:  "127.0.0.1:6379",

    Password: "",

    DB:       0,

    Prefix:   "job01",

}

err := c.SetStorage(storage)

if err != nil {

    panic(err)

}

```

## Bugs

Bugs or suggestions? Visit the [issue tracker](https://github.com/gocolly/redisstorage/issues) or join `#colly` on freenode