https://github.com/coghost/roddy

colly liked crawler with go-rod(chromium) as backend.
https://github.com/coghost/roddy

Last synced: 23 days ago
JSON representation

colly liked crawler with go-rod(chromium) as backend.

• Host: GitHub
• URL: https://github.com/coghost/roddy
• Owner: coghost
• License: gpl-3.0
• Created: 2023-06-07T08:43:32.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2024-02-19T10:35:17.000Z (over 2 years ago)
• Last Synced: 2025-01-02T21:20:00.570Z (over 1 year ago)
• Language: Go
• Homepage:
• Size: 115 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# roddy

## Example

```go

func main() {

	c := roddy.NewCollector()

	// Find and visit all links

	c.OnHTML("a[href]", func(e *roddy.HTMLElement) {

		e.Request.Visit(e.Attr("href"))

	})

	c.OnRequest(func(r *roddy.Request) {

		fmt.Println("Visiting", r.URL)

	})

	c.Visit("http://go-colly.org/")

}

```

See [examples folder](https://github.com/coghost/roddy/tree/main/examples) for more detailed examples.