https://github.com/eze-kiel/go-scraper

a simple web scraper in go
https://github.com/eze-kiel/go-scraper

content-scraper go golang web-scraping

Last synced: 4 days ago
JSON representation

a simple web scraper in go

• Host: GitHub
• URL: https://github.com/eze-kiel/go-scraper
• Owner: eze-kiel
• Created: 2020-05-17T15:38:22.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-05-17T16:35:53.000Z (over 4 years ago)
• Last Synced: 2024-06-19T05:32:24.680Z (5 months ago)
• Topics: content-scraper, go, golang, web-scraping
• Language: Go
• Homepage:
• Size: 4.88 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# go-scraper

A web scraper bot in Go.

## Usage

```

simplest usage :

go-scraper -t 

```

## Options

```

-t     : URL to scrap

-type : content type that will be scraped. Types are detailed in the Types section

```

## Types

`url` : default value. Scrap all the links on the page

`img` : scrap all the links to images

`script` : scrap all the links to scripts

`mail` : scrap all the mailto: links

`style` : scrap all imported stylesheets

`comments` : scrap all HTML comments