https://github.com/ks6088ts/scraper-go

scraper written in Go
https://github.com/ks6088ts/scraper-go

Last synced: 28 days ago
JSON representation

scraper written in Go

• Host: GitHub
• URL: https://github.com/ks6088ts/scraper-go
• Owner: ks6088ts
• License: mit
• Created: 2021-02-24T12:54:54.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2023-12-15T11:59:14.000Z (11 months ago)
• Last Synced: 2024-06-20T17:41:40.923Z (5 months ago)
• Language: Go
• Size: 29.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![test](https://github.com/ks6088ts/scraper-go/workflows/test/badge.svg)

[![Go Report Card](https://goreportcard.com/badge/github.com/ks6088ts/scraper-go)](https://goreportcard.com/report/github.com/ks6088ts/scraper-go)

[![GoDoc](https://godoc.org/github.com/ks6088ts/scraper-go?status.svg)](https://godoc.org/github.com/ks6088ts/scraper-go)

# scraper-go

Template repository for Go

# commands

## browser

scrape elements matched with the specified XPATH with browser

**Prerequisites**

- install Google Chrome

- set PATH to [chromedriver](https://chromedriver.chromium.org/downloads)

```bash

# help for browser

scraper-go browser --help

# scrape webpage

scraper-go browser \

    --mode chrome

    --xpath //a/article/h1 \

    --url https://search.yahoo.co.jp/realtime

```