https://github.com/pyk/liputan6-scraper

https://github.com/pyk/liputan6-scraper

Last synced: 12 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/pyk/liputan6-scraper
• Owner: pyk
• Created: 2015-11-24T21:47:07.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2015-11-24T22:22:06.000Z (over 10 years ago)
• Last Synced: 2025-02-07T17:23:26.069Z (over 1 year ago)
• Language: Go
• Size: 382 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
This simple go program will scrape all articles from 

[liputan6](http://www.liputan6.com).

## Setup & Usage

Make sure you setup [Go workspace](https://golang.org/doc/code.html) and install [godep](https://github.com/tools/godep)

    git clone https://github.com/pyk/liputan6-scraper.git

    cd liputan6-scraper

    godep go build

Usage

    

    ./liputan6-scraper -tag="banjir-jakarta" -maxpage=10

it will fetch all articles in the first 10 pages of [Banjir Jakarta](http://www.liputan6.com/tag/banjir-jakarta) tag.