https://github.com/humbertodias/go-nie-crawler

Simple crawler that extract some useful informations from sede.administracionespublicas.gob.es.
https://github.com/humbertodias/go-nie-crawler

crawler golang

Last synced: 3 days ago
JSON representation

Simple crawler that extract some useful informations from sede.administracionespublicas.gob.es.

• Host: GitHub
• URL: https://github.com/humbertodias/go-nie-crawler
• Owner: humbertodias
• Created: 2018-12-23T11:43:41.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2022-10-23T12:36:07.000Z (about 2 years ago)
• Last Synced: 2024-06-20T17:48:34.421Z (5 months ago)
• Topics: crawler, golang
• Language: Go
• Homepage:
• Size: 20.5 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
[![Build Status](https://travis-ci.org/humbertodias/go-nie-crawler.svg?branch=master)](https://travis-ci.org/humbertodias/go-nie-crawler)

# GO Crawler Demo

Simple crawler that extract some useful informations from sede.administracionespublicas.gob.es.

# Clone

    mkdir -p ~/go/src/github.com/humbertodias && cd $_

    git clone https://github.com/humbertodias/go-nie-crawler

    cd go-nie-crawler

# Run

    make run

Check the files: provincias.json, tramites.json

# Ref

[Scraping-the-Web-in-Golang-with-Colly-and-Goquery](https://benjamincongdon.me/blog/2018/03/01/Scraping-the-Web-in-Golang-with-Colly-and-Goquery/)

[go-colly](http://go-colly.org)