https://github.com/codeforcroatia/imamopravoznati-tjv

TJV Parser is a script that will scrape and parse public authorities file and post online in open format
https://github.com/codeforcroatia/imamopravoznati-tjv

opendata scraper

Last synced: 10 days ago
JSON representation

TJV Parser is a script that will scrape and parse public authorities file and post online in open format

• Host: GitHub
• URL: https://github.com/codeforcroatia/imamopravoznati-tjv
• Owner: codeforcroatia
• Created: 2019-11-16T22:24:24.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2022-05-08T10:53:48.000Z (over 2 years ago)
• Last Synced: 2024-11-11T22:37:43.964Z (2 months ago)
• Topics: opendata, scraper
• Language: Python
• Homepage: https://morph.io/codeforcroatia/imamopravoznati-tjv
• Size: 562 KB
• Stars: 0
• Watchers: 3
• Forks: 2
• Open Issues: 5
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# TJV register scraper

This is a scraper that runs on [Morph](https://morph.io). To get started [see Morph.io the documentation](https://morph.io/documentation).

Scraper runs and data on Morph.io: https://morph.io/codeforcroatia/imamopravoznati-tjv.

Python 3.5 with Pandas.

## How it works?

1. Scraper will take data from official CSV register at https://tjv.pristupinfo.hr/ (TJV)

2. Scraped TJV CSV data will be stored to `allData` table

3. Then data will be processed and cleanup - it will compare existing `data` and `allData` and mark what was updated since last run.

4. Clean data will be stored to `data` table

Work by [SelectSoft](https://github.com/SelectSoft)