https://github.com/chris-martin/georgia

Data harvested from open.georgia.gov
https://github.com/chris-martin/georgia

Last synced: 26 days ago
JSON representation

Data harvested from open.georgia.gov

• Host: GitHub
• URL: https://github.com/chris-martin/georgia
• Owner: chris-martin
• Created: 2013-04-06T08:37:28.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2014-08-03T18:36:53.000Z (over 10 years ago)
• Last Synced: 2023-03-11T07:58:48.252Z (over 1 year ago)
• Language: JavaScript
• Homepage:
• Size: 105 MB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
This project is an effort to make the data from

[open.georgia.gov](http://www.open.georgia.gov/)

more accessible.

## Progress

The _Salaries and Travel Reimbursements_ section is fully scraped,

and all of the data from 2008 to 2012 has been obtained.

I have not yet looked into what else can be scraped, but it looks like

something similar can be done with _Other Expenditure Information_.

I'm currently in the process of building a web-based API and human interface.

## Repository contents

### `master`

`scrape/` -

A web scraping library which pulls data from open.georgia.gov and stores it in JSON format.

`database/` -

Defines a PostgreSQL database schema and jOOQ-based Java for it.

`json-to-sql/` -

Converts the content of the `json` branch to the content of the `sql` branch.

`web` -

Website using the Play framework.

### `json`

The `json` branch contains the most raw dump of the data from the scraping process.

### `sql`

The `sql` branch contains SQL scripts (in PostgreSQL dialect) suitable for filling a

database with schema defined by `database/src/main/sql/schema.sql` in the `master` branch.