https://github.com/pixelastic/datagouv-scrapper
Getting data from data.gouv.fr in a more easily readable format.
https://github.com/pixelastic/datagouv-scrapper
Last synced: over 1 year ago
JSON representation
Getting data from data.gouv.fr in a more easily readable format.
- Host: GitHub
- URL: https://github.com/pixelastic/datagouv-scrapper
- Owner: pixelastic
- Created: 2014-02-22T18:16:45.000Z (over 12 years ago)
- Default Branch: master
- Last Pushed: 2014-03-01T14:30:13.000Z (over 12 years ago)
- Last Synced: 2024-04-12T01:05:05.187Z (about 2 years ago)
- Language: Ruby
- Size: 230 KB
- Stars: 6
- Watchers: 4
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# Datagouv Scrapper
This tool was built during the Open Data 2014 Hackathon in Paris.
The goal was to get data from http://data.gouv.fr/ in a more easily readable
way for human. We wanted to get a simple spreadsheet to manually check each
file to see if the data contained in the downloadable ressources were easy to
use or not.
The tool will generate json and csv file by requesting the CKAN API exposed by
data.gouv.fr, ask for an organization, loop through all associated packages,
request the api for each of these packages, loop through their associated items
and aggregate all this data to form a nicely coherent list.
# Usage
$ ruby ./scrapper.rb ministere-de-l-interieur
## Fetching organization
http://qa.data.gouv.fr/api/1/datasets?organization=ministere-de-l-interieur
## Fetching a package
http://qa.data.gouv.fr/api/1/datasets/ce01b63a-63fc-4a00-a340-bcdec51e2035