https://github.com/podemos-info/gataloger
A Geographical data gatherer and cataloger.
https://github.com/podemos-info/gataloger
fetcher geography ruby-cli
Last synced: 9 months ago
JSON representation
A Geographical data gatherer and cataloger.
- Host: GitHub
- URL: https://github.com/podemos-info/gataloger
- Owner: podemos-info
- License: agpl-3.0
- Created: 2017-03-28T08:35:45.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2023-01-20T20:28:37.000Z (over 3 years ago)
- Last Synced: 2023-02-27T14:51:26.137Z (over 3 years ago)
- Topics: fetcher, geography, ruby-cli
- Language: Ruby
- Homepage:
- Size: 1.11 MB
- Stars: 1
- Watchers: 9
- Forks: 1
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Gataloger
> A Geographical dATA gatherer and cataLOGER.
Gataloger features the following:
* A generic system for geographical and statistical data gathering
* A simple and easy to use format to store, transfer and process geographical information
* Plugins based on World and Spain information that can be optionally used
It consist in a console application that gathers information from several sources and generates a standard and static database. Each layer of data is fetched with a plugin, usually associated to a source. This database could be used in any application through a loading process. It allows to regenerate data files to include source changes.
It current setup is created specifically to have Spanish extra details, but it can be adapted easily to be used in other territories.
# How to Use Gataloger
Install and run.
bundle install
bundle exec bin/gataloger --prepare
The ```--prepare``` downloads external files and generates additional input files, it must be used in the first run. Downloaded files are cached, use ```--no-cache``` to force the program to download them again.
After its execution, output files will be in the ```output``` folder:
* `territories.tsv` will contain a territory per line, with a unique identifier (UID), a name and a territory name.
* `territories.translations.tsv` will contain a translation per line, with a UID, locale and translation. Languages used can be set on command execution.
* `territories.mappings.tsv` will contain different a standard association per line, with a UID, a standard code and it associated value.
* `territories.metadata.tsv` will contain extra information per line, with a UID, and a key-value pair.
# Information sources evaluated / used
unlocode all iso 3166-2
- http://www.unece.org/cefact/codesfortrade/codes_index.html
carmen: iso-3166-2 + i18n
- https://github.com/jim/carmen
## Spain
INE:
- https://github.com/PopulateTools/ine-places
Towns:
- http://www.ine.es/dyngs/INEbase/es/operacion.htm?c=Estadistica_C&cid=1254736177031&menu=ultiDatos&idp=1254734710990
- http://www.ine.es/daco/daco42/codmun/codmun17/17codmun.xlsx
- http://www.ine.es/dynt3/inebase/es/index.html?padre=517&dh=1
Towns and sublevels
- http://www.ine.es/nomen_files/nacional/Nacional_2016.zip
Postal codes
- https://github.com/luismiramirez/spain_zip_codes
- https://www.codigospostales.com/descarga.html
## Maps
- https://github.com/topojson/world-atlas
- https://github.com/martgnz/es-atlas
- http://www.tnoda.com/blog/2013-12-07
- http://www.naturalearthdata.com/downloads/10m-cultural-vectors/