https://github.com/strawpants/geoslurp

A tool for downloading, managing and querying datasets in the geosciences
https://github.com/strawpants/geoslurp

data-management earth-science postgis postgres python

Last synced: 6 months ago
JSON representation

A tool for downloading, managing and querying datasets in the geosciences

• Host: GitHub
• URL: https://github.com/strawpants/geoslurp
• Owner: strawpants
• License: lgpl-3.0
• Created: 2018-02-05T19:59:36.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2025-05-13T12:15:33.000Z (8 months ago)
• Last Synced: 2025-06-15T23:56:17.126Z (7 months ago)
• Topics: data-management, earth-science, postgis, postgres, python
• Language: Python
• Homepage: https://geoslurp.wobbly.earth
• Size: 8.67 MB
• Stars: 9
• Watchers: 3
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Download and manage datasets in a PostGreSQL database with the PostGIS

[![Build and Publish](https://github.com/strawpants/geoslurp/actions/workflows/python-publish.yml/badge.svg)](https://github.com/strawpants/geoslurp/actions/workflows/python-publish.yml)

[![PyPI version](https://badge.fury.io/py/geoslurp.svg)](https://badge.fury.io/py/geoslurp)

[![Documentation Status](https://readthedocs.org/projects/geoslurp/badge/?version=latest)](https://geoslurp.wobbly.earth/latest/?badge=latest)

The idea is that this tool contains script to download (i.e. **slurp**) commonly used datasets and to register them in a postgresql+postgis database. This database can then be queried allowing the retrieval of the relevant data or datafiles. 

The main documentation lives at [geoslurp.wobbly.earth](https://geoslurp.wobbly.earth)

## Workings

The geoslurp module itself is a pure python module, which acts as a client. For this to work one needs to [set up a running PostGreSQL database](https://github.com/strawpants/docker-geoslurp).

![Image of geoslurp clients versus database server](docs/source/_static/geoslurp_network.svg)

## Change log V3

* Use python entry points to register datasets, views and functions (removes registration of user plugin directories)

* Move documentation to [https://readthedocs.org](https://geoslurp.wobbly.earth)

* Change github actions to pusblish and then release

* Work with SQAlchemy 2

* more (see commit messages)

## TODO's

* Move remaining 'orphaned' datasets to suitable python packages modules or include in the main package

* Improve this README