Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jsanz/cumbre-vieja
Data workflow to publish geospatial information related to La Palma Cumbre Vieja volcano eruption.
https://github.com/jsanz/cumbre-vieja
Last synced: about 2 months ago
JSON representation
Data workflow to publish geospatial information related to La Palma Cumbre Vieja volcano eruption.
- Host: GitHub
- URL: https://github.com/jsanz/cumbre-vieja
- Owner: jsanz
- License: mit
- Created: 2021-11-04T16:30:46.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-06-21T09:04:48.000Z (over 2 years ago)
- Last Synced: 2024-04-15T12:27:07.001Z (9 months ago)
- Language: Python
- Homepage:
- Size: 101 KB
- Stars: 2
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Cumbre Vieja data publishing
Data workflow to publish geospatial information related to La Palma Cumbre Vieja volcano eruption into Elasticsearch.
How to run the data script:
1. Create a Python virtual environment and install dependencies with `pip install -r requirements.txt`
2. Export the environment variables: `ES_CLOUD_ID`, `ES_USER`, and `ES_PASSWORD` or alternatively, store them in an `.env` file
3. Run `python src/app.py`Notes:
* This repo has a Github Actions [worflow](https://github.com/jsanz/cumbre-vieja/blob/main/.github/workflows/python-app.yml) to run the process on every push to the `main` branch.
* Adapt the Elasticsearch Python `client` initialization if you use a different authentication than an Elastic Cloud identifier.
* Check the `app.py` script for boolean variables to control which data to process and if you want to export the datasets into the `/tmp` folder as GeoJSON files.
* HTTP requests are cached in a SQLite database stored in the user cache directory (`$USER/.cache` in Linux systems).