https://github.com/jamiew/helium-etl-queries

A collection of SQL views used to enrich data produced by a Helium blockchain-etl
https://github.com/jamiew/helium-etl-queries

etl helium sql

Last synced: 25 days ago
JSON representation

A collection of SQL views used to enrich data produced by a Helium blockchain-etl

• Host: GitHub
• URL: https://github.com/jamiew/helium-etl-queries
• Owner: jamiew
• Created: 2020-10-12T13:54:38.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2022-08-19T12:00:18.000Z (about 2 years ago)
• Last Synced: 2024-10-04T10:44:43.487Z (about 1 month ago)
• Topics: etl, helium, sql
• Language: PLpgSQL
• Homepage:
• Size: 61.5 KB
• Stars: 15
• Watchers: 6
• Forks: 7
• Open Issues: 4
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
helium-etl-queries

==================

A collection of SQL queries used to enrich data produced by a Helium [blockchain-etl](https://github.com/helium/blockchain-etl)

This repo is specifically trying to create and manage views that better surface the embedded JSON fields in a

more managable form, e.g. turning `transactions[type='state_channel_close']` => `data_credits` table, with properly typed columns

A live instance with these views is avaialble on the beta DeWi ETL instance, which runs Metabase:

https://etl.dewi.org

If you're interested in using it, please contact @jamiedubs/@wishplorer on Discord. There is auto signup available if using gmail.com email address with google signin.

Documentation available on: https://dbdocs.io/wishplorer/HeliumDewiETL

Setup

----

- setup a blockchain-etl instance – this might take a while

- load all the views from this repository:

```

dbname="etl"

for i in views/*; do psql $dbname < $i; done

```

Or load them one at a time etc.

TODO

----

* More views: `challenges`, `consensus_groups`, `payments`, split out reward-types, etc

* Get fancy and use [dbt](https://github.com/fishtown-analytics/dbt)

Contributing

------------

* Pull requests welcome

* Ask questions in #hips or #blockchain-dev on Discord

Contributors

------------

* @\~zav\~

* @jamiedubs ([@jamiew](https://github.com/jamiew/))

* [@wishplorer](https://github.com/wishplorer)

* [@GregKarabinos](GregKarabinos)

License

-------

MIT