https://github.com/blockchain-etl/solana-etl-airflow
ETL for Solana. Contributions are welcome. Join the Telegram channel https://t.me/joinchat/GsMpbA3mv1OJ6YMp3T5ORQ
https://github.com/blockchain-etl/solana-etl-airflow
Last synced: 4 months ago
JSON representation
ETL for Solana. Contributions are welcome. Join the Telegram channel https://t.me/joinchat/GsMpbA3mv1OJ6YMp3T5ORQ
- Host: GitHub
- URL: https://github.com/blockchain-etl/solana-etl-airflow
- Owner: blockchain-etl
- License: mit
- Created: 2021-07-23T12:00:37.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2023-12-19T14:58:29.000Z (over 1 year ago)
- Last Synced: 2023-12-19T18:14:52.542Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 3.71 MB
- Stars: 32
- Watchers: 6
- Forks: 12
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-svm - GitHub
README
# Solana ETL, Airflow
## Overview
Solana ETL Airflow allows you to setup an ETL pipeline in Google Cloud Platform for ingesting Solana blockchain data
into BigQuery via Airflow. It comes with [CLI tools](/cli) for exporting Solana data into convenient formats like CSVs and relational databases.## Code quality
Over time, we intend to format python files in this repo using isort and autopep8.
At the moment, we are *only formatting any changed or added files*We have not implemented any sort of automation (e.g. pre-commit), but a requirements_dev.txt is provided for contributors to use.
## Testing
Various tests are implemented (`airflow/tests`, `cli/tests` and `./tests`).
As part of an effort towards consistency, they all source the same requirements_test.txt.