https://github.com/blockchain-etl/tezos-etl
Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations
https://github.com/blockchain-etl/tezos-etl
bigquery blockchain cryptocurrency csv sql tezos
Last synced: 2 months ago
JSON representation
Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations
- Host: GitHub
- URL: https://github.com/blockchain-etl/tezos-etl
- Owner: blockchain-etl
- License: mit
- Created: 2020-06-03T14:40:44.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2023-05-22T21:39:29.000Z (about 2 years ago)
- Last Synced: 2025-03-27T22:51:17.487Z (3 months ago)
- Topics: bigquery, blockchain, cryptocurrency, csv, sql, tezos
- Language: Python
- Homepage: https://console.cloud.google.com/bigquery?page=dataset&d=crypto_tezos&p=public-data-finance
- Size: 228 KB
- Stars: 13
- Watchers: 5
- Forks: 3
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Tezos ETL
[](https://travis-ci.org/blockchain-etl/tezos-etl)
[](https://tezos-etl.readthedocs.io/en/latest/?badge=latest)
[Full documentation available here](http://tezos-etl.readthedocs.io/).
## Quickstart
Install Tezos ETL:
```bash
pip install tezos-etl
```
Export blocks, balance updates and operations ([Schema](docs/schema.md), [Reference](docs/commands.md#export)):
```bash
tezosetl export --start-block 1 --end-block 100 \
--provider-uri https://mainnet.api.tez.ie --output-dir output --output-format json
```
For the latest version, checkout the repo and call
```bash
pip install -e .
python tezosetl.py
```
## Running Tests
```bash
pip install -e .[dev]
echo "TEZOSETL_PROVIDER_URI variable is optional"
export TEZOSETL_PROVIDER_URI=https://mainnet.api.tez.ie
pytest -vv
```
### Running Tox Tests
```bash
pip install tox
tox
```
## Running in Docker
1. Install Docker https://docs.docker.com/install/
2. Build a docker image:
docker build -t tezos-etl:latest .
docker image ls
3. Start the export using the image:
docker run -v $HOME/output:/tezos-etl/output tezos-etl:latest export_partitioned \
-s 2018-06-30 -e 2018-07-01 -p https://mainnet.api.tez.ie --output-format csv