https://github.com/paradigmxyz/paradigm-data-portal

a collection of open source crypto datasets for researchers and tool builders
https://github.com/paradigmxyz/paradigm-data-portal

crypto cryptocurrency ethereum evm

Last synced: 4 days ago
JSON representation

a collection of open source crypto datasets for researchers and tool builders

• Host: GitHub
• URL: https://github.com/paradigmxyz/paradigm-data-portal
• Owner: paradigmxyz
• License: apache-2.0
• Created: 2023-03-17T16:23:22.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-03-29T11:43:10.000Z (9 months ago)
• Last Synced: 2024-12-14T21:08:05.562Z (11 days ago)
• Topics: crypto, cryptocurrency, ethereum, evm
• Language: Python
• Homepage: https://data.paradigm.xyz/
• Size: 154 KB
• Stars: 293
• Watchers: 8
• Forks: 17
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE-APACHE

Awesome Lists containing this project

• awesome-evm-data-tools - Paradigm Data Portal - Open source crypto datasets collection for researchers and tool builders (Datasets)

README

        

# Paradigm Data Portal

The Paradigm Data Portal is a collection of open source crypto datasets for researchers and tool builders

## Datasets

- [`ethereum_contracts`](https://github.com/paradigmxyz/paradigm-data-portal/tree/main/datasets/ethereum_contracts): all historical contract deployments

- [`ethereum_native_transfers`](https://github.com/paradigmxyz/paradigm-data-portal/tree/main/datasets/ethereum_native_transfers): all native transfers in similar format to ERC20 Transfers (excluding tx fees)

- [`ethereum_slots`](https://github.com/paradigmxyz/paradigm-data-portal/tree/main/datasets/ethereum_slots): all slots of each contract, including historical usage metadata

All datasets are released under a [CC0](https://creativecommons.org/share-your-work/public-domain/cc0/) license into the public domain unless otherwise noted.

## `pdp`

`pdp` is a CLI tool that can be used to obtain and manage PDP datasets

To install: `pip install paradigm-data-portal`

#### Example Usage

- List available datasets `pdp ls`

- List dataset files `pdp ls `

- Download a dataset `pdp download `

Each command has multiple options, view help with `pdp  -h`

## Dataset Versioning

Every dataset has a version in `..` format, e.g. `1.2.8`

- when a schema is updated, the major version is increased

- when rows are added, removed, or modified, the minor version is increased

- when rows are added due to new blocks, the patch is increased

Updates will be documented in dataset changelogs