https://github.com/rpcpool/solana-big-table-compare
Scripts & librarys to compare two Solana BigTable Instances.
https://github.com/rpcpool/solana-big-table-compare
Last synced: 2 months ago
JSON representation
Scripts & librarys to compare two Solana BigTable Instances.
- Host: GitHub
- URL: https://github.com/rpcpool/solana-big-table-compare
- Owner: rpcpool
- License: mit
- Created: 2021-11-28T23:23:25.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-12-28T00:09:11.000Z (about 4 years ago)
- Last Synced: 2023-03-03T23:42:47.299Z (about 3 years ago)
- Size: 4.88 KB
- Stars: 1
- Watchers: 8
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# solana-big-table-compare
Scripts & libraries to compare two Solana BigTable Instances.
At the present time, historical Solana ledger data is contained in Google BigTable instances held by several parties. Since integrity of the data is critical, several archive holders would like the ability to compare their respective archives for equivalence.
## Features
Prepare a script or program that can accept read-only credentials for two different BigTable instances and compare the data for a given range of slots.
The script/program should do:
1. Verify that the two instances contain the same blocks.
2. Verify the same number of transactions within the blocks.
3. Allow us to quickly add more checks (e.g. signature comparisons) in the future.
The script/program should support:
- Configuration for two separate BigTable instances.
- A starting slot with a default of zero (0).
- An ending slot with a default of the current slot according to an RPC call.
- Specify rate limits to be sleep briefly within a loop. Default TBD.
- Specification of a log file location with the default in the current directory.
- Specification of different log error levels [INFO, WARN, ERROR] with default INFO.
- Use of environment variables or command line switches for the above settings.
- Error handling, lots of error handling.
We're expecting production-quality code with developer comments and informative error messages.
## Tooling
Your solution should be written in a popular software language and be easy to run with minimal installation requirements. Our team works in Go, Python, Ruby, Rust & other languages. We're open to ideas as long as they can meet the minimal installation requirement.
## BigTable Access
We can provide read-only credentials for two different BigTable Instances. Please contact `@brianlong` on Twitter or Telegram for details.