Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/keep-network/electrs-blockstream


https://github.com/keep-network/electrs-blockstream

Last synced: 18 days ago
JSON representation

Awesome Lists containing this project

README 

        
# Esplora - Electrs backend API



A block chain index engine and HTTP API written in Rust based on [romanz/electrs](https://github.com/romanz/electrs).



Used as the backend for the [Esplora block explorer](https://github.com/Blockstream/esplora) powering [blockstream.info](https://blockstream.info/).



API documentation [is available here](https://github.com/blockstream/esplora/blob/master/API.md).



Documentation for the database schema and indexing process [is available here](doc/schema.md).



### Installing & indexing



Install Rust, Bitcoin Core (no `txindex` needed) and the `clang` and `cmake` packages, then:



```bash

$ git clone https://github.com/blockstream/electrs && cd electrs

$ git checkout new-index

$ cargo run --release --bin electrs -- -vvvv --daemon-dir ~/.bitcoin



# Or for liquid:

$ cargo run --features liquid --release --bin electrs -- -vvvv --network liquid --daemon-dir ~/.liquid

```



See [electrs's original documentation](https://github.com/romanz/electrs/blob/master/doc/usage.md) for more detailed instructions.

Note that our indexes are incompatible with electrs's and has to be created separately.



The indexes require 610GB of storage after running compaction (as of June 2020), but you'll need to have

free space of about double that available during the index compaction process.

Creating the indexes should take a few hours on a beefy machine with SSD.



To deploy with Docker, follow the [instructions here](https://github.com/Blockstream/esplora#how-to-build-the-docker-image).



### Light mode



For personal or low-volume use, you may set `--lightmode` to reduce disk storage requirements

by roughly 50% at the cost of slower and more expensive lookups.



With this option set, raw transactions and metadata associated with blocks will not be kept in rocksdb

(the `T`, `X` and `M` indexes),

but instead queried from bitcoind on demand.



### Notable changes from Electrs:



- HTTP REST API in addition to the Electrum JSON-RPC protocol, with extended transaction information

  (previous outputs, spending transactions, script asm and more).



- Extended indexes and database storage for improved performance under high load:



  - A full transaction store mapping txids to raw transactions is kept in the database under the prefix `t`.

  - An index of all spendable transaction outputs is kept under the prefix `O`.

  - An index of all addresses (encoded as string) is kept under the prefix `a` to enable by-prefix address search.

  - A map of blockhash to txids is kept in the database under the prefix `X`.

  - Block stats metadata (number of transactions, size and weight) is kept in the database under the prefix `M`.



  With these new indexes, bitcoind is no longer queried to serve user requests and is only polled

  periodically for new blocks and for syncing the mempool.



- Support for Liquid and other Elements-based networks, including CT, peg-in/out and multi-asset.

  (requires enabling the `liquid` feature flag using `--features liquid`)



### CLI options



In addition to electrs's original configuration options, a few new options are also available:



- `--http-addr ` - HTTP server address/port to listen on (default: `127.0.0.1:3000`).

- `--lightmode` - enable light mode (see above)

- `--cors ` - origins allowed to make cross-site request (optional, defaults to none).

- `--address-search` - enables the by-prefix address search index.

- `--index-unspendables` - enables indexing of provably unspendable outputs.

- `--utxos-limit ` - maximum number of utxos to return per address.

- `--electrum-txs-limit ` - maximum number of txs to return per address in the electrum server (does not apply for the http api).

- `--electrum-banner ` - welcome banner text for electrum server.



Additional options with the `liquid` feature:

- `--parent-network ` - the parent network this chain is pegged to.



Additional options with the `electrum-discovery` feature:

- `--electrum-hosts ` - a json map of the public hosts where the electrum server is reachable, in the [`server.features` format](https://electrumx.readthedocs.io/en/latest/protocol-methods.html#server.features).

- `--electrum-announce` - announce the electrum server on the electrum p2p server discovery network.



See `$ cargo run --release --bin electrs -- --help` for the full list of options.



## License



MIT