{"id":18542748,"url":"https://github.com/coinbase/btcexport","last_synced_at":"2025-04-09T18:32:08.698Z","repository":{"id":54821272,"uuid":"112231115","full_name":"coinbase/btcexport","owner":"coinbase","description":"Export process for Bitcoin blockchain data to CSV","archived":false,"fork":false,"pushed_at":"2018-09-19T17:32:00.000Z","size":32,"stargazers_count":23,"open_issues_count":0,"forks_count":5,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-03-24T10:38:40.555Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/coinbase.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-11-27T18:13:59.000Z","updated_at":"2024-11-08T02:23:45.000Z","dependencies_parsed_at":"2022-08-14T03:50:36.747Z","dependency_job_id":null,"html_url":"https://github.com/coinbase/btcexport","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/coinbase%2Fbtcexport","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/coinbase%2Fbtcexport/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/coinbase%2Fbtcexport/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/coinbase%2Fbtcexport/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/coinbase","download_url":"https://codeload.github.com/coinbase/btcexport/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248087850,"owners_count":21045600,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T20:10:22.659Z","updated_at":"2025-04-09T18:32:03.688Z","avatar_url":"https://github.com/coinbase.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# btcexport\n\nbtcexport is a utility for parsing the blockchain as stored by a [btcd](https://github.com/btcsuite/btcd) full node and exporting it as CSV to be loaded into a columnar data store. The project supports multiple file destinations, currently the local filesystem and Amazon S3.\n\nTo run btcexport, you must have a btcd node that is synced to the chain height you intend to export to. The node *must be off* while the export process is running.\n\n# Usage\n\n```\nUsage:\n  btcexport [OPTIONS]\n\nApplication Options:\n  -b, --datadir=      Location of the btcd data directory (default: /home/nobody/.btcd/data)\n      --dbtype=       Database backend to use for the Block Chain (default: ffldb)\n      --testnet       Use the test network\n      --regtest       Use the regression test network\n      --simnet        Use the simulation test network\n      --output=       Directory to write output files to\n      --s3-bucket=    S3 bucket to write output files to\n      --s3-prefix=    Key prefix of S3 objects to upload\n      --start-height= Optional beginning height of export range (default=0)\n      --end-height=   Ending height of of export range (default=tip-6)\n  -p, --progress=     Show a progress message each time this number of seconds have passed -- Use 0 to disable progress announcements (default: 10)\n\nHelp Options:\n  -h, --help          Show this help message\n```\n\n## Examples\n\nExport entire mainnet chain to `output` directory on local filesystem.\n\n```bash\n$ btcexport --output=output\n```\n\nExport testnet blocks beginning at height 400,000 to Amazon S3.\n\n```bash\n$ btcexport \\\n      --testnet \\\n      --start-height=400000 \\\n      --s3-bucket=my-btcexport\n      --s3-prefix mainnet\n```\n\n## Output format\n\nThe program outputs CSV files compressed with gzip for four different logical tables:\n\n- `blocks-%d.csv.gz`\n- `txs-%d.csv.gz`\n- `txins-%d.csv.gz`\n- `txouts-%d.csv.gz`\n\nThe rows of each logical table are split across multiple files. Each file is capped at *approximately* 1 MiB.\n\n# Installing\n\n```bash\n$ go get -u github.com/coinbase/btcexport\n$ cd $GOPATH/src/github.com/coinbase/btcexport\n$ dep ensure\n$ go install ./cmd/...\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcoinbase%2Fbtcexport","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcoinbase%2Fbtcexport","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcoinbase%2Fbtcexport/lists"}