{"id":15138569,"url":"https://github.com/codingchili/ethereum-ingest","last_synced_at":"2025-10-23T15:30:31.921Z","repository":{"id":62027768,"uuid":"106056831","full_name":"codingchili/ethereum-ingest","owner":"codingchili","description":"JavaFX and commandline application to import events from the Ethereum blockchain into ElasticSearch, MongoDB, Hazelcast, CQEngine and SQLite.","archived":false,"fork":false,"pushed_at":"2019-04-01T15:57:42.000Z","size":2813,"stargazers_count":35,"open_issues_count":1,"forks_count":9,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-01-30T19:08:05.451Z","etag":null,"topics":["chili-core","cqengine","elasticsearch","ether","ethereum","geth","hazelcast","infura","ingest","mongodb","sqlite","vertx"],"latest_commit_sha":null,"homepage":"https://ethereum-ingest.com/","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codingchili.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-10-06T22:54:11.000Z","updated_at":"2024-05-29T18:32:11.000Z","dependencies_parsed_at":"2022-10-25T10:00:26.577Z","dependency_job_id":null,"html_url":"https://github.com/codingchili/ethereum-ingest","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingchili%2Fethereum-ingest","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingchili%2Fethereum-ingest/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingchili%2Fethereum-ingest/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingchili%2Fethereum-ingest/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codingchili","download_url":"https://codeload.github.com/codingchili/ethereum-ingest/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":237843829,"owners_count":19375210,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chili-core","cqengine","elasticsearch","ether","ethereum","geth","hazelcast","infura","ingest","mongodb","sqlite","vertx"],"created_at":"2024-09-26T07:41:35.477Z","updated_at":"2025-10-23T15:30:26.189Z","avatar_url":"https://github.com/codingchili.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ethereum-ingest [![Build Status](https://travis-ci.org/codingchili/ethereum-ingest.svg?branch=master)](https://travis-ci.org/codingchili/ethereum-ingest)\nImports blocks and transactions from the Ethereum blockchain into ElasticSearch, MongoDB, Hazelcast, CQEngine and SQLite! Works with Geth IPC, Geth REST API and Infura.\n\nDemo video: [YouTube](https://www.youtube.com/watch?v=FFI9OnW9IuI)\n\n![user interface](https://raw.githubusercontent.com/codingchili/ethereum-ingest/master/eth-ingest.jpg)\n\nTested with\n- Java 11 (minimim requirement)\n- ElasticSeach 7.0.0\n- MongoDB 4.0.8\n- Hazelcast 3.10.5\n- geth 1.8.23\n\n### Building\nBuild with\n```console\n# detects the current platform.\n./gradlew build\n\n# to build for a specific platform, 'win', 'mac' or 'linux'.\n./gradlew build -Pplatform=linux\n```\nRequires chili-core through jitpack or local repo.\n\n### Importing\nThe first step is to start your ethereum IPC client, for geth use:\n```console\ngeth --rpcapi personal,db,eth,net,web3 --rpc --testnet\n```\n\nStart the importer with:\n```console\njava -jar \u003cfilename\u003e.jar --import\njava -jar \u003cfilename\u003e.jar --gui\njava -jar \u003cfilename\u003e.jar --help\n```\n* --import: starts an import using application.json.\n* --gui: starts the application with the graphical user interface.\n\n### Configuring\nSet configuration in application.json before running --import. WHen using the graphical application the configuration is saved automatically.\n\nDefault configuration\n```console\n{\n  \"startBlock\" : \"1964770\",\n  \"blockEnd\" : \"1964900\",\n  \"storage\" : \"ELASTICSEARCH\",\n  \"targetNode\" : \"\\\\\\\\.\\\\pipe\\\\geth.targetNode\",\n  \"os\" : \"WINDOWS\",\n  \"txIndex\" : \"ether-tx-demo-iix\",\n  \"blockIndex\" : \"etdder-block-demo-iix\",\n  \"backpressureBlocks\" : 6,\n  \"backPressureTx\" : 32,\n  \"txImport\" : true,\n  \"blockImport\" : true\n}\n```\nBackpressure for blocks and tx should not exceed 200 when multiplied with eachother. If you want to\nincrease these values further you need to make sure the storage is capable of handling that many connections.\n\nStorage can be any of the following\n- MONGODB (default: localhost:27017)\n- ELASTICSEARCH (default: localhost:9300)\n- HAZELCAST\n- SQLITE (CQEngine)\n- MEMORY\n\nos can be any of the following, required for targetNode to work correctly\n- UNIX\n- WINDOWS\n\nImports can be executed multiple times over the same block range without resulting in duplicates.\n\nTo configure a custom host:port for MongoDB or ElasticSearch please add/edit this file in \"conf/system/storage.yaml\"\n\n```console\n---\nstorage:\n  com.codingchili.core.storage.MongoDBMap:\n    host: \"localhost\"\n    port: 27017\n  com.codingchili.core.storage.ElasticMap:\n    host: \"localhost\"\n    port: 9200\n```\n\n### Contributing\nSubmit an issue or a PR ! :blue_heart:\n\n[![donate](https://img.shields.io/badge/donate-%CE%9ETH%20/%20%C9%83TC-ff00cc.svg?style=flat\u0026logo=ethereum)](https://commerce.coinbase.com/checkout/673e693e-be6d-4583-9791-611da87861e3)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingchili%2Fethereum-ingest","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodingchili%2Fethereum-ingest","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingchili%2Fethereum-ingest/lists"}