{"id":20678518,"url":"https://github.com/codecentric/elasticsearch-fileimport","last_synced_at":"2025-04-19T21:32:28.649Z","repository":{"id":144964944,"uuid":"37764803","full_name":"codecentric/elasticsearch-fileimport","owner":"codecentric","description":"Import JSON files directly as documents into Elasticsearch by using the ES transport protocol (not HTTP/REST)","archived":false,"fork":false,"pushed_at":"2015-06-25T09:44:00.000Z","size":128,"stargazers_count":5,"open_issues_count":0,"forks_count":4,"subscribers_count":160,"default_branch":"master","last_synced_at":"2023-03-22T13:44:41.094Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codecentric.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-06-20T09:32:25.000Z","updated_at":"2023-03-30T14:00:24.732Z","dependencies_parsed_at":"2023-03-30T14:00:24.601Z","dependency_job_id":null,"html_url":"https://github.com/codecentric/elasticsearch-fileimport","commit_stats":null,"previous_names":[],"tags_count":null,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codecentric%2Felasticsearch-fileimport","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codecentric%2Felasticsearch-fileimport/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codecentric%2Felasticsearch-fileimport/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codecentric%2Felasticsearch-fileimport/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codecentric","download_url":"https://codeload.github.com/codecentric/elasticsearch-fileimport/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224970226,"owners_count":17400373,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-16T21:20:40.373Z","updated_at":"2024-11-16T21:20:40.975Z","avatar_url":"https://github.com/codecentric.png","language":"Java","readme":"#elasticsearch-fileimport\n\nImport JSON files directly as documents into Elasticsearch by using the ES transport protocol (not HTTP/REST).\nThe import is done via bulk requests.\n\n##Prerequisites\n* Java 8\n* Tested with Elasticsearch 1.6 (should also work with earlier versions)\n\n##Usage\n\n    mvn package\n    java -jar target/elasticsearch-fileimport-0.6-SNAPSHOT-jar-with-dependencies.jar file_import_settings.yml\n\nTo execute all unittests, also those who runs longer execute\n\n    mvn clean package -DargLine=\"-Dfileimport.tests.big\"\n\n##Configuration\nThe configuration is done in YAML (or JSON). Look at the following example to see what's configurable:\n\n    fileimport:\n        # either transport or node\n        mode: node\n        \n        # Folder with data\n        # Folder is scanned recursively\n        root: import/data\n        \n        # Fileextension of files to import, default is json\n        #fileext: json\n        \n        # If set to true then import files line by line (one json doc per line)\n        # If set to false (which is the default) treat one file as one document\n        #linebyline: true   \n        \n        # Index name\n        index: test\n        \n        # Type name\n        type: test\n        \n        # Bulk settings, see https://www.elastic.co/guide/en/elasticsearch/client/java-api/current/bulk.html\n        #flush_interval: 5s\n        max_bulk_actions: 1000\n        max_concurrent_bulk_requests: 1\n        max_volume_per_bulk_request: 10mb\n        \n        # needed when mode: transport\n        transport:\n            addresses:\n                - localhost:9300\n                - es.comany.com:9300\n                \n    # needed when mode: node\n    cluster:\n        name: elasticsearch\n        \n    \n    # list other elasticsearch settings here if needed\n    #discovery.zen.ping.multicast.enabled: false\n    #discovery.zen.ping.unicast.hosts: host:9300\n    #...\n\n##Before you run it\n* Install and start your Elasticsearch cluster\n* Create your index (with your desired settings)\n* Create your type mapping\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodecentric%2Felasticsearch-fileimport","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodecentric%2Felasticsearch-fileimport","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodecentric%2Felasticsearch-fileimport/lists"}