{"id":28912722,"url":"https://github.com/tonycox/spark-ignite-docker","last_synced_at":"2026-05-04T23:34:38.292Z","repository":{"id":192894259,"uuid":"80624088","full_name":"tonycox/spark-ignite-docker","owner":"tonycox","description":"Standalone Spark with Ignite In-memory Rdd sharding on Docker","archived":false,"fork":false,"pushed_at":"2017-02-06T00:49:28.000Z","size":7,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-06-21T20:13:02.641Z","etag":null,"topics":["docker","ignite","spark"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tonycox.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2017-02-01T13:48:42.000Z","updated_at":"2020-07-06T11:52:33.000Z","dependencies_parsed_at":null,"dependency_job_id":"0d68fb66-5a33-49c9-bf13-5e5b32dce633","html_url":"https://github.com/tonycox/spark-ignite-docker","commit_stats":null,"previous_names":["tonycox/spark-ignite-docker"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/tonycox/spark-ignite-docker","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tonycox%2Fspark-ignite-docker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tonycox%2Fspark-ignite-docker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tonycox%2Fspark-ignite-docker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tonycox%2Fspark-ignite-docker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tonycox","download_url":"https://codeload.github.com/tonycox/spark-ignite-docker/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tonycox%2Fspark-ignite-docker/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32628835,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-04T10:08:07.713Z","status":"ssl_error","status_checked_at":"2026-05-04T10:08:02.005Z","response_time":58,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","ignite","spark"],"created_at":"2025-06-21T20:13:01.372Z","updated_at":"2026-05-04T23:34:38.286Z","avatar_url":"https://github.com/tonycox.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n##start spark master, worker and ignite node\n\n```\ndocker-compose up\n```\n**scale mode:**\n```\ndocker-compose scale spark-master=1 spark-slave=2\n```\n**stop all containers:**\n```\ndocker kill $(docker ps -q)\n```\n**spark submit:**\n```\ndocker exec -v \u003cvolume-folder\u003e \\\n  spark-master spark-submit \\\n  --class \u003cmain-class\u003e \\\n  --master spark://spark-master:7077 \\\n  \u003capplication-jar\u003e \\\n  [application-arguments]\n```\n\n**spark shell:**\n```\ndocker exec -it spark-master spark-shell \\\n  --master spark://spark-master:7077 \\\n  --packages org.apache.ignite:ignite-spark_2.10:1.8.0,org.apache.ignite:ignite-spring:1.8.0\n```\n###Manual start spark\n**build**\n```\ndocker build -t spark-config . \u0026\u0026\ndocker build -t spark-master ./spark-master \u0026\u0026\ndocker build -t spark-slave ./spark-slave\n```\n**start master**\n```\ndocker run -it --name \u003ccontainer-name\u003e spark-master\n```\n**start slave**\n```\ndocker run -it -e SPARK_MASTER_URL=spark://\u003cmaster-ip\u003e:7077 \\\n  --name \u003ccontainer-name\u003e spark-slave\n```\nget ip:\n```\ndocker exec -it spark-master hostname -i\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftonycox%2Fspark-ignite-docker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftonycox%2Fspark-ignite-docker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftonycox%2Fspark-ignite-docker/lists"}