{"id":19031462,"url":"https://github.com/plandes/docker-spark-service","last_synced_at":"2026-05-18T00:32:54.606Z","repository":{"id":80107515,"uuid":"77173447","full_name":"plandes/docker-spark-service","owner":"plandes","description":"Extends the docker-spark, which creates a Spark cluster in a docker image by making it a service.","archived":false,"fork":false,"pushed_at":"2017-03-05T01:05:43.000Z","size":6,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-07-08T09:52:58.086Z","etag":null,"topics":["docker","docker-spark","dockerfile","spark"],"latest_commit_sha":null,"homepage":null,"language":"Makefile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/plandes.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-12-22T20:21:44.000Z","updated_at":"2017-06-22T19:09:50.000Z","dependencies_parsed_at":null,"dependency_job_id":"46e59b91-b9b2-4a7c-a444-179c80142bdd","html_url":"https://github.com/plandes/docker-spark-service","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/plandes/docker-spark-service","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fdocker-spark-service","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fdocker-spark-service/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fdocker-spark-service/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fdocker-spark-service/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/plandes","download_url":"https://codeload.github.com/plandes/docker-spark-service/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/plandes%2Fdocker-spark-service/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33160481,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-17T22:39:12.733Z","status":"ssl_error","status_checked_at":"2026-05-17T22:39:10.741Z","response_time":107,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","docker-spark","dockerfile","spark"],"created_at":"2024-11-08T21:23:32.439Z","updated_at":"2026-05-18T00:32:54.592Z","avatar_url":"https://github.com/plandes.png","language":"Makefile","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Spark Cluster as a Service in Docker\n\nThis extends the [docker-spark](https://github.com/P7h/docker-spark) repo,\nwhich creates a [Spark](http://spark.apache.org) cluster in a\n[docker](http://www.docker.com) image by making it a service (avoid having to\nrun the start commands) and/or use it in a docker compose configuration.\n\nNote that the version of the image is defined in\n[makefile](https://github.com/plandes/docker-spark-service/blob/master/makefile#L1)\nand coresponds to the `docker-spark` docker image and Spark version.\n\n\n## Obtaining the Image\n\nThe image is available on\n[docker hub](https://hub.docker.com/r/plandes/docker-spark-service/) or by\npulling it with:\n```bash\n$ docker pull plandes/docker-spark-service\n```\n\n\n## Docker Compose\n\nThe following is an example docker compose file:\n```yaml\nspark-service:\n  container_name: spark\n  image: plandes/docker-spark-service:2.1.0\n  hostname: spark\n  ports:\n    - \"8080:8080\"\n    - \"8081:8081\"\n    - \"4040:4040\"\n  volumes:\n    - /Volumns/spark-mount:/root\n  links:\n    - nlpserv\n```\n\nTo use this, create the mount point and start docker:\n```bash\n$ mkdir -p /Volumns/spark-mount\n$ docker-compose up -d\n```\n\n\n## License\n\nCopyright © 2016, 2017 Paul Landes\n\nApache License version 2.0\n\nLicensed under the Apache License, Version 2.0 (the \"License\"); you may not use\nthis file except in compliance with the License.  You may obtain a copy of the\nLicense at\n\n[http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)\n\nUnless required by applicable law or agreed to in writing, software distributed\nunder the License is distributed on an \"AS IS\" BASIS, WITHOUT WARRANTIES OR\nCONDITIONS OF ANY KIND, either express or implied.  See the License for the\nspecific language governing permissions and limitations under the License.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fplandes%2Fdocker-spark-service","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fplandes%2Fdocker-spark-service","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fplandes%2Fdocker-spark-service/lists"}