https://github.com/prabaprakash/docker-pipeline-for-hadoop-n-spark-submit

Docker CI/CD Pipeline
https://github.com/prabaprakash/docker-pipeline-for-hadoop-n-spark-submit

apache-spark docker docker-compose docker-pipeline gocd-agent gocd-agent-docker gocd-server hadoop spark

Last synced: 18 days ago
JSON representation

Docker CI/CD Pipeline

• Host: GitHub
• URL: https://github.com/prabaprakash/docker-pipeline-for-hadoop-n-spark-submit
• Owner: prabaprakash
• Created: 2019-09-16T12:13:46.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2019-09-30T19:37:36.000Z (over 5 years ago)
• Last Synced: 2024-11-14T15:45:06.498Z (3 months ago)
• Topics: apache-spark, docker, docker-compose, docker-pipeline, gocd-agent, gocd-agent-docker, gocd-server, hadoop, spark
• Language: Java
• Size: 24.4 KB
• Stars: 2
• Watchers: 1
• Forks: 1
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
### Relevant articles

- [Introduction to Apache Spark](http://www.baeldung.com/apache-spark)

- [Building a Data Pipeline with Kafka, Spark Streaming and Cassandra](https://www.baeldung.com/kafka-spark-data-pipeline)

### Gocd Pipeline

docker run -d -p 8153:8153 -p 8154:8154 --name=gocd-server gocd/gocd-server:v19.8.0

docker run --privileged -d -e GO_SERVER_URL=https://$(docker inspect --format='{{(index (index .NetworkSettings.IPAddress))}}' gocd-server):8154/go gocd/gocd-agent-docker-dind:v19.8.0