{"id":18926003,"url":"https://github.com/murshidazher/hdp-docker-sandbox","last_synced_at":"2025-06-29T00:33:34.123Z","repository":{"id":104059209,"uuid":"374598394","full_name":"murshidazher/hdp-docker-sandbox","owner":"murshidazher","description":"📦  Hortonworks Data Platform 2.6.5 \u0026 3.0.1 sandbox through docker","archived":false,"fork":false,"pushed_at":"2021-07-21T17:57:41.000Z","size":55,"stargazers_count":5,"open_issues_count":0,"forks_count":12,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-15T15:53:12.502Z","etag":null,"topics":["aws","docker","hdp","hdp-docker-sandbox","hortonworks-sandbox"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/murshidazher.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-06-07T08:53:50.000Z","updated_at":"2025-02-12T17:05:49.000Z","dependencies_parsed_at":null,"dependency_job_id":"1ffdfd8b-8b67-4dfa-b217-664e8c419b80","html_url":"https://github.com/murshidazher/hdp-docker-sandbox","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/murshidazher/hdp-docker-sandbox","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/murshidazher%2Fhdp-docker-sandbox","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/murshidazher%2Fhdp-docker-sandbox/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/murshidazher%2Fhdp-docker-sandbox/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/murshidazher%2Fhdp-docker-sandbox/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/murshidazher","download_url":"https://codeload.github.com/murshidazher/hdp-docker-sandbox/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/murshidazher%2Fhdp-docker-sandbox/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262518102,"owners_count":23323301,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","docker","hdp","hdp-docker-sandbox","hortonworks-sandbox"],"created_at":"2024-11-08T11:14:05.744Z","updated_at":"2025-06-29T00:33:34.098Z","avatar_url":"https://github.com/murshidazher.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# [hdp-docker-sandbox](https://github.com/murshidazher/hdp-docker-sandbox)\n\n\u003e Hortonworks Data Platform 2.6.5 \u0026 3.0.1 sandbox through `docker` 🔥🔥🔥\n\n- To launch an automated hdp2.6.5 workflow in aws ec2 instance, look into this [repo](https://github.com/murshidazher/terraform-hadoop).\n\n## Table of Contents\n\n- [hdp-docker-sandbox](#hdp-docker-sandbox)\n  - [Table of Contents](#table-of-contents)\n  - [Installing / Getting started](#installing--getting-started)\n    - [Installing Docker](#installing-docker)\n    - [Install HDP 2.6.5](#install-hdp-265)\n    - [Install HDP 3.0.1](#install-hdp-301)\n  - [Credentials](#credentials)\n  - [Restarting HDP](#restarting-hdp)\n  - [Pausing and Resume Docker Container](#pausing-and-resume-docker-container)\n  - [Port Forwards](#port-forwards)\n  - [References](#references)\n  - [License](#license)\n\n## Installing / Getting started\n\nClone the repository\n\n```sh\n\u003e git clone https://github.com/murshidazher/hdp-docker-sandbox.git\n\u003e cd hdp-docker-sandbox \n```\n\n### Installing Docker\n\nInstall docker to the instance,\n\n```sh\n\u003e cd hdp-docker-sandbox \n\u003e sudo bash install_docker.sh\n```\n\n### Install HDP 2.6.5\n\n\u003e :bulb: Recommended\n\nRun the docker deployment script,\n\n```sh\n\u003e docker info\n\u003e cd hdp-docker-sandbox/HDP_2.6.5\n\u003e sudo bash docker-deploy-hdp265.sh\n```\n\n### Install HDP 3.0.1\n\n\u003e ⚠️ Hive View is not present in HDP `3.0.1` or Ambari `2.7`.\n\nRun the docker deployment script,\n\n```sh\n\u003e docker info\n\u003e cd hdp-docker-sandbox/HDP_3.0.1\n\u003e sudo bash docker-deploy-hdp30.sh\n```\n\n## Credentials\n\n- The default Ambari credentials are `raj_ops`:`raj_ops` and `maria_dev`: `maria_dev` . The default `AmbariShell` login credential is `root`:`hadoop`.\n\n## Restarting HDP\n\nTo stop the running docker instance and restart the services,\n\n```sh\n\u003e cd hdp-docker-sandbox\n\u003e sudo bash restart_docker.sh\n```\n\n## Pausing and Resume Docker Container\n\nTo pause the container before stopping an ec2 instance,\n\n```sh\n\u003e cd hdp-docker-sandbox\n\u003e sudo bash pause_docker.sh\n```\n\nTo resume the container after a restart,\n\n```sh\n\u003e cd hdp-docker-sandbox\n\u003e sudo bash resume_docker.sh\n```\n\n## [Port Forwards](https://www.cloudera.com/tutorials/hortonworks-sandbox-guide/3.html)\n\n| Default | Forwarded | Description                    |\n|---------|-----------|--------------------------------|\n| 2122    | 22        | HostSSH                        |\n| 2200    | 22        | HostSSH2                       |\n| 2222    | 2222      | DockerSSH                      |\n| 7777    | 7777      | Streaming Analytics Manager    |\n| 8585    | 8585      | Streams Messaging Manager      |\n| 7788    | 7788      | Schema Registry                |\n| 8000    | 8000      | Storm Logviewer                |\n| 9995    | 9995      | Zeppelin1                      |\n| 9996    | 9996      | Zeppelin2                      |\n| 9088    | 9088      | NiFi Protocol                  |\n| 61080   | 61080     | NiFi Registry                  |\n| 8886    | 8886      | AmbariInfra                    |\n| 61888   | 61888     | Log Search                     |\n| 10500   | 10500     | HS2v2                          |\n| 4040    | 4040      | Spark                          |\n| 4200    | 4200      | AmbariShell                    |\n| 8983    | 8983      | SolrAdmin                      |\n| 42080   | 80        | Apache                         |\n| 42111   | 42111     | nfs                            |\n| 8020    | 8020      | HDFS                           |\n| 8040    | 8040      | nodemanager                    |\n| 8032    | 8032      | RM                             |\n| 8080    | 8080      | ambari                         |\n| 8443    | 8443      | Knox                           |\n| 8744    | 8744      | StormUI                        |\n| 1080    | 1080      | Splash Page                    |\n| 8993    | 8993      | Solr                           |\n| 10000   | 10000     | HS2                            |\n| 10001   | 10001     | HS2Http                        |\n| 10002   | 10002     | HiveJDBCJar                    |\n| 30800   | 30800     | DAS                            |\n| 11000   | 11000     | Oozie                          |\n| 15000   | 15000     | Falcon                         |\n| 19888   | 19888     | JobHistory                     |\n| 50070   | 50070     | WebHdfs                        |\n| 50075   | 50075     | Datanode                       |\n| 50095   | 50095     | Accumulo                       |\n| 50111   | 50111     | WebHcat                        |\n| 16010   | 16010     | HBaseMaster                    |\n| 16030   | 16030     | HBaseRegion                    |\n| 60080   | 60080     | WebHBase                       |\n| 6080    | 6080      | XASecure                       |\n| 18080   | 18080     | SparkHistoryServer             |\n| 8042    | 8042      | NodeManager                    |\n| 21000   | 21000     | Atlas                          |\n| 8889    | 8889      | Jupyter                        |\n| 8088    | 8088      | YARN                           |\n| 2181    | 2181      | Zookeeper                      |\n| 9090    | 9090      | Nifi                           |\n| 4557    | 4557      | NiFi DistributedMapCacheServer |\n| 6627    | 6627      | Storm Nimbus Thrift            |\n| 9000    | 9000      | HST                            |\n| 6667    | 6667      | Kafka                          |\n| 9091    | 9091      | NiFi UI HTTPS                  |\n| 2202    | 2202      | Sandbox SSH 2                  |\n| 8188    | 8188      | YarnATS                        |\n| 8198    | 8198      | YarnATSR                       |\n| 9089    | 9089      | Druid1                         |\n| 8081    | 8081      | Druid2                         |\n| 2201    | 2201      | SSH HDP CDA                    |\n\n## References\n\n- Official hortonworks [docker deployment docs](https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide/section/3/).\n- Original [AWS deployment article by ruslanmv](https://ruslanmv.com/blog/Cloudera-HDP-Sanbox-on-AWS).\n- Original HDP2.6.5 deployment docker script can be found [here](https://archive.cloudera.com/hwx-sandbox/hdp/hdp-2.6.5/HDP_2.6.5_deploy-scripts_180624d542a25.zip)\n\n## License\n\n[MIT](./LICENSE) © Murshid Azher.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmurshidazher%2Fhdp-docker-sandbox","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmurshidazher%2Fhdp-docker-sandbox","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmurshidazher%2Fhdp-docker-sandbox/lists"}