{"id":18802283,"url":"https://github.com/oracle-quickstart/oci-hadoop","last_synced_at":"2025-04-13T18:31:26.975Z","repository":{"id":106380165,"uuid":"187123506","full_name":"oracle-quickstart/oci-hadoop","owner":"oracle-quickstart","description":"Terraform module to deploy Hadoop on Oracle Cloud Infrastructure (OCI)","archived":true,"fork":false,"pushed_at":"2022-06-10T21:45:02.000Z","size":548,"stargazers_count":4,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-21T06:43:56.488Z","etag":null,"topics":["cloud","hadoop","oci","oracle","oracle-led","terraform"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/oracle-quickstart.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-05-17T01:09:48.000Z","updated_at":"2024-05-23T00:42:33.000Z","dependencies_parsed_at":null,"dependency_job_id":"4a2db9ea-79b9-4ea1-a029-111693acd605","html_url":"https://github.com/oracle-quickstart/oci-hadoop","commit_stats":null,"previous_names":[],"tags_count":12,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oracle-quickstart%2Foci-hadoop","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oracle-quickstart%2Foci-hadoop/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oracle-quickstart%2Foci-hadoop/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/oracle-quickstart%2Foci-hadoop/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/oracle-quickstart","download_url":"https://codeload.github.com/oracle-quickstart/oci-hadoop/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248760348,"owners_count":21157344,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloud","hadoop","oci","oracle","oracle-led","terraform"],"created_at":"2024-11-07T22:27:20.793Z","updated_at":"2025-04-13T18:31:26.968Z","avatar_url":"https://github.com/oracle-quickstart.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# oci-hadoop\nApache Hadoop on OCI\n\n## Deployment\nThis template uses [Oracle Resource Manager](https://docs.oracle.com/en-us/iaas/Content/ResourceManager/Concepts/resourcemanager.htm) to deploy an [Apache Hadoop](http://hadoop.apache.org) cluster on OCI.  The schema driven install will guide you through customization options available prior to deployment.\n\nSimply click the Deploy to OCI button here to initiate deployment of the stack.\n\n[![Deploy to Oracle Cloud](https://oci-resourcemanager-plugin.plugins.oci.oraclecloud.com/latest/deploy-to-oracle-cloud.svg)](https://cloud.oracle.com/resourcemanager/stacks/create?region=home\u0026zipUrl=https://github.com/oracle-quickstart/oci-hadoop/archive/1.0.10.zip)\n\n## Architecture\nHere is a diagram of the deployment architecture when creating a VCN as part of the stack deployment:\n\n![Deployment Architecture Diagram](images/deployment_architecture.png)\n\n## Hadoop Components\nCluster service topology is as follows:\n* Master 1 is NameNode and JobHistory server\n* Master 2 is ResourceManager, Timeline, Proxy and History Server\n* All Master hosts are ZooKeeper servers\n\nEdge node has client libraries deployed in .bashrc for root user.   Cluster hosts have deployment logs in /var/log/OCI-Hadoop.log which can be used to triage any deployment issues.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foracle-quickstart%2Foci-hadoop","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Foracle-quickstart%2Foci-hadoop","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foracle-quickstart%2Foci-hadoop/lists"}