{"id":24435386,"url":"https://github.com/young-ook/terraform-aws-emr","last_synced_at":"2025-04-29T09:53:20.863Z","repository":{"id":64424260,"uuid":"191270238","full_name":"Young-ook/terraform-aws-emr","owner":"Young-ook","description":"Terraform Module: Amazon EMR","archived":false,"fork":false,"pushed_at":"2025-02-12T06:18:17.000Z","size":7469,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-30T12:11:14.443Z","etag":null,"topics":["aws","mapreduce","terraform"],"latest_commit_sha":null,"homepage":"","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Young-ook.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-06-11T01:22:24.000Z","updated_at":"2025-02-12T06:18:18.000Z","dependencies_parsed_at":"2024-01-08T06:54:37.935Z","dependency_job_id":"6c927239-603a-4fea-b8d7-359566d6e30c","html_url":"https://github.com/Young-ook/terraform-aws-emr","commit_stats":null,"previous_names":[],"tags_count":10,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Young-ook%2Fterraform-aws-emr","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Young-ook%2Fterraform-aws-emr/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Young-ook%2Fterraform-aws-emr/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Young-ook%2Fterraform-aws-emr/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Young-ook","download_url":"https://codeload.github.com/Young-ook/terraform-aws-emr/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251480033,"owners_count":21596015,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","mapreduce","terraform"],"created_at":"2025-01-20T17:19:55.332Z","updated_at":"2025-04-29T09:53:20.840Z","avatar_url":"https://github.com/Young-ook.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"[[English](README.md)] [[한국어](README.ko.md)]\n\n# Amazon EMR (Elastic MapReduce)\n[Amazon EMR](https://aws.amazon.com/emr/) is the industry-leading cloud big data solution for petabyte-scale data processing, interactive analytics, and machine learning using open-source frameworks such as Apache Spark, Apache Hive, and Presto.\n\n![aws-emr-explorer](images/aws-emr-explorer.png)\n\n## Examples\n- [Amazon SageMaker Blueprint](https://github.com/Young-ook/terraform-aws-sagemaker/tree/main/examples/blueprint)\n- [Analytics on AWS](https://github.com/Young-ook/terraform-aws-emr/tree/main/examples/blueprint)\n- [Data on Amazon EKS](https://github.com/Young-ook/terraform-aws-eks/blob/main/examples/data-ai)\n\n## Getting started\n### AWS CLI\nFollow the official guide to install and configure profiles.\n- [AWS CLI Installation](https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-install.html)\n- [AWS CLI Configuration](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-profiles.html)\n\nAfter the installation is complete, you can check the aws cli version:\n```\naws --version\naws-cli/2.5.8 Python/3.9.11 Darwin/21.4.0 exe/x86_64 prompt/off\n```\n\n### Terraform\nTerraform is an open-source infrastructure as code software tool that enables you to safely and predictably create, change, and improve infrastructure.\n\n#### Install\nThis is the official guide for terraform binary installation. Please visit this [Install Terraform](https://learn.hashicorp.com/tutorials/terraform/install-cli) website and follow the instructions.\n\nOr, you can manually get a specific version of terraform binary from the websiate. Move to the [Downloads](https://www.terraform.io/downloads.html) page and look for the appropriate package for your system. Download the selected zip archive package. Unzip and install terraform by navigating to a directory included in your system's `PATH`.\n\nOr, you can use [tfenv](https://github.com/tfutils/tfenv) utility. It is very useful and easy solution to install and switch the multiple versions of terraform-cli.\n\nFirst, install tfenv using brew.\n```\nbrew install tfenv\n```\nThen, you can use tfenv in your workspace like below.\n```\ntfenv install \u003cversion\u003e\ntfenv use \u003cversion\u003e\n```\nAlso this tool is helpful to upgrade terraform v0.12. It is a major release focused on configuration language improvements and thus includes some changes that you'll need to consider when upgrading. But the version 0.11 and 0.12 are very different. So if some codes are written in older version and others are in 0.12 it would be great for us to have nice tool to support quick switching of version.\n```\ntfenv list\ntfenv install latest\ntfenv use \u003cversion\u003e\n```\n\n### Setup\n```\nmodule \"emr\" {\n  source  = \"Young-ook/emr/aws\"\n  name    = \"emr\"\n}\n```\nRun terraform:\n```\nterraform init\nterraform apply\n```\n\n# Additional Resources\n## Amazon EMR (Elastic MapReduce)\n- [Amazon EMR Migration TCO(Total Cost of Ownership) Simulator](https://github.com/awslabs/migration-hadoop-to-emr-tco-simulator)\n\n## Data Catalog\n- [What are the main features of Data Catalog software](https://www.techtarget.com/searchdatamanagement/answer/What-are-the-main-features-of-data-catalog-software)\n\n## Data Lake\n- [Data Lake](https://en.wikipedia.org/wiki/Data_lake)\n- [What is a data lake?](https://aws.amazon.com/big-data/datalakes-and-analytics/what-is-a-data-lake/)\n- [Introduction to Data Lakes](https://www.databricks.com/discover/data-lakes)\n\n## Data Mesh\n- [Data Mesh: A Monolithic Data Lake to a Distributed Data Mesh](https://martinfowler.com/articles/data-monolith-to-mesh.html)\n- [Data Mesh Architecture](https://www.datamesh-architecture.com/)\n- [Amazon DataZone - Data Mesh and Modern Data Architecture on AWS](https://youtu.be/arA-s8GTs6c?si=BsYUgAWNLrbsGbi8)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyoung-ook%2Fterraform-aws-emr","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyoung-ook%2Fterraform-aws-emr","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyoung-ook%2Fterraform-aws-emr/lists"}