{"id":13571539,"url":"https://github.com/bluishglc/emr-edgenode-maker","last_synced_at":"2025-04-04T08:31:22.907Z","repository":{"id":49846115,"uuid":"293993647","full_name":"bluishglc/emr-edgenode-maker","owner":"bluishglc","description":"This tool can easily make / build an emr cluster edge node / client node / gateway node","archived":false,"fork":false,"pushed_at":"2022-06-01T05:41:51.000Z","size":7,"stargazers_count":10,"open_issues_count":0,"forks_count":14,"subscribers_count":0,"default_branch":"master","last_synced_at":"2024-11-05T04:34:12.511Z","etag":null,"topics":["client","edgenode","emr","gateway"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bluishglc.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-09-09T03:34:07.000Z","updated_at":"2024-09-05T10:06:22.000Z","dependencies_parsed_at":"2022-09-19T18:40:55.581Z","dependency_job_id":null,"html_url":"https://github.com/bluishglc/emr-edgenode-maker","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bluishglc%2Femr-edgenode-maker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bluishglc%2Femr-edgenode-maker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bluishglc%2Femr-edgenode-maker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bluishglc%2Femr-edgenode-maker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bluishglc","download_url":"https://codeload.github.com/bluishglc/emr-edgenode-maker/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247147225,"owners_count":20891651,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["client","edgenode","emr","gateway"],"created_at":"2024-08-01T14:01:02.935Z","updated_at":"2025-04-04T08:31:20.540Z","avatar_url":"https://github.com/bluishglc.png","language":"Shell","funding_links":[],"categories":["Shell"],"sub_categories":[],"readme":"\n# 脚本使用方法\n\n**关于该脚本的详细介绍，请参考作者博客文章：[如何制作一个AWS EMR客户端节点（ Client Node / Edge Node / Gateway Node )](https://laurence.blog.csdn.net/article/details/108529087)**\n\n检出后需要先给shell文件`make-emr-edge-node.sh`添加可执行属性：\n\n```bash\nchmod a+x make-emr-edge-node.sh\n```\n\n然后可以通过help选项查看使用方式：\n\n```bash\nsudo ./make-emr-edge-node.sh help\n\n==================  [ MAKE EMR EDGE NODE SCRIPTS ] USAGE  ==================\n\n# 说明：初始化（只需执行一次）, 安装基础软件包，emr基础app, 配置emr repo, 创建hadoop用户, 创建必要文件夹\n./make-emr-edge-node.sh init [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作hadoop客户端\n./make-emr-edge-node.sh make-hadoop-client [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作spark客户端\n./make-emr-edge-node.sh make-spark-client [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作hive客户端\n./make-emr-edge-node.sh make-hive-client [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作hbase客户端\n./make-emr-edge-node.sh make-hbase-client [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作oozie客户端\n./make-emr-edge-node.sh make-oozie-client [PEM_FILE_PATH] [MASTER_NODE_IP]\n\n# 说明：制作hudi客户端\n./make-emr-edge-node.sh make-hudi-client\n\n# 说明：制作sqoop客户端\n./make-emr-edge-node.sh make-sqoop-client\n\n```\n\n关于脚本的使用方式，如下几点需要注意：\n\n1. 由于脚本中大量操作需要使用root权限，所以必须以root用户或sudo方式运行脚本，否则脚本会给出错误提示\n2. 命令行中只涉及两个参数：\n- [PEM_FILE_PATH] ：你的AWS账号的PEM文件，执行脚本需要使用该秘钥文件登入Master节点拷贝配置文件；\n- [MASTER_NODE_IP]：你的Master节点IP或域名\n3. 在执行`make-*-client`操作前，需要先执行`init`操作（仅一次即可）\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbluishglc%2Femr-edgenode-maker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbluishglc%2Femr-edgenode-maker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbluishglc%2Femr-edgenode-maker/lists"}