{"id":18414799,"url":"https://github.com/navdeep-g/h2o-ec2","last_synced_at":"2026-05-09T09:48:09.674Z","repository":{"id":145427373,"uuid":"57929806","full_name":"navdeep-G/h2o-ec2","owner":"navdeep-G","description":"Launch an H2O cluster in EC2 Classic","archived":false,"fork":false,"pushed_at":"2019-05-25T15:42:50.000Z","size":30,"stargazers_count":1,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-13T00:58:38.733Z","etag":null,"topics":["aws","boto","cloud-computing","ec2","h2o-3","python"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/navdeep-G.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-05-03T00:25:48.000Z","updated_at":"2019-05-25T15:42:55.000Z","dependencies_parsed_at":null,"dependency_job_id":"cc3b05ef-53ec-479e-90a3-4e2bec73113c","html_url":"https://github.com/navdeep-G/h2o-ec2","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navdeep-G%2Fh2o-ec2","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navdeep-G%2Fh2o-ec2/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navdeep-G%2Fh2o-ec2/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navdeep-G%2Fh2o-ec2/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/navdeep-G","download_url":"https://codeload.github.com/navdeep-G/h2o-ec2/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248650435,"owners_count":21139672,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","boto","cloud-computing","ec2","h2o-3","python"],"created_at":"2024-11-06T03:52:22.822Z","updated_at":"2026-05-09T09:48:04.651Z","avatar_url":"https://github.com/navdeep-G.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# h2o-ec2\n\nThis directory contains scripts to launch an H2O cluster in EC2 (EC2-Classic).\n\nSTEP 1:  Set up Amazon Credentials\n-----------------------------------------\n\n- Add key info to `~/.bash_profile`:\n```\n# EC2 keys\nexport AWS_ACCESS_KEY_ID=\"\"\nexport AWS_SECRET_ACCESS_KEY=\"\"\nexport AWS_SSH_PRIVATE_KEY_FILE=\"/path/to/private_key.pem\"\n```\n- Source the file:\n```\nsource ~/.bash_profile\n```\n\nSTEP 2:  Install python 2 and boto, if necessary\n-----------------------------------------\n\n- Boto: http://boto.readthedocs.org/en/latest/\n- Python: https://www.python.org/\n\nSTEP 3:  Build a cluster of EC2 instances\n-----------------------------------------\n\n- Edit h2o-cluster-launch-instances.py to suit your specific environment.\n- Particularly, you can update the key name, instance type, number of worker nodes, and the instance name:\n```\nkeyName = 'SSH key pair name'\nnumInstancesToLaunch = 4\ninstanceType = 'm3.2xlarge'\ninstanceNameRoot = 'h2o-instance'\n```\n- You can also specify a [maximum Spot request bid](https://aws.amazon.com/ec2/spot/pricing/) if running on Spot is desired:\n```\nspotBid = '1.35'\n```\n**Note:** After following steps 1-3 (where you set up your environment) you can run the scripts within the repo using the following command: `./run-all.sh` or you can do it manually by following steps 4-5.\n\n**Note:** If you fail to initialize a cluster instance, then you should `Terminate` the instance before re-trying to prevent a refusal of connection.\n\nSTEP 4:  Start H2O Cluster\n-------------------------------------------------\n\n- After changing the previous run the following to build a cluster of EC2 instances manually:\n```\n./h2o-cluster-launch-instances.py\n```\n\n**Note:** If using Spot requests and your spot bid is too low, the entire request will be automatically cancelled for you.\n\n- Below will distribute the `h2o.jar` file to all the worker nodes, along with your AWS credentials and then start the H2O cluster. Note, the `h2o.jar` is reflective of the latest stable build from H2O.\n```\n./h2o-cluster-download-h2o.sh\n./h2o-cluster-distribute-aws-credentials.sh\n./h2o-cluster-start-h2o.sh\n```\n\nSTEP 5:  Point your browser to H2O\n----------------------------------\n\nPoint your web browser to the following: \n- http://any one of the public DNS node addresses:54321 or http://any one of the public DNS node addresses:54322 for H2O Flow\n- http://any one of the public DNS node addresses:8787 for RStudio (login: h2oai:0xdata)\n- Note: An example of a DNS is as follows: `ec2-54-221-129-217.compute-1.amazonaws.com`. This can be found in your AWS console under `Public DNS` or in your terminal output next to `Starting on node [x]`.\n\nStopping and restarting H2O\n---------------------------\n\n - ./h2o-cluster-stop-h2o.sh\n - ./h2o-cluster-start-h2o.sh\n\nControl files (generated when starting the cluster and/or H2O)\n--------------------------------------------------------------\n\n    nodes-public\n        A list of H2O nodes by public DNS name.\n\n    nodes-private\n        A list of H2O nodes by private AWS IP address.\n\n    flatfile.txt\n        A list of H2O nodes by (private) IP address and port.\n\n    latest (produced by h2o-cluster-download-h2o.sh)\n        Latest build number for the requested branch.\n\n    project_version (produced by h2o-cluster-download-h2o.sh)\n        Full project version number for the requested build.\n\n    core-site.xml (produced by ./h2o-cluster-distribute-aws-credentials.sh)\n    aws_credentials.properties (produced by ./h2o-cluster-distribute-aws-credentials.sh)\n        AWS credentials copied to each instance.\n\n\nStopping/Terminating the cluster\n--------------------------------\n\nGo to your Amazon AWS console and do the operation manually.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnavdeep-g%2Fh2o-ec2","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnavdeep-g%2Fh2o-ec2","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnavdeep-g%2Fh2o-ec2/lists"}