{"id":20630641,"url":"https://github.com/brookisme/gcloud_gpu","last_synced_at":"2026-04-20T15:03:39.100Z","repository":{"id":151273999,"uuid":"93555704","full_name":"brookisme/gcloud_gpu","owner":"brookisme","description":"Setup scripts and files for GCloud GPU (and CPU) instances","archived":false,"fork":false,"pushed_at":"2018-08-02T17:54:28.000Z","size":34,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-15T18:13:17.967Z","etag":null,"topics":["compute-engine","gcloud-gpu","gpu","machine-learning"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/brookisme.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-06-06T19:26:37.000Z","updated_at":"2018-11-10T09:14:24.000Z","dependencies_parsed_at":null,"dependency_job_id":"e46333df-afd5-463e-8aa3-8536a881e13b","html_url":"https://github.com/brookisme/gcloud_gpu","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/brookisme/gcloud_gpu","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brookisme%2Fgcloud_gpu","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brookisme%2Fgcloud_gpu/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brookisme%2Fgcloud_gpu/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brookisme%2Fgcloud_gpu/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/brookisme","download_url":"https://codeload.github.com/brookisme/gcloud_gpu/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brookisme%2Fgcloud_gpu/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32052538,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-20T11:35:06.609Z","status":"ssl_error","status_checked_at":"2026-04-20T11:34:48.899Z","response_time":94,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["compute-engine","gcloud-gpu","gpu","machine-learning"],"created_at":"2024-11-16T14:09:05.937Z","updated_at":"2026-04-20T15:03:39.095Z","avatar_url":"https://github.com/brookisme.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"## GCLOUD GPU \n\n1. [TLDR; Run two lines of code and you're done (almost)](#tldr)\n2. [Create Instance Script](#create)\n3. [Instance Setup Script](#setup)\n4. [Almost: The rest of the setup](#almost)\n\n---\n\n\u003ca name=\"tldr\"\u003e\u003c/a\u003e\n\n### TLDR;\n\n##### TLDR; TLDR;\n\n```bash\n# from local computer\n. create_instance.sh gpu-84 4 500\n\n# from remote instance\n. instance-setup.sh\n```\n\n##### SLIGHTLY MORE DETAIL\n\nLOCAL COMPUTER:\n\n```bash\n# example: create instance named gpu-84 with 4 GPUs 500GB of memory \n. create_instance.sh gpu-84 4 500\n```\n\n\n```bash\n# example: copy setup script to remote instance named gpu-84\ngcloud compute scp instance-setup.sh gpu-84:~/\n```\n\n```bash\n# example: ssh into instance named gpu-84\ngcloud compute ssh gpu-84\n\n# --OR-- using alias (https://github.com/brookisme/gcloud_gpu/wiki/Local-Setup#gcloud_alias)\ngssh gpu-84\n```\n\nREMOTE INSTANCE:\n\n```bash\n# example: run setup script installing TensorFlow from pip\n. instance-setup.sh\n\n# --OR-- example: run setup script installing TensorFlow later from sources (https://github.com/brookisme/gcloud_gpu/wiki/TensorFlow:-Install-from-Sources)\n. instance-setup.sh gpu skip-tf\n```\n\n\n---\n\n\u003ca name=\"create\"\u003e\u003c/a\u003e\n\n### CREATE INSTANCE\n\nUse the script [create_instance.sh](https://github.com/brookisme/gcloud_gpu/blob/master/create_instance.sh) to create new instances.\n\nUSAGE:\n\n```bash\n. create_instance.sh \\\n    \u003cNAME\u003e \\\n    \u003cCOUNT\u003e \\\n    [DISK_SIZE: 200] \\\n    [SNAPSHOT_NAME: No snapshot]\n```\n\nVARS:\n\n- NAME: (required) name of instance\n- COUNT: (required) GPUs -1,2,4 | CPUs 0\n- DISK_SIZE: \n    - defaluts to 200 (GB) \n    - consider decreasing disk-size and [adding a persistent disk](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup#pdisk)\n    \n- SNAPSHOT_NAME (_see note below_): \n    - must first create snapshot (see above note)\n    - DISK_SIZE is ignored so pass in anything as a space filler (like \"skip\" in example below)\n\n\nEXAMPLES:\n\n```bash\n# 4 gpu, default disk size (200GB)\n. create_instance.sh gpu-84 4\n\n# 4 gpu, from snapshot\n. create_instance.sh gpu-84-snapshot-name 4 skip snapshot_name\n```\n\n\n **NOTE ON SNAPSHOTS:** If creating instance from a snapshot you must first  create the disk\n\n```bash\ngcloud compute disks create DISK_NAME --source-snapshot SNAPSHOT_NAME\n```\n\n\n---\n\n\u003ca name=\"setup\"\u003e\u003c/a\u003e\n\n### INSTANCE SETUP\n\nUse the script [instance-setup.sh](https://github.com/brookisme/gcloud_gpu/blob/master/instance-setup.sh) to setup new instances. You can find a list of what is being installed [here](https://github.com/brookisme/gcloud_gpu/wiki/Install-List).\n\n\n##### Copy setup script to instance\n\n```bash\ngcloud compute scp instance-setup.sh \u003cINSTANCE_NAME\u003e:~/\n```\n\n\n##### Run setup script\n\n**NOTE:** The Anaconda install is interactive. The default for add anaconda to PATH is no -- **type yes!!!**\n\nYou can choose to install with TensorFlow or, if you are going to [install from sources](https://github.com/brookisme/gcloud_gpu/wiki/TensorFlow:-Install-from-Sources-Notes), skip the tensorflow installs. You also have the option of skipping the \"geo tools\" listed [here](https://github.com/brookisme/gcloud_gpu/wiki/Install-List#py3).\n\n```bash\n# CPU (with TF)\n. instance-setup.sh cpu\n\n# GPU (with TF)\n. instance-setup.sh\n\n# GPU (without TF)\n. instance-setup.sh gpu skip-tf\n\n# GPU (without TF or GEO-tools)\n. instance-setup.sh gpu skip-tf skip-geo\n\n# GPU (including TF but without GEO-tools)\n. instance-setup.sh gpu tf skip-geo\n```\n\n\n---\n\n\u003ca name=\"almost\"\u003e\u003c/a\u003e\n\n### THE REST\n\nThere are still a small handful of steps (most of which are optional).\n\n##### REQUIRED:\n\n- [GPU Setup](https://github.com/brookisme/gcloud_gpu/wiki/GPU-Setup)\n- [IP Config](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup#ip)\n\n##### OPTIONAL:\n\n[REMOTE INSTANCE](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup):\n\n- [TMUX](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup#tmux)\n- [Pretty Prompt](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup#prompt)\n- [Jupyter-PWD](https://github.com/brookisme/gcloud_gpu/wiki/Instance-Setup#jupyter)\n\n[LOCAL COMPUTER](https://github.com/brookisme/gcloud_gpu/wiki/Local-Setup): \n\n- [GCloud Aliases](https://github.com/brookisme/gcloud_gpu/wiki/Local-Setup#gcloud_alias)\n- [Sublime-SFTP and Sublime-Remote](https://github.com/brookisme/gcloud_gpu/wiki/Local-Setup#subl_sftp)\n\nAlso consider installing [TensorFlow from sources](https://github.com/brookisme/gcloud_gpu/wiki/TensorFlow:-Install-from-Sources).\n\n\n\n\n\n ","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrookisme%2Fgcloud_gpu","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrookisme%2Fgcloud_gpu","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrookisme%2Fgcloud_gpu/lists"}