{"id":19888229,"url":"https://github.com/project-codeflare/ibm-vpc-ray-connector","last_synced_at":"2025-05-02T17:31:53.638Z","repository":{"id":45609509,"uuid":"381635475","full_name":"project-codeflare/ibm-vpc-ray-connector","owner":"project-codeflare","description":"Enables Ray to use IBM Gen2 backend","archived":false,"fork":false,"pushed_at":"2023-04-06T16:31:37.000Z","size":1557,"stargazers_count":3,"open_issues_count":1,"forks_count":2,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-10-30T14:54:54.011Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/project-codeflare.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-06-30T08:50:58.000Z","updated_at":"2023-02-25T18:23:11.000Z","dependencies_parsed_at":"2023-01-29T00:32:16.372Z","dependency_job_id":null,"html_url":"https://github.com/project-codeflare/ibm-vpc-ray-connector","commit_stats":null,"previous_names":["project-codeflare/gen2-connector"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/project-codeflare%2Fibm-vpc-ray-connector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/project-codeflare%2Fibm-vpc-ray-connector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/project-codeflare%2Fibm-vpc-ray-connector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/project-codeflare%2Fibm-vpc-ray-connector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/project-codeflare","download_url":"https://codeload.github.com/project-codeflare/ibm-vpc-ray-connector/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224324498,"owners_count":17292521,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-12T18:06:41.658Z","updated_at":"2025-05-02T17:31:53.630Z","avatar_url":"https://github.com/project-codeflare.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ibm-vpc-ray-connector\nA connector for [Ray](https://github.com/ray-project/ray) over IBM VPC infrastructure.\n\n## Setup\n\u003e Use of python virtual environment, e.g. [virtualenv](https://virtualenv.pypa.io/en/latest), is greatly encouraged to avoid installing Python packages globally, which could break system tools or other projects\n\n1. Install ibm-vpc-ray-connector on your machine\n\n```\npip install ibm-vpc-ray-connector\n```\n\n2. Configure ibm vpc\n    * [Generate API KEY](https://www.ibm.com/docs/en/spectrumvirtualizecl/8.1.3?topic=installing-creating-api-key)\n\n    * [Create/Update security group](https://cloud.ibm.com/docs/vpc?topic=vpc-configuring-the-security-group) to have SSH, Redis and Ray Dashboard ports open: 22, 8265 and 6379\n\n3. Create cluster config file\n\n    * Use interactive `ibm-ray-config` config tool to generate cluster.yaml configuration file\n    ```\n    pip install ibm-ray-config\n    ibm-ray-config -o cluster.yaml\n    ```\n## Usage\n- Use generated file to bring ray cluster up, e.g `ray up cluster.yaml`.\n\n* After finished, find cluster head node and worker nodes ips:\n\n```\nray get-head-ip cluster.yaml\nray get-worker-ips cluster.yaml\n```\n\n* To get status of the cluster\n\n```\nray status --address PUBLIC_HEAD_IP:6379\n```\n\n* Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use `ray dashboard` to forward ray cluster dashboard to your localhost. \n\n* Submit example task `ray submit cluster.yaml templates/example.py`\n\n## Logs\nLogs for the node_provider can be found under `/tmp/connector_logs/`.  \nLogs of all levels will be written to `connector_logs`.  \nThe default log level for console output is `INFO`.   \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproject-codeflare%2Fibm-vpc-ray-connector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fproject-codeflare%2Fibm-vpc-ray-connector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproject-codeflare%2Fibm-vpc-ray-connector/lists"}