{"id":28376122,"url":"https://github.com/purestorage-openconnect/ai-platform","last_synced_at":"2026-03-05T00:03:06.725Z","repository":{"id":152685483,"uuid":"236615560","full_name":"PureStorage-OpenConnect/ai-platform","owner":"PureStorage-OpenConnect","description":"examples of using Pure Storage in a data hub","archived":false,"fork":false,"pushed_at":"2020-04-02T20:12:30.000Z","size":12,"stargazers_count":5,"open_issues_count":1,"forks_count":2,"subscribers_count":8,"default_branch":"master","last_synced_at":"2025-08-18T15:52:57.107Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PureStorage-OpenConnect.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-01-27T23:08:19.000Z","updated_at":"2021-05-20T09:05:35.000Z","dependencies_parsed_at":"2023-08-17T08:49:48.781Z","dependency_job_id":null,"html_url":"https://github.com/PureStorage-OpenConnect/ai-platform","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/PureStorage-OpenConnect/ai-platform","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PureStorage-OpenConnect%2Fai-platform","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PureStorage-OpenConnect%2Fai-platform/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PureStorage-OpenConnect%2Fai-platform/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PureStorage-OpenConnect%2Fai-platform/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PureStorage-OpenConnect","download_url":"https://codeload.github.com/PureStorage-OpenConnect/ai-platform/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PureStorage-OpenConnect%2Fai-platform/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30101687,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-04T23:59:36.199Z","status":"ssl_error","status_checked_at":"2026-03-04T23:56:48.556Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-30T00:05:29.244Z","updated_at":"2026-03-05T00:03:06.696Z","avatar_url":"https://github.com/PureStorage-OpenConnect.png","language":"Dockerfile","readme":"## AI Data Hub\nThis repo contains examples of using Pure Storage FlashBlade in an AI Data Hub. \nModules available: \n- JupyterHub as a Service\n\n##\n# JupyterHub as a Service on FlashBlade\n\n## Introduction\nJupyter notebooks are a popular tool for data scientists to explore datasets and experiment with model development. They enable developers to easily supplement code with analysis and visualizations. \n\nRather than the historical practice of having users manage their own notebook servers, JupyterHub can be deployed by an organization to offer a centralized notebook platform. JupyterHub also enables infrastructure teams to give each user access to centralized storage for: shared datasets, scratch space, and a persistent IDE. \n\nIn this example deployment, users are able to create new notebook servers on the fly within a Kubernetes cluster with zero-touch provisioning. IT teams are able to manage efficient use of compute and storage resources across users. \n\n## Installation\n\n### Prep Steps\n- Clone this repo. \n\n- On your local machine, ensure that your cluster config is active for kubectl. \n\n- On your local machine, install Helm and the Helm repos for PSO and for JupyterHub:\n    - `helm repo add pure https://purestorage.github.io/helm-charts`  \n    - `helm repo add jupyterhub https://jupyterhub.github.io/helm-chart/`\n\n- Each node in the cluster needs to have access to the datasets on FlashBlade. Mount the datasets folder directly to each cluster node at `/datasets`.\n\n### Deploy PSO\n**Customize:**\n\nAdjust the \"arrays\" section of [./psovalues.yaml](https://github.com/PureStorage-OpenConnect/ai-platform/blob/master/psovalues.yaml) to include your FlashBlade specifics. Example customization: \n\n```arrays:\n  FlashBlades:\n    - MgmtEndPoint: \"10.61.169.20\"                           # CHANGE \n      APIToken: \"T-c4925090-c9bf-4033-8537-d24ee5669135\"     # CHANGE \n      NFSEndPoint: \"10.61.169.30\"                            # CHANGE \n```\n*Further reading: PSO configuration \u003clink\u003e.*\n\n**Install:**\n\n`helm install pure-storage-driver pure/pure-csi --namespace jhub -f \u003cyour_own_dir\u003e/psovalues.yaml`\n\nInstalling PSO creates a few storage classes in your cluster. The example values.yaml file uses the “pure-file” storage class for JupyterHub. \n\n\n### Deploy a PV for shared datasets\n**Customize:**\n\nThe [./datasetpv.yaml](https://github.com/PureStorage-OpenConnect/ai-platform/blob/master/datasetpv.yaml) file is used create a Persistent Volume Claim named “shared-ai-datasets”. Adjust it to use your FlashBlade Data VIP and filesystem name.  \n\n```nfs:\n    server: 10.61.169.100      # CHANGE to your data vip \n    path: /datasets            # CHANGE to your filesystem name\n```\n**Install:**\n\n`kubectl create -f datasetpv.yaml`\n\n\n### Deploy JupyterHub\n**Customize:**\n\nThe only change required for the [./jupvalues.yaml](https://github.com/PureStorage-OpenConnect/ai-platform/blob/master/jupvalues.yaml) file is to add a security token. Generate a random hex string:\n\n`openssl rand -hex 32`\n\nCopy the output and, in your jupvalues.yaml file, replace the phrase SECRET_TOKEN with your generated string:\n```proxy:\n  secretToken: 'SECRET_TOKEN'   # CHANGE to 32-digit secret token (use straight quotes '')\n```\n*Further reading: description of settings in Pure’s jupvalues.yaml \u003clink\u003e*\n\n**Install:**\n\n`helm install jhub jupyterhub/jupyterhub --namespace jhub --version 0.8.2 -f jupyterhub/values.yaml`\n\n## Use Jupyter notebooks! \nJupyterHub is now ready for use. \n\nInstalling JupyterHub creates a proxy service that serves traffic for end users. The public address (proxy-public) can be found via:\n\n```\n\u003e kubectl --namespace=jhub get svc proxy-public\nNAME           TYPE           CLUSTER-IP       EXTERNAL-IP     PORT(S)                      AGE\nproxy-public   LoadBalancer   10.43.197.255.   10.61.169.60    80:30615/TCP,443:30987/TCP   5d19h\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpurestorage-openconnect%2Fai-platform","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpurestorage-openconnect%2Fai-platform","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpurestorage-openconnect%2Fai-platform/lists"}