{"id":26597201,"url":"https://github.com/oaklight/xinference-singularity","last_synced_at":"2026-04-29T11:02:36.248Z","repository":{"id":283720057,"uuid":"952696877","full_name":"Oaklight/xinference-singularity","owner":"Oaklight","description":"scripts to run xinference via singularity","archived":false,"fork":false,"pushed_at":"2025-06-03T21:11:17.000Z","size":11,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-09-18T14:13:29.664Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Oaklight.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-21T18:07:37.000Z","updated_at":"2025-06-03T21:11:18.000Z","dependencies_parsed_at":"2025-03-21T19:40:24.147Z","dependency_job_id":"02d1d78b-9e71-4fca-9e0d-bf0a7f2b1afc","html_url":"https://github.com/Oaklight/xinference-singularity","commit_stats":null,"previous_names":["oaklight/xinference-singularity"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Oaklight/xinference-singularity","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oaklight%2Fxinference-singularity","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oaklight%2Fxinference-singularity/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oaklight%2Fxinference-singularity/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oaklight%2Fxinference-singularity/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Oaklight","download_url":"https://codeload.github.com/Oaklight/xinference-singularity/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oaklight%2Fxinference-singularity/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32422532,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-29T06:29:02.080Z","status":"ssl_error","status_checked_at":"2026-04-29T06:29:00.631Z","response_time":110,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-23T17:32:01.028Z","updated_at":"2026-04-29T11:02:36.219Z","avatar_url":"https://github.com/Oaklight.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# XInference Singularity\n\n[中文版本](README_zh.md)\n\nXInference Singularity is a repository containing a set of scripts designed to manage inference workflows using Singularity containers. The repository allows you to start and stop the inference server, download models or datasets from Hugging Face, and update the inference container.\n\n## Files\n\n- start-xinference.sh  \n  Launches the inference container using Singularity with a default version (v1.2.2) and configured local directory.\n\n- stop-xinference.sh  \n  Stops the inference server by terminating the process listening on port 9997.\n\n- hfd.sh  \n  Downloads models or datasets from Hugging Face using aria2c or wget with support for authentication and resuming downloads.\n\n- start-xinference-instance.sh  \n  Starts a Singularity instance and runs the xinference-local command within the instance, logging output to a designated log file.\n\n- update-xinference.sh  \n  Updates the inference container by pulling a Docker image (default version v1.2.0) and converting it for use with Singularity.\n\n## Usage\n\n### Starting the Inference Server\n\nRun:\n\n```bash\n./start-xinference.sh\n```\n\nOr, to run within an instance:\n\n```bash\n./start-xinference-instance.sh\n```\n\n### Stopping the Inference Server\n\nRun:\n\n```bash\n./stop-xinference.sh\n```\n\n### Downloading Models/Datasets\n\nRun:\n\n```bash\n./hfd.sh \u003crepo_id\u003e [options]\n```\n\nFor detailed options, run:\n\n```bash\n./hfd.sh -h\n```\n\n### Updating the Inference Container\n\nRun:\n\n```bash\n./update-xinference.sh\n```\n\n_Note: The update script uses a default version of v1.2.0 for updating the container image. Adjust the LATEST_VERSION environment variable as needed._\n\n## Prerequisites\n\nEnsure that Singularity is installed. Additionally, the following dependencies must be available on your system:\n\n- aria2c or wget\n- curl\n- git and git-lfs\n\nEnvironment variables can be used to customize paths, instance names, version numbers, and other configurations.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foaklight%2Fxinference-singularity","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Foaklight%2Fxinference-singularity","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foaklight%2Fxinference-singularity/lists"}