{"id":15035396,"url":"https://github.com/opencsgs/csghub-server","last_synced_at":"2026-03-10T04:11:09.860Z","repository":{"id":217083696,"uuid":"742385776","full_name":"OpenCSGs/csghub-server","owner":"OpenCSGs","description":"csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.","archived":false,"fork":false,"pushed_at":"2025-05-15T06:49:05.000Z","size":33718,"stargazers_count":642,"open_issues_count":5,"forks_count":109,"subscribers_count":77,"default_branch":"main","last_synced_at":"2025-05-15T07:04:53.695Z","etag":null,"topics":["ai","datasets","golang","huggingface","llm","models","platform"],"latest_commit_sha":null,"homepage":"https://opencsg.com/models","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/OpenCSGs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-01-12T11:04:59.000Z","updated_at":"2025-05-15T06:45:17.000Z","dependencies_parsed_at":"2024-02-04T06:26:30.825Z","dependency_job_id":"d106d004-33f9-4105-b242-847d18098eb7","html_url":"https://github.com/OpenCSGs/csghub-server","commit_stats":null,"previous_names":["opencsgs/csghub-server"],"tags_count":29,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OpenCSGs%2Fcsghub-server","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OpenCSGs%2Fcsghub-server/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OpenCSGs%2Fcsghub-server/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OpenCSGs%2Fcsghub-server/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/OpenCSGs","download_url":"https://codeload.github.com/OpenCSGs/csghub-server/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254292040,"owners_count":22046426,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","datasets","golang","huggingface","llm","models","platform"],"created_at":"2024-09-24T20:28:33.335Z","updated_at":"2026-03-10T04:11:09.802Z","avatar_url":"https://github.com/OpenCSGs.png","language":"Go","readme":"*[English](README_en.md) ∙ [简体中文](README_cn.md) ∙ [日本語](README_ja.md)*\n\n`CSGHub Server` is a part of the open source and reliable large model assets management platform - [CSGHub](https://github.com/OpenCSGs/CSGHub/). It focuses on management of models、datasets and other LLM assets through REST API。\n\n## Key Features：\n- Creation and Management of users and orgnizations\n- Auto-tagging of model and dataset labels\n- Search for users, organizations, models, and data\n- Online preview of dataset files, like `.parquet` file\n- Content moderation for both text and image \n- Download of individual files, including LFS files\n- Tracking of model and dataset activity data, such as downloads and likes volume\n\n## Demo\nIn order to help users to quickly understand the features and usage of CSGHub, we have recorded a demo video. You can watch this video to get a quick understanding of the main features and operation procedures of this program.\n- CSGHub Demo video is as blew，you can also check it at [YouTube](https://www.youtube.com/watch?v=SFDISpqowXs) or [Bilibili](https://www.bilibili.com/video/BV12T4y187bv/)\n\u003cvideo width=\"658\" height=\"432\" src=\"https://github-production-user-asset-6210df.s3.amazonaws.com/3232817/296556812-205d07f2-de9d-4a7f-b3f5-83514a71453e.mp4\"\u003e\u003c/video\u003e\n\nPlease visit the [OpenCSG website](https://portal.opencsg.com/models) to experience the powerful management features. \n\n## Quick Start\n\u003e System resource requirements: 4c CPU/8GB memory\n\nPlease install Docker yourself. This project has been tested in Ubuntu22 environment.\n\nYou can quickly deploy the localized `CSGHub Server` service through docker-compose:\n```shell\n# The API token should be at least 128 characters long, and HTTP requests to csghub-server require the API token to be sent as a Bearer token for authentication.\nexport STARHUB_SERVER_API_TOKEN=\u003cAPI token\u003e\nmkdir -m 777 gitea minio_data\ncurl -L https://raw.githubusercontent.com/OpenCSGs/csghub-server/main/docker-compose.yml -o docker-compose.yml\ndocker-compose -f docker-compose.yml up -d\n```\n\n## Start CSGHub Server Services Locally\n\nCSGHub supports TOML format for config files. When starting any service from the command line, you can specify the config file with the `--config` option:\n\n```\ngo run cmd/csghub-server/main.go start server --config local.toml\ngo run cmd/csghub-server/main.go deploy runner --config local.toml\n...\n```\n\nWe provide an [example config file](common/config/config.toml.example), you can rename it, modify as needed and use. All available configurations are defined in [this Go file](common/config/config.go). The TOML configuration uses snake_case naming convention, and names automatically map to corresponding struct field names.\n\n## Technical Architecture\n\u003cdiv align=center\u003e\n  \u003cimg src=\"docs/csghub_server-arch.png\" alt=\"csghub-server architecture\" width=\"800px\"\u003e\n\u003c/div\u003e\n\n### Extensible and customizable\n\n- Supports different git servers, such as Gitea, GitLab, etc.\n- Supports flexible configuration of the LFS storage system, and you can choose to use local or any third-party cloud storage service that is compatible with the S3 protocol.\n- Enable content moderation on demand, and choose any third-party content moderation service.\n\n## Roadmap\n- [x] Support more Git Servers: Currently supports Gitea, and plans to support mainstream Git repositories in the future.\n- [x] Git LFS: Git LFS supports large files, and supports Git command operations and online download through the Web UI. \n- [x] DataSet online viewer: Data set preview, supports the Top20/TopN loading preview of LFS format data sets. \n- [x] Model/Dataset AutoTag: Supports custom metadata and automatic extraction of model/dataset tags. \n- [x] S3 Protocol Support: Supports S3 (MinIO) storage protocol, providing higher reliability and storage cost-effectiveness.\n- [ ] Model format convert: Conversion of mainstream model formats.\n- [x] Model oneclick deploy: Supports integration with OpenCSG llm-inference, one-click to start model inference.\n\n## License\nWe use the Apache 2.0 license, the content of which is detailed in the `LICENSE` file.\n\n## Contributing\nIf you wish to contribute, please follow the [Contribution Guidelines](docs/en/contributing.md). We are very excited about your contributions!\n\nBefore you begin development, we highly recommend checking out our [Backend Developer Guides](contribute/), which provide helpful information to ensure a smooth development process.\n\n## Acknowledgments\nThis project is based on open source projects such as Gin, DuckDB, minio, and Gitea. We would like to express our sincere gratitude to them for their open source contributions!\n\n### CONTACT WITH US\nIf you meet any problem during usage, you can contact with us by any following way:\n1. initiate an issue in github\n2. join our WeChat group by scaning wechat helper qrcode\n3. join our offical discord channel: [OpenCSG Discord Channel](https://discord.gg/bXnu4C9BkR)\n4. join our slack workspace:[OpenCSG Slack Channel](https://join.slack.com/t/opencsghq/shared_invite/zt-2fmtem7hs-s_RmMeoOIoF1qzslql2q~A)\n\u003cdiv style=\"display:inline-block\"\u003e\n\u003cimg src=\"https://github.com/OpenCSGs/csghub/blob/main/docs/images/wechat-assistant-new.png\" width='200'\u003e\n\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\n\u003cimg src=\"https://github.com/OpenCSGs/csghub/blob/main/docs/images/discord-qrcode.png\" width='200'\u003e\n  \u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\n\u003cimg src=\"https://github.com/OpenCSGs/csghub/blob/main/docs/images/slack-qrcode.png\" width='200'\u003e\n\u003c/div\u003e\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopencsgs%2Fcsghub-server","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopencsgs%2Fcsghub-server","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopencsgs%2Fcsghub-server/lists"}