https://github.com/OpenCSGs/csghub
CSGHub is an open-source large model platform just like on-premise version of Hugging Face. You can easily manage models and datasets, deploy model applications and setup model finetune or inference jobs with user interface. CSGHub also provides Python SDK with full compatibility of hf sdk. Join us together to build a safer and more open platform⭐️
https://github.com/OpenCSGs/csghub
ai datasets huggingface llm management-system models platform
Last synced: 5 months ago
JSON representation
CSGHub is an open-source large model platform just like on-premise version of Hugging Face. You can easily manage models and datasets, deploy model applications and setup model finetune or inference jobs with user interface. CSGHub also provides Python SDK with full compatibility of hf sdk. Join us together to build a safer and more open platform⭐️
- Host: GitHub
- URL: https://github.com/OpenCSGs/csghub
- Owner: OpenCSGs
- License: apache-2.0
- Created: 2024-01-12T09:44:48.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-11-23T09:42:55.000Z (over 1 year ago)
- Last Synced: 2024-11-24T21:02:53.162Z (over 1 year ago)
- Topics: ai, datasets, huggingface, llm, management-system, models, platform
- Language: Vue
- Homepage: https://opencsg.com
- Size: 48.7 MB
- Stars: 3,040
- Watchers: 318
- Forks: 468
- Open Issues: 52
-
Metadata Files:
- Readme: README.md
- Contributing: docs/CONTRIBUTING_en.md
- License: LICENSE
- Roadmap: docs/roadmap.md
Awesome Lists containing this project
- StarryDivineSky - OpenCSGs/csghub
README
[](https://github.com/OpenCSGs/csghub/actions/workflows/unit_tests.yml)
[](./docs/images/wechat-assistant-new.png)
[](https://join.slack.com/t/opencsghq/shared_invite/zt-2fmtem7hs-s_RmMeoOIoF1qzslql2q~A)
[](https://discord.gg/bXnu4C9BkR)
[](https://gurubase.io/g/csghub)
**[简体中文](README_zh.md) ∙ [日本語](README_jp.md) ∙ [한국어](README_kr.md) ∙ [Español](README_es.md)**
## CSGHub
CSGHub is an open-source platform designed for managing Large Language Models (LLM) assets, offering an efficient way to handle the entire LLM and their assets such as datasets, spaces and codes etc. It allows users to upload, download, store, verify, and distribute LLM assets like DeepSeek,Llama etc.via a web interface, `git` command line, a natural language Chatbot, or [CSGHub SDK](https://github.com/OpenCSGs/csghub-sdk).
Additionally, CSGHub features microservice submodules and standardized OpenAPIs for seamless integration with existing systems. It aims to provide a user-friendly management platform specifically for LLM, which can be deployed On-Premise for secure, offline operation. Essentially, CSGHub serves as a private, on-premise version of Huggingface.
### Key Features
- Unified LLMs Management
- Extensible Development Framework
- Advanced Model Capabilities and Optimization
- Space and Asset Management Assistant (Copilot)
- Multi-Source Data Synchronization and Recommendation
- Enterprise-Level Security and Access Control
- On-Premises Deployment Solutions
- E2E Data Processing and Intelligent Annotation System
- Resilient High-Availability Architecture
For further information, please see the [detailed introduction](./docs/detailed_intro_en.md) of CSGHub.
### Demo Video
To help users get up to speed with CSGHub, we have created a demo video that highlights its key features and how it works. You can watch it below or on [YouTube](https://www.youtube.com/watch?v=6LwGQ07qBxU)/[Bilibili](https://www.bilibili.com/video/BV1ynmxY3EXz/).
### Quick Start
- For those looking to quickly explore, experiment with CSGHub's free SaaS version on the [OpenCSG website](https://opencsg.com). Refer to this [brief quick start guide](./docs/csghub_saas_en.md) to handle LLMs/datasets and deploy LLM applications with CSGHub SaaS interface.
- **For users seeking further practice:** Please refer to the [CSGHub official documentation](https://opencsg.com/docs/csghub/101/introduction). The documentation currently provides installation methods using [Docker Compose](https://opencsg.com/docs/csghub/101/install/install_csghub_by_docker) and [Helm Chart](https://opencsg.com/docs/csghub/101/install/install_csghub_by_helm).
_For more information and advanced tutorials, please refer to the [OpenCSG Documentation Center](https://opencsg.com/docs/intro)._
### Quick Try
[](https://market.aliyun.com/products/56014009/cmgj00068499.html?source=5176.29345612&userCode=swc743za)
### Roadmap
Discover the [roadmap](./docs/roadmap_en.md) outlining CSGHub's future direction.
### Release Notes
Refer to [release notes](./docs/release_notes.md) for information on feature improvements.
### Meetings & Contributing
We warmly invite you to explore the [OpenCSG Community](https://github.com/OpenCSGs/community), where you'll find comprehensive guides on becoming a vital part of the project.
- The process for joining [community meetings](https://github.com/OpenCSGs/community?tab=readme-ov-file#community-meeting), where you can engage with fellow members and share your ideas.
- Refer to the [contribution guide](https://github.com/OpenCSGs/community/blob/main/guidelines/CONTRIBUTING_en.md) for strategies on how to contribute to the project.
- [Contact us](https://github.com/OpenCSGs/community?tab=readme-ov-file#questions-and-issues) for any questions or issues, ensuring you're always supported throughout your journey with OpenCSG.
- Refer to the [development guide](./docs/setup_en.md) for instructions on setting up the development environment.