https://github.com/microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
https://github.com/microsoft/DeepSpeed
billion-parameters compression data-parallelism deep-learning gpu inference machine-learning mixture-of-experts model-parallelism pipeline-parallelism pytorch trillion-parameters zero
Last synced: about 1 month ago
JSON representation
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- Host: GitHub
- URL: https://github.com/microsoft/DeepSpeed
- Owner: deepspeedai
- License: apache-2.0
- Created: 2020-01-23T18:35:18.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2025-03-31T23:00:03.000Z (about 1 month ago)
- Last Synced: 2025-03-31T23:04:23.914Z (about 1 month ago)
- Topics: billion-parameters, compression, data-parallelism, deep-learning, gpu, inference, machine-learning, mixture-of-experts, model-parallelism, pipeline-parallelism, pytorch, trillion-parameters, zero
- Language: Python
- Homepage: https://www.deepspeed.ai/
- Size: 215 MB
- Stars: 37,696
- Watchers: 348
- Forks: 4,324
- Open Issues: 1,133
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Governance: GOVERNANCE.md
Awesome Lists containing this project
- awesome-starts - microsoft/DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective. (Python)
- awesome-mlops - DeepSpeed - Deep learning optimization library that makes distributed training easy, efficient, and effective. (Optimization Tools)
- awesome-local-ai - DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. (Training)
- Awesome_Multimodel_LLM - DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. (LLM Training Frameworks)
- awesome-open-gpt - DeepSpeed Chat🔥
- awesome-llmops - DeepSpeed -  - A deep learning optimization library that makes distributed training and inference easy, efficient, and effective. (Tools (GitHub) / LLMOps vs MLOps)
- awesome-mlvid - DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. (MLVU Frameworks / Weakly-supervised learning)
- awesome-python-machine-learning-resources - GitHub - 48% open · ⏱️ 25.08.2022): (分布式机器学习)
- awesome-mojo - DeepSpeed
- Awesome-ChatGPT - DeepSpeed Chat🔥
- awesome-llmops - DeepSpeed - square) | (Training / Frameworks for Training)
- AiTreasureBox - microsoft/DeepSpeed - 05-06_38226_17](https://img.shields.io/github/stars/microsoft/DeepSpeed.svg) |A deep learning optimization library that makes distributed training and inference easy, efficient, and effective| (Repos)
- awesome-huggingface - Deepspeed - Deepspeed-ZeRO - scales any model size with zero to no changes to the model. [Integrated with HF Trainer](https://huggingface.co/docs/transformers/master/main_classes/deepspeed). (🌗 Model Scalability)
- awesome-list - DeepSpeed - An easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference. (Deep Learning Framework / Deployment & Distribution)
- awesome-llm - DeepSpeed - 一款深度学习优化库，旨在简化分布式训练和推理，提高效率和效果。 (LLM训练框架 / LLM 评估工具)
- awesome-gpt - DeepSpeed - DeepSpeed empowers ChatGPT-like model training with a single click, offering 15x speedup over SOTA RLHF systems with unprecedented cost reduction at all scales. (Projects and Tools / LLM (Large Language Model))
- awesome-ai-papers - [DeepSpeed - us/research/blog/zero-deepspeed-new-system-optimizations-enable-training-models-with-over-100-billion-parameters/)\] (NLP / 3. Pretraining)