https://github.com/microsoft/deepspeed-mii

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
https://github.com/microsoft/deepspeed-mii

deep-learning inference pytorch

Last synced: about 13 hours ago
JSON representation

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

• Host: GitHub
• URL: https://github.com/microsoft/deepspeed-mii
• Owner: microsoft
• License: apache-2.0
• Created: 2022-03-23T22:30:45.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-09-11T14:49:48.000Z (14 days ago)
• Last Synced: 2024-09-21T07:02:37.185Z (4 days ago)
• Topics: deep-learning, inference, pytorch
• Language: Python
• Homepage:
• Size: 6.43 MB
• Stars: 1,846
• Watchers: 41
• Forks: 173
• Open Issues: 193
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: CODEOWNERS
  • Security: SECURITY.md
  • Support: SUPPORT.md

Awesome Lists containing this project