Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/MachineLearningSystem/FlexGen
Running large language models like OPT-175B/GPT-3 on a single GPU. Up to 100x faster than other offloading systems.
https://github.com/MachineLearningSystem/FlexGen
Last synced: about 1 month ago
JSON representation
Running large language models like OPT-175B/GPT-3 on a single GPU. Up to 100x faster than other offloading systems.
- Host: GitHub
- URL: https://github.com/MachineLearningSystem/FlexGen
- Owner: MachineLearningSystem
- License: apache-2.0
- Fork: true (FMInference/FlexGen)
- Created: 2023-02-21T00:06:47.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-03-14T09:34:41.000Z (almost 2 years ago)
- Last Synced: 2024-08-02T19:34:13.282Z (5 months ago)
- Homepage:
- Size: 35.1 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-AI-system - High-throughput Generative Inference of Large Language Modelwith a Single GPU ICML'23