Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/nagababumo/efficiently-serving-llms
https://github.com/nagababumo/efficiently-serving-llms
batching continuous-batching lora lorax low-rank-adaptation multi-lora quantization
Last synced: about 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/nagababumo/efficiently-serving-llms
- Owner: nagababumo
- License: gpl-3.0
- Created: 2024-06-19T09:28:45.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-06-19T17:11:35.000Z (7 months ago)
- Last Synced: 2024-06-20T19:27:00.367Z (7 months ago)
- Topics: batching, continuous-batching, lora, lorax, low-rank-adaptation, multi-lora, quantization
- Language: Jupyter Notebook
- Homepage:
- Size: 221 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Efficiently-Serving-LLMs