Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kvablack/LLaVA-server
https://github.com/kvablack/LLaVA-server
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/kvablack/LLaVA-server
- Owner: kvablack
- License: mit
- Created: 2023-04-30T01:21:30.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-10-20T18:09:03.000Z (over 1 year ago)
- Last Synced: 2024-08-01T13:28:35.650Z (7 months ago)
- Language: Python
- Size: 373 KB
- Stars: 18
- Watchers: 1
- Forks: 5
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LLaVA-server
Serves LLaVA inference using an HTTP server. Supports batched inference and caches the embeddings for each image in order to produce multiple responses per image more efficiently.
## Usage
```bash
gunicorn "app:create_app()"
```
You must modify `gunicorn.conf.py` to change the number of GPUs.