https://github.com/bentoml/diffusers-examples
API serving for your diffusers models
https://github.com/bentoml/diffusers-examples
bentoml diffusers model-deployment model-serving
Last synced: 2 months ago
JSON representation
API serving for your diffusers models
- Host: GitHub
- URL: https://github.com/bentoml/diffusers-examples
- Owner: bentoml
- Created: 2023-02-11T00:44:04.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-19T04:23:21.000Z (over 1 year ago)
- Last Synced: 2025-07-15T07:12:52.970Z (3 months ago)
- Topics: bentoml, diffusers, model-deployment, model-serving
- Language: Python
- Homepage: https://bentoml.com
- Size: 57.6 KB
- Stars: 11
- Watchers: 3
- Forks: 4
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# `bentoml.diffusers` examples
This repository hosts supplementary materials of the article [Creating Stable Diffusion 2.0 Service With BentoML And Diffusers](https://modelserving.com/blog/creating-stable-diffusion-20-service-with-bentoml-and-diffusers).
Prompt: Kawaii low poly grey American shorthair cat character, 3D isometric render, ambient occlusion, unity engine, lively color
Negative prompt: low-res, blurry, mutation, deformed
Currently we have three examples:
- `sd2/` contains a service with `txt2img/` endpoint utilizing [`stabilityai/stable-diffusion-2`](https://huggingface.co/stabilityai/stable-diffusion-2)
- `sd2_mega/` contains a service with `txt2img/` and `img2img/` endpoints utilizing [`stabilityai/stable-diffusion-2`](https://huggingface.co/stabilityai/stable-diffusion-2) and diffusers' [custom pipline](https://github.com/huggingface/diffusers/tree/main/examples/community)
- `anything_v3/` contains a service with `txt2img/` endpoint utilizing [`Linaqruf/anything-v3.0`](https://huggingface.co/Linaqruf/anything-v3.0)
## Prepare environment
We recommend running these services on a machine equipped with a Nvidia graphic card and CUDA Toolkit installed.
First let's prepare a virtual environment and install requried depedencies
```
python3 -m venv venv/ && source venv/bin/activate
pip install -U -r requirements.txt
```
## Import models
You may need to authorize your huggingface account to download models, to do that, run:
```
pip install -U huggingface_hub
huggingface-cli login
```
then:
- to import [`stabilityai/stable-diffusion-2`](https://huggingface.co/stabilityai/stable-diffusion-2), run `python3 import_model.py`
- to import [`Linaqruf/anything-v3.0`](https://huggingface.co/Linaqruf/anything-v3.0), run `python3 import_anything_v3`
## Start the service and go on
After the model is imported, you can go into `sd2/`, `sd2_mega` or `anything_v3` and follow the readme inside the folder to start the service and make a docker image for each service