https://github.com/sitamgithub-msit/sana-litserve
https://github.com/sitamgithub-msit/sana-litserve
Last synced: 11 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/sitamgithub-msit/sana-litserve
- Owner: sitamgithub-MSIT
- License: apache-2.0
- Created: 2025-02-22T21:11:06.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2025-02-22T21:25:25.000Z (11 months ago)
- Last Synced: 2025-02-22T22:24:01.934Z (11 months ago)
- Language: Python
- Size: 292 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Sana LitServe
[](https://lightning.ai/sitammeur/studios/deploy-sana-text-to-image-generation-model)
[Sana](https://huggingface.co/collections/Efficient-Large-Model/sana-673efba2a57ed99843f11f9e), an efficient text-to-image model from NVIDIA, generates high-resolution images quickly on a laptop GPU. While limited in complex scene generation, its capabilities improve with detailed prompts. This project shows how to create a self-hosted, private API that deploys [text-to-image generation model](https://huggingface.co/Efficient-Large-Model/Sana_1600M_1024px_BF16_diffusers) with LitServe, an easy-to-use, flexible serving engine for AI models built on FastAPI.
## Project Structure
The project is structured as follows:
- `server.py`: The file containing the main code for the web server.
- `client.py`: The file containing the code for client-side requests.
- `LICENSE`: The license file for the project.
- `README.md`: The README file that contains information about the project.
- `assets`: The folder containing screenshots for working on the application.
- `.gitignore`: The file containing the list of files and directories to be ignored by Git.
## Tech Stack
- Python (for the programming language)
- PyTorch (for the deep learning framework)
- Hugging Face Diffusers Library (for the model)
- LitServe (for the serving engine)
## Getting Started
To get started with this project, follow the steps below:
1. Run the server: `python server.py`
2. Upon running the server successfully, you will see uvicorn running on port 8000.
3. Open a new terminal window.
4. Run the client: `python client.py`
Now, you can see the model's output based on the input request. The model will generate image output with the given prompt.
## Usage
The project can be used to serve the Sana text-to-image generation model using LitServe. It allows you to input a prompt and generate an image based on it, showcasing potential use cases in prototype, illustration, design, educational content generation, etc.
## Contributing
Contributions are welcome! If you would like to contribute to this project, please raise an issue to discuss the changes you want to make. Once the changes are approved, you can create a pull request.
## License
This project is licensed under the [Apache-2.0 License](LICENSE).
## Contact
If you have any questions or suggestions about the project, please contact me on my GitHub profile.
Happy coding! 🚀