An open API service indexing awesome lists of open source software.

https://github.com/miteshgupta07/sketchgen

SketchGen is an Image-to-Image Translation project that generates realistic images from hand-drawn sketches and descriptive prompts. Built using a pre-trained Stable Diffusion model, it combines the structure of sketches with the creativity of textual guidance to create stunning visuals.
https://github.com/miteshgupta07/sketchgen

image-generation stable-diffusion streamlit text-to-image

Last synced: about 1 month ago
JSON representation

SketchGen is an Image-to-Image Translation project that generates realistic images from hand-drawn sketches and descriptive prompts. Built using a pre-trained Stable Diffusion model, it combines the structure of sketches with the creativity of textual guidance to create stunning visuals.

Awesome Lists containing this project

README

        

# SketchGen: Transform Your Imagination into Images✨

**SketchGen** is an innovative tool that allows users to generate realistic images from text descriptions or sketches. Powered by the **Stable Diffusion 3.5 model**, it combines cutting-edge AI with creative freedom to produce stunning visuals from user inputs.

## Features πŸš€

- **Text-to-Image Generation**: Enter a text prompt and let the AI create images based on your imagination. πŸ“βž‘οΈπŸ–ΌοΈ
- **Sketch-to-Image Generation**: (Coming soon...) Convert your rough sketches into realistic images. βœοΈβž‘οΈπŸ–ΌοΈ
- **Customization Options**:
- **Style Selection**: Choose from **Default**, **Photorealistic**, or **Anime** styles. 🎨
- **Image Resolution**: Select from **512x512**, **768x768**, or **1024x1024** resolution. πŸ–₯️
- **Fine-tune with** **Inference Steps** and **Guidance Scale** for better control over the generated image. βš™οΈ

## Demo πŸ’»

You can try out the application on [Streamlit](https://sketchgen.streamlit.app/).

## Example Generated Images πŸ“Έ

Here are some images generated using my SketchGen app:




## Installation πŸ› οΈ

1. Clone the repository:
```bash
git clone https://github.com/miteshgupta07/SketchGen.git
```
2. Navigate into the project directory:
```bash
cd sketchgen
```
3. Install the dependencies:
```bash
pip install -r requirements.txt
```

5. Run the Streamlit app:
```bash
streamlit run app.py
```

## Usage πŸ’‘

- Open the app and select between "Generate with Prompt" or "Generate with Image".
- For text generation: Enter a prompt (e.g., "A cat on Mars") and hit Generate. πŸ“βž‘οΈπŸ–ΌοΈ
- For image generation: Upload a sketch and generate a detailed image based on your sketch. βœοΈβž‘οΈπŸ–ΌοΈ
- Customize your image with options such as style, resolution, and AI parameters. πŸŽ¨πŸ”§
- Download the generated image by clicking the Download button. ⬇️

## Technologies Used πŸ› οΈ

- Python 🐍
- Streamlit: Framework for building the interactive web app. πŸ’»
- Hugging Face: Hosted the Stable Diffusion 3.5 model. πŸ€—
- PIL: Image manipulation. πŸ–ΌοΈ
- diffusers: For handling the image generation using Stable Diffusion. πŸ’¨

## Future Improvements 🚧

- **Sketch-to-Image**: Convert sketches into detailed images (Coming soon). βœοΈβž‘οΈπŸ–ΌοΈ
- **More Image Styles**: Additional AI models for unique image styles. 🎨

## Acknowledgment πŸ™

We would like to express our gratitude to the following:

- **Hugging Face**: For providing access to the Stable Diffusion 3.5 model. πŸ€—
- **Streamlit**: For offering a fantastic framework to build and deploy the web app. πŸ’»
- **Python and Libraries**: For being the backbone of our project with libraries like PIL and diffusers. 🐍
- **The Open-Source Community**: For providing inspiration and valuable resources that helped shape this project. 🌍

Thank you to everyone who contributed to this project, whether directly or indirectly! πŸ™Œ

## Contributing 🀝

Feel free to fork the project and submit pull requests. If you have any feature requests or bugs to report, please open an issue. πŸ› οΈ

## License πŸ“œ

This project is licensed under the MIT License - see the LICENSE [file](https://github.com/miteshgupta07/SketchGen/blob/main/LICENSE) for details. 🏷️