https://github.com/raihan4520/stable-diffusion
This repository demonstrates how to use Hugging Face's pre-trained models for Text-to-Image and Image-to-Text generation using Stable Diffusion.
https://github.com/raihan4520/stable-diffusion
computer-vision deep-learning generative-ai hugging-face image-captioning image-to-text machine-learning stable-diffusion text-to-image
Last synced: 8 months ago
JSON representation
This repository demonstrates how to use Hugging Face's pre-trained models for Text-to-Image and Image-to-Text generation using Stable Diffusion.
- Host: GitHub
- URL: https://github.com/raihan4520/stable-diffusion
- Owner: Raihan4520
- Created: 2024-10-03T16:04:43.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-03T18:46:14.000Z (about 1 year ago)
- Last Synced: 2025-01-13T14:24:08.124Z (9 months ago)
- Topics: computer-vision, deep-learning, generative-ai, hugging-face, image-captioning, image-to-text, machine-learning, stable-diffusion, text-to-image
- Language: Jupyter Notebook
- Homepage: https://huggingface.co/models
- Size: 30.8 MB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Stable Diffusion: Text-to-Image and Image-to-Text Generation
This repository demonstrates the use of pre-trained models from Hugging Face for both **Text-to-Image** and **Image-to-Text** generation tasks. Using Stable Diffusion for Text-to-Image generation, you can input descriptive text prompts to create high-quality images. Conversely, the Image-to-Text pipeline generates captions for images using state-of-the-art deep learning models.
The notebook is divided into two parts:
- **Text-to-Image Generation**: Generate images from textual descriptions using the Stable Diffusion model.
- **Image-to-Text Generation**: Generate textual descriptions from images using image captioning models.
The project provides an interactive experience where you can experiment with both models and customize prompts or images. Feel free to explore and play around with the notebook to create and caption your own images!
## How to Use
1. Clone the repository:
```bash
git clone https://github.com/Raihan4520/Stable-Diffusion.git
```
2. Install the necessary Python libraries:
```bash
pip install diffusers transformers torch accelerate pillow datasets huggingface_hub torchvision
```
3. Open the Jupyter Notebook `Text2Image_Image2Text_StableDiffusion.ipynb` in your preferred environment (e.g., Jupyter Notebook, Google Colab).
4. Follow the instructions inside the notebook to:
- Generate images from text prompts.
- Generate captions for images.
## Acknowledgements
This project uses the Stable Diffusion model and Hugging Face's API for both Text-to-Image and Image-to-Text tasks. Special thanks to the Hugging Face community for providing access to these powerful models.
## Contact
If you have any questions or suggestions, feel free to reach out through the repository's issues or contact me directly.