Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/arig23498/makeanime

Last synced: 13 days ago
JSON representation

Host: GitHub
URL: https://github.com/arig23498/makeanime
Owner: ariG23498
Created: 2024-09-04T10:29:04.000Z (2 months ago)
Default Branch: main
Last Pushed: 2024-09-04T14:28:45.000Z (2 months ago)
Last Synced: 2024-10-04T19:46:30.323Z (about 1 month ago)
Language: Python
Size: 1.38 MB
Stars: 7
Watchers: 1
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: .github/README.md

Awesome Lists containing this project

README

# makeanime

[![Generic badge](https://img.shields.io/badge/🤗-Open%20In%20Spaces-blue.svg)](https://huggingface.co/spaces/ariG23498/makeanime) [![Generic badge](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/gist/ariG23498/645f0f276612a60fb32ad2b387e0d301/scratchpad.ipynb)

![image](output.png)

`makeanime` is a CLI tool for generating anime-style images from a face image and a text prompt using Stable Diffusion XL and an IP-Adapter for applying anime-like styles.

## Features

- Generates anime-style images by blending a face image with anime style references.
- Leverages Stable Diffusion XL for high-quality text-to-image generation.
- Uses an IP-Adapter to combine face and anime-style attributes.
- Supports custom prompt input for greater flexibility.
- Allows control over the influence of face and style using weights.

## Installation

```shell
$ pip install -Uq git+https://github.com/ariG23498/makeanime
```

## Usage

You can use the `makeanime` CLI to generate images. The tool accepts the following arguments:

- `image`: URL of the face image to be stylized.
- `prompt`: Text prompt to guide the image generation.
- `style_weight`: (Optional) A float that controls how much the anime style influences the image. Default is `0.5`.
- `face_weight`: (Optional) A float that controls how much the face image influences the result. Default is `0.5`.

### Example Command

```bash
$ makeanime \
--image "https://example.com/your-face-image.jpg" \
--prompt "a man" \
--style_weight 0.7 \
--face_weight 0.3
```

This command will generate an anime-style image based on the provided face image URL and prompt. The resulting image will be saved as `output.png` in the working directory.

## File Structure

- `makeanime/app.py`: Contains the main logic for generating anime-style images.
- `makeanime/__main__.py`: Sets up the CLI using Python's `Fire` library.

## How it Works

- **CLIPVisionModelWithProjection** is used to encode the input face image.
- **Stable Diffusion XL** is used for generating images based on the text prompt and the encoded face.
- An **IP-Adapter** is loaded to modulate the anime style and face weights.
- Images are generated at 1024x1024 resolution, and the output is a grid of the original face image and the generated anime image.

## Requirements

- Python 3.10+
- PyTorch
- Diffusers
- Transformers
- Fire

## References

The code is taken from the [Hugging Face IP-Adapter Guide](https://huggingface.co/docs/diffusers/main/en/using-diffusers/ip_adapter)