Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/julienkay/com.doji.diffusers

A Unity package to run pretrained diffusion models with Unity Sentis
https://github.com/julienkay/com.doji.diffusers

ai diffusers diffusion diffusion-models generative-ai image-generation machine-learning sentis stable-diffusion text2image unity

Last synced: 8 days ago
JSON representation

A Unity package to run pretrained diffusion models with Unity Sentis

Host: GitHub
URL: https://github.com/julienkay/com.doji.diffusers
Owner: julienkay
License: mit
Created: 2023-12-24T22:20:28.000Z (about 1 year ago)
Default Branch: master
Last Pushed: 2024-10-11T12:33:56.000Z (4 months ago)
Last Synced: 2025-01-17T21:32:57.498Z (16 days ago)
Topics: ai, diffusers, diffusion, diffusion-models, generative-ai, image-generation, machine-learning, sentis, stable-diffusion, text2image, unity
Language: C#
Homepage:
Size: 2.94 MB
Stars: 56
Watchers: 6
Forks: 8
Open Issues: 0
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE

Awesome Lists containing this project

README

        

  



# Diffusers

A Unity package to run pretrained diffusion models with Unity Sentis

[OpenUPM] · [Documentation (coming soon)] · [Feedback/Questions]

## About

This is essentially a port of Hugging Face’s [diffusers] library.

It is still ***very*** early though, so as of today only a limited number of pipelines and schedulers are supported (see below).

### Installation

   via OpenUPM 

  

  In `Edit -> Project Settings -> Package Manager`, add a new scoped registry:

    Name: Doji

    URL: https://package.openupm.com

    Scope(s): com.doji

 

  In the Package Manager install `com.doji.diffusers` either by name or select it in the list under `Package Manager -> My Registries`

### Roadmap

Some things that might be worked on next are:

- [x] add/fix classifier-free guidance

- [ ] support more models

  - [x] SD 1.5

  - [x] SD 2.1

  - [x] SDXL

  - [x] SD-Turbo

  - [x] SDXL-Turbo

  - [ ] LoRA models

- [ ] more scheduler implementations

  - [x] PNDM

  - [x] DDIM

  - [x] EulerDiscrete

  - [x] EulerAncestralDiscrete

  - [ ] LCM

  - [ ] DDPM

  - [ ] KDPM2Discrete

  - [ ] KDPM2AncestralDiscrete

- [ ] more pipeline/model types

  - [x] txt2img

  - [x] img2img,

  - [ ] inpaint,

  - [ ] upscale,

  - [ ] depth2img

  - [ ] marigold

- [x] async pipeline methods (sliced inference)

- [ ] support multiple images per prompt

- [ ] write some documentation

### Dependencies

- [com.doji.transformers]

- [com.doji.pngcs]

[OpenUPM]: https://openupm.com/packages/com.doji.diffusers

[Documentation (coming soon)]: https://github.com/julienkay/com.doji.diffusers

[Feedback/Questions]: https://discussions.unity.com/t/stable-diffusion-diffusers-transformers-package/332701?u=julienkay

[diffusers]: https://github.com/huggingface/diffusers

[com.doji.transformers]: https://github.com/julienkay/com.doji.transformers

[com.doji.pngcs]: https://github.com/julienkay/com.doji.pngcs