Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/mdbecker/dalle2_outpaint

Scripts/tools for dalle2 outpainting
https://github.com/mdbecker/dalle2_outpaint

artificial-intelligence dalle dalle2 deep-learning generative-art image-generation openai text-to-image

Last synced: about 2 months ago
JSON representation

Scripts/tools for dalle2 outpainting

Host: GitHub
URL: https://github.com/mdbecker/dalle2_outpaint
Owner: mdbecker
License: mit
Created: 2022-07-05T18:10:17.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2022-07-20T05:06:02.000Z (over 2 years ago)
Last Synced: 2023-03-12T08:28:49.099Z (almost 2 years ago)
Topics: artificial-intelligence, dalle, dalle2, deep-learning, generative-art, image-generation, openai, text-to-image
Language: Jupyter Notebook
Homepage:
Size: 20.1 MB
Stars: 56
Watchers: 4
Forks: 6
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

# dalle2_outpaint
Scripts/tools for dalle2 outpainting

## outpaint.sh
### Instructions
This shell script, which uses imagemagick, can be used for 1 (1912x1912) or 2 (2868x2868) layers of square outpainting each step of the process (see illustration below) involves the following steps:
1. Cropping out the region that needs to be outfilled
2. (outside script) Upload image to OpenAI for outfill. Choose your favorite result.
3. (outside script) View source of html to download the webp version of the image without the OpenAI watermark in the corner
4. Add the new outfilled image to the collage
5. Repeat until complete

Each step of the script uses filename that correspond to the section in the illustration below. So for example:
* 2.png is the file you will upload to OpenAI in step 2 above
* 2.webp is the file you will download from OpenAI in step 3
* o2.png is the collage with 2.webp added

For now the user has to run these commands manually in an iterative fashion since there are steps that need to be run by the human and there is no api access to allow for automation at this time. In the future this could potentially become a semi-automated webapp.

### Illustration
![Illustration of outpainting steps](outpaint_grid.png)

### Output
There will be 2 main output files of the process:
* stage1.png (this includes the inner square of 1-4)
* final.png (this includes the full outpainting of 1-13)

### Example output

#### Original image
![original](og.jpg)

#### After step 5
![after step 5](stage1.jpg)

#### Final image
![final](final.jpg)

## Dalle2 zoom outpainting.ipynb
### Instructions
[This jupyter notebook](Dalle2%20zoom%20outpainting.ipynb) can be used to generate animated zoom outpainting.
Detailed instructions are included within.

To build and start a docker container that includes all the dependencies run

docker-compose up --build notebook

### Illustration
![Illustration of zoom outpainting results](outpaint.gif)

See mp4 version of the results [here](https://youtube.com/shorts/AkGObHWOT50?feature=share).