{"id":13456162,"url":"https://github.com/IrisRainbowNeko/DreamArtist-stable-diffusion","last_synced_at":"2025-03-24T09:31:34.937Z","repository":{"id":62147042,"uuid":"551320265","full_name":"IrisRainbowNeko/DreamArtist-stable-diffusion","owner":"IrisRainbowNeko","description":"stable diffusion webui with contrastive prompt tuning","archived":false,"fork":false,"pushed_at":"2022-11-23T02:22:28.000Z","size":300817,"stargazers_count":871,"open_issues_count":17,"forks_count":54,"subscribers_count":13,"default_branch":"master","last_synced_at":"2024-05-19T00:27:16.205Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/IrisRainbowNeko.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null}},"created_at":"2022-10-14T07:25:41.000Z","updated_at":"2024-05-16T04:36:13.000Z","dependencies_parsed_at":"2022-10-27T08:45:31.959Z","dependency_job_id":null,"html_url":"https://github.com/IrisRainbowNeko/DreamArtist-stable-diffusion","commit_stats":null,"previous_names":["irisrainbowneko/dreamartist-stable-diffusion"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IrisRainbowNeko%2FDreamArtist-stable-diffusion","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IrisRainbowNeko%2FDreamArtist-stable-diffusion/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IrisRainbowNeko%2FDreamArtist-stable-diffusion/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IrisRainbowNeko%2FDreamArtist-stable-diffusion/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/IrisRainbowNeko","download_url":"https://codeload.github.com/IrisRainbowNeko/DreamArtist-stable-diffusion/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245243300,"owners_count":20583602,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T08:01:17.088Z","updated_at":"2025-03-24T09:31:29.927Z","avatar_url":"https://github.com/IrisRainbowNeko.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# DreamArtist\n\nPaper: [![arXiv](https://img.shields.io/badge/arXiv-2211.11337-b31b1b.svg)](https://arxiv.org/abs/2211.11337)\n\nThis repo is the official PyTorch implementation of ***\"DreamArtist: Towards Controllable One-Shot Text-to-Image Generation via Contrastive Prompt-Tuning\"*** \nwith [Stable-Diffusion-webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui).\n\n***Stable-Diffusion-webui Extension Version :*** [DreamArtist-sd-webui-extension](https://github.com/7eu7d7/DreamArtist-sd-webui-extension)\n\nEveryone is an artist. Rome wasn't built in a day, but your artist dreams can be!\n\nWith just ***one*** training image DreamArtist learns the content and style in it, generating diverse high-quality images with high controllability.\nEmbeddings of DreamArtist can be easily combined with additional descriptions, as well as two learned embeddings.\n\n![](imgs/exp1.jpg)\n![](imgs/exp_text1.jpg)\n![](imgs/exp_text2.jpg)\n![](imgs/exp_text3.jpg)\n\n# Setup and Running\nClone this repo.\n```bash\ngit clone https://github.com/7eu7d7/DreamArtist-stable-diffusion\n```\n\nFollowing the [instructions of webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui#automatic-installation-on-windows) to install.\n\n## Training and Usage\n\nFirst create the positive and negative embeddings in ```DreamArtist Create Embedding``` Tab.\n![](imgs/create.jpg)\n\n### Preview Setting\nAfter that, the ```names``` of the positive and negative embedding (```{name}``` and ```{name}-neg```) should be filled into the\n```txt2img Tab``` with some common descriptions. This will ensure a correct preview image.\n![](https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/preview.png)\n\n### Train\nThen, select positive embedding and set the parameters and image folder path in the ```Train``` Tab to start training.\nThe corresponding negative embedding is loaded automatically.\nIf your VRAM is low or you want save time, you can uncheck the ```reconstruction```.\n\n[Recommended parameters](https://github.com/7eu7d7/DreamArtist-sd-webui-extension#pre-trained-embeddings)\n\n***better to train without filewords***\n![](imgs/train.jpg)\n\nRemember to check the option below, otherwise the preview is wrong.\n![](https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/fromtxt.png)\n\n### Inference\nFill the trained positive and negative embedding into txt2img to generate with DreamArtist prompt.\n![](https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/gen.jpg)\n\n## Tested models (need ema version):\n+ Stable Diffusion v1.5\n+ animefull-latest\n+ Anything v3.0\n\nEmbeddings can be transferred between different models of the same dataset.\n\n## Pre-trained embeddings:\n\n[Download](https://github.com/7eu7d7/DreamArtist-stable-diffusion/releases/tag/embeddings_v2)\n\n| Name       | Model            | Image                                                              | embedding length \u003cbr\u003e (Positive, Negative) | iter  | lr     | cfg scale |\n|------------|------------------|--------------------------------------------------------------------|--------------------------------------------|-------|--------|-----------|\n| ani-nahida | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/nahida.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e | 3, 6                                       | 8000  | 0.0025 | 3         |\n| ani-cocomi | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/cocomi.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e | 3, 6                                       | 8000  | 0.0025 | 3         |\n| ani-gura   | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/gura.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e   | 3, 6                                       | 12000 | 0.0025 | 3         |\n| ani-g      | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/g.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e      | 3, 10                                      | 1500  | 0.003  | 5         |\n| asty-bk    | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/bk.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e     | 3, 6                                       | 5000  | 0.003  | 3         |\n| asty-gc    | animefull-latest | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/gc.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e     | 3, 10                                      | 1000  | 0.005  | 5         |\n| real-dog   | sd v1.4          | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/dog.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e    | 3, 3                                       | 1000  | 0.005  | 5         |\n| real-sship | sd v1.4          | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/sship.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e  | 3, 3                                       | 3000  | 0.003  | 5         |\n| sty-cyber  | sd v1.4          | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/cyber.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e  | 3, 5                                       | 15000 | 0.0025 | 5         |\n| sty-shuimo | sd v1.4          | \u003cimg src=\"https://github.com/7eu7d7/DreamArtist-sd-webui-extension/blob/master/imgs/pre/shuimo.jpg\" width = \"80\" height = \"80\" alt=\"\"/\u003e | 3, 5                                       | 15000 | 0.0025 | 5         |\n\n\n# Style Clone\n![](imgs/exp_style.jpg)\n\n# Prompt Compositions\n![](imgs/exp_comp.jpg)\n\n# Comparison on One-Shot Learning\n![](imgs/cmp.jpg)\n\n# Other Results\n![](imgs/cnx.jpg)\n![](imgs/cnx2.jpg)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FIrisRainbowNeko%2FDreamArtist-stable-diffusion","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FIrisRainbowNeko%2FDreamArtist-stable-diffusion","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FIrisRainbowNeko%2FDreamArtist-stable-diffusion/lists"}