{"id":16604759,"url":"https://github.com/dmmaze/sketch2manga","last_synced_at":"2025-08-07T04:38:35.259Z","repository":{"id":227602832,"uuid":"736951970","full_name":"dmMaze/sketch2manga","owner":"dmMaze","description":"Apply screentone to line drawings or colored illustrations with diffusion models.","archived":false,"fork":false,"pushed_at":"2025-03-31T03:01:41.000Z","size":6251,"stargazers_count":40,"open_issues_count":0,"forks_count":10,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-31T04:19:48.383Z","etag":null,"topics":["comfyui","image-processing","manga","screentone","stable-diffusion"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dmMaze.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-29T11:00:40.000Z","updated_at":"2025-03-31T03:01:45.000Z","dependencies_parsed_at":"2025-03-31T04:19:49.602Z","dependency_job_id":"1daf1527-9f4f-4dca-a778-fb5028e42cfa","html_url":"https://github.com/dmMaze/sketch2manga","commit_stats":null,"previous_names":["dmmaze/sketch2manga"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dmMaze/sketch2manga","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmMaze%2Fsketch2manga","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmMaze%2Fsketch2manga/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmMaze%2Fsketch2manga/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmMaze%2Fsketch2manga/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dmMaze","download_url":"https://codeload.github.com/dmMaze/sketch2manga/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dmMaze%2Fsketch2manga/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":269201154,"owners_count":24377447,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-07T02:00:09.698Z","response_time":73,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["comfyui","image-processing","manga","screentone","stable-diffusion"],"created_at":"2024-10-12T00:59:16.768Z","updated_at":"2025-08-07T04:38:35.250Z","avatar_url":"https://github.com/dmMaze.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Sketch2Manga\n\n[![arXiv](https://img.shields.io/badge/arXiv-2403.08266-\u003cCOLOR\u003e)](https://arxiv.org/abs/2403.08266)\n\nApply screentone to line drawings or colored illustrations with diffusion models.\n\n\u003cp float=\"center\"\u003e\n  \u003cimg src=\"https://github.com/dmMaze/sketch2manga/assets/51270320/85098012-68d8-471f-b8ed-0476d856cce5\" /\u003e\n  \u003cbr\u003e\n    \u003cem\u003eSketch2Manga - Drag and drop into ComfyUI to load the workflow \u003c/em\u003e\n  \u003ca href=\"https://twitter.com/ini_pmh/status/715578786830417921/photo/1\"\u003e(Source @ini_pmh)\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp float=\"center\"\u003e\n  \u003cimg src=\"https://github.com/dmMaze/sketch2manga/assets/51270320/ecaf6632-e108-4a8d-9e7e-8882bdb2e620\" /\u003e\n  \u003cbr\u003e\n    \u003cem\u003eIllustration2Manga - Drag and drop into ComfyUI to load the workflow \u003c/em\u003e\n  \u003ca href=\"https://danbooru.donmai.us/posts/5493050\"\u003e(Source @curecu8)\u003c/a\u003e\n\u003c/p\u003e\n\n\n\n\n## Usage\n\n### Preperation\n\n### ComfyUI\n\nDownload a diffusion model for colorization (this demo used [meinapastel](https://civitai.com/models/11866/meinapastel) for ComfyUI) and [control_v11p_sd15_lineart](https://huggingface.co/lllyasviel/ControlNet-v1-1/blob/main/control_v11p_sd15_lineart.pth).  \nDownload the finetuned [vae](https://huggingface.co/dreMaz/sketch2manga/blob/main/vae/mangatone_default.ckpt) and [diffusion model](https://huggingface.co/dreMaz/sketch2manga/blob/main/mangatone.ckpt) for screening.\n\nInstall [ComfyUI](https://github.com/comfyanonymous/ComfyUI).  \nClone this repo to the ComfyUI directory and install dependencies:\n``` bash\ngit clone https://github.com/dmMaze/sketch2manga [ComfyUI Directory]/custom_nodes/sketch2manga\ncd [ComfyUI Directory]/custom_nodes/sketch2manga \npip install -r requirements.txt\n```\nLaunch ComfyUI, drag and drop the figure above to load the workflow.\n\n\n### Gradio Demo\n\nPrepare environment\n```  bash\nconda env create -f conda_env.yaml\npip install git+https://github.com/openai/CLIP.git\n```\n\nDownload a diffusion model for colorization (this demo used [anything-v4.5](https://huggingface.co/ckpt/anything-v4.5-vae-swapped/tree/main) for sd-webui) and [control_v11p_sd15_lineart](https://huggingface.co/lllyasviel/ControlNet-v1-1/blob/main/control_v11p_sd15_lineart.pth).  \nDownload the finetuned [vae](https://huggingface.co/dreMaz/sketch2manga/blob/main/vae/mangatone_default.ckpt) and [diffusion model](https://huggingface.co/dreMaz/sketch2manga/blob/main/mangatone.ckpt) for screening.  \n\nWe're using stable-diffusion-webui @ [bef51aed](https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/bef51aed032c0aaa5cfd80445bc4cf0d85b408b5) and sd-webui-controlnet @ [aa2aa81](https://github.com/Mikubill/sd-webui-controlnet/commit/aa2aa812e86a1f47ef360572888d66027d640f60), other versions might not work. For convient, you can use this [hard fork](https://github.com/dmMaze/stable-diffusion-webui-with-controlnet).  Put models metioned above into corresponding sd-webui directories, and launch webui ```python webui.py --api```.  \nFinally launch the gradio demo:  \n```\npython gradio_demo/launch.py\n```\n\n#### SD-WebUI API\nThere is an example ```webuiapi_demo.ipynb``` showcasing inference using SD-WebUI API, it is a bit outdated though, but the logic applied is the same.\n\n## Comparsion\nOur Illustration to Manga method compared with [Mimic Manga](https://lllyasviel.github.io/MangaFilter/) (considered as SOTA)\n\u003ctable\u003e\n  \u003cthead\u003e\n    \u003ctr\u003e\n      \u003cth align=\"center\" width=\"33%\"\u003eIllustration (Input)\u003c/th\u003e\n      \u003cth align=\"center\" width=\"33%\"\u003eMimic Manga\u003c/th\u003e\n      \u003cth align=\"center\" width=\"33%\"\u003eOurs\u003c/th\u003e\n    \u003c/tr\u003e\n  \u003c/thead\u003e\n  \u003ctbody\u003e\n    \u003ctr\u003e\n      \u003ctd align=\"center\" \u003e\n        \u003ca href=\"https://github.com/dmMaze/sketch2manga/assets/51270320/50977ee7-d1a6-4fa0-a0b3-7cbb22b4b317\"\u003e\n          \u003cimg alt=\"Input\" src=\"https://github.com/dmMaze/sketch2manga/assets/51270320/50977ee7-d1a6-4fa0-a0b3-7cbb22b4b317\" /\u003e\n        \u003c/a\u003e\n      \u003c/td\u003e\n      \u003ctd align=\"center\"\u003e\n        \u003ca href=\"https://github.com/dmMaze/sketch2manga/assets/51270320/75704188-3d2e-4358-8142-f17ecdf06c84\"\u003e\n          \u003cimg alt=\"MimicManga\" src=\"https://github.com/dmMaze/sketch2manga/assets/51270320/75704188-3d2e-4358-8142-f17ecdf06c84\" /\u003e\n        \u003c/a\u003e\n      \u003c/td\u003e\n      \u003ctd align=\"center\" \u003e\n        \u003ca href=\"https://github.com/dmMaze/sketch2manga/assets/51270320/2ad2947d-aaf9-428e-bace-d33a3b9679e3\"\u003e\n          \u003cimg alt=\"Ours\" src=\"https://github.com/dmMaze/sketch2manga/assets/51270320/2ad2947d-aaf9-428e-bace-d33a3b9679e3\" /\u003e\n        \u003c/a\u003e\n      \u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/tbody\u003e\n\u003c/table\u003e\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdmmaze%2Fsketch2manga","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdmmaze%2Fsketch2manga","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdmmaze%2Fsketch2manga/lists"}