Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.
Awesome Lists | Featured Topics | Projects
https://github.com/SerialLain3170/AwesomeAnimeResearch

Papers, repository and other data about anime or manga research. Please let me know if you have information that the list does not include.
https://github.com/SerialLain3170/AwesomeAnimeResearch
List: AwesomeAnimeResearch
anime awesome deep-learning machine-learning
Last synced: about 1 month ago
JSON representation
Papers, repository and other data about anime or manga research. Please let me know if you have information that the list does not include.
Host: GitHub
URL: https://github.com/SerialLain3170/AwesomeAnimeResearch
Owner: SerialLain3170
Created: 2020-04-26T20:24:22.000Z (over 4 years ago)
Default Branch: master
Last Pushed: 2024-04-08T04:12:52.000Z (5 months ago)
Last Synced: 2024-04-09T20:53:50.160Z (5 months ago)
Topics: anime, awesome, deep-learning, machine-learning
Homepage:
Size: 115 KB
Stars: 959
Watchers: 52
Forks: 63
Open Issues: 1
Metadata Files:
- Readme: README.md
Awesome Lists containing this project

ultimate-awesome - AwesomeAnimeResearch - Papers, repository and other data about anime or manga research. Please let me know if you have information that the list does not include. (Other Lists / PowerShell Lists)
README

        # AwesomeAnimeResearch

signal processing or machine learning related to anime or manga

## Papers

Summary of published or preprint papers

### Dataset

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives](https://arxiv.org/pdf/1611.05118.pdf) | CVPR2017 | [Github](https://github.com/miyyer/comics) |

| [Creative Flow+ Dataset](https://openaccess.thecvf.com/content_CVPR_2019/papers/Shugrina_Creative_Flow_Dataset_CVPR_2019_paper.pdf) | CVPR2019 | [HP](https://www.cs.toronto.edu/creativeflow/) |

| [Building a Manga Dataset ”Manga109” with Annotations for Multimedia Applications](https://arxiv.org/pdf/2005.04425.pdf) | IEEE MultiMedia,2020 | [HP](http://www.manga109.org/ja/download_s.html) |

| [DanbooRegion: An Illustration Region Dataset](https://lllyasviel.github.io/DanbooRegion/paper/paper.pdf) | ECCV2020 | [Github](https://github.com/lllyasviel/DanbooRegion) |

| [Unconstrained Text Detection in Manga: a New Dataset and Baseline](https://arxiv.org/pdf/2009.04042.pdf) | ECCVW2020 | [Github](https://github.com/juvian/Manga-Text-Segmentation) |

| [Cartoon Face Recognition: A Benchmark Dataset](https://arxiv.org/pdf/1907.13394.pdf) | ACM MM2020 | [Github](https://github.com/luxiangju-PersonAI/iCartoonFace) |

| [DAF:RE: A CHALLENGING, CROWD-SOURCED, LARGE-SCALE, LONG-TAILED DATASET FOR ANIME CHARACTER RECOGNITION](https://arxiv.org/pdf/2101.08674.pdf) | | [Github](https://github.com/arkel23/animesion) |

| [AnimeCeleb: Large-Scale Animation CelebHeads Dataset for Head Reenactment](https://arxiv.org/pdf/2111.07640.pdf) | ECCV2022 | [Github](https://github.com/kangyeolk/AnimeCeleb) |

| [A Challenging Benchmark of Anime Style Recognition](https://openaccess.thecvf.com/content/CVPR2022W/VDU/papers/Li_A_Challenging_Benchmark_of_Anime_Style_Recognition_CVPRW_2022_paper.pdf) | CVPRW2022 | |

| [COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Texts](https://arxiv.org/pdf/2207.04675.pdf) | ECCV2022 | [Github](https://github.com/ku21fan/COO-Comic-Onomatopoeia) |

| [AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies](https://openreview.net/pdf?id=04OPxj0jGN_) | | [HP](https://lisiyao21.github.io/projects/AnimeRun) |

| [Parsing-Conditioned Anime Translation: A New Dataset and Method](https://dl.acm.org/doi/10.1145/3585002) | ACM TG2023 | [Github](https://github.com/zsl2018/StyleAnime) | 

| [Semi-supervised reference-based sketch extraction using a contrastive learning framework](https://drive.google.com/file/d/1FELTVl73OrQ9Q0uBXN7jLbRStSsF-NgM/view?pli=1) | ACM TG2023 | [Github](https://github.com/Chanuku/4skst) |

| [Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detection](https://arxiv.org/pdf/2306.17469.pdf) |  | [Github](https://github.com/manga109/public-annotations) |

| [Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes](https://openaccess.thecvf.com/content/CVPR2023/papers/Ju_Human-Art_A_Versatile_Human-Centric_Dataset_Bridging_Natural_and_Artificial_Scenes_CVPR_2023_paper.pdf) | CVPR2023 | [Github](https://github.com/IDEA-Research/HumanArt) | 

### Image Generation

| Subcategory | Paper | Conference | Links |

| ---- | ---- | ---- | ---- |

| Generation | [Towards the Automatic Anime Characters Creation with Generative Adversarial Networks](https://arxiv.org/pdf/1708.05509.pdf) | Comiket92 | [HP](https://make.girls.moe/#/) |

| | [Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks](https://arxiv.org/pdf/1809.01890v1.pdf) | ECCVW2018 | [HP](https://dena.com/intl/anime-generation/) |

| | [Generate Novel Image Styles using Weighted Hybrid Generative Adversarial Nets](https://ieeexplore.ieee.org/document/8489080) | IJCNN2018 | |

| | [Towards Diverse Anime Face Generation: Active Label Completion and Style Feature Network](https://diglib.eg.org/bitstream/handle/10.2312/egs20191016/065-068.pdf?sequence=1&isAllowed=y) | EUROGRAPHICS2019 | |

| | [An Adaptive Control Algorithm for Stable Training of Generative Adversarial Networks](https://ieeexplore.ieee.org/document/8936350) | IEEE Access2019 | |

| | [Overcoming Long-term Catastrophic Forgetting through Adversarial Neural Pruning and Synaptic Consolidation](https://arxiv.org/pdf/1912.09091.pdf) | | |

| | [Autoencoding Generative Adversarial Networks](https://arxiv.org/pdf/2004.05472.pdf) | | [Github](https://github.com/ConorLazarou/AEGAN-keras) |

| | [Classification Representations Can be Reused for Downstream Generations](https://arxiv.org/pdf/2004.07543.pdf) | | |

| | [GAN Memory with No Forgetting](https://arxiv.org/pdf/2006.07543.pdf) | NeurIPS2020 | [Github](https://github.com/MiaoyunZhao/GANmemory_LifelongLearning) |

| | [Generating Full-Body Standing Figures of Anime Characters and Its Style Transfer by GAN](https://waseda.repo.nii.ac.jp/?action=pages_view_main&active_action=repository_view_main_item_detail&item_id=58145&item_no=1&page_id=13&block_id=21) | | |

| | [HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms](https://arxiv.org/pdf/2011.11731.pdf) | CVPR2021 | [Github](https://github.com/mahmoudnafifi/HistoGAN) |

| | [Efficient Continual Adaptation for Generative Adversarial Networks](https://arxiv.org/pdf/2103.04032.pdf) | | |

| | [Generating "Ideal" Anime Opening Frames Using Neural Networks](https://ieeexplore.ieee.org/abstract/document/9396557) | ElConRus2021 | |

| | [CoPE: Conditional image generation using Polynomial Expansions](https://arxiv.org/pdf/2104.05077.pdf) | | |

| | [StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators](https://arxiv.org/pdf/2108.00946.pdf) | SIGGRAPH2022 | [Github](https://github.com/rinongal/StyleGAN-nada) |

| | [DisUnknown: Distilling Unknown Factors for Disentanglement Learning](https://arxiv.org/pdf/2109.08090.pdf) | ICCV2021 | [Github](https://github.com/stormraiser/disunknown) |

| | [Combating Mode Collapse in GANs via Manifold Entropy Estimation](https://arxiv.org/pdf/2208.12055.pdf) | | [Github](https://arxiv.org/pdf/2208.12055.pdf) |

| Few-shot | [Image Generation From Small Datasets via Batch Statistics Adaptation](https://openaccess.thecvf.com/content_ICCV_2019/papers/Noguchi_Image_Generation_From_Small_Datasets_via_Batch_Statistics_Adaptation_ICCV_2019_paper.pdf) | ICCV2019 | [Github](https://github.com/nogu-atsu/small-dataset-image-generation) |

| | [FEW-SHOT ADAPTATION OF GENERATIVE ADVERSARIAL NETWORKS](https://arxiv.org/pdf/2010.11943.pdf) | | [Github](https://github.com/e-271/few-shot-gan) |

| | [MineGAN: effective knowledge transfer from GANs to target domains with few images](https://openaccess.thecvf.com/content_CVPR_2020/papers/Wang_MineGAN_Effective_Knowledge_Transfer_From_GANs_to_Target_Domains_With_CVPR_2020_paper.pdf) | CVPR2020 | [Github](https://github.com/yaxingwang/MineGAN) |

| | [Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs](https://arxiv.org/pdf/2002.10964.pdf) | CVPRW2020 | [Github](https://github.com/sangwoomo/FreezeD) |

| | [DATA INSTANCE PRIOR FOR TRANSFER LEARNING IN GANS](https://arxiv.org/pdf/2012.04256.pdf) | | |

| | [MineGAN++: Mining Generative Models for Efficient Knowledge Transfer to Limited Data Domains](https://arxiv.org/pdf/2104.13742.pdf) | | |

| | [Data InStance Prior (DISP) in Generative Adversarial Networks](https://openaccess.thecvf.com/content/WACV2022/papers/Mangla_Data_InStance_Prior_DISP_in_Generative_Adversarial_Networks_WACV_2022_paper.pdf) | WACV2022 | |

| | [Controlling StyleGANs Using Rough Scribbles via One-shot Learning](http://www.cgg.cs.tsukuba.ac.jp/~endo/projects/StyleGANSparseControl/CAVW_endo22_preprint.pdf) | CAVW2022 | [HP](http://www.cgg.cs.tsukuba.ac.jp/~endo/projects/StyleGANSparseControl/) |

| Interpretability | [RPGAN: GANs Interpretability via Random Routing](https://arxiv.org/pdf/1912.10920.pdf) | | [Github](https://github.com/anvoynov/RandomPathGAN) |

| | [Unsupervised Discovery of Interpretable Directions in the GAN Latent Space](https://arxiv.org/pdf/2002.03754.pdf) | ICML2020 | [Github](https://github.com/anvoynov/GANLatentDiscovery) |

| | [Closed-Form Factorization of Latent Semantics in GANs](https://arxiv.org/pdf/2007.06600.pdf) | CVPR2021 | [Github](https://github.com/genforce/sefa) |

| | [Unsupervised Discovery of Disentangled Manifolds in GANs](https://arxiv.org/pdf/2011.11842.pdf) | | |

| | [Do Generative Models Know Disentanglement? Contrastive Learning is All You Need](https://arxiv.org/pdf/2102.10543.pdf) | | [Github](https://github.com/xrenaa/DisCo) |

| | [Surrogate Gradient Field for Latent Space Manipulation](https://arxiv.org/pdf/2104.09065.pdf) | CVPR2021 | |

| | [EigenGAN: Layer-Wise Eigen-Learning for GANs](https://arxiv.org/pdf/2104.12476.pdf) | | [Github](https://github.com/LynnHo/EigenGAN-Tensorflow) |

| | [Discovering Interpretable Latent Space Directions of GANs Beyond Binary Attributes](https://openaccess.thecvf.com/content/CVPR2021/papers/Yang_Discovering_Interpretable_Latent_Space_Directions_of_GANs_Beyond_Binary_Attributes_CVPR_2021_paper.pdf) | CVPR2021 | |

| | [Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image Transformations](https://dl.acm.org/doi/pdf/10.1145/3474085.3475293) | MM 2021 | | |

| | [Self-supervised Enhancement of Latent Discovery in GANs](https://arxiv.org/pdf/2112.08835.pdf) | AAAI2022 | | 

| | [Unsupervised Discovery of Disentangled Interpretable Directions for Layer-Wise GAN](https://link.springer.com/chapter/10.1007/978-981-19-8331-3_2) | Big Data2022 | |

| Montage | [MontageGAN: Generation and Assembly of Multiple Components by GANs](https://arxiv.org/pdf/2205.15577.pdf) | ICPR2022 | [Github](https://github.com/uchidalab/docker-montage-gan)|

| | [Sprite-from-Sprite: Cartoon Animation Decomposition with Self-supervised Sprite Estimation](https://dl.acm.org/doi/pdf/10.1145/3550454.3555439) | TOG2022 | |

| Text-to-Image | [Adding Conditional Control to Text-to-Image Diffusion Models](https://arxiv.org/pdf/2302.05543.pdf) | | [Github](https://github.com/lllyasviel/ControlNet) |

| | [DreamArtist: Towards Controllable One-Shot Text-to-Image Generation via Positive-Negative Prompt-Tuning](https://arxiv.org/pdf/2211.11337.pdf) | | [Github](https://github.com/7eu7d7/DreamArtist-stable-diffusion) |

### Image-to-image Translation

| Subcategory | Paper | Conference | Link |

| ---- | ---- | ---- | ---- |

| Face2anime| [Improving Shape Deformation in Unsupervised Image-to-Image Translation](http://openaccess.thecvf.com/content_ECCV_2018/papers/Aaron_Gokaslan_Improving_Shape_Deformation_ECCV_2018_paper.pdf) | ECCV2018 | [Github](https://github.com/brownvc/ganimorph) |

| | [Twin-GAN – Unpaired Cross-Domain Image Translation with Weight-Sharing GANs](https://arxiv.org/pdf/1809.00946.pdf) | | [Github](https://github.com/jerryli27/TwinGAN) |

| | [DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks](https://openaccess.thecvf.com/content_cvpr_2018/papers/Ma_DA-GAN_Instance-Level_Image_CVPR_2018_paper.pdf) | CVPR2018 | [Github](https://github.com/Rongpeng-Lin/A-DA-GAN-architecture) |

| | [Landmark Assisted CycleGAN for Cartoon Face Generation](https://arxiv.org/pdf/1907.01424v1.pdf) | | |

| | [Generating Anime from Real Human Image with Adversarial Training](https://ieeexplore.ieee.org/document/8934465) | ICASERT2019 | |

| | [Auto-Encoding for Shared Cross Domain Feature Representation and Image-to-Image Translation](https://arxiv.org/pdf/2006.11404.pdf) | | |

| | [Few-shot Knowledge Transfer for Fine-grained Cartoon Face Generation](https://arxiv.org/pdf/2007.13332.pdf) | | |

| | [Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network](https://arxiv.org/pdf/2010.05713.pdf) | | [Github](https://github.com/HideUnderBush/UI2I_via_StyleGAN2) |

| | [A Note on Data Biases in Generative Models](https://arxiv.org/pdf/2012.02516.pdf) | NeurIPSW2020 | |

| | [Turn Real People into Anime Cartoonization](https://ieeexplore.ieee.org/document/9342433) | ICCECE2021 | |

| | [AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation](https://arxiv.org/pdf/2102.12593.pdf) | | [Github](https://github.com/bing-li-ai/AniGAN) |

| | [Multi-CartoonGAN for Conditional Artistic Face Translation ](https://www.jstage.jst.go.jp/article/pjsai/JSAI2021/0/JSAI2021_2N1IS2a01/_pdf) | JSAI2021 | |

| | [GANs N’ Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)](https://arxiv.org/pdf/2106.06561.pdf) | | [Github](https://github.com/mchong6/GANsNRoses) |

| | [FINE-TUNING STYLEGAN2 FOR CARTOON FACE GENERATION](https://arxiv.org/pdf/2106.12445.pdf) | | [Github](https://github.com/happy-jihye/Cartoon-StyleGAN) |

| | [AgileGAN: Stylizing Portraits by Inversion-Consistent Transfer Learning](https://dl.acm.org/doi/pdf/10.1145/3450626.3459771) | ACM Trans. Graph. 2021 | [Github](https://github.com/GuoxianSong/AgileGAN) |

| | [A Domain Gap Aware Generative Adversarial Network for Multi-domain Image Translation](https://arxiv.org/pdf/2110.10837.pdf) | | |

| | [Cross-Domain Style Mixing for Face Cartoonization](https://arxiv.org/pdf/2205.12450.pdf) | CVPRW2022 | [HP](https://webtoon.github.io/WebtoonMe/en)|

| | [Neural Optimal Transport](https://arxiv.org/pdf/2201.12220.pdf) | | |

| | [Appearance-preserved Portrait-to-anime Translation via Proxy-guided Domain Adaptation](https://ieeexplore.ieee.org/document/9982378) | TVCG2022 | |

| | [StyO: Stylize Your Face in Only One-Shot](https://arxiv.org/pdf/2303.03231.pdf) | | |

| Selfie2anime | [U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation](https://arxiv.org/pdf/1907.10830.pdf) | ICLR2020 | [Github](https://github.com/taki0112/UGATIT) |

| | [Breaking the cycle—Colleagues are all you need](https://arxiv.org/pdf/1911.10538.pdf) | CVPR2020 | [Github](https://github.com/Onr/Council-GAN) |

| | [AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks](https://arxiv.org/pdf/1911.11897.pdf) | IJCNN2019 | [Github](https://github.com/Ha0Tang/AttentionGAN) |

| | [Unpaired Image-to-Image Translation using Adversarial Consistency Loss](https://arxiv.org/pdf/2003.04858.pdf) | ECCV2020 | [Github](https://github.com/hyperplane-lab/ACL-GAN) |

| | [Feature Quantization Improves GAN Training](https://arxiv.org/pdf/2004.02088.pdf) | ICML2020 | [Github](https://github.com/YangNaruto/FQ-GAN) |

| | [Interpolation based Anime Face Style Transfer](https://ieeexplore.ieee.org/abstract/document/9237764) | MAPR2020 | |

| | [SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translation](https://arxiv.org/pdf/2103.16219.pdf) | | |

| | [Good Artists Copy, Great Artists Steal: Model Extraction Attacks Against Image Translation Generative Adversarial Networks](https://arxiv.org/pdf/2104.12623.pdf) | | |

| | [Unaligned Image-to-Image Translation by Learning to Reweight](https://arxiv.org/pdf/2109.11736.pdf) | ICCV2021 | |

| | [UVCGAN: UNET VISION TRANSFORMER CYCLE-CONSISTENT GAN FOR UNPAIRED IMAGE-TO-IMAGE TRANSLATION](https://arxiv.org/pdf/2203.02557.pdf) | | |

| | [Unpaired Cartoon Image Synthesis via Gated Cycle Mapping](https://openaccess.thecvf.com/content/CVPR2022/papers/Men_Unpaired_Cartoon_Image_Synthesis_via_Gated_Cycle_Mapping_CVPR_2022_paper.pdf) | CVPR2022 | |

| | [Unpaired Image-to-Image Translation using Negative Learning for Noisy Patches](https://ieeexplore.ieee.org/document/9780547) | IEEE MM2022| |

| | [Hyprogan: Breaking the Dimensional wall From Human to Anime](https://ieeexplore.ieee.org/document/9897973) | ICIP2022 | |

| | [Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint](https://openaccess.thecvf.com/content/CVPR2022/papers/Guo_Alleviating_Semantics_Distortion_in_Unsupervised_Low-Level_Image-to-Image_Translation_via_Structure_CVPR_2022_paper.pdf) | CVPR2022 | |

| Photo2anime | [CartoonGAN: Generative Adversarial Networks for Photo Cartoonization](http://openaccess.thecvf.com/content_cvpr_2018/papers/Chen_CartoonGAN_Generative_Adversarial_CVPR_2018_paper.pdf) | CVPR2018 | [Github](https://github.com/znxlwm/pytorch-CartoonGAN) |

| | [Comixify: Transform video into a comics](https://arxiv.org/pdf/1812.03473.pdf) | | [Github](https://github.com/maciej3031/comixify) |

| | [GANILLA: Generative adversarial networks for image to illustration translation](https://arxiv.org/pdf/2002.05638.pdf) | | [Github](https://github.com/giddyyupp/ganilla) |

| | [CartoonRenderer: An Instance-based Multi-Style Cartoon Image Translator](https://arxiv.org/pdf/1911.06102.pdf) | MMM2020 | |

| | [Learning to Cartoonize Using White-box Cartoon Representations](https://github.com/SystemErrorWang/White-box-Cartoonization/blob/master/paper/06791.pdf) | CVPR2020 | [Github](https://github.com/SystemErrorWang/White-box-Cartoonization) |

| | [Generative Adversarial Networks for photo to Hayao Miyazaki style cartoons](https://arxiv.org/pdf/2005.07702.pdf) | | [Github](https://github.com/FilipAndersson245/cartoon-gan) |

| | [AnimeGAN: a novel lightweight GAN for photo animation](https://github.com/TachibanaYoshino/AnimeGAN/blob/master/doc/Chen2020_Chapter_AnimeGAN.pdf) | | [Github](https://github.com/TachibanaYoshino/AnimeGAN) |

| | [GAN-based Multi-Style Photo Cartoonization](https://ieeexplore.ieee.org/document/9382902) | IEEE TVCG2021 | |

| | [Pseudo-Supervised Learning for Semantic Multi-Style Transfer](https://ieeexplore.ieee.org/document/9316188) | IEEE Access (Vol. 9) |

| | [Cartoonize Images using TinyML Strategies with Transfer Learning](https://ieeexplore.ieee.org/document/9581835) | IEEE 2021 | |

| | [Transfer photo to anime with dual discriminators GAN](https://ieeexplore.ieee.org/document/9712766) | ICCECE2022 | |

| | [ARGAN: Fast Converging GAN for Animation Style Transfer](https://ieeexplore.ieee.org/document/9738752) | MVIP2022 | [Github](https://github.com/amirzenoozi/ARGAN) |

| | [Unsupervised Coherent Video Cartoonization with Perceptual Motion Consistency](https://www.aaai.org/AAAI22Papers/AAAI-6861.ZhenahuanL.pdf) | AAAI2022 | |

| | [Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonization](https://proceedings.mlr.press/v162/gao22k/gao22k.pdf) | ICML2022 | |

| | [Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo Cartoonization](https://dl.acm.org/doi/abs/10.1145/3503161.3548094) | MM2022 | |

| | [Interactive Cartoonization with Controllable Perceptual Factors](https://openaccess.thecvf.com/content/CVPR2023/papers/Ahn_Interactive_Cartoonization_With_Controllable_Perceptual_Factors_CVPR_2023_paper.pdf) | CVPR2023 | |

| | [Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation](https://arxiv.org/abs/2308.12968) | ICCV2023 | [Github](https://github.com/Yuxinn-J/Scenimefy) |

| | [A Novel Double-Tail Generative Adversarial Network for Fast Photo Animation](https://www.jstage.jst.go.jp/article/transinf/E107.D/1/E107.D_2023EDP7061/_pdf) | IEICE TIS2024 |[HP](https://tachibanayoshino.github.io/AnimeGANv3/) |

| Sketch2anime | [SmartPaint: a co-creative drawing system based on generative adversarial networks](https://link.springer.com/content/pdf/10.1631/FITEE.1900386.pdf) | FITEE2019 | |

| | [PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain](https://arxiv.org/pdf/1903.10146.pdf) | | [Github](https://github.com/youyuge34/PI-REC) |

| | [Modeling Artistic Workflows for Image Generation and Editing](https://arxiv.org/pdf/2007.07238.pdf) | ECCV2020 | [Github](https://github.com/hytseng0509/ArtEditing) |

| | [Deep Sketch-guided Cartoon Video Inbetweening](https://arxiv.org/pdf/2008.04149.pdf) | IEEE2021 | |

| | [SketchBetween: Video-to-Video Synthesis for Sprite Animation via Sketches](https://arxiv.org/pdf/2209.00185.pdf) | FDG2022 | |

| | [How to train your conditional GAN: An approach using geometrically structured latent manifolds](https://arxiv.org/pdf/2011.13055.pdf) | | |

| | [PMSGAN: Parallel Multistage GANs for Face Image Translation](https://ieeexplore.ieee.org/document/10014017) | TNNLS2022 | |

| | [AniFaceDrawing: Anime Portrait Exploration during Your Sketching](https://arxiv.org/abs/2306.07476) | ACM TG2023 | [HP](http://www.jaist.ac.jp/~xie/AniFaceDrawing.html) |

| Photo2manga | [MangaGAN: Unpaired Photo-to-Manga Translation Based on The Methodology of Manga Drawing](https://arxiv.org/pdf/2004.10634.pdf) | AAAI2021 | |

| Anime2costume | [Anime-to-Real Clothing: Cosplay Costume Generation via Image-to-Image Translation](https://arxiv.org/pdf/2008.11479.pdf) | | |

| Style transfer | [Anime Style Space Exploration Using Metric Learning and Generative Adversarial Networks](https://arxiv.org/pdf/1805.07997v1.pdf) | | |

| | [Disentangling Style and Content in Anime Illustrations](https://arxiv.org/pdf/1905.10742v2.pdf) | | [Github](https://github.com/stormraiser/adversarial-disentangle) |

| | [RAG: Facial Attribute Editing by Learning Residual Attributes](https://www.researchgate.net/publication/334058885_RAG_Facial_Attribute_Editing_by_Learning_Residual_Attributes) | IEEE Access2019 | |

| | [StarGAN Based Facial Expression Transfer for Anime Characters](https://ieeexplore.ieee.org/document/9050061) | CSICC2020 | |

| | [Few-shot Semantic Image Synthesis Using StyleGAN Prior](https://arxiv.org/pdf/2103.14877.pdf) | | [Github](https://github.com/endo-yuki-t/Fewshot-SMIS) |

| | [Fine-Grained Control of Artistic Styles in Image Generation](https://arxiv.org/pdf/2110.10278.pdf) | | |

| | [JoJoGAN: One Shot Face Stylization](https://arxiv.org/pdf/2112.11641.pdf) | | [Github](https://github.com/mchong6/JoJoGAN) |

| | [Unsupersived Image Texture Transfer Based On Generative Adversarial Network](https://ieeexplore.ieee.org/document/9712754) | ICCECE2022 | |

| | [Styleverse: Towards Identity Stylization across Heterogeneous Domains](https://arxiv.org/pdf/2203.00861.pdf) | | |

| | [Cross-modal and Semantics-Augmented Asymmetric CycleGAN for Data-Imbalanced Anime Style Face Translation](https://dl.acm.org/doi/fullHtml/10.1145/3503961.3503969) | VSIP2021 | |

| | [Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networks](https://arxiv.org/pdf/2110.08398.pdf) | ICLR2022 | [Github](https://github.com/ZPdesu/MindTheGap) |

| | [Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer](https://arxiv.org/pdf/2203.13248.pdf) | CVPR2022 | [Github](https://github.com/williamyang1991/DualStyleGAN) |

| | [Towards Diverse and Faithful One-shot Adaption of Generative Adversarial Networks](https://arxiv.org/pdf/2207.08736.pdf) | | [Github](https://github.com/1170300521/DiFa) |

| | [LANIT: Language-Driven Image-to-Image Translation for Unlabeled Data](https://arxiv.org/pdf/2208.14889.pdf) | | [Github](https://github.com/KU-CVLAB/LANIT) |

| | [HRInversion: High-Resolution GAN Inversion for Cross-Domain Image Synthesis](https://ieeexplore.ieee.org/document/9953153) | TCSVT2022 | |

| | [Diffutoon: High-Resolution Editable Toon Shading via Diffusion Models](https://arxiv.org/pdf/2401.16224) | | [HP](https://ecnu-cilab.github.io/DiffutoonProjectPage/) |

| Author style transfer | [Translation of Illustration Artist Style Using Sailormoonredraw Data](https://ieeexplore.ieee.org/document/9897787) | ICIP2022 |  |

### Automatic Line Art Colorization

| Subcategory | Paper | Conference | Links |

| ---- | ---- | ---- | ---- |

| NoHint | [Automatic Sketch Colorization with Tandem Conditional Adversarial Networks](https://ieeexplore.ieee.org/document/8695564) | ISCID2018 | |

| | [Do You Like Sclera? Sclera-region Detection and Colorization for Anime Character Line Drawings](https://www.atlantis-press.com/journals/ijndc/125913573) | IJNDC2019 | |

| | [Colorization for Anime Sketches with Cycle-Consistent Adversarial Network](http://www.ijpe-online.com/EN/abstract/abstract4089.shtml) | IJPE2019 | |

| | [Seg2pix: Few Shot Training Line Art Colorization with Segmented Image Data](https://www.mdpi.com/2076-3417/11/4/1464) | Appl. Sci. 2021 | |

| | [Semi-automatic Manga Colorization Using Conditional Adversarial Networks](https://www.gwern.net/docs/ai/anime/2021-golyadkin.pdf) | | [Github](https://github.com/qweasdd/manga-colorization) |

| | [Stylized-Colorization for Line Arts](https://www.gwern.net/docs/ai/anime/2021-fang.pdf) | ICPR2021 | |

| | [Generative Probabilistic Image Colorization](https://arxiv.org/pdf/2109.14518.pdf) | | |

| | [FlatMagic: Improving Flat Colorization through AI-driven Design for Digital Comic Professionals](https://dl.acm.org/doi/10.1145/3491102.3502075) | CHI2022 | [Github](https://cragl.cs.gmu.edu/flatmagic/) |

| | [Attention-Based Unsupervised Sketch Colorization of Anime Avatar](https://dl.acm.org/doi/abs/10.1145/3548608.3559316) | ICCIR2022 | |

| | [Robust Manga Page Colorization via Coloring Latent Space](https://ieeexplore.ieee.org/document/10278137) | IEEE Access2023 | |

| Atari | [Manga Colorization](http://www.cse.cuhk.edu.hk/~ttwong/papers/manga/manga.pdf) | ACM Trans. Graph. 2006 | |

| | [TexToons: Practical Texture Mapping for Hand-drawn Cartoon Animations](https://dcgi.fel.cvut.cz/home/sykorad/Sykora11-NPAR.pdf) | NPAR2011 | |

| | [Outline Colorization through Tandem Adversarial Networks](https://arxiv.org/pdf/1704.08834.pdf) | | |

| | [A Fast and Efficient Semi-guided Algorithm for Flat Coloring Line-arts](https://hal.archives-ouvertes.fr/hal-01891876/document) | EG2018 | |

| | [Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Wasserstein Generative Adversarial Networks](https://arxiv.org/pdf/1705.01908.pdf) | Neurocomputing2018 | [Github](https://github.com/irfanICMLL/Auto_painter) |

| | [User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks](https://arxiv.org/pdf/1808.03240.pdf) | ACMMC2018 | [Github](https://github.com/orashi/AlacGAN) |

| | [Two-stage Sketch Colorization](https://github.com/lllyasviel/style2paints/blob/master/papers/sa.pdf) | ACM Trans. Graph. 2018 | [Github](https://github.com/lllyasviel/style2paints) |

| | [Anime Sketch Coloring with Swish-gated Residual U-net and Spectrally Normalized GAN](http://www.engineeringletters.com/issues_v27/issue_3/EL_27_3_01.pdf) | | [Github](https://github.com/pradeeplam/Anime-Sketch-Coloring-with-Swish-Gated-Residual-UNet) |

| | [PaintsTorch: a User-Guided Anime Line Art Colorization Tool with Double Generator Conditional Adversarial Network](https://dl.acm.org/doi/10.1145/3359998.3369401) | CVMP2019 | |

| | [Interactive Anime Sketch Colorization with Style Consistency via a Deep Residual Neural Network](https://ieeexplore.ieee.org/document/8959911) | TAAI2019 | |

| | [Semi-Auto Sketch Colorization Based on Conditional Generative Adversarial Networks](https://ieeexplore.ieee.org/document/8965999) | CISP-BMEI2019 | |

| | [MANGAN: ASSISTING COLORIZATION OF MANGA CHARACTERS CONCEPT ART USING CONDITIONAL GAN](https://ieeexplore.ieee.org/document/8803667) | ICIP2019 | [Github](https://github.com/felipelodur/ManGAN) |

| | [Two-Stage Sketch Colorization With Color Parsing](https://ieeexplore.ieee.org/document/8944253) | IEEE Access2019 | |

| | [User Guided Digital Artwork Colorization](https://dl.acm.org/doi/10.1145/3374587.3374604) | CSAI2019 | |

| | [Cartoon image colorization based on emotion recognition and superpixel color resolution](https://ieeexplore.ieee.org/document/9262834) | ICCST2020 | |

| | [Automatic Colorization of Anime Style Illustrations Using a Two-Stage Generator](https://www.mdpi.com/2076-3417/10/23/8699) | Appl. Sci. 2020 | |

| | [Line Art Colorization with Concatenated Spatial Attention](https://openaccess.thecvf.com/content/CVPR2021W/CVFAD/papers/Yuan_Line_Art_Colorization_With_Concatenated_Spatial_Attention_CVPRW_2021_paper.pdf) | CVPRW2021 | |

| | [User-Guided Line Art Flat Filling with Split Filling Mechanism](https://openaccess.thecvf.com/content/CVPR2021/papers/Zhang_User-Guided_Line_Art_Flat_Filling_With_Split_Filling_Mechanism_CVPR_2021_paper.pdf) | CVPR2021 | [HP](https://lllyasviel.github.io/SplitFilling/) |

| | [Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects](https://arxiv.org/pdf/2107.01619.pdf) | | |

| | [Dual Color Space Guided Sketch Colorization](https://ieeexplore.ieee.org/document/9515572) | IEEE Trans. on Img. Proc. 2021 | |

| | [Interactive Manga Colorization with Fast Flat Coloring](https://dl.acm.org/doi/fullHtml/10.1145/3476124.3488628) | SIGGRAPH Asia2021 | |

| | [Late-resizing: A Simple but Effective Sketch Extraction Strategy for Improving Generalization of Line-art Colorization](https://openaccess.thecvf.com/content/WACV2022/papers/Kim_Late-Resizing_A_Simple_but_Effective_Sketch_Extraction_Strategy_for_Improving_WACV_2022_paper.pdf) | WACV2022 | |

| | [StencilTorch: An Iterative and User-Guided Framework for Anime Lineart Colorization](https://dl.acm.org/doi/abs/10.1007/978-3-031-25825-1_1) | IVCNZ2022 | |

| | [Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization](https://arxiv.org/pdf/2210.14270.pdf) | WACV2023 | |

| | [Diffusart: Enhancing Line Art Colorization with Conditional Diffusion Models](https://openaccess.thecvf.com/content/CVPR2023W/CVFAD/papers/Carrillo_Diffusart_Enhancing_Line_Art_Colorization_With_Conditional_Diffusion_Models_CVPRW_2023_paper.pdf) | CVPRW2023 | |

| Reference | [Unsupervised Colorization of Black-and-White Cartoons](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.95.2629&rep=rep1&type=pdf) | NPAR2004 | |

| | [Reference-based Manga Colorization by Graph Correspondence Using Quadratic Programming](http://yusukematsui.me/pdf/sato_sa2014.pdf) | SIGGRAPH2014 | |

| | [Deep Manga Colorization with Color Style Extraction by Conditional Adversarially Learned Inference](http://www.iaiai.org/journals/index.php/IEE/article/view/214) | IIAI2017 | |

| | [Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN](https://arxiv.org/pdf/1706.03319.pdf) | ACPR2017 | |

| | [cGAN-based Manga Colorization Using a Single Training Image](https://arxiv.org/pdf/1706.06918.pdf) | ICDAR2017 | [Github](https://github.com/sudheerachary/Manga_Colorization) |

| | [Comicolorization: Semi-Automatic Manga Colorization](https://arxiv.org/pdf/1706.06759.pdf) | SIGGRAPH2017 | [Github](https://github.com/DwangoMediaVillage/Comicolorization) |

| | [Automatic manga colorization with color style by generative adversarial nets](https://ieeexplore.ieee.org/document/8022768) | 2017 18th IEEE/ACIS SNPD | |

| | [Attentioned Deep Paint](https://github.com/ktaebum/AttentionedDeepPaint/blob/master/poster.pdf) | | [Github](https://github.com/ktaebum/AttentionedDeepPaint) |

| | [Fully Automatic Colorization for Anime Character Considering Accurate Eye Colors](https://dl.acm.org/doi/pdf/10.1145/3306214.3338585) | SIGGRAPH2019 | |

| | [Semantic Example Guided Image-to-Image Translation](https://arxiv.org/pdf/1909.13028.pdf) | IEEE Transactions on Multimedia2020 | |

| | [Graph Matching based Anime Colorization with Multiple References](https://ahcweb01.naist.jp/papers/conference/2019/201907_SIGGRAPH2019_s-nakamura/201907_SIGGRAPH_s-nakamura.slides.pdf) | SIGGRAPH2019 | |

| | [Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Correspondence](https://arxiv.org/pdf/2005.05207.pdf) | CVPR2020 | [Github](https://github.com/Jungjaewon/Reference_based_Skectch_Image_Colorization) |

| | [Multi-Density Sketch-to-Image Translation Network](https://arxiv.org/pdf/2006.10649.pdf) | | |

| | [Deep-Eyes: Fully Automatic Anime Character Colorization with Painting of Details on Empty Pupils](https://www.gwern.net/docs/ai/anime/2020-akita.pdf) | EG2020 | |

| | [Colorization of Line Drawings with Empty Pupils](https://www.gwern.net/docs/anime/2020-akita.pdf) | PG2020 | |

| | [Anime Sketch Colorization by Component-based Matching using Deep Appearance Features and Graph Representation](https://ieeexplore.ieee.org/document/9412507) | ICPR2021 | |

| | [Anime Style Transfer With Spatially-Adaptive Normalization](https://ieeexplore.ieee.org/document/9428305) | ICME2021 | |

| | [Exploring Sketch-based Character Design Guided by Automatic Colorization](https://rawanmg.github.io/pdf/gi21.pdf) | | |

| | [PAINTING STYLE-AWARE MANGA COLORIZATION BASED ON GENERATIVE ADVERSARIAL NETWORKS](https://arxiv.org/pdf/2107.07943.pdf) | ICIP2021 | |

| | [Disentangled and controllable sketch creation based ondisentangling the structure and color enhancement](https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/ipr2.12343) | | |

| | [Reference-guided structure-aware deep sketch colorization for cartoons](https://link.springer.com/content/pdf/10.1007/s41095-021-0228-6.pdf) | CVM2022 | |

| | [Anime Character Colorization using Few-shot Learning](https://dl.acm.org/doi/10.1145/3478512.3488604) | SIGGRAPH Asia2021 | |

| | [Exemplar-Based Sketch Colorization with Cross-Domain Dense Semantic Correspondence](https://www.mdpi.com/2227-7390/10/12/1988/htm) | Mathematics2022 | |

| | [Eliminating Gradient Conflict in Reference-based Line-Art Colorization](https://arxiv.org/pdf/2207.06095.pdf) | ECCV2022 | [Github](https://github.com/kunkun0w0/SGA) |

| | [Improving Reference-Based Image Colorization For Line Arts Via Feature Aggregation And Contrastive Learning](https://ieeexplore.ieee.org/document/9746326) | ICASSP2022 | |

| | [Semi-Automatic Colorization Pipeline for Anime Characters and its Evaluation in Production](https://ieeexplore.ieee.org/document/9848507) | NicoInt2022 | |

| | [ATTENTION-AWARE ANIME LINE DRAWING COLORIZATION](https://arxiv.org/pdf/2212.10988.pdf) | |

| | [AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models](https://arxiv.org/pdf/2303.11137.pdf) | |

| | [Two-Step Training: Adjustable Sketch Colourization via Reference Image and Text Tag](https://onlinelibrary.wiley.com/doi/pdfdirect/10.1111/cgf.14791) | CG Forum2023 | [Github](https://github.com/ydk-tellurion/sketch_colorizer) |

| | [Learning Inclusion Matching for Animation Paint Bucket Coloriation](https://arxiv.org/pdf/2403.18342) | CVPR2024 | [HP](https://ykdai.github.io/projects/InclusionMatching) |

| | [ColorizeDiffusion: Adjustable Sketch Colorization with Reference Image and Text](https://arxiv.org/pdf/2401.01456.pdf) | |  |

| Tag | [Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss](http://openaccess.thecvf.com/content_ICCV_2019/papers/Kim_Tag2Pix_Line_Art_Colorization_Using_Text_Tag_With_SECat_and_ICCV_2019_paper.pdf) | ICCV2019 | [Github](https://github.com/blandocs/Tag2Pix) |

| | [Line Art Colorization Based on Explicit Region Segmentation](https://www.sysu-imsl.com/files/PG2021/line_art_colorization_pg2021_main.pdf) | PG 2021 | |

| Video | [Automatic Temporally Coherent Video Colorization](https://arxiv.org/pdf/1904.09527.pdf) | | [Github](https://github.com/Harry-Thasarathan/TCVC) |

| | [Artist-Guided Semiautomatic Animation Colorization](https://openaccess.thecvf.com/content_ICCVW_2019/papers/CVFAD/Thasarathan_Artist-Guided_Semiautomatic_Animation_Colorization_ICCVW_2019_paper.pdf) | ICCVW2019 | |

| | [Deep Line Art Video Colorization with a Few References](https://arxiv.org/pdf/2003.10685.pdf) | | |

| | [Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization](https://openaccess.thecvf.com/content/WACV2021/papers/Zhang_Line_Art_Correlation_Matching_Feature_Transfer_Network_for_Automatic_Animation_WACV_2021_paper.pdf) | WACV2021 | |

| | [The Animation Transformer: Visual Correspondence via Segment Matching](https://arxiv.org/pdf/2109.02614.pdf) | ICCV2021 | [Video](https://cadmium.app/) |

| | [Coloring anime line art videos with transformation region enhancement network](https://www.sciencedirect.com/science/article/pii/S0031320323002625?casa_token=evjknkPkujoAAAAA:a0kjRw6hy3aaO9UAkINCtXYlELCDMDQu5RykR6k7qNeRPaYsaBfR8_PNSg0R-MsIs3vOCePOTfYh) | PR2023 |  |

### Automatic Character Lighting

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters](https://dcgi.fel.cvut.cz/home/sykorad/Sykora14-TOG.pdf) | ACM Trans. Graph. 2014 | |

| [Deep Normal Estimation for Automatic Shading of Hand-Drawn Characters](http://openaccess.thecvf.com/content_ECCVW_2018/papers/11131/Hudon_Deep_Normal_Estimation_for_Automatic_Shading_of_Hand-Drawn_Characters_ECCVW_2018_paper.pdf) | ECCVW2018 | [Github](https://github.com/V-Sense/DeepNormals) |

| [Automatic Illumination Effects for 2D Characters](https://nips2018creativity.github.io/doc/Automatic_Illumination_Effects_for_2D_Characters.pdf) | NIPSW2018 | |

| [2D shading for cel animation](https://dl.acm.org/doi/10.1145/3229147.3229148) | NPAR2018 | [HP](https://v-sense.scss.tcd.ie/research/vfx-animation/2d-shading-for-cel-animation/) |

| [Augmenting Hand-Drawn Art with Global Illumination Effects through Surface Inflation](https://dl.acm.org/doi/abs/10.1145/3359998.3369400) | CVMP 2019 | [HP](https://v-sense.scss.tcd.ie/research/augmenting-hand-drawn-art-with-global-illumination-effects-through-surface-inflation/) |

| [Generating Digital Painting Lighting Effects via RGB-space Geometry](https://lllyasviel.github.io/PaintingLight/files/TOG20PaintingLight.pdf) | ACM Trans. Graph. 2020 | [Github](https://github.com/lllyasviel/PaintingLight) |

| [Learning to Shadow Hand-drawn Sketches](https://arxiv.org/pdf/2002.11812.pdf) | CVPR2020 | [Github](https://github.com/qyzdao/ShadeSketch) |

| [SmartShadow: Artistic Shadow Drawing Tool for Line Drawings](https://openaccess.thecvf.com/content/ICCV2021/papers/Zhang_SmartShadow_Artistic_Shadow_Drawing_Tool_for_Line_Drawings_ICCV_2021_paper.pdf) | ICCV2021 | |

| [Automatic Illumination of Flat-Colored Drawings by 3D Augmentation of 2D Silhouettes](https://ieeexplore.ieee.org/document/9897386) | ICIP2022 | |

### Automatic Illustration Editing

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Decomposing Images into Layers with Advanced Color Blending](https://onlinelibrary.wiley.com/doi/10.1111/cgf.13577) | PG2018 | [Github](https://github.com/yuki-koyama/unblending) |

| [Spatially Controllable Image Synthesis with Internal Representation Collaging](https://arxiv.org/pdf/1811.10153.pdf) | | [Github](https://github.com/quolc/neural-collage) |

| [Erasing Appearance Preservation in Optimization-based Smoothing](https://lllyasviel.github.io/AppearanceEraser/paper/paper.pdf) | ECCV2020 | [Github](https://github.com/lllyasviel/AppearanceEraser) |

| [Cross-Domain and Disentangled Face Manipulation with 3D Guidance](https://arxiv.org/pdf/2104.11228.pdf) | | [Github](https://github.com/cassiePython/cddfm3d) |

| [L2M-GAN: Learning to Manipulate Latent Space Semantics for Facial Attribute Editing](https://openaccess.thecvf.com/content/CVPR2021/papers/Yang_L2M-GAN_Learning_To_Manipulate_Latent_Space_Semantics_for_Facial_Attribute_CVPR_2021_paper.pdf) | CVPR2021 | |

| [Deep Unfolding with Normalizing Flow Priors for Inverse Problems](https://arxiv.org/pdf/2107.02848.pdf) | | |

| [Sketch-based Anime Hairstyle Editing with Generative Inpainting](https://ieeexplore.ieee.org/document/9515963) | NicoInt2021 | |

| [DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing](https://arxiv.org/pdf/2109.10737.pdf) | | |

| [Improving The Quality Of Illustrations: Transforming Amateur Illustrations To A Professional Standard](https://ieeexplore.ieee.org/document/9506615) | ICIP2021 | |

| [Universal Face Restoration With Memorized Modulation](https://arxiv.org/pdf/2110.01033.pdf) | | |

| [Unsupervised Learning of Compositional Energy Concepts](https://arxiv.org/pdf/2111.03042.pdf) | NeurIPS2021 | [Github](https://github.com/yilundu/comet) |

| [Reference-based Image Composition with Sketch via Structure-aware Diffusion Model](https://arxiv.org/pdf/2304.09748.pdf) | | [Github](https://github.com/kangyeolk/Paint-by-Sketch) |

| [Instance-guided Cartoon Editing with a Large-scale Dataset](https://arxiv.org/pdf/2312.01943.pdf) | | |

| [Re:Draw - Context Aware Translation as a Controllable Method for Artistic Production](https://arxiv.org/pdf/2401.03499.pdf) | | |

| [DreamTuner: Single Image is Enough for Subject-Driven Generation](https://arxiv.org/pdf/2312.13691) | | |

### Automatic Sketch Editing

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Temporal Noise Control for Sketchy Animation](https://dl.acm.org/doi/10.1145/2024676.2024691) | NPAR2011 |

| [Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup](https://esslab.jp/~ess/publications/SimoSerraSIGGRAPH2016.pdf) | ACM Trans. Graph. 2016 | [Github](https://github.com/bobbens/sketch_simplification) |

| [Deep Extraction of Manga Structural Lines](https://dl.acm.org/doi/10.1145/3072959.3073675) | ACM Trans. Graph. 2017 | [Github](https://github.com/ljsabc/MangaLineExtraction) |

| [Mastering Sketching: Adversarial Augmentation for Structured Prediction](https://arxiv.org/pdf/1703.08966.pdf) | ACM Trans. Graph. 2018 | [Github](https://github.com/bobbens/sketch_simplification) |

| [Real-Time Data-Driven Interactive Rough Sketch Inking](https://dl.acm.org/doi/pdf/10.1145/3197517.3201370) | ACM Trans. Graph. 2018 | [Github](https://github.com/bobbens/line_thinning) |

| [Unpaired Sketch-to-Line Translation via Synthesis of Sketches](https://dl.acm.org/doi/pdf/10.1145/3355088.3365163) | SIGGRAPH2019 | |

| [Perceptual-aware Sketch Simplification Based on Integrated VGG Layers](https://ieeexplore.ieee.org/abstract/document/8771128) | TVCG2019 | |

| [Progressive Full Data Convolutional Neural Networks for Line Extraction from Anime-Style Illustrations](https://www.mdpi.com/2076-3417/10/1/41) | Appl. Sci. 2020 | |

| [SketchMan: Learning to Create Professional Sketches](https://dl.acm.org/doi/abs/10.1145/3394171.3413720) | MM2020 | [Github](https://github.com/LCXCUC/SketchMan2020) |

| [One-shot Line Extraction from Color Illustrations](https://ieeexplore.ieee.org/document/9515964) | NicoInt2021 | |

| [A Drawing Support System for Sketching Aging Anime Faces](https://ieeexplore.ieee.org/abstract/document/9937356) | CW2022 | |

| [End-to-End Line Drawing Vectorization](https://ojs.aaai.org/index.php/AAAI/article/download/20379/20138) | AAAI2022 | |

| [Reference Based Sketch Extraction via Attention Mechanism](https://dl.acm.org/doi/abs/10.1145/3550454.3555504) | ACM TG2022 | [Github](https://github.com/ref2sketch/ref2sketch) |

| [Semi-supervised reference-based sketch extraction using a contrastive learning framework](https://drive.google.com/file/d/1FELTVl73OrQ9Q0uBXN7jLbRStSsF-NgM/view?pli=1) | ACM TG2023 | [Github](https://github.com/Chanuku/semi_ref2sketch_code) |

| [Joint Geometric-Semantic Driven Character Line Drawing Generation](https://dl.acm.org/doi/10.1145/3591106.3592216) | ICMR2023 | |

### Automatic Animation Inbetweening

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [A filter based approach for inbetweening (Japanese)](https://arxiv.org/pdf/1706.03497.pdf) | | [Movie](https://www.youtube.com/watch?v=_RM1zUrY1AQ) |

| [DiLight: Digital light table – Inbetweening for 2D animations using guidelines](http://graphics.tudelft.nl/Publications-new/2017/CMV17/pdf.pdf) | CMV2017 | |

| [Optical Flow Based Line Drawing Frame Interpolation Using Distance Transform to Support Inbetweenings](https://ieeexplore.ieee.org/document/8803506) | ICIP2019 | |

| [Deep Animation Video Interpolation in the Wild](https://arxiv.org/pdf/2104.02495.pdf) | CVPR2021 | [Github](https://github.com/lisiyao21/AnimeInterp/) |

| [Improving the Perceptual Quality of 2D Animation Interpolation](https://arxiv.org/pdf/2111.12792.pdf) | ECCV2022 | [Github](https://github.com/ShuhongChen/eisai-anime-interpolator/) |

| [Enhanced Deep Animation Video Interpolation](https://arxiv.org/pdf/2206.12657.pdf) | ICIP2022 | [Github](https://github.com/laomao0/AutoSktFI) |

| [Deep Geometrized Cartoon Line Inbetweening](https://openaccess.thecvf.com/content/ICCV2023/papers/Siyao_Deep_Geometrized_Cartoon_Line_Inbetweening_ICCV_2023_paper.pdf) | ICCV2023 | [Github](https://github.com/lisiyao21/animeinbet) |

| [Automatic Animation Inbetweening](https://link.springer.com/article/10.1007/s11042-023-17354-x) | MTA2023 | |

### Automatic Image Enhancement

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Enhancement of Anime Imaging Enlargement using Modified Super-Resolution CNN](https://arxiv.org/pdf/2110.02321.pdf) | JSCI2021 | [Github](https://github.com/TanakitInt/SRCNN-anime) |

| [Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data](https://arxiv.org/pdf/2107.10833.pdf) | ICCVW2021 | [Github](https://github.com/xinntao/Real-ESRGAN) |

| [A Transformer-Based Model for Super-Resolution of Anime Image](https://www.mdpi.com/1424-8220/22/21/8126) | Sensors2022 | |

| [AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos](https://arxiv.org/pdf/2206.07038.pdf) | | [Github](https://github.com/TencentARC/AnimeSR) |

| [APISR: Anime Production Inspired Real-World Anime Super-Resolution](https://arxiv.org/pdf/2403.01598.pdf) | CVPR2024 | [Github](https://github.com/Kiteretsu77/APISR) |

### Character Animating

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [MakeItTalk: Speaker-Aware Talking-Head Animation](https://arxiv.org/pdf/2004.12992.pdf) | SIGGRAPH Asia2020 | |

| [CPTNet: Cascade Pose Transform Network for Single Image Talking Head Animation](https://openaccess.thecvf.com/content/ACCV2020/papers/Zhang_CPTNet_Cascade_Pose_Transform_Network_for_Single_Image_Talking_Head_ACCV_2020_paper.pdf) | ACCV2020 | |

| [Collaborative Neural Rendering using Anime Character Sheets](https://arxiv.org/pdf/2207.05378.pdf) | | [Github](https://github.com/megvii-research/CONR) |

| [Language-Guided Face Animation by Recurrent StyleGAN-based Generator](https://arxiv.org/pdf/2208.05617.pdf) | | [Github](https://github.com/TiankaiHang/language-guided-animation) |

| [Hierarchical Feature Warping and Blending for Talking Head Animation](https://gwern.net/doc/ai/anime/2024-zhang.pdf) | IEEE TCSVT2024 | |

| [AnimateDiff-Lightning: Cross-Model Diffusion Distillation](https://arxiv.org/pdf/2403.12706) | | [HF](https://huggingface.co/ByteDance/AnimateDiff-Lightning) |

### Manga Application

| Subcategory | Paper | Conference | Links |

| ---- | ---- | ---- | ---- |

| Classification | [Panel-Page-Aware Comic Genre Understanding](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10112648) | IEEE Transactions on Image Processing, 2023 | |

| Generation | [Synthesis of Screentone Patterns of Manga Characters](https://ieeexplore.ieee.org/document/8959008) | ISM2019 | |

| | [Manga Filling Style Conversion with Screentone Variational Autoencoder](http://www.cse.cuhk.edu.hk/~ttwong/papers/screenstyle/screenstyle.pdf) | SIGGRAPH2020 | |

| | [Generating Manga from Illustrations via Mimicking Manga Workflow](https://openaccess.thecvf.com/content/CVPR2021/papers/Zhang_Generating_Manga_From_Illustrations_via_Mimicking_Manga_Creation_Workflow_CVPR_2021_paper.pdf) | CVPR2021 | [HP](https://lllyasviel.github.io/MangaFilter/) |

| | [Hair Shading Style Transfer for Manga with cGAN](https://www.scitepress.org/Papers/2020/89614/89614.pdf) | ICAART2020 | 

| | [SKETCH2MANGA: SHADED MANGA SCREENING FROM SKETCH WITH DIFFUSION MODELS](https://arxiv.org/pdf/2403.08266) | | [Github](https://github.com/dmMaze/sketch2manga) |

| Restoration | [Exploiting Aliasing for Manga Restoration](https://openaccess.thecvf.com/content/CVPR2021/papers/Xie_Exploiting_Aliasing_for_Manga_Restoration_CVPR_2021_paper.pdf) | CVPR2021 | [Github](https://github.com/msxie92/MangaRestoration) |

| Inpainting | [Seamless Manga Inpainting with Semantics Awareness](http://www.cse.cuhk.edu.hk/~ttwong/papers/mangainpaint/mangainpaint.pdf) | TOG2021 | |

| Editing | [Manga Rescreening with Interpretable Screentone Representation](https://arxiv.org/pdf/2306.04114.pdf) | | |

| | [Comic Image Inpainting via Distance Transform](https://dl.acm.org/doi/abs/10.1145/3478512.3488607) | SIGGRAPH Asia 2021 | |

| Text Detection | [Method for Real Time Text Extraction of Digital Manga Comic](https://www.cscjournals.org/manuscript/Journals/IJIP/Volume4/Issue6/IJIP-290.pdf) | IJIP2011 | |

| | [CNN based Extraction of Panels/Characters from Bengali Comic Book Page Images](https://ieeexplore.ieee.org/document/8893046) | ICDARW2019 |

| | [Deep Learning-Based Classification of the Polar Emotions of “Moe”-Style Cartoon Pictures](https://ieeexplore.ieee.org/document/9220754) | TST2020 |

| | [Learning from the Past: Meta-Continual Learning withKnowledge Embedding for Jointly Sketch, Cartoon, andCaricature Face Recognition](https://dl.acm.org/doi/epdf/10.1145/3394171.3413892) | MM2020 |

| Landmark Detection | [Facial Landmark Detection for Manga Images](https://arxiv.org/pdf/1811.03214.pdf) | | |

| Segmentation | [Extraction of Frame Sequences in the Manga Context](https://ieeexplore.ieee.org/document/9327968) | 2020 IEEE International Symposium on Multimedia (ISM) | |

| | [Towards Content-Aware Pixel-Wise Comic Panel Segmentation](https://link.springer.com/chapter/10.1007/978-3-031-37742-6_1) | ICPR2022 | |

| Translation | [Towards Fully Automated Manga Translation](https://arxiv.org/pdf/2012.14271.pdf) | AAAI2021 | |

| Depth Estimation | [Estimating Image Depth in the Comics Domain](https://arxiv.org/pdf/2110.03575.pdf) | WACV2022 | |

| Vectorization | [Vectorization of Raster Manga by Deep Reinforcement Learning](https://arxiv.org/pdf/2110.04830.pdf) | | |

| Re-identification | [Unsupervised Manga Character Re-identification via Face-body and Spatial-temporal Associated Clustering](https://arxiv.org/pdf/2204.04621.pdf) | | |

| | [Zero-Shot Character Identification and Speaker Prediction in Comics via Iterative Multimodal Fusion](https://arxiv.org/pdf/2404.13993) | | |

### Representation Learning

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Illustration2Vec: A Semantic Vector Representation of Illustrations](https://www.gwern.net/docs/anime/2015-saito.pdf) | SIGGRAPH2015 | [Github](https://github.com/rezoo/illustration2vec) |

### Pose Estimation

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Pose Estimation of Anime/Manga Characters: A Case for Synthetic Data](http://www.cs.cornell.edu/~pramook/papers/manpu2016.pdf) | MANPU2016 |

| [Transfer Learning for Pose Estimation of Illustrated Characters](https://arxiv.org/pdf/2108.01819.pdf) | WACV2022 | [Github](https://github.com/ShuhongChen/bizarre-pose-estimator) |

| [VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning](https://arxiv.org/pdf/2402.14456) | | |

### Image Retrieval

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Sketch-based Manga Retrieval using Manga109 Dataset](https://arxiv.org/pdf/1510.04389.pdf) | MTA2017 | |

| [AugNet: End-to-End Unsupervised Visual Representation Learning with Image Augmentation](https://arxiv.org/pdf/2106.06250.pdf) | | [Github](https://github.com/chenmingxiang110/AugNet) |

### Visual Correspondence

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Globally Optimal Toon Tracking](http://www.cse.cuhk.edu.hk/~ttwong/papers/toontrack/toontrack.pdf) | ACM Trans. Graph. 2016 | [HP](http://www.cse.cuhk.edu.hk/~ttwong/papers/toontrack/toontrack.html) |

### Character Recognition

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Object Detection for Comics using Manga109 Annotations](https://arxiv.org/abs/1803.08670) | |

| [Progressive Deep Feature Learning for Manga Character Recognition via Unlabeled Training Data](https://dl.acm.org/doi/pdf/10.1145/3321408.3322624) | ACM TURC2019| |

| [CNN based Extraction of Panels/Characters from Bengali Comic Book Page Images](https://ieeexplore.ieee.org/document/8893046) | ICDARW2019 |

| [Deep Learning-Based Classification of the Polar Emotions of “Moe”-Style Cartoon Pictures](https://ieeexplore.ieee.org/document/9220754) | TST2020 |

| [Learning from the Past: Meta-Continual Learning withKnowledge Embedding for Jointly Sketch, Cartoon, andCaricature Face Recognition](https://dl.acm.org/doi/epdf/10.1145/3394171.3413892) | MM2020 |

| [Graph Jigsaw Learning for Cartoon Face Recognition](https://arxiv.org/pdf/2107.06532.pdf) | |

| [ACFD: Asymmetric Cartoon Face Detector](https://arxiv.org/pdf/2007.00899.pdf) | IJCAI2020 | | 

| [CAST: CHARACTER LABELING IN ANIMATION USING SELF-SUPERVISION BY TRACKING](https://arxiv.org/pdf/2201.07619.pdf) | EG2022 | |

| [Open-Vocabulary DETR with Conditional Matching](https://arxiv.org/pdf/2203.11876.pdf) | | [Github](https://github.com/yuhangzang/OV-DETR) |

| [AniWho : A Quick and Accurate Way to Classify Anime Character Faces in Images](https://arxiv.org/pdf/2208.11012.pdf) | | |

| [GCN-Based Multi-Modal Multi-Label Attribute Classification in Anime Illustration Using Domain-Specific Semantic Features](https://ieeexplore.ieee.org/document/9898071) | ICIP2022 | |

| [Hierarchical Multi-Label Attribute Classification With Graph Convolutional Networks on Anime Illustration](https://ieeexplore.ieee.org/document/10097719) | IEEE Access2023 | 

### 3D Character Creation

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Automatic Generation of 3D Natural Anime-like Non-Player Characters with Machine Learning](https://ieeexplore.ieee.org/document/9240508) | ICCW2020 | |

| [DreamWaltz: Make a Scene with Complex 3D Animatable Avatars](https://arxiv.org/pdf/2305.12529.pdf) |  | [Github](https://github.com/IDEA-Research/DreamWaltz) |

### Robotics

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Making Robots Draw A Vivid Portrait In Two Minutes](https://arxiv.org/pdf/2005.05526.pdf) | | |

### Speech Synthesis

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [Comic-Guided Speech Synthesis](https://dl.acm.org/doi/pdf/10.1145/3355089.3356487) | ACM Trans. Graph. 2019 | [HP](https://bitwangyujia.github.io/research/project/comic2speech.html) |

### Adult Content Detection

| Paper | Conference | Links |

| ---- | ---- | ---- |

| [KidsGUARD: Fine Grained Approach for Child Unsafe Video Representation and Detection](https://precog.iiitd.edu.in/pubs/KidsGuard-cam-ready.pdf) | ACM SAC2019 | [Github](https://github.com/precog-iiitd/kidsguard-sac) |

| [An Evaluation of Traditional and CNN-Based Feature Descriptors for Cartoon Pornography Detection](https://ieeexplore.ieee.org/document/9371684) | IEEE Access2021 |  |

| [A Deep Learning-Based Approach for Inappropriate Content Detection and Classification of YouTube Videos](https://ieeexplore.ieee.org/document/9696242) | IEEE Access2022 |  |

### Survey & Review

| Paper | Conference |

| ---- | ---- |

| [A Survey of Comics Research in Computer Science](https://arxiv.org/pdf/1804.05490.pdf) | |

| [Computational Approaches to Comics Analysis](https://pubmed.ncbi.nlm.nih.gov/31705626/) | |

| [Image Colorization: A Survey and Dataset](https://arxiv.org/pdf/2008.10774.pdf) | |

| [Cartoon Image Processing: A Survey](https://link.springer.com/article/10.1007/s11263-022-01645-1) | IJCV2022 | 

| [Anime like Character Face Generation: A survey](https://www.researchgate.net/publication/374705438_Anime-like_Character_Face_Generation_A_Survey) | |

## Projects

Summary of github or other types of projects that are related to anime or manga except above.

### Repository

- [Awesome-Animation-Research](https://github.com/zhenglinpan/Awesome-Animation-Research)

### Dataset

- [Layered Temporal Dataset for Anime Drawings](https://layered-anime.github.io/)

- [TRIGGER dataset](https://www.nii.ac.jp/dsc/idr/trigger/)

- [Anime Art](https://www.kaggle.com/datasets/muoncollider/danbooru2020small)

### Representation Learning

- [Classification and vectorization of key-frames and face characters of anime](https://github.com/enmanuelmag/AnimeClassificator)

### Image Generation

- [makegirlsmoe](https://github.com/makegirlsmoe/makegirlsmoe_web)

- [ANIME305/Anime-GAN-tensorflow](https://github.com/ANIME305/Anime-GAN-tensorflow)

- [jayleicn/AnimeGAN](https://github.com/jayleicn/animeGAN)

- [FangYang970206/Anime_GAN](https://github.com/FangYang970206/Anime_GAN)

- [pavitrakumar78/Anime-Face-GAN-Keras](https://github.com/pavitrakumar78/Anime-Face-GAN-Keras)

- [forcecore/Keras-GAN-Animeface-Character](https://github.com/forcecore/Keras-GAN-Animeface-Character)

- [tdrussell/IllustrationGAN](https://github.com/tdrussell/IllustrationGAN)

- [m516825/Conditional-GAN](https://github.com/m516825/Conditional-GAN)

- [bchao1/Anime-Generation](https://github.com/bchao1/Anime-Generation)

- Diffusion models

  - [harubaru/waifu-diffusion](https://github.com/harubaru/waifu-diffusion)

  - [DGSpitzer/Cyberpunk-Anime-Diffusion](https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion)

  - [NovelAI](https://novelai.net/)

  - [Stable Diffusion Models](https://cyberes.github.io/stable-diffusion-models/)

### Image-to-Image Tranlation

- [Aixile/chainer-cyclegan](https://github.com/Aixile/chainer-cyclegan)

- [SystemErrorWang/FacialCartoonization](https://github.com/SystemErrorWang/FacialCartoonization)

- [experience-ml/cartoonize](https://github.com/experience-ml/cartoonize)

- [racinmat/anime-style-transfer](https://github.com/racinmat/anime-style-transfer)

- [TachibanaYoshino/AnimeGANv2](https://github.com/TachibanaYoshino/AnimeGANv2)

- [XiaoSanGit/Real2Animation-video-generation](https://github.com/XiaoSanGit/Real2Animation-video-generation)

- [Avatar Artist Using GAN](http://cs230.stanford.edu/projects_winter_2020/reports/32639139.pdf)

- [Generating Cartoon Style Facial Expressions with StackGAN](https://cs230.stanford.edu/projects_fall_2019/reports/26242839.pdf)

### Automatic Line Art Colorization

- [style2paints](https://github.com/lllyasviel/style2paints)

- [PaintsChainer](https://github.com/pfnet/PaintsChainer)

- [Ugness/Line-Art-Colorization-SPADE](https://github.com/Ugness/Line-Art-Colorization-SPADE)

- [sanjay235/Sketch2Color-anime-translation](https://github.com/sanjay235/Sketch2Color-anime-translation)

- [Pengxiao-Wang/Style2Paints_V3](https://github.com/Pengxiao-Wang/Style2Paints_V3)

- [GANime: Generating Anime and Manga Character Drawings from Sketches](http://cs230.stanford.edu/projects_winter_2020/posters/32226261.pdf)

- [Line Drawing Colorization](http://cs231n.stanford.edu/reports/2017/pdfs/425.pdf)

### Character Animating

- [Talking Head Anime from a Single Image](https://github.com/pkhungurn/talking-head-anime-demo)

- [Talking Head Anime from a Single Image 2: More Expressive](https://github.com/pkhungurn/talking-head-anime-2-demo)

- [Talking Head(?) Anime from a Single Image 3: Now the Body Too](https://github.com/pkhungurn/talking-head-anime-3-demo)

- [Neural Rendering with Attention: An Incremental Improvement for Anime Character Animation](https://github.com/transpchan/Live3D-v2)

### Super Resolution

- [waifu2x](https://github.com/nagadomi/waifu2x)

- [Anime4K](https://github.com/bloc97/Anime4K)

- [goldhuang/SRGAN-PyTorch](https://github.com/goldhuang/SRGAN-PyTorch)

- [Real-CUGAN](https://github.com/bilibili/ailab/blob/main/Real-CUGAN/README_EN.md)

### Segmentation

- [jerryli27/AniSeg](https://github.com/jerryli27/AniSeg)

- [zymk9/Yet-Another-Anime-Segmenter](https://github.com/zymk9/Yet-Another-Anime-Segmenter)

### Landmark Detection

- [Anime face landmark detection by deep cascaded regression](https://github.com/kanosawa/anime_face_landmark_detection)

- [Anime Face Detector using mmdet and mmpose](https://github.com/hysts/anime-face-detector)