ai4artists
A list of AI Art courses, tools, libraries, people, and places.
https://github.com/jonathandinu/ai4artists
Last synced: 6 days ago
JSON representation
-
Tools
-
Stable Diffusion (SD)
-
Creative Coding
-
Text-to-Image
- VQGAN+CLIP
- Muse: Text-To-Image Generation via Masked Generative Transformers - to-image models used masked image modeling w/ transformers
-
Generative Modeling
- NVIDIA Imaginaire
- NVIDIA Omniverse
- mmgeneration
- Modelverse - Based Search for Deep Generative Models
-
Creative ML
-
Deep Learning Frameworks
-
Runtimes/Deployment
-
Neural Radiance Fields
-
-
Research
-
Foundational Papers
-
-
Datasets
-
Permissively Licensed/Open Access
- Unsplash Images
- Mozilla Common Voice
- Museum für Kunst und Gewerbe Hamburg Steintorplatz
- Pixabay
- Pexels
- Open Images - level labels, object bounding boxes, object segmentation masks, visual relationships, and localized narratives:
- Flickr Commons
- Internet Archive - profit library of millions of free books, movies, software, music, websites, and more.
- Wikimedia Commons
- Prelinger Archives
- Getty Library Open Content Program
- Public Domain Review - of-copyright material that everyone is free to enjoy, share, and build upon without restrictions.
- Library of Congress
- Biodiversity Heritage Library
- The Met Open Access
- The National Gallery of Art Open Access
- Art Institute of Chicago Open Access
- NY Public Library Public Domain Collections
- FairFace
- Conceptual Captions
- Quick, Draw!
- Open Images
- Visual Question Answering
- TensorFlow Flowers
- DeepMind 3d Shapes
- PASS - supervised pretraining without humans which can be used for high-quality pretraining while significantly reducing privacy concerns.
-
Faces/People (restricted licenses)
-
-
Products/Apps
-
Other
- Midjourney
- Runway - AI powered video editor.
- Facet AI - AI powered image editor.
- ClipDrop
- DALLE 2 (OpenAI)
- Artbreeder
-
Video
- Adobe Sensei - AI powered features for the Creative Cloud suite.
- NVIDIA AI Demos
-
-
Artists
-
Institutions/Places
-
Video
-
Other
-
-
Related lists and collections
-
Other
- Machine Learning for Art
- Tools and Resources for AI Art (pharmapsychotic) - Big list of Google Colab notebooks for generative text-to-image techniques as well as general tools and resources.
-
Video
- Awesome Generative Deep Art - A curated list of Generative Deep Art / Generative AI projects, tools, artworks, and models
-
-
Learning
-
Courses
- Practical Deep Learning for Coders (fast.ai)
- Introduction to Deep Learning (CMU)
- Deep Learning for Computer Vision (UMich)
- Deep Learning for Computer Vision (Stanford CS231n)
- Natural Language Processing with Deep Learning (Stanford CS224n)
- Deep Generative Models (Stanford)
- Deep Unsupervised Learning (UC Berkeley)
- Differentiable Inference and Generative Models (Toronto)
- From Deep Learning Foundations to Stable Diffusion (fast.ai)
- Deep Learning for Art, Aesthetics, and Creativity (MIT)
- Art and Machine Learning (CMU)
- New Media Installation: Art that Learns (CMU)
- Deep Learning (NYU)
- Deep Learning (NYU)
-
Videos
-
Books
-
Tutorials and Blogs
- VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance (Crowson and Biderman)
- Tutorial on Deep Generative Models (IJCAI-ECAI 2018)
- Tutorial on GANs (CVPR 2018)
- Lil'Log (Lilian Weng)
- Distill [on hiatus
- Making Generative Art with Simple Mathematics
- Book of Shaders: Generative Designs
- Mike Bostock: Visualizing Algorithms
- Generative Music
-
Papers/Methods
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
- GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
- High-Resolution Image Synthesis with Latent Diffusion Models
- Prompt-to-Prompt Image Editing with Cross-Attention Control
- An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion - to-prompt but instead takes an input image and a text description. Kinda like Style Transfer... but with Stable diffusion.
- DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation
- Novel View Synthesis with Diffusion Models
- AudioGen: Textually Guided Audio Generation
- Make-A-Video: Text-to-Video Generation without Text-Video Data
- Imagic: Text-Based Real Image Editing with Diffusion Models
- Soft Diffusion: Score Matching for General Corruptions
- Multi-Concept Customization of Text-to-Image Diffusion
- eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
- Imagen Video: High Definition Video Generation with Diffusion Models
- Structure-from-Motion Revisited
- Deferred Neural Rendering: Image Synthesis using Neural Textures
- Neural Volumes: Learning Dynamic Renderable Volumes from Images
- DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
- Neural Radiance Fields for Unconstrained Photo Collections
- Nerfies: Deformable Neural Radiance Fields - the-wild photos and videos (like from a cellphone)
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
- Depth-supervised NeRF: Fewer Views and Faster Training for Free
- NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields
- nerf2nerf: Pairwise Registration of Neural Radiance Fields
- ClimateNeRF: Physically-based Neural Rendering for Extreme Climate Synthesis
- Neural Point Catacaustics for Novel-View Synthesis of Reflections
- 3D Moments from Near-Duplicate Photos
- NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors
-
3D and point clouds
- DreamFusion: Text-to-3D using 2D Diffusion (Google)
- 3D Neural Field Generation using Triplane Diffusion
- 🎠MagicPony: Learning Articulated 3D Animals in the Wild
- ObjectStitch: Generative Object Compositing (Adobe)
- LADIS: Language Disentanglement for 3D Shape Editing (Snap)
- Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion (Microsoft)
- DiffRF: Rendering-guided 3D Radiance Field Diffusion (Meta)
- Novel View Synthesis with Diffusion Models (Google)
- Magic3D: High-Resolution Text-to-3D Content Creation (NVIDIA)
-
Unconditional Image Synthesis
- Sampling Generative Networks
- Neural Discrete Representation Learning (VQVAE)
- Progressive Growing of GANs for Improved Quality, Stability, and Variation
- A Style-Based Generator Architecture for Generative Adversarial Networks (StyleGAN)
- Analyzing and Improving the Image Quality of StyleGAN (StyleGAN2)
- Generating Diverse High-Fidelity Images with VQ-VAE-2
- Diffusion Models Beat GANs on Image Synthesis
- StyleNAT: Giving Each Head a New Perspective
- StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets
-
Conditional Image Synthesis (and inverse problems)
- Semantic Editing of Scenes by Adding, Manipulating or Erasing Objects (SESAME)
- You Only Need Adversarial Supervision for Semantic Image Synthesis (OASIS)
- Multimodal Conditional Image Synthesis with Product-of-Experts GANs
- Palette: Image-to-Image Diffusion Models
- Sketch-Guided Text-to-Image Diffusion Models
- PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation
- Pretraining is All You Need for Image-to-Image Translation (PITI)
-
GAN inversion (and editing)
-
Latent Space Interpretation
-
Image Matting
-
Programming Languages
Categories
Sub Categories
Papers/Methods
29
Other
27
Permissively Licensed/Open Access
26
Creative Coding
16
Courses
14
Video
13
3D and point clouds
9
Tutorials and Blogs
9
Unconditional Image Synthesis
9
Conditional Image Synthesis (and inverse problems)
7
Image Matting
6
Deep Learning Frameworks
6
Stable Diffusion (SD)
6
Creative ML
5
Books
5
Faces/People (restricted licenses)
5
Videos
5
Runtimes/Deployment
5
Generative Modeling
4
GAN inversion (and editing)
4
Neural Radiance Fields
3
Latent Space Interpretation
2
Text-to-Image
2
Foundational Papers
1