awesome-multimodal-ml

Reading list for research topics in multimodal machine learning
https://github.com/pliang279/awesome-multimodal-ml

Last synced: 5 days ago
JSON representation

Applications and Datasets

Programming Languages

Categories

Applications and Datasets 436 Core Areas 172 Survey Papers 108 Architectures 10 Course content + workshops 3

Sub Categories

Multimodal Content Generation 112 Human AI Interaction 59 Multimodal Representations 41 Language and Visual QA 31 Multimodal Machine Translation 29 Multimodal Fusion 26 Language Grounding in Vision 26 Language Grouding in Navigation 24 Media Description 21 Robotics 19 Audio and Visual 19 Multi-agent Communication 16 Healthcare 16 Affect Recognition and Multimodal Language 14 Multimodal Alignment 11 Language and Audio 11 Multimodal Reinforcement Learning 11 Generative Learning 10 Bias and Fairness 10 Multimodal Pretraining 10 Multimodal Dialog 8 Knowledge Graphs and Knowledge Bases 7 Analysis of Multimodal Models 6 Multimodal Memory 6 Self-supervised Learning 6 Multimodal Translation 6 Commonsense Reasoning 6 Missing or Imperfect Modalities 5 Few-Shot Learning 5 Language Models 5 Crossmodal Retrieval 5 Multimodal Co-learning 4 Autonomous Driving 4 Human in the Loop Learning 4 Finance 4 Semi-supervised Learning 4 Intepretable Learning 4 Multimodal Transformers 4 Visual, IMU and Wireless 3 Video Generation from Text 3 Adversarial Attacks 3