Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
27 "multimodal" Awesome Lists
Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.
chain-of-thought in-context-learning instruction-following instruction-tuning large-language-models large-vision-language-model large-vision-language-models multi-modality multimodal-chain-of-thought multimodal-in-context-learning
8,858 stars
589 forks
408 projects
Last updated: 25 Apr 2024
awesome-multimodal-ml
Reading list for research topics in multimodal machine learning
computer-vision deep-learning healthcare machine-learning multimodal-learning natural-language-processing reading-list reinforcement-learning representation-learning robotics
5,465 stars
820 forks
474 projects
Last updated: 04 May 2024
Awesome-AIGC-Tutorials
Curated tutorials and resources for Large Language Models, AI Painting, and more.
ai aigc awesome chatgpt courses-resource deep-learning llm midjourney multimodal nlp
3,438 stars
222 forks
140 projects
Last updated: 03 May 2024
Awesome-Text-to-Image
(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.
awseome-list generative-adversarial-network image-generation image-manipulation image-synthesis multimodal multimodal-deep-learning survey text-to-face text-to-image
1,853 stars
172 forks
387 projects
Last updated: 14 Apr 2024
Awesome-Multimodal-Research
A curated list of Multimodal Related Research.
awesome multimodal multimodal-learning multimodal-research
1,264 stars
150 forks
38 projects
Last updated: 23 Apr 2024
awesome-vision-language-pretraining-papers
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
bert multimodal-deep-learning pretraining vision-and-language vl-ptms
1,125 stars
101 forks
82 projects
Last updated: 01 May 2024
Awesome-LLM-Reasoning
Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.
awesome chain-of-thought chatgpt cot gpt gpt-4 in-context-learning language-models mllm multimodal
1,114 stars
58 forks
115 projects
Last updated: 08 May 2024
awesome-grounding
awesome grounding: A curated list of research papers in visual grounding
arxiv awesome-list captioning-images captioning-videos computer-vision embodied-agent grounding image-grounding language-grounding multimodal-deep-learning
958 stars
92 forks
154 projects
Last updated: 04 May 2024
awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
awesome awesome-list awesome-lists embeddings foundation-models generative-ai generative-model generative-models japanese japanese-language
756 stars
21 forks
226 projects
Last updated: 07 May 2024
awesome-vision-and-language
A curated list of awesome vision and language resources (still under construction... stay tuned!)
awesome awesome-list multimodal-learning vision-and-language
399 stars
33 forks
188 projects
Last updated: 01 May 2024
awesome-multimodal-in-medical-imaging
A collection of resources on applications of multi-modal learning in medical imaging.
large-language-models large-multimodal-models medical-imaging medical-report-generation multimodal-deep-learning multimodal-large-language-models multimodal-learning visual-question-answering
296 stars
28 forks
211 projects
Last updated: 10 Apr 2024
awesome-Vision-and-Language-Pre-training
Recent Advances in Vision and Language Pre-training (VLP)
multimodal-deep-learning pretraining vision-and-language vision-and-language-pre-training vlp
278 stars
14 forks
107 projects
Last updated: 28 Apr 2024
multimodal-ml-music
List of academic resources on Multimodal ML for Music
academic-publications awesome-list multimodal-data multimodal-deep-learning multimodal-learning music-ai music-information-retrieval music-research resources
270 stars
12 forks
59 projects
Last updated: 01 May 2024
awesome-emotion-recognition-in-conversations
A comprehensive reading list for Emotion Recognition in Conversations
conversational-ai dialogue-systems emotion-recognition emotion-recognition-in-conversation multimodal-deep-learning multimodal-interactions natural-language-processing
243 stars
42 forks
95 projects
Last updated: 01 May 2024
awesome-self-supervised-multimodal-learning
A curated list of self-supervised multimodal learning resources.
awesome-list machine-learning multimodal-learning self-supervised-learning
179 stars
7 forks
195 projects
Last updated: 07 Apr 2024
Awesome-Multimodal-LLM-Autonomous-Driving
[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving
autonomous-car autonomous-driving autonomous-vehicles foundation-models large-language-models multimodal multimodal-large-language-models self-driving vision-language-model vision-transformer
131 stars
3 forks
53 projects
Last updated: 18 Apr 2024
awesome-Large-MultiModal-Hallucination
😎 up-to-date & curated list of awesome LMM hallucinations papers, methods & resources.
hallucination lmm multi-modal multimodal
110 stars
10 forks
47 projects
Last updated: 30 Apr 2024
awesome-rvos
Referring Video Object Segmentation / Multi-Object Tracking Repo
image linguistic multi-modal multimodal-deep-learning refer-segmentation refer-vos refering-seg rvos segmentation text
80 stars
4 forks
44 projects
Last updated: 09 Apr 2024
awesome-vlm-architectures
Famous Vision Language Models and Their Architectures
awesome awesome-list blip clip cogvlm image-encoder internlm kosmos llava multimodal
66 stars
7 forks
56 projects
Last updated: 09 Apr 2024
Awesome-Multimodal-Chatbot
Awesome Multimodal Assistant is a curated list of multimodal chatbots/conversational assistants that utilize various modes of interaction, such as text, speech, images, and videos, to provide a seamless and versatile user experience.
awesome chat-application chatbot general-ai instruction-following instruction-tuning multimodal multimodal-assistant multimodal-dialogue papers
58 stars
5 forks
61 projects
Last updated: 23 Apr 2024
awesome-salient-object-detection
A curated list of awesome resources for salient object detection (SOD), focusing more on multi-modal SOD, such as RGB-D SOD.
multimodal object-segmentation rgbd-sod salient-object-detection sod
52 stars
2 forks
107 projects
Last updated: 21 Apr 2024
Awesome-Multimodal-LLM
Reading list for Multimodal Large Language Models
awesome-list computer-vision large-language-models machine-learning multimodal-large-language-models multimodal-machine-learning natural-language-processing paper-list vision-language-model
49 stars
6 forks
60 projects
Last updated: 04 Apr 2024
Awesome-Multi-Modal-Dialog
[Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
awesome-list dialogue dialogue-system multimodal multimodal-datasets multimodal-deep-learning multimodal-dialogue multimodal-learning paperlist
34 stars
4 forks
67 projects
Last updated: 25 Apr 2024
awesome-visual-dialog
Recent Advances in Visual Dialog
guesswhat multimodal-deep-learning multimodal-dialogue visual-dialog
29 stars
1 forks
33 projects
Last updated: 09 Mar 2024
awesome-multimodal-dialogue
Paper, dataset and code list for multimodal dialogue.
dialog dialogue multimodal-dialogue visual-dialog visual-dialogue
16 stars
0 forks
58 projects
Last updated: 25 Apr 2024
awesome-mmps
Corpus of resources for multimodal machine learning with physiological signals
deep-learning machine-learning multimodal multimodal-data multimodal-deep-learning multimodal-learning physiological-signals signal-processing
7 stars
0 forks
140 projects
Last updated: 25 Mar 2024
awesome-multimodal-convai
Paper reading list for Multimodal Conversational AI
computer-vision conversational-ai deep-learning dialogue-systems language machine-learning multimodal natural-language-processing nlp papers
3 stars
0 forks
78 projects
Last updated: 25 Apr 2024