Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Awesome-Multimodality
A Survey on multimodal learning research.
https://github.com/Yutong-Zhou-cv/Awesome-Multimodality
- Survey
- [v1
- 💬Transformer
- [v1
- [v1
- 💬Knowledge Enhanced
- [v1
- [v1
- [v1
- 💬Cardiac Image Computing
- 💬Vision and language Pre-training (VLP)
- 💬Video Saliency Detection
- 💬Vision and language Pre-training (VLP)
- 💬Vision and language Pre-training (VLP)
- 💬Vision and language Pre-training (VLP)
- 💬Multi-Modal Knowledge Graph
- 💬Auto Driving
- [v1
- 💬Vision and language
- [Paper
- [Paper - LLMl)]
- [Paper - dataset.github.io/wukong-dataset/download.html)]
- [Paper - WuDao/WuDaoMM/)]
- [Paper
- [Paper
- [Paper
- [Paper
- ![PWC - segmentation-on-ade20k?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - segmentation-on-ade20k-val?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - modal-retrieval-on-coco-2014?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - shot-cross-modal-retrieval-on-flickr30k?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - modal-retrieval-on-flickr30k?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - reasoning-on-nlvr2-dev?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - reasoning-on-nlvr2-test?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - question-answering-on-vqa-v2-test-dev?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - question-answering-on-vqa-v2-test-std?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - segmentation-on-coco?p=image-as-a-foreign-language-beit-pretraining)
- ![PWC - detection-on-coco?p=image-as-a-foreign-language-beit-pretraining)
- [Paper - PLM)]
- **CVPR 2022 Tutorial**
- 💬Data Augmentation
- [Paper - 97/X-VLM)]
- [Paper - learning-multiple-modalities-with.html)]
- [Paper
- [Paper
- [Paper
- [Paper - smile/TCL)]
- [Paper
- [Paper
- [Paper
- [Paper - alpha.github.io/)] [[Code](https://github.com/matrix-alpha/Accountable-Textual-Visual-Chat)]
- [Paper
- [Paper - gen.github.io/)] [[Code](https://github.com/microsoft/i-Code/tree/main/i-Code-V3)]
- [Paper - Owl/summary)] [[Code](https://github.com/X-PLUG/mPLUG-Owl)]
- [Paper
- 💬Visual Metaphors
- [Paper - NLP/MM-SHAP)]
- [Paper - Labs/Versatile-Diffusion)] [[Hugging Face](https://huggingface.co/spaces/shi-labs/Versatile-Diffusion)]
- 💬Vision-language transformer
- 💬Multimodal Modeling
- 💬Navigation
- 💬Video Chapter Generation
- 💬Visual Question Answering (VQA)
- 💬Multi-modal & Bias
- 💬Audio-Visual Speech Separation
- 💬Multi-modal for Recommendation
- 💬Video Synthesis - research/MMVID)] [[Project](https://snap-research.github.io/MMVID/)]
- 💬Dialogue State Tracking
- 💬Multi-modal Multi-task - VILAB/MultiMAE)] [[Project](https://multimae.epfl.ch/)]
- 💬Text-Video Retrieval - labs/xpool)] [[Project](https://layer6ai-labs.github.io/xpool/)]
- 💬Visual Commonsense - commonsense)]
- 💬Pretraining framework
- 💬Food Retrieval
- 💬Image+Videos+3D Data Recognition
- 💬Hyper-text Language-image Model
- 💬Visual Synthesis
- 💬Video-Text Alignment
- 💬Class-agnostic Object Detection
- 💬Video-Text Retrieval - Ng/HANet)]
- 💬Video Recognition
- 💬Video Representation
- 💬Text-guided Image Manipulation
- 💬Facial Editing - to-Edit)] [[Project](https://www.mmlab-ntu.com/project/talkedit/)] [[Dataset Project](https://mmlab.ie.cuhk.edu.hk/projects/CelebA/CelebA_Dialog.html)] [[Dataset(CelebA-Dialog Dataset)](https://drive.google.com/drive/folders/18nejI_hrwNzWyoF6SW8bL27EYnM4STAs)]
- 💬Video Action Recognition
- 💬Video+Language Pre-training
- CMU MultiModal Machine Learning
- Yutong ZHOU - Interaction-Laboratory) ଘ(੭*ˊᵕˋ)੭
Keywords