Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

27 "multimodal" Awesome Lists

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

chain-of-thought in-context-learning instruction-following instruction-tuning large-language-models large-vision-language-model large-vision-language-models multi-modality multimodal-chain-of-thought multimodal-in-context-learning

8,858 stars
589 forks
408 projects

Last updated: 25 Apr 2024

awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

computer-vision deep-learning healthcare machine-learning multimodal-learning natural-language-processing reading-list reinforcement-learning representation-learning robotics

5,465 stars
820 forks
474 projects

Last updated: 04 May 2024

Awesome-AIGC-Tutorials

Curated tutorials and resources for Large Language Models, AI Painting, and more.

ai aigc awesome chatgpt courses-resource deep-learning llm midjourney multimodal nlp

3,438 stars
222 forks
140 projects

Last updated: 03 May 2024

Awesome-Text-to-Image

(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.

awseome-list generative-adversarial-network image-generation image-manipulation image-synthesis multimodal multimodal-deep-learning survey text-to-face text-to-image

1,853 stars
172 forks
387 projects

Last updated: 14 Apr 2024

Awesome-Multimodal-Research

A curated list of Multimodal Related Research.

awesome multimodal multimodal-learning multimodal-research

1,264 stars
150 forks
38 projects

Last updated: 23 Apr 2024

awesome-vision-language-pretraining-papers

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

bert multimodal-deep-learning pretraining vision-and-language vl-ptms

1,125 stars
101 forks
82 projects

Last updated: 01 May 2024

Awesome-LLM-Reasoning

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

awesome chain-of-thought chatgpt cot gpt gpt-4 in-context-learning language-models mllm multimodal

1,114 stars
58 forks
115 projects

Last updated: 08 May 2024

awesome-grounding

awesome grounding: A curated list of research papers in visual grounding

arxiv awesome-list captioning-images captioning-videos computer-vision embodied-agent grounding image-grounding language-grounding multimodal-deep-learning

958 stars
92 forks
154 projects

Last updated: 04 May 2024

awesome-japanese-llm

日本語LLMまとめ - Overview of Japanese LLMs

awesome awesome-list awesome-lists embeddings foundation-models generative-ai generative-model generative-models japanese japanese-language

756 stars
21 forks
226 projects

Last updated: 07 May 2024

awesome-vision-and-language

A curated list of awesome vision and language resources (still under construction... stay tuned!)

awesome awesome-list multimodal-learning vision-and-language

399 stars
33 forks
188 projects

Last updated: 01 May 2024

awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

large-language-models large-multimodal-models medical-imaging medical-report-generation multimodal-deep-learning multimodal-large-language-models multimodal-learning visual-question-answering

296 stars
28 forks
211 projects

Last updated: 10 Apr 2024

awesome-Vision-and-Language-Pre-training

Recent Advances in Vision and Language Pre-training (VLP)

multimodal-deep-learning pretraining vision-and-language vision-and-language-pre-training vlp

278 stars
14 forks
107 projects

Last updated: 28 Apr 2024

multimodal-ml-music

List of academic resources on Multimodal ML for Music

academic-publications awesome-list multimodal-data multimodal-deep-learning multimodal-learning music-ai music-information-retrieval music-research resources

270 stars
12 forks
59 projects

Last updated: 01 May 2024

awesome-self-supervised-multimodal-learning

A curated list of self-supervised multimodal learning resources.

awesome-list machine-learning multimodal-learning self-supervised-learning

179 stars
7 forks
195 projects

Last updated: 07 Apr 2024

Awesome-Multimodal-LLM-Autonomous-Driving

[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving

autonomous-car autonomous-driving autonomous-vehicles foundation-models large-language-models multimodal multimodal-large-language-models self-driving vision-language-model vision-transformer

131 stars
3 forks
53 projects

Last updated: 18 Apr 2024

awesome-Large-MultiModal-Hallucination

😎 up-to-date & curated list of awesome LMM hallucinations papers, methods & resources.

hallucination lmm multi-modal multimodal

110 stars
10 forks
47 projects

Last updated: 30 Apr 2024

awesome-rvos

Referring Video Object Segmentation / Multi-Object Tracking Repo

image linguistic multi-modal multimodal-deep-learning refer-segmentation refer-vos refering-seg rvos segmentation text

80 stars
4 forks
44 projects

Last updated: 09 Apr 2024

awesome-vlm-architectures

Famous Vision Language Models and Their Architectures

awesome awesome-list blip clip cogvlm image-encoder internlm kosmos llava multimodal

66 stars
7 forks
56 projects

Last updated: 09 Apr 2024

Awesome-Multimodal-Chatbot

Awesome Multimodal Assistant is a curated list of multimodal chatbots/conversational assistants that utilize various modes of interaction, such as text, speech, images, and videos, to provide a seamless and versatile user experience.

awesome chat-application chatbot general-ai instruction-following instruction-tuning multimodal multimodal-assistant multimodal-dialogue papers

58 stars
5 forks
61 projects

Last updated: 23 Apr 2024

awesome-salient-object-detection

A curated list of awesome resources for salient object detection (SOD), focusing more on multi-modal SOD, such as RGB-D SOD.

multimodal object-segmentation rgbd-sod salient-object-detection sod

52 stars
2 forks
107 projects

Last updated: 21 Apr 2024

Awesome-Multi-Modal-Dialog

[Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics

awesome-list dialogue dialogue-system multimodal multimodal-datasets multimodal-deep-learning multimodal-dialogue multimodal-learning paperlist

34 stars
4 forks
67 projects

Last updated: 25 Apr 2024

awesome-visual-dialog

Recent Advances in Visual Dialog

guesswhat multimodal-deep-learning multimodal-dialogue visual-dialog

29 stars
1 forks
33 projects

Last updated: 09 Mar 2024

awesome-multimodal-dialogue

Paper, dataset and code list for multimodal dialogue.

dialog dialogue multimodal-dialogue visual-dialog visual-dialogue

16 stars
0 forks
58 projects

Last updated: 25 Apr 2024

awesome-mmps

Corpus of resources for multimodal machine learning with physiological signals

deep-learning machine-learning multimodal multimodal-data multimodal-deep-learning multimodal-learning physiological-signals signal-processing

7 stars
0 forks
140 projects

Last updated: 25 Mar 2024

awesome-multimodal-convai

Paper reading list for Multimodal Conversational AI

computer-vision conversational-ai deep-learning dialogue-systems language machine-learning multimodal natural-language-processing nlp papers

3 stars
0 forks
78 projects

Last updated: 25 Apr 2024

Keywords
awesome-list 2,418 awesome 2,207 machine-learning 320 list 289 deep-learning 280 resources 230 hacktoberfest 193 awesome-lists 183 lists 163 python 156 javascript 133 security 117 blockchain 98 computer-vision 98 artificial-intelligence 79 data-science 77 ai 74 nlp 74 react 72 open-source 68 android 65 curated-list 65 tools 64 chatgpt 63 natural-language-processing 59 ios 58 learning 57 ethereum 57 linux 55 awesome-readme 53 css 52 devops 52 papers 50 nodejs 47 reinforcement-learning 46 kubernetes 42 llm 42 computer-science 42 robotics 41 game-development 41 frontend 40 macos 39 awesome-resources 39 bitcoin 38 tutorial 37 golang 37 privacy 37 design 37 php 36 deep-neural-networks 36 collection 36 programming 35 cybersecurity 35 openai 35 large-language-models 35 development 34 java 34 datasets 33 rust 33 books 32 cloud 32 web 32 cryptocurrency 32 swift 32 hacking 32 dataset 31 paper 31 go 30 web3 30 data 30 education 29 opensource 29 security-tools 29 iot 29 neural-network 27 tutorials 27 data-visualization 27 database 27 gpt 27 vue 27 gamedev 27 aws 26 html 25 tensorflow 25 smart-contracts 25 courses 24 community 24 collections 24 free 24 architecture 24 research 24 libraries 24 ruby 23 software 23 flutter 23 docker 23 framework 22 gpt-4 22 game 21 github 21 video 21 paper-list 21 react-native 21 typescript 21 automation 21 solidity 21 developer-tools 21 games 20 api 20 reactjs 20 gpt-3 20 defi 20 hardware 19 documentation 19 testing 19 object-detection 19 music 19 angular 19 links 19 algorithms 19 pytorch 18 embedded 18 audio 18 unity 18 windows 18 awesomeness 18 bioinformatics 18 serverless 18 computer-graphics 17 graph-neural-networks 17 best-practices 17 raspberry-pi 17 data-mining 17 hacktoberfest-accepted 17 cryptography 17 cpp 17 federated-learning 17 mobile 17 survey 17 ml 17 microsoft 17 dotnet 17 awsome 16 startups 16 containers 16 csharp 16 visualization 16 youtube 16 r 16 git 16 productivity 16 cloud-computing 16 web-development 16 programming-language 16 pentesting 16 kotlin 16 infosec 16 segmentation 16 deeplearning 16 science 15 ui 15 azure 15 osint 15 machinelearning 15 markdown 15 knowledge-graph 15 time-series 15 interview 15 penetration-testing 15 software-engineering 14 transformer 14 c 14 microservices 14 neural-networks 14 awsome-list 14 image-processing 14 website 14 language 14 data-analysis 14 chinese 14 self-supervised-learning 14 graph 14 graphql 14 django 14 llms 14 slam 14 front-end 14 decentralized 14 cli 13 marketing 13 python3 13 optimization 13 saas 13 guidelines 13 opendata 13 roadmap 13 jobs 13 game-engine 13 reverse-engineering 13 webgl 13 cloud-native 13 crypto 13 vuejs 13 coding 13 deep-reinforcement-learning 13 apple 13 chatbot 13 multimodal 13 blogs 13 bash 12 autonomous-driving 12 speech-recognition 12 stable-diffusion 12 gis 12 knowledge 12 engineering 12 svelte 12 webassembly 12 podcast 12 finance 12 mysql 12 cms 12 sql 12 bugbounty 12 data-engineering 12 autonomous-vehicles 12 mathematics 12 ros 12 wordpress 12 statistics 12 startup 12 big-data 12 gan 11 curated 11 detection 11 elasticsearch 11 prompt-engineering 11 pentest 11 laravel 11 library 11 analytics 11 diffusion-models 11 llama 11 generative-adversarial-network 11 multimodal-deep-learning 11 hacktoberfest2020 11 dart 11 dapp 11 bert 11 icons 11 microservice 11 distributed-systems 11 monitoring 11 generative-ai 11 code 11 dotnet-core 10 question-answering 10 backend 10 mlops 10 telegram 10 apps 10 static-analysis 10 generative-art 10 node 10 representation-learning 10 android-development 10 cheatsheet 10 automl 10 prompt 10 pwa 10 resource 10 recommender-system 10 text-mining 10 terminal 10 p2p 10 devsecops 10 graphics 10 graphics-programming 10 open-data 10 seo 10 algorithm 10 evm 10 unicorns 10 unity3d 10 android-library 10 data-structures 10 malware-analysis 10 model-compression 10 networking 10 performance 10 wasm 10 storage 10 articles 10 rails 10 vscode 10 self-hosted 10 ecommerce 10 search 9 pose-estimation 9 simulation 9 front-end-development 9 design-systems 9 transfer-learning 9 fuzzing 9 software-development 9 malware 9 databases 9 interview-questions 9 quantization 9 plugins 9 point-cloud 9 movies 9 gpts 9 chatgpt-api 9 blog 9 webpack 9 search-engine 9 swiftui 9 technology 9 react-components 9 semantic-web 9 remote-sensing 9 authentication 9 js 9 guide 9 podcasts 9 oss 9 microservices-architecture 8 cross-platform 8 korean 8 prometheus 8 developer 8 book 8 google 8 mac 8 course 8 classification 8 article 8 trading 8 free-software 8 erlang 8 vision-and-language 8 projects 8 ubuntu 8 3d-graphics 8 art 8 quantum-computing 8 bsd 8 command-line 8 json 8 powershell 8 sentiment-analysis 8 haskell 8 language-model 8 planning 8 geospatial 8 operating-system 8 pruning 8 leadership 8 indonesia 8 transformers 8 management 8 cv 8 hacktoberfest2021 8 reading-list 8 system-design 8 speech-processing 8 neural-architecture-search 8 ansible 8 reddit 8 discord 8 multimodal-learning 8 frameworks 8 creative-coding 8 fpga 8 nerf 8 ux 8 augmented-reality 8 foss 8 jupyter-notebook 8 videos 8 vr 8 ctf 8 xcode 8 spring-boot 8 edge-computing 8 postgresql 8 text-to-image 8 learning-resources 7 static-site-generator 7 adversarial-attacks 7 fairness 7 speech 7 chinese-translation 7 healthcare 7 gpu 7 ui-design 7 gpt4 7 wordpress-plugin 7 3d-vision 7 readme 7 font 7 twitter 7 time-series-analysis 7 beginner-friendly 7 cvpr 7 k8s 7 nosql 7 notes 7 drug-discovery 7 open-science 7 arduino 7 flutter-examples 7 flutter-apps 7 webcomponents 7 gaming 7 application 7 blockchain-technology 7 animation 7 programming-languages 7 in-context-learning 7 map 7 load-testing 7 aigc 7 chemistry 7 few-shot-learning 7 email 7 lightning-network 7 adversarial-machine-learning 7 machine-learning-algorithms 7 explainable-ai 7 forensics 7 websites 7 interpretability 7 curated-lists 7 bots 7 infrastructure 7 spark 7 conference 7 checklist 7 reference 7 nginx 7 conferences 7 maps 7 bookmarks 7 terraform 7 ide 7 opengl 7 speech-to-text 7 rest-api 7 ionic 7 fintech 7 paas 7 infrastructure-as-code 7 vulnerabilities 7 sysadmin 7 hosting 7 semantic-segmentation 7 btc 7 hacking-tools 7 yolo 7 applications 7 flask 7 xai 7 arkit 6 no-code 6 apache-spark 6 software-architecture 6 covid-19 6 workflow 6 vision-transformer 6 android-app 6 network 6 research-paper 6 medical-imaging 6 cicd 6 trading-strategies 6 redteaming 6 3d-reconstruction 6 hacks 6 apis 6 desktop-environment 6 production 6 linux-desktop 6 design-system 6 sre 6 cheatsheets 6 meta-learning 6 gcp 6 lua 6 remote-work 6 browser 6 virtual-reality 6 job-board 6 low-code 6 reasoning 6 engineering-management 6 anomaly-detection 6 spring 6 redux 6