Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Awesome-Multimodal-Chatbot

Awesome Multimodal Assistant is a curated list of multimodal chatbots/conversational assistants that utilize various modes of interaction, such as text, speech, images, and videos, to provide a seamless and versatile user experience.
https://github.com/zjr2000/Awesome-Multimodal-Chatbot

Last synced: 1 day ago
JSON representation

  • Multimodal Instruction Tuning

  • LLM-Based Modularized Frameworks

    • [paper
    • [paper - columbia/viper) [[project page]](https://viper.cs.columbia.edu/)
    • [paper
    • [paper - CAIR/ChatCaptioner)
    • [paper - REACT) [[project page]](https://multimodal-react.github.io/) [[demo]](https://huggingface.co/spaces/microsoft-cognitive-service/mm-react)
    • [paper
    • ![Star
    • [paper - CAIR/ChatCaptioner/tree/main/Video_ChatCaptioner)
    • [paper
    • [paper - Anything) [[demo]](https://huggingface.co/spaces/ynhe/AskAnything)
    • [code
    • ![Star - columbia/viper)
    • ![Star - REACT)
Programming Languages
Python 2
Categories
Multimodal Instruction Tuning 31 LLM-Based Modularized Frameworks 13
Sub Categories
Keywords
whisper 1 video-language 1 large-language-model 1 langchain 1 chatgpt 1 vision-language-pretraining 1 video-language-pretraining 1 multi-modal-chatgpt 1 minigpt4 1 llama 1 large-language-models 1 cross-modal-pretraining 1 blip2 1