Architectures 66 Important References 3

**ViT: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale** 4 **Fuyu-8B: A Multimodal Architecture for AI Agents** 2 **IDEFICS** 2 **Flamingo: a Visual Language Model for Few-Shot Learning** 1 **SigLIP: Sigmoid Loss for Language Image Pre-Training** 1 **KOSMOS-2: Grounding Multimodal Large Language Models to the World** 1 **COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training** 1 **SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models** 1 **CLIP: Contrastive Language-Image Pre-training** 1 **Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond** 1 **TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones** 1 **DeepSeek-VL: Towards Real-World Vision-Language Understanding** 1 **OtterHD: A High-Resolution Multi-modality Model** 1 **MiniCPM-V: A GPT-4V Level MLLM on Your Phone** 1 **MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models** 1 **BLIP: Bootstrapping Language-Image Pre-training** 1 **MetaCLIP: Demystifying CLIP Data** 1 **BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions** 1 **MULTIINSTRUCT: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning** 1 **VITA: Towards Open-Source Interactive Omni Multimodal LLM** 1 **LLaVA 1.5: Improved Baselines with Visual Instruction Tuning** 1 **ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models** 1 **Parrot: Multilingual Visual Instruction Tuning** 1 **PaLI-3 Vision Language Models: Smaller, Faster, Stronger** 1 **SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models** 1 **CogVLM2: Enhanced Vision-Language Models for Image and Video Understanding** 1 **LaVIN: Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models** 1 **MANTIS: Mastering Multi-Image Understanding Through Interleaved Instruction Tuning** 1 **CogVLM: Visual Expert for Pretrained Language Models** 1 **xGen-MM (BLIP-3): An Open-Source Framework for Building Powerful and Responsible Large Multimodal Models** 1 **KOSMOS-1: Language Is Not All You Need: Aligning Perception with Language Models** 1 **BakLLaVA** 1 **MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning** 1 **Florence-2: A Deep Dive into its Unified Architecture and Multi-Task Capabilities** 1 **VILA²: VILA Augmented VILA** 1 **OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models** 1 **LLaVA-OneVision: Easy Visual Task Transfer** 1 **InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD** 1 **ImageBind: One Embedding Space To Bind Them All** 1 **PaLM-E: An Embodied Multimodal Language Model** 1 **SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models** 1 **InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning** 1 **OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding** 1 **GLaMM: Pixel Grounding Large Multimodal Model** 1 **InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output** 1 **Ferret: Refer and Ground Anything Anywhere at Any Granularity** 1 **MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices** 1 **CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding** 1 **EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders** 1 **FROZEN: Multimodal Few-Shot Learning with Frozen Language Models** 1 **Alpha-CLIP: A CLIP Model Focusing on Wherever You Want** 1 **MouSi: Poly-Visual-Expert Vision-Language Models** 1 **PaLI: A Jointly-Scaled Multilingual Language-Image Model** 1 **EVLM: An Efficient Vision-Language Model for Visual Understanding** 1 **GLIP: Grounded Language-Image Pre-training** 1 **u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model** 1 **INF-LLaVA: High-Resolution Image Perception for Multimodal Large Language Models** 1 **LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents** 1 **PaliGemma: A Versatile and Transferable 3B Vision-Language Model** 1 **MoE-LLaVA: Mixture of Experts for Large Vision-Language Models** 1 **Idefics3-8B: Building and Better Understanding Vision-Language Models** 1 **BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models** 1 **LLaVA: Large Language and Vision Assistant - Visual Instruction Tuning** 1 **Idefics2** 1