An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with image-captioning

A curated list of projects in awesome lists tagged with image-captioning .

https://github.com/salesforce/blip

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

image-captioning image-text-retrieval vision-and-language-pre-training vision-language vision-language-transformer visual-question-answering visual-reasoning

Last synced: 14 May 2025

https://github.com/salesforce/BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

image-captioning image-text-retrieval vision-and-language-pre-training vision-language vision-language-transformer visual-question-answering visual-reasoning

Last synced: 16 Mar 2025

https://github.com/OpenGVLab/InternGPT

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

chatgpt click draggan foundation-model gpt gpt-4 gradio husky image-captioning imagebind internimage langchain llama llm multimodal sam segment-anything vicuna video-generation vqa

Last synced: 27 Mar 2025

https://github.com/opengvlab/interngpt

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

chatgpt click draggan foundation-model gpt gpt-4 gradio husky image-captioning imagebind internimage langchain llama llm multimodal sam segment-anything vicuna video-generation vqa

Last synced: 14 May 2025

https://github.com/ofa-sys/ofa

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

chinese image-captioning multimodal pretrained-models pretraining prompt prompt-tuning referring-expression-comprehension text-to-image-synthesis vision-language visual-question-answering

Last synced: 15 May 2025

https://github.com/OFA-Sys/OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

chinese image-captioning multimodal pretrained-models pretraining prompt prompt-tuning referring-expression-comprehension text-to-image-synthesis vision-language visual-question-answering

Last synced: 02 Apr 2025

https://github.com/ttengwang/caption-anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything

chatgpt controllable-generation controllable-image-captioning image-captioning segment-anything

Last synced: 15 May 2025

https://github.com/ttengwang/Caption-Anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything

chatgpt controllable-generation controllable-image-captioning image-captioning segment-anything

Last synced: 12 Mar 2025

https://github.com/peteanderson80/bottom-up-attention

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

caffe captioning-images faster-rcnn image-captioning mscoco mscoco-dataset visual-question-answering vqa

Last synced: 08 Apr 2025

https://github.com/imaginary-cloud/cameramanager

Simple Swift class to provide all the configurations you need to create custom camera view in your app

camera carthage cocoapods custom-camera image-captioning ios qrcode-reader swift swift-package-manager video-recording

Last synced: 10 Apr 2025

https://github.com/imaginary-cloud/CameraManager

Simple Swift class to provide all the configurations you need to create custom camera view in your app

camera carthage cocoapods custom-camera image-captioning ios qrcode-reader swift swift-package-manager video-recording

Last synced: 30 Jul 2025

https://github.com/nvlabs/prismer

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

image-captioning language-model multi-modal-learning multi-task-learning vision-and-language vision-language-model vqa

Last synced: 16 May 2025

https://github.com/ruotianluo/self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

image-captioning

Last synced: 16 May 2025

https://github.com/yehli/xmodaler

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

cross-modal-retrieval image-captioning pretraining tden video-captioning vision-and-language visual-question-answering

Last synced: 12 Apr 2025

https://github.com/YehLi/xmodaler

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

cross-modal-retrieval image-captioning pretraining tden video-captioning vision-and-language visual-question-answering

Last synced: 02 Apr 2025

https://github.com/jhc13/taggui

Tag manager and captioner for image datasets

cogvlm florence-2 image-captioning image-tagging llava pyside6 stable-diffusion tag-manager

Last synced: 10 Aug 2025

https://github.com/kdexd/virtex

[CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations

coco-dataset cvpr2021 image-captioning model-zoo pretrained-models

Last synced: 05 Apr 2025

https://github.com/subho406/OmniNet

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

artificial-intelligence deep-learning image-captioning machine-learning multimodal-learning multitask-learning neural-network nlp transformer video-recognition

Last synced: 19 Jul 2025

https://github.com/kuanghuei/scan

PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)

computer-vision cross-modal deep-learning image-captioning neural-network pytorch visual-semantic

Last synced: 24 Jun 2025

https://github.com/jiasenlu/adaptiveattention

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

attention-mechanism image-captioning torch

Last synced: 09 Apr 2025

https://github.com/jiasenlu/AdaptiveAttention

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

attention-mechanism image-captioning torch

Last synced: 19 Jul 2025

https://github.com/yashk2810/Image-Captioning

Image Captioning using InceptionV3 and beam search

beam-search cnn image-captioning keras lstm tensorflow

Last synced: 19 Jul 2025

https://github.com/yashk2810/image-captioning

Image Captioning using InceptionV3 and beam search

beam-search cnn image-captioning keras lstm tensorflow

Last synced: 21 Jul 2025

https://github.com/scopeInfinity/Video2Description

Video to Text: Natural language description generator for some given video. [Video Captioning]

audio-processing cnn-keras deep-neural-networks image-captioning lstm-neural-networks video-captioning video-processing video-to-text

Last synced: 07 Apr 2025

https://github.com/krasserm/fairseq-image-captioning

Transformer-based image captioning extension for pytorch/fairseq

fairseq image-captioning pytorch transformer

Last synced: 07 Apr 2025

https://github.com/aimagelab/show-control-and-tell

Show, Control and Tell: A Framework for Generating Controllable and Grounded Captions. CVPR 2019

caption-generation captioning-images cvpr2019 image-captioning pytorch visual-semantic

Last synced: 07 Sep 2025

https://github.com/jdai-cv/image-captioning

Implementation of 'X-Linear Attention Networks for Image Captioning' [CVPR 2020]

image-captioning vision-and-language

Last synced: 09 Apr 2025

https://github.com/anuragmishracse/caption_generator

A modular library built on top of Keras and TensorFlow to generate a caption in natural language for any input image.

bleu-score captioning-images cnn image image-captioning keras lstm rnn tensorflow

Last synced: 09 Apr 2025

https://github.com/DataTurks/DataTurks

ML data annotations made super easy for teams. Just upload data, add your team and build training/evaluation dataset in hours.

annotation-tool document-annotate document-classification image-captioning image-classification image-processing image-segmentation java ner

Last synced: 23 Aug 2025

https://github.com/peteanderson80/up-down-captioner

Automatic image captioning model based on Caffe, using features from bottom-up attention.

caffe captioning-images image-captioning lstm

Last synced: 20 Jun 2025

https://github.com/j-min/clip-caption-reward

PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)

clip image-captioning reinforcement-learning vision-and-language

Last synced: 10 Apr 2025

https://github.com/gokayfem/comfyui_vlm_nodes

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

comfyui custom-nodes image-captioning img2sfx img2text joytag llava llm mllm nodes phi15 siglip vlm

Last synced: 07 Apr 2025

https://github.com/gokayfem/ComfyUI_VLM_nodes

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

comfyui custom-nodes image-captioning img2sfx img2text joytag llava llm mllm nodes phi15 siglip vlm

Last synced: 14 Jul 2025

https://github.com/peteanderson80/spice

Semantic Propositional Image Caption Evaluation

captioning-images image-captioning mscoco

Last synced: 15 Apr 2025

https://github.com/zhiqwang/sightseq

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

attention crnn ctc densenet faster-rcnn image-captioning mobilenet object-detection ocr pytorch scene-texts text-recognition transformer

Last synced: 14 Aug 2025

https://github.com/phachon/gis

gis (go image server) go 实现的图片服务,实现基本的上传,下载,存储,按比例裁剪等功能

fastdfs fastgfs gfs go golang image image-captioning image-download image-gallery image-thumbnails image-upload imageserver picture picture-server pictures tfs thumbnail

Last synced: 14 May 2025

https://github.com/jmisilo/clip-gpt-captioning

CLIPxGPT Captioner is Image Captioning Model based on OpenAI's CLIP and GPT-2.

computer-vision cv deep-learning image-caption image-caption-generator image-captioning machine-learning nlp python pytorch

Last synced: 09 Apr 2025

https://github.com/zsdonghao/image-captioning

TensorFlow (TensorLayer) Implementation of Image Captioning

deep-learning image-captioning tensorflow tensorlayer

Last synced: 14 Apr 2025

https://github.com/zsdonghao/Image-Captioning

TensorFlow (TensorLayer) Implementation of Image Captioning

deep-learning image-captioning tensorflow tensorlayer

Last synced: 13 Apr 2025

https://github.com/x-plug/mplug

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)

image-captioning image-text image-text-retrieval multimodal pretraining pytorch transformer visual-language vqa

Last synced: 26 Jun 2025

https://github.com/miteshputhran/image-caption-generator

The LSTM model generates captions for the input images after extracting features from pre-trained VGG-16 model. (Computer Vision, NLP, Deep Learning, Python)

bleu-score caption-generator computer-vision flickr image-captioning jupyter-notebook lstm-model machine-learning natural-language-processing python

Last synced: 14 Apr 2025

https://github.com/arashsajjadi/ai-powered-video-analyzer

An offline AI-powered video analysis tool with object detection (YOLO), image captioning (BLIP), speech transcription (Whisper), audio event detection (PANNs), and AI-generated summaries (LLMs via Ollama). It ensures privacy and offline use with a user-friendly GUI.

ai-video-analysis audio-event-detection blip2 gui image-captioning image-captioning-ai llm llm-summarization object-detection offline-processing ollama ollama-api panns privacy speech-transcription whisper whisper-ai yolo yolo11

Last synced: 15 Jun 2026

https://github.com/kacky24/stylenet

A pytorch implemention of "StyleNet: Generating Attractive Visual Captions with Styles"

caption cnn dlhacks image-captioning lstm microsoft pytorch pytorch-implemention stylenet

Last synced: 13 Apr 2025

https://github.com/gt-ripl/xmodal-ctx

Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning

clip cross-modal image-captioning vision-and-language

Last synced: 11 Apr 2025

https://github.com/neural-nuts/cam2caption

[DEPRECATED] An Android application which converts camera feed to captions in real time

android-application convolutional-neural-networks image-captioning recurrent-neural-networks tensorflow-android tensorflow-models

Last synced: 30 Sep 2025

https://github.com/peteanderson80/coco-caption

Adds SPICE metric to coco-caption evaluation server codes

captioning-images image-captioning mscoco mscoco-dataset mscoco-image-dataset spice

Last synced: 20 Aug 2025

https://github.com/Curt-Park/cs231n_assignments

[Assignments] CS231N: Convolutional Neural Networks for Visual Recognition (2016 & 2017)

convolutional-neural-networks image-captioning recurrent-neural-networks visual-recognition

Last synced: 20 Apr 2025

https://github.com/curt-park/cs231n_assignments

[Assignments] CS231N: Convolutional Neural Networks for Visual Recognition (2016 & 2017)

convolutional-neural-networks image-captioning recurrent-neural-networks visual-recognition

Last synced: 13 Apr 2025

https://github.com/visinf/cos-cvae

Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)

conditional-vae image-captioning latent-variable-models neurips2020 variational-autoencoder

Last synced: 23 Mar 2025

https://github.com/yuanxiaosc/image-captioning

CNN-Encoder and RNN-Decoder (Bahdanau Attention) for image caption or image to text on MS-COCO dataset. 图片描述

image-captioning image2text template-project tensorflow tensorflow2

Last synced: 25 Jun 2025

https://github.com/angeligareta/image-captioning

Image Caption Generator implemented using Tensorflow and Keras in a Python Jupyter Notebook. The goal is to describe the content of an image by using a CNN and RNN.

cnn cnn-keras cnn-tensorflow image-caption-generator image-captioning jupyter-notebook keras python rnn rnn-tensorflow tensorflow

Last synced: 06 Mar 2026

https://github.com/aimagelab/camel

CaMEL: Mean Teacher Learning for Image Captioning. ICPR 2022

artificial-intelligence captioning captioning-images computer-vision image-captioning pytorch

Last synced: 11 Apr 2025

https://github.com/akagawatsurunaki/zerolanliverobot

AI VTuber with LLM, ASR, TTS, OCR, CV and more technologies to live stream or play Minecraft with you.

ai ai-vtuber asr bilibili cv image-captioning llm minecraft ocr tts video-captioning

Last synced: 18 Jan 2026

https://github.com/aldenhovel/bleu-rouge-meteor-cider-spice-eval4imagecaption

Evaluation tools for image captioning. Including BLEU, ROUGE-L, CIDEr, METEOR, SPICE scores.

bleu cider evaluation-metrics image-captioning meteor rouge-l spice

Last synced: 12 Apr 2025

https://github.com/cstsunfu/dlk

A PyTorch Based Deep Learning Quick Develop Framework. One-Stop for train/predict/server/demo

adversarial-training deep-learning demo grid-search image-captioning image-classification lightning ner nli pytorch relation-extraction streamlit summary

Last synced: 18 Sep 2025

https://github.com/lromul/gramtion

Twitter bot for generating photo descriptions (alt text)

accessibility alt-text deep-learning image-captioning twitter twitter-bot

Last synced: 05 May 2025

https://github.com/markdtw/soft-attention-image-captioning

tensorflow implementation of show, attend and tell (ICML'15)

image-captioning tensorflow

Last synced: 04 Oct 2025

https://github.com/peri044/stt

A multi-task model which does image captioning, sentence paraphrasing and cross-modal retrieval.

common-vector-space cross-modal-retrieval deep-learning image-captioning sentence-paraphrasing sequence-to-sequence

Last synced: 15 Mar 2026

https://github.com/koldim2001/image_captioning

Генерация описаний к изображениям с помощью различных архитектур нейронных сетей

attention-mechanism captioning-images computer-vision image-captioning lstm model-deployment model-inference nlp soft-attention streamlit website word-embeddings

Last synced: 23 Oct 2025

https://github.com/aimagelab/pma-net

With a Little Help from your own Past: Prototypical Memory Networks for Image Captioning. ICCV 2023

captioning captioning-images iccv2023 image-captioning memory-augmented-neural-networks transformer vision-and-language vision-language

Last synced: 22 Jul 2025

https://github.com/aimagelab/dico

[BMVC'24 Oral ✨] Revisiting Image Captioning Training Paradigm via Direct CLIP-based Optimization

bmvc2024 caption-generation captioning-images image-captioning vision-and-language

Last synced: 11 Apr 2025

https://github.com/adityajn105/image-caption-bot

Implementation of 'merge' architecture for generating image captions from paper "What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?" using Keras. Dataset used is Flickr8k available on Kaggle.

flickr8k-dataset image-captioning lstm-networks vgg19

Last synced: 13 Apr 2025

https://github.com/soskek/captioning_chainer

A fast implementation of Neural Image Caption by Chainer

beam-search chainer image-captioning neural-networks rnn

Last synced: 04 Oct 2025

https://github.com/rayandrew/indonesian-image-captioning

Indonesian Image Captioning using Attention-based Semantic Compositional Networks

attention captioning image-captioning indonesia indonesian pytorch resnet

Last synced: 12 Apr 2025

https://github.com/aehrc/cxrmate

CXRMate: Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation

chest-x-ray-report-generation chest-xray-images image-captioning medical-imaging multimodal-learning radiology-reports

Last synced: 12 Apr 2025

https://github.com/kabachuha/video2scenario

Recursively writes descriptions of video scenes using Large Language Models and Image Captioners

gradio image-captioning large-language-models video-labeling

Last synced: 19 Mar 2025

https://github.com/gabrielepicco/pynter

Minimal Python utility for writing textual caption on images

image-captioning write-on-image

Last synced: 23 Apr 2025

https://github.com/ajaysub110/a-neural-compositional-paradigm-for-image-captioning

Implementation of 'A Neural Compositional Paradigm for Image Captioning' by B. Dai, S.Fidler, D. Lin

computer-vision deep-learning image-captioning natural-language-processing paper-implementations

Last synced: 01 Aug 2025

https://github.com/renovamen/image-captioning

PyTorch re-implementation of some papers on image captioning | 图像描述

adaptive-attention attention captions cv image-captioning nlp pytorch show-and-tell show-attend-and-tell

Last synced: 24 Apr 2025

https://github.com/ShaunakSen/AI-for-Web-Accessibility

This is the GitHub repository for my Masters dissertation titled: Artificial Intelligence for Web Accessibility which I completed as a part of my MSc in Data Science course in the University of Southampton, UK under the supervision of Prof. Mike Wald

artificial-intelligence convolutional-neural-networks deep-learning image-captioning natural-language-processing recurrent-neural-networks transfer-learning web-accessibility word2vec

Last synced: 11 Mar 2025