Projects in Awesome Lists by declare-lab

https://github.com/declare-lab/conv-emotion

This repo contains implementation of different architectures for emotion recognition in conversations.

conversational-agents conversational-ai dialogue-systems emotion-analysis emotion-recognition emotion-recognition-in-conversation lstm memory-network natural-language-processing natural-language-understanding pretrained-models pytorch sentiment-analysis

Last synced: 15 May 2025

https://github.com/declare-lab/tango

A family of diffusion models for text-to-audio generation.

audio-generation diffusion diffusion-models language-models large-language-models text-to-audio

Last synced: 16 May 2025

https://github.com/declare-lab/MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

chatbot conversational-ai dialogue dialogue-systems emotion emotion-detection emotion-recognition emotion-recognition-in-conversation multimodal-emotion-recognition multimodal-interactions multimodal-sentiment-analysis personality-profiling personality-traits sentiment-analysis

Last synced: 21 Jul 2025

https://github.com/declare-lab/meld

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

chatbot conversational-ai dialogue dialogue-systems emotion emotion-detection emotion-recognition emotion-recognition-in-conversation multimodal-emotion-recognition multimodal-interactions multimodal-sentiment-analysis personality-profiling personality-traits sentiment-analysis

Last synced: 16 May 2025

https://github.com/declare-lab/multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-deep-learning multimodal-interactions multimodal-learning multimodal-sentiment-analysis

Last synced: 25 Jan 2026

https://declare-lab.github.io/instruct-eval/

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

instruct-tuning llm

Last synced: 29 Mar 2025

https://github.com/declare-lab/instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

instruct-tuning llm

Last synced: 04 Apr 2025

https://github.com/declare-lab/flan-alpaca

This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.

alpaca flan-t5 language-model llm transformers

Last synced: 06 Apr 2025

https://github.com/declare-lab/misa

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis

Last synced: 04 Oct 2025

https://github.com/declare-lab/nora

NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks

vision-language-action-model

Last synced: 21 Jan 2026

https://github.com/declare-lab/multimodal-infomax

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

multimodal-deep-learning multimodal-fusion multimodal-sentiment-analysis

Last synced: 09 Mar 2026

https://github.com/declare-lab/reccon

This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.

bert-model causal-inference causal-models causal-spans causality conversations dataset dialogue-generation dialogue-systems emotion emotion-cause emotion-cause-pair-extraction emotion-recognition emotion-recognition-in-conversation emotion-tasks inference natural-language-inference reasoning roberta

Last synced: 23 Jul 2025

https://github.com/declare-lab/jamify

JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment

ai-song ai-song-generator song-generation tts

Last synced: 04 Apr 2026

https://github.com/declare-lab/relationprompt

This repository implements our ACL Findings 2022 research paper RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction. The goal of Zero-Shot Relation Triplet Extraction (ZeroRTE) is to extract relation triplets of the format (head entity, tail entity, relation), despite not having annotated data for the test relation labels.

data-augumentation generative-models relation-extraction

Last synced: 14 Apr 2025

https://github.com/declare-lab/dialogue-understanding

This repository contains PyTorch implementation for the baseline models from the paper Utterance-level Dialogue Understanding: An Empirical Study

adversarial-attacks bert bert-embeddings conversational-agents conversational-ai dialogue dialogue-act dialogue-systems dialogue-understanding emotion-analysis emotion-recognition emotion-recognition-in-conversation explainable-ai lstm natural-language-processing natural-language-understanding pretrained-models pytorch sentiment-analysis utterance-level-dialogue

Last synced: 14 Apr 2025

https://github.com/declare-lab/contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

keras lstm lstm-neural-networks multimodal-interactions multimodal-sentiment-analysis sentiment-analysis

Last synced: 14 Apr 2025

https://github.com/declare-lab/flacuna

Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.

large-language-models llama transformer

Last synced: 02 Aug 2025

https://github.com/declare-lab/nora-1.5

NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewards

vision-language-action-model

Last synced: 04 Apr 2026

https://github.com/declare-lab/llm-puzzletest

This repository is maintained to release dataset and models for multimodal puzzle reasoning.

gemini gemini-pro gpt-4 language-model large-language-models llm llms multimodal-deep-learning multimodal-learning

Last synced: 22 Sep 2025

https://github.com/declare-lab/cascade

This repo contains code to detect sarcasm from text in discussion forum using deep learning

deep-learning lstm reddit sarcasm-detection stylometric-features tensorflow tweets user-embeddings

Last synced: 14 Apr 2025

https://github.com/declare-lab/red-instruct

Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

huggingface-transformers llama llama2 llm llms

Last synced: 14 Apr 2025

https://github.com/declare-lab/bbfn

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

huggingface-transformers multimodal-deep-learning multimodal-representation multimodal-sentiment-analysis

Last synced: 14 Apr 2025

https://github.com/declare-lab/cicero

The purpose of this repository is to introduce new dialogue-level commonsense inference datasets and tasks. We chose dialogues as the data source because dialogues are known to be complex and rich in commonsense.

commonsense-reasoning dialogue-systems roberta-model seq2seq transformers

Last synced: 14 Apr 2025

https://github.com/declare-lab/dialog-hgat

Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks

dialogue-relation-extraction graph-neural-networks relation-extraction

Last synced: 14 Apr 2025

https://github.com/declare-lab/kingdom

Domain Adaptation using External Knowledge for Sentiment Analysis

adversarial-learning adversarial-networks deep-learning deep-neural-networks domain-adaptation opinion-mining sentiment-analysis

Last synced: 13 Sep 2025

https://github.com/declare-lab/trust-align

Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse

rag retrieval-augmented-generation

Last synced: 14 Apr 2025

https://github.com/declare-lab/mime

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

conversational-bots dialogue-systems empathetic-dialogues empathetic-responses natural-language-processing transformer-encoder

Last synced: 14 Apr 2025

https://github.com/declare-lab/hfusion

Multimodal sentiment analysis using hierarchical fusion with context modeling

data-fusion emotion-analysis emotion-detection emotion-recognition fusion multimodal-fusion multimodal-interactions multimodal-sentiment-analysis sentiment-analysis

Last synced: 14 Apr 2025

https://github.com/declare-lab/speech-adapters

Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech understanding

adapter asr speech-processing speech-recognition speech-synthesis speech-to-text tts

Last synced: 14 Apr 2025

https://github.com/declare-lab/hypertts

Last synced: 14 Apr 2025

https://github.com/declare-lab/msa-robustness

NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis

multimodal-deep-learning multimodal-sentiment-analysis robustness-analysis

Last synced: 14 Apr 2025

https://github.com/declare-lab/della

DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

huggingface llm llms model-merging transformer

Last synced: 14 Apr 2025

https://github.com/declare-lab/resta

Restore safety in fine-tuned language models through task arithmetic

alignment alignment-algorithm llm llm-safety llm-safety-benchmark llms llms-benchmarking safety

Last synced: 14 Apr 2025

https://github.com/declare-lab/mm-align

[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"

machine-learning multimodal-deep-learning multimodal-sentiment-analysis natural-language-processing optimal-transport

Last synced: 14 Apr 2025

https://github.com/declare-lab/sentence-ordering

This repository contains the PyTorch implementation of the paper STaCK: Sentence Ordering with Temporal Commonsense Knowledge appearing at EMNLP 2021.

commonsense-reasoning natural-language-inference

Last synced: 14 Apr 2025

https://github.com/declare-lab/hyperred

This repository implements our EMNLP 2022 research paper A Dataset for Hyper-Relational Extraction and a Cube-Filling Approach.

Last synced: 14 Apr 2025

https://github.com/declare-lab/mm-instructeval

This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimodal content comprehension tasks.

multimodal-content-comprehension-tasks multimodal-large-language-models

Last synced: 14 Apr 2025

https://github.com/declare-lab/cider

This repository contains the dataset and the pytorch implementations of the models from the paper CIDER: Commonsense Inference for Dialogue Explanation and Reasoning. CIDER has been accepted to appear at SIGDIAL 2021.

commonsense-extraction commonsense-reasoning dialogue-systems natural-language-processing nli reasoning

Last synced: 14 Apr 2025

https://github.com/declare-lab/team

Our EMNLP 2022 paper on MCQA

deberta mcq question-answering roberta transformers

Last synced: 14 Apr 2025

https://github.com/declare-lab/exemplary-empathy

This repository contains the source codes of the paper -- Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication

dialogue-generation dialogue-systems emotion-recognition emotion-recognition-in-conversation empathetic-dialogues empathetic-responses huggingface transformers

Last synced: 14 Apr 2025

https://github.com/declare-lab/identifiable-transformers

attention-weights explainable-artificial-intelligence explainable-ml text-classification transformer

Last synced: 14 Apr 2025

https://github.com/declare-lab/doublemix

Code for the COLING 2022 paper "DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification"

Last synced: 14 Apr 2025

https://github.com/declare-lab/aste-rl

This repository contains the source codes for the paper: "Aspect Sentiment Triplet Extraction using Reinforcement Learning" published at CIKM 2021.

absa aspect-based-sentiment-analysis aspect-term-extraction aspect-term-polarity-co-extraction

Last synced: 14 Apr 2025

https://github.com/declare-lab/m2h2-dataset

This repository contains the dataset and baselines explained in the paper: M2H2: A Multimodal Multiparty Hindi Dataset For HumorRecognition in Conversations

emotion-recognition-in-conversation humor-detection multimodal-deep-learning multimodal-fusion

Last synced: 08 Mar 2026