Discover declare-lab/hfusion Open Source project

Stars
44
Rank 634,578 (Top 13 %)
Language
Python
License
MIT License
Created about 6 years ago
Updated almost 2 years ago

declare-lab

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Multimodal sentiment analysis using hierarchical fusion with context modeling

conv-emotion

This repo contains implementation of different architectures for emotion recognition in conversations.

Python

1,336

MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

Python

793

tango

Codes and Model of the paper "Text-to-Audio Generation using Instruction Tuned LLM and Latent Diffusion Model"

Python

754

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

OpenEdge ABL

730

awesome-sentiment-analysis

Reading list for Awesome Sentiment Analysis papers

517

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Python

500

flan-alpaca

This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.

Python

343

awesome-emotion-recognition-in-conversations

A comprehensive reading list for Emotion Recognition in Conversations

252

MISA

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis

Python

192

RECCON

This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.

Python

169

Multimodal-Infomax

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

Python

154

dialogue-understanding

This repository contains PyTorch implementation for the baseline models from the paper Utterance-level Dialogue Understanding: An Empirical Study

Python

123

RelationPrompt

This repository implements our ACL Findings 2022 research paper RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction. The goal of Zero-Shot Relation Triplet Extraction (ZeroRTE) is to extract relation triplets of the format (head entity, tail entity, relation), despite not having annotated data for the test relation labels.

Python

123

contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

Python

123

flacuna

Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.

Python

106

CASCADE

This repo contains code to detect sarcasm from text in discussion forum using deep learning

Python

red-instruct

Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

Python

BBFN

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Python

CICERO

The purpose of this repository is to introduce new dialogue-level commonsense inference datasets and tasks. We chose dialogues as the data source because dialogues are known to be complex and rich in commonsense.

Python

dialog-HGAT

Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks

Python

kingdom

Domain Adaptation using External Knowledge for Sentiment Analysis

Python

MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

Python

speech-adapters

Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech understanding

Python

LLM-PuzzleTest

This repository is maintained to release dataset and models for multimodal puzzle reasoning.

Python

HyperTTS

Python

MSA-Robustness

NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis

Python

CIDER

This repository contains the dataset and the pytorch implementations of the models from the paper CIDER: Commonsense Inference for Dialogue Explanation and Reasoning. CIDER has been accepted to appear at SIGDIAL 2021.

Python

sentence-ordering

This repository contains the PyTorch implementation of the paper STaCK: Sentence Ordering with Temporal Commonsense Knowledge appearing at EMNLP 2021.

Python

resta

Restore safety in fine-tuned language models through task arithmetic

Python

HyperRED

This repository implements our EMNLP 2022 research paper A Dataset for Hyper-Relational Extraction and a Cube-Filling Approach.

Python

MM-InstructEval

This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimodal content comprehension tasks.

Python

MM-Align

[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"

Python

identifiable-transformers

Python

exemplary-empathy

This repository contains the source codes of the paper -- Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication

Python

della

DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

Python

TEAM

Our EMNLP 2022 paper on MCQA

Python

DoubleMix

Code for the COLING 2022 paper "DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification"

Python

adapter-mix

Python

M2H2-dataset

This repository contains the dataset and baselines explained in the paper: M2H2: A Multimodal Multiparty Hindi Dataset For HumorRecognition in Conversations

Python

ASTE-RL

This repository contains the source codes for the paper: "Aspect Sentiment Triplet Extraction using Reinforcement Learning" published at CIKM 2021.

Python

SAT

Code for the EMNLP 2022 Findings short paper "SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Training"

Jupyter Notebook

KNOT

This repository contains the implementation of the paper -- KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks

Python

WikiDes

A Wikipedia-based summarization dataset

Python

Sealing

[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"

Python

VIP

Our EMNLP 2022 paper on VIP-Based Prompting for Parameter-Efficient Learning

Python

domadapter

Code for EACL'23 paper "Udapter: Efficient Domain Adaptation Using Adapters"

Python

RobustMIFT

[Arxiv 2024] Official Implementation of the paper: "Towards Robust Instruction Tuning on Multimodal Large Language Models"

Jupyter Notebook

ferret

Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique

Python

SANCL

[COLING 2022] This repository contains the code of the paper SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning.

Python

segue

Codes and Checkpoints of the Interspeech paper "Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding"

Python

llm_robustness

Python

NLP-OT

declare-lab/hfusion

declare-lab

Reviews

Repository Details

More Repositories