HKUST-KnowComp/R-Net HKUST-KnowComp/R-Net

  • Stars
    star
    581
  • Rank 76,875 (Top 2 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 7 years ago
  • Updated about 6 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
HKUST-KnowComp/R-Net
github

HKUST-KnowComp

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Tensorflow Implementation of R-Net

R-Net

Requirements

There have been a lot of known problems caused by using different software versions. Please check your versions before opening issues or emailing me.

General

  • Python >= 3.4
  • unzip, wget

Python Packages

  • tensorflow-gpu >= 1.5.0
  • spaCy >= 2.0.0
  • tqdm
  • ujson

Usage

To download and preprocess the data, run

# download SQuAD and Glove
sh download.sh
# preprocess the data
python config.py --mode prepro

Hyper parameters are stored in config.py. To debug/train/test the model, run

python config.py --mode debug/train/test

To get the official score, run

python evaluate-v1.1.py ~/data/squad/dev-v1.1.json log/answer/answer.json

The default directory for tensorboard log file is log/event

See release for trained model.

Detailed Implementaion

  • The original paper uses additive attention, which consumes lots of memory. This project adopts scaled multiplicative attention presented in Attention Is All You Need.
  • This project adopts variational dropout presented in A Theoretically Grounded Application of Dropout in Recurrent Neural Networks.
  • To solve the degradation problem in stacked RNN, outputs of each layer are concatenated to produce the final output.
  • When the loss on dev set increases in a certain period, the learning rate is halved.
  • During prediction, the project adopts search method presented in Machine Comprehension Using Match-LSTM and Answer Pointer.
  • To address efficiency issue, this implementation uses bucketing method (contributed by xiongyifan) and CudnnGRU. The bucketing method can speedup training, but will lower the F1 score by 0.3%.

Performance

Score

EM F1
original paper 71.1 79.5
this project 71.07 79.51

Training Time (s/it)

Native Native + Bucket Cudnn Cudnn + Bucket
E5-2640 6.21 3.56 - -
TITAN X 2.56 1.31 0.41 0.28

Extensions

These settings may increase the score but not used in the model by default. You can turn these settings on in config.py.

More Repositories

1

ASER

ASER (Activities, States, Events, and their Relations): a large-scale weighted eventuality knowledge graph.
Python
294
star
2

FMG

KDD17_FMG
MATLAB
137
star
3

MnemonicReader

A PyTorch implementation of Mnemonic Reader for the Machine Comprehension task
Python
135
star
4

DeepGraphCNNforTexts

Python
129
star
5

JWE

Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components
C
100
star
6

MNE

Source Code for IJCAI 2018 paper "Scalable Multiplex Network Embedding"
C
74
star
7

TransOMCS

TransOMCS is a commonsense knowledge resource transferred from ASER. It is in the format of OMCS but two orders of magnitude larger.
Python
68
star
8

MLMA_hate_speech

Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"
Python
54
star
9

NeuralSubgraphCounting

Source Code for KDD 2020 paper "Neural Subgraph Isomorphism Counting"
Python
46
star
10

DISCOS-commonsense

Codes for the WWW2021 paper: DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge (https://arxiv.org/abs/2101.00154).
Python
43
star
11

DMSC

This repository is for the paper "Document-Level Multi-Aspect Sentiment Classification as Machine Comprehension"
Python
42
star
12

RINANTE

Neural Aspect and Opinion Term Extraction with Mined Rules as Weak Supervision
Python
38
star
13

Motif-based-PageRank

Python
34
star
14

semihin

source code for the paper "Semi-supervised Learning over Heterogeneous Information Networks by Ensemble of Meta-graph Guided Random Walks"
Python
32
star
15

FolkScope

Codes and Datasets for the ACL2023 Findings Paper: FolkScope: Intention Knowledge Graph Construction for Discovering E-commerce Commonsense
Python
30
star
16

FKGE

Code for CIKM 2021 paper: Differentially Private Federated Knowledge Graphs Embedding (https://arxiv.org/abs/2105.07615)
Python
29
star
17

Knowledge-Constrained-Decoding

Official Code for EMNLP2023 Main Conference paper: "KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection"
Python
27
star
18

CSKB-Population

Codes for the EMNLP2021 paper: Benchmarking Commonsense Knowledge Base Population (https://aclanthology.org/2021.emnlp-main.705.pdf). An updated version CKBP v2 (https://arxiv.org/pdf/2304.10392.pdf)
Python
26
star
19

Visual_PCR

Dataset and Source code for EMNLP 2019 paper "What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues"
Python
25
star
20

COLA

Official code repository for the main conference paper in ACL2023: COLA: Contextualized Commonsense Causality Reasoning from the Causal Inference Perspective
Python
24
star
21

atomic-conceptualization

Code and data for the paper Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization
Python
23
star
22

GEIA

Code for Findings-ACL 2023 paper: Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence
Python
23
star
23

DualMessagePassing

Source Code for AAAI 2022 paper "Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching"
Python
21
star
24

VWS-DMSC

Python
21
star
25

BMGF-RoBERTa

Source Code for IJCAI 2020 paper "On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classification"
Python
20
star
26

EFO-1-QA-benchmark

Benchmark for Answering Existential First Order Queries with Single Free Variable (NeurIPS dataset and benchmark 2021)
Python
19
star
27

MLMET

Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model
Python
18
star
28

DummyNode4GraphLearning

Source Code for ICML 2022 paper "Boosting Graph Structure Learning with Dummy Nodes"
Python
18
star
29

WinoWhy

WinoWhy provides human-annotated reasons for answering WSC questions.
Python
17
star
30

cfet

Python
16
star
31

Pronoun-Coref-KG

Python
16
star
32

IFETEL

Improving Fine-grained Entity Typing with Entity Linking
Python
16
star
33

NRN

Python
15
star
34

Pronoun-Coref

Python
14
star
35

Social-Explorative-Attention-Networks

Python
14
star
36

MoHINRec

Python
14
star
37

HeteSpaceyWalk

Python
13
star
38

LMPNN

Logical Message Passing Networks with One-hop Inference in Atomic Formulas (ICLR 2023)
Python
13
star
39

PathPredictionForTextClassification

Source code for WWW 2019 paper "Efficient Path Prediction for Semi-Supervised and Weakly Supervised Hierarchical Text Classification"
Python
13
star
40

SocializedWordEmbeddings

Python
12
star
41

AbsPyramid

Official code repository for the paper: AbsPyramid: Benchmarking the Abstration Ability of Language Models with a Unified Entailment Graph
Python
12
star
42

WFRE

Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport (Findings-ACL 2023)
Python
11
star
43

ELWSMP

Entity Linking within a Social Media Platform
Python
11
star
44

SubeventWriter

Official code repository for the main conference paper in EMNLP 2022: SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controller
Python
11
star
45

ComHyper

Code for EMNLP'20 paper "When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models"
Python
11
star
46

ComplexHyperbolicKGE

Source code for the paper 'Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier Transform'.
Python
11
star
47

PseudoReasoner

Official code repository for Findings of EMNLP 2022 paper: PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population
Python
11
star
48

CAT

Codes for the ACL2023 main conference paper: CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning (https://arxiv.org/pdf/2305.04808.pdf).
Python
10
star
49

MICO

This is the code repo for Findings of EMNLP2022 paper: MICO: a multi-alternative contrastive learning framework for commonsense knowledge representation
Python
10
star
50

SP-10K

SP-10K is a large-scale human-annotated selectional preference set. Five selectional preference relations are included.
10
star
51

WDDC

Source code for NAACL 2022 paper Weakly Supervised Text Classification using Supervision Signals from a Language Mode
Python
10
star
52

C2

The implementation for the paper:
Python
9
star
53

RE-RegDVAE

Source code for paper Relation Discovery with Out-of-Relation Knowledge Base as Supervision
Python
9
star
54

query2particles

query2particles
Python
9
star
55

SRBRW

Source Code for IJCAI 2018 paper "Biased Random Walk based Social Regularization for Word Embeddings"
C
9
star
56

SQE

Python
9
star
57

CEQA

Official Implementation of paper: Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints
Python
9
star
58

VD-PCR

Source code for paper "VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution"
Python
8
star
59

ASER-EEG

Eventuality Entailment Graph built on ASER
Python
8
star
60

FisherDA

code for "Fisher Deep Domain Adaptation"
Python
8
star
61

DiscoPrompt

Codes for the ACL2023 paper: DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognition
Python
8
star
62

EventGround

Python
7
star
63

ConstraintChecker

Official code repository for the EACL2024 paper "ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases"
Jupyter Notebook
7
star
64

CAR

Codes for the EMNLP2023 Findings paper: CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering (https://aclanthology.org/2023.findings-emnlp.902.pdf).
Python
7
star
65

Persona_leakage_and_defense_in_GPT-2

Code for NAACL 2022 paper "You Donโ€™t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakersโ€™ Private Personas"
Python
6
star
66

EFOK-CQA

EFOK-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation
Python
6
star
67

Vis_Causal

Python
6
star
68

QaDynamics

Codes for the EMNLP2023 Findings paper: QaDynamics: Training Dynamics-Driven Synthetic QA Diagnostic for Zero-Shot Commonsense Question Answering.
Python
6
star
69

NLI4CT

Codes for the SemEval2023 paper: KnowComp at SemEval-2023 Task 7: Fine-tuning Pretrained Language Models for Clinical Trial Entailment Identification.
Python
5
star
70

PCR

Codes for the survey paper on pronoun coreference resolution
Python
5
star
71

Exo-PCR

Source code for EMNLP 2021 paper "Exophoric Pronoun Resolution in Dialogues with Topic Regularization"
Python
5
star
72

Fair_HIN

This code is for the ICWSM 2021 paper: Fair Representation Learning for Heterogeneous Information Networks http://arxiv.org/abs/2104.08769
Python
5
star
73

UnitBall

Source code for the paper 'Unit Ball Model for Embedding Hierarchical Structures in the Complex Hyperbolic Space'.
Python
5
star
74

HPHG

Source Code for "Hyper-Path-Based Representation Learning for Hyper-Networks" (CIKM '19)
Python
5
star
75

GOLD

Codes for the EMNLP2023 Findings paper: Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection
Python
5
star
76

AbductiveKGR

[ACL 2024] Implementation for Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation
Python
5
star
77

FIT

Fuzzy Inference with Truth value
Python
4
star
78

Probing_toxicity_in_PTLMs

Probing Toxic Content in Large Pretrained Language Models
Python
4
star
79

DisCOC

Source Code for ACL 2021 paper "Exploring Discourse Structures for Argument Impact Classification"
Jupyter Notebook
4
star
80

LLM-Multistep-Jailbreak

Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT
Python
4
star
81

Alpha-PACE

Codes for the AACL2023 paper: Self-Consistent Narrative Prompts on Abductive Natural Language Inference
Python
4
star
82

BEKG

Source Code for paper: BEKG: A Built Environment Knowledge Graph
Python
4
star
83

TILFA

Codes for the EMNLP 2023 workshop paper: TILFA: A Unified Framework for Text, Image, and Layout Fusion in Argument Mining
Python
3
star
84

MWE

Python
3
star
85

HS_Bias_Eval

Data and code of our EMNLP 2020 paper "Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets".
Python
3
star
86

SLT

Codes for the WMT@EMNLP2023 workshop paper: KnowComp Submission for WMT23 Sign Language Translation Task
Python
2
star
87

GeoAlign

Source code for AKBC 2021 paper "Manifold Alignment across Geometric Spaces for Knowledge Base Representation Learning"
Python
2
star
88

AbsInstruct

Offical Repo of ACL 2024 paper: AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation
Python
2
star
89

NeuPath

The codes for CIKM 2021 paper "Neural PathSim for Inductive Similarity Search in Heterogeneous Information Networks"
Python
2
star
90

CODC-Dialogue-Summarization

Codes of the AKBC 2021 paper: Do Boat and Ocean Suggest Beach? Dialogue Summarization with External Knowledge
Python
2
star
91

HMTGIN

Python
2
star
92

FAPAT

Source Code for NeurIPS 2023 paper "Enhancing User Intent Capture in Session-Based Recommendation with Attribute Patterns"
Jupyter Notebook
2
star
93

ActPlan-1K

Python
2
star
94

CodeGraph

official code repo for the paper: "CodeGraph: Enhancing Graph Reasoning of LLMs with Code"
1
star
95

AttackTransferLearning

Code for KDD20 paper "Two Sides of the Same Coin: White-box and Black-box Attacks for Transfer Learning"
Python
1
star
96

PrivateGraphEncoder

Source Code for CIKM2023 paper "Independent Distribution Regularization for Private Graph Embedding"
Python
1
star
97

SRFET

Exploiting Semantic Relations for Fine-grained Entity Typing
Python
1
star
98

Co2LM

Source code for CoCoLM: Complex Commonsense Enhanced Language Models with Language Models
Python
1
star
99

VWS-PR

This code is for the EACL 2021 paper: Variational Weakly Supervised Sentiment Analysis with Posterior Regularization
Python
1
star
100

PCR4ALL

This is the github repo for LREC 2022 paper "PCR4ALL: A Comprehensive Evaluation Benchmark for Pronoun Coreference Resolution in English".
1
star