• Stars
    star
    291
  • Rank 141,696 (Top 3 %)
  • Language
    Python
  • Created over 7 years ago
  • Updated over 6 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

attention-based LSTM/Dense implemented by Keras

LSTM_Attention

X = Input Sequence of length n.
H = LSTM(X); Note that here the LSTM has return_sequences = True,
    so H is a sequence of vectors of length n.
s is the hidden state of the LSTM (h and c)

h is a weighted sum over H: 加权和
h = sigma(j = 0 to n-1)  alpha(j) * H(j)

weight alpha[i, j] for each hj is computed as follows:
H = [h1,h2,...,hn]
M = tanh(H)
alhpa = softmax(w.transpose * M)

h# = tanh(h)
y = softmax(W * h# + b)

J(theta) = negative_log_likelihood + regularity

attModel1

GitHub 项目

datalogue/keras-attention

1

Attention_Recurrent

GitHub 项目

ningshixian/LSTM_Attention

attModel2

GitHub 项目

Keras Attention Mechanism

Example: Attention block*

Attention defined per time series (each TS has its own attention)

attModel3

Github 项目

keras-language-modeling

https://github.com/roebius/deeplearning_keras2/blob/master/nbs2/attention_wrapper.py

attModel4

Github 项目

CDRextraction

hierarchical-attention-networks

Github:

synthesio/hierarchical-attention-networks

self-attention-networks

参考

More Repositories

1

UMLs

UMLs(一体化医学语言系统)介绍
36
star
2

Keras-Tutorial

Keras深度学习框架配置+Keras教程+Keras Trick
Roff
33
star
3

NER-CONLL2003

Entity recognition of CONLL2003 corpus using Keras
Python
31
star
4

AC-BLSTM

Asymmetric Convolutional Bidirectional LSTM Networks for Text Classification
Python
11
star
5

hmm-viterbi-Ch-POS

利用HMM以及Viterbi算法实现中文词性标注
Python
11
star
6

dut_tianchi_mobile_recommend_train

##阿里移动推荐算法竞赛 ###
Python
9
star
7

NLP-zoo

nlp related resources+all kinds of tutorials 中文自然语言处理相关资料
Jupyter Notebook
8
star
8

Relation_path_Extract

生物医学 实体关系的路径抽取
Python
5
star
9

Overview-of-the-BioCreative-V-chemical-disease-relation-CDR-task

BioCreative-V CDR关系抽取任务综述
4
star
10

CID_Relation_Extractor

句间关系抽取
Python
3
star
11

LSTM-TOKEN

利用双向LSTM实现中文分词
Python
3
star
12

keras_bc6_track1

BioCreative 6 track1 BioId Assignment
Python
3
star
13

mac-software-onekey

给 Mac 优雅地一键「装机」
Shell
2
star
14

seq2seq_with_bert_unilm

以“BERT+UniLM”为基础架构,训练一个Seq2Seq模型 https://www.yuque.com/ningshixian/pz10h0/ep4qy2
Python
2
star
15

learning_to_rank

排序学习LTR实验 https://www.yuque.com/ningshixian/pz10h0/zhhpol
Python
1
star
16

chinese-interrogative-recognition

中文疑问句识别
Python
1
star
17

Hedge_Ch_BLSTM_Adversarial

Keras 构建基于BLSTM+对抗学习的跨领域中文模糊限制语识别
Python
1
star
18

All-about-keras

关于 Keras 你所需要的一切
Jupyter Notebook
1
star
19

Tokenizer

中文分词+词性标注笔记
1
star
20

metric_learning

度量学习&对比学习实验
Jupyter Notebook
1
star
21

GPT-FINE-TUNE

lora+llama+domain_data
Jupyter Notebook
1
star
22

LSTM-CNN-SCOPE

利用 keras 构建LSTM- CNN模型实现NLP模糊限制语的范围检测
OpenEdge ABL
1
star
23

bc6_track1_pner_pnen

BioCreative 6 Track 1
Roff
1
star