FranxYao/Retrieval-Head-with-Flash-Attention FranxYao/Retrieval-Head-with-Flash-Attention

Twitter logo Share LinkedIn logo Share Facebook logo Share
FranxYao/Retrieval-Head-with-Flash-Attention
github

FranxYao

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Efficient retrieval head analysis with triton flash attention that supports topK probability

More Repositories

1

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
Jupyter Notebook
2,556
star
2

Deep-Generative-Models-for-Natural-Language-Processing

DGMs for NLP. A roadmap.
392
star
3

GPT-Bargaining

Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
Jupyter Notebook
198
star
4

dgm_latent_bow

Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words
Python
124
star
5

FlanT5-CoT-Specialization

Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
Jupyter Notebook
122
star
6

Distributional-Generalization-in-Natural-Language-Processing

Distributional Generalization in NLP. A roadmap.
Jupyter Notebook
86
star
7

Gumbel-CRF

Implementation of NeurIPS 20 paper: Latent Template Induction with Gumbel-CRFs
Python
53
star
8

PoincareProbe

Implementation of ICLR 21 paper: Probing BERT in Hyperbolic Spaces
Jupyter Notebook
50
star
9

Partially-Observed-TreeCRFs

Implementation of AAAI 21 paper: Nested Named Entity Recognition with Partially Observed TreeCRFs
Python
49
star
10

franxyao.github.io

35
star
11

Language-Model-Pretraining-for-Text-Generation

LM pretraining for generation, reading list, resources, conference mappings.
19
star
12

pivot_analysis

Implementation of INLG 19 paper: Rethinking Text Attribute Transfer: A Lexical Analysis
Python
15
star
13

RDP

Implementation of ICML 22 Paper: Scaling Structured Inference with Randomization
Jupyter Notebook
13
star
14

Complexity-Based-Prompting

Complexity Based Prompting for Multi-Step Reasoning
10
star
15

prompt-handbook

Rules of Thumb 👍 for Writing Good Magical Prompts
5
star
16

nlu-cw2

Python
4
star
17

Natural-Ansewr-Generation

Python
2
star
18

SCAN_reproduce

Python
1
star