jzhang38/EasyContext jzhang38/EasyContext

  • Stars
    star
    621
  • Rank 72,294 (Top 2 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 8 months ago
  • Updated about 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
jzhang38/EasyContext
github

jzhang38

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

More Repositories

1

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
Python
7,652
star
2

LongMamba

Some preliminary explorations of Mamba's context scaling.
Python
187
star
3

LPD

code for EMNLP 2022 paper Better Few-Shot Relation Extraction with Label Prompt Dropout
Python
23
star
4

awsome-diffusion-serving

4
star
5

Peiyuan-s-NLP-Reading-List

2
star
6

ChatUI-HF-Space

Dockerfile
2
star
7

FPGA_Snake_Game_Using_16bit_CPU

reckoning, judgement, apocalypse
Verilog
1
star