nawnoes/pytorch-gpt-x nawnoes/pytorch-gpt-x

  • Stars
    star
    32
  • Rank 801,539 (Top 16 %)
  • Language
    Python
  • Created over 3 years ago
  • Updated almost 3 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
nawnoes/pytorch-gpt-x
github

nawnoes

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.

More Repositories

1

WellnessConversation-LanguageModel

Korean Language Model์„ ์ด์šฉํ•œ ์‹ฌ๋ฆฌ์ƒ๋‹ด ๋Œ€ํ™” ์–ธ์–ด ๋ชจ๋ธ
Jupyter Notebook
210
star
2

pytorch-transformer

Pytorch ํŠธ๋žœ์Šคํฌ๋จธ ๊ตฌํ˜„๊ณผ ์–ธ์–ด๋ชจ๋ธ(BERT MLM, ELECTRA), ๊ธฐ๊ณ„๋ฒˆ์—ญ ํ…Œ์ŠคํŠธ.
Jupyter Notebook
50
star
3

pytorch-meena

Implementation Google Meena for open domain conversation.
Python
29
star
4

reformer-language-model

Reformer Language Model
Jupyter Notebook
19
star
5

NamuwikiExtractor

๋‚˜๋ฌด์œ„ํ‚ค๋คํ”„์—์„œ ์ •์ œ๋œ ํ…์ŠคํŠธ๋ฅผ ์–ป๊ธฐ ์œ„ํ•œ NamuwikiExtractor
Python
16
star
6

ReforBERT

BERT using Reformer
Python
5
star
7

pytorch-poly-chatbot

Chatbot using BERT and Poly-encoder
Python
3
star
8

DeepPurple

AlphaGo Lee for chess
Python
3
star
9

BERT-QA-APP

BERT QA App using React-native, node.js, mongodb, tensorflow
Python
3
star
10

pytorch-performer

Performer simple implementation using pytorch
Python
2
star
11

dacon-ko-summarization

๋ฐ์ด์ฝ˜ ํ•œ๊ตญ์–ด ๋ฌธ์„œ ์ถ”์ถœ ๋ฐ ์š”์•ฝ AI ๊ฒฝ์ง„๋Œ€ํšŒ
Jupyter Notebook
1
star
12

DeepPurpleZero

AlphaGoZero for chess
Python
1
star