Tongjilibo/build_MiniLLM_from_scratch Tongjilibo/build_MiniLLM_from_scratch

  • Stars
    star
    71
  • Rank 443,012 (Top 9 %)
  • Language
    Python
  • License
    MIT License
  • Created 9 months ago
  • Updated 8 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Tongjilibo/build_MiniLLM_from_scratch
github

Tongjilibo

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

从0到1构建一个MiniLLM

More Repositories

1

bert4torch

An elegent pytorch implement of transformers
Python
1,094
star
2

torch4keras

bert4torch底层训练框架，用keras风格写torch代码
Python
70
star
3

rec4torch

推荐系统的pytorch算法实现
Python
62
star
4

rnn_numpy_stock

利用numpy实现rnn时间序列预测股票
Python
16
star
5

chat4doc

RAG的最小实现
CSS
4
star
6

GAU-alpha-pytorch

基于bert4torch框架，GAU-alpha的pytorch简洁实现
3
star
7

bert4vector

向量计算、存储、检索、相似度计算
Python
3
star
8

roformer_pytorch

基于bert4torch框架，roformer/roformer_v2的pytorch简洁实现
2
star
9

llm_nbce

大模型使用朴素贝叶斯思想来扩展LLM的Context处理长度
Python
2
star
10

nlp_competition

NLP比赛top解决方案复现
1
star
11

nlp_notes

nlp notes
1
star
12

bert4torch_llama

基于bert4torch的llama预测
1
star
13

llm_finetune

基于bert4torch的大模型微调代码，含chatglm+pv2, lora, plora等多种方式
Python
1
star
14

simbert-roformer_sim-pytorch

基于bert4torch框架，simbert和roformer-sim的pytorch实现
1
star