jiahe7ay/infini-mini-transformer

Stars
49
Rank 582,901 (Top 12 %)
Language
Python
Created 5 months ago
Updated 5 months ago

jiahe7ay/infini-mini-transformer

jiahe7ay

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and training code.

MINI_LLM

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

MiniCharacterLLM

这是一个一键让小参数大模型进行角色扮演的项目，从数据构成和训练都包含在这项目中

llm_learning

这是个人关于llm的学习归纳，把我学到的知识分享给大家，让大家也能系统和简单学习llm理论及应用实战

M2GEREI