michaelnny/InstructLLaMA michaelnny/InstructLLaMA

  • Stars
    star
    25
  • Rank 952,333 (Top 19 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created about 1 year ago
  • Updated 7 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
michaelnny/InstructLLaMA
github

michaelnny

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the LLaMA2 model to follow human instructions, similar to InstructGPT or ChatGPT, but on a much smaller scale.

More Repositories

1

deep_rl_zoo

A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.
Python
88
star
2

alpha_zero

A PyTorch implementation of DeepMind's AlphaZero agent to play Go and Gomoku board games
Python
27
star
3

muzero

A PyTorch implementation of DeepMind's MuZero agent
Python
20
star
4

SAP-UI5-Development-Re-Introduction

This is the official source code for Udemy course SAP UI5 Development Re-Introduction
JavaScript
12
star
5

miniGPT

Try to implement pre-training and fine-tuning GPT-2 model for research and education purpose.
Jupyter Notebook
6
star
6

MM-LLaMA

Bring multimodality to the LLaMA model by leveraging ImageBind as the modal encoder. This project supports vision input (both images and short videos) to the LLaMA model, with text output generated by LLaMA.
Python
2
star
7

QLoRA-LLM

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
Python
1
star
8

DPO-LLaMA

A clean implementation of direct preference optimization (DPO) to train the LLaMA 2 model to align with human preferences.
Python
1
star