michaelnny/QLoRA-LLM michaelnny/QLoRA-LLM

  • Stars
    star
    1
  • Language
    Python
  • License
    MIT License
  • Created 9 months ago
  • Updated 8 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
michaelnny/QLoRA-LLM
github

michaelnny

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

More Repositories

1

deep_rl_zoo

A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.
Python
88
star
2

alpha_zero

A PyTorch implementation of DeepMind's AlphaZero agent to play Go and Gomoku board games
Python
27
star
3

InstructLLaMA

Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the LLaMA2 model to follow human instructions, similar to InstructGPT or ChatGPT, but on a much smaller scale.
Jupyter Notebook
25
star
4

muzero

A PyTorch implementation of DeepMind's MuZero agent
Python
20
star
5

SAP-UI5-Development-Re-Introduction

This is the official source code for Udemy course SAP UI5 Development Re-Introduction
JavaScript
12
star
6

miniGPT

Try to implement pre-training and fine-tuning GPT-2 model for research and education purpose.
Jupyter Notebook
6
star
7

MM-LLaMA

Bring multimodality to the LLaMA model by leveraging ImageBind as the modal encoder. This project supports vision input (both images and short videos) to the LLaMA model, with text output generated by LLaMA.
Python
2
star
8

DPO-LLaMA

A clean implementation of direct preference optimization (DPO) to train the LLaMA 2 model to align with human preferences.
Python
1
star