kyleliang919/forward_forward_gpt kyleliang919/forward_forward_gpt

  • This repository has been archived on 13/Sep/2023
  • Stars
    star
    8
  • Rank 2,088,316 (Top 42 %)
  • Language
    Python
  • License
    MIT License
  • Created over 1 year ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
kyleliang919/forward_forward_gpt
github

kyleliang919

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Using the forward forward algorithm to train large language model

More Repositories

1

Long-context-transformers

Exploring finetuning public checkpoints on filter 8K sequences on Pile
Python
110
star
2

NIPS-2017-Learning-to-Run

Reinforcement learning environments with musculoskeletal models
Python
12
star
3

The-Everything-App

One App to rule them all, powered by ChatGPT
Python
10
star
4

Interval-bound-propagation-pytorch

This repository contains the pytorch attempts to replicate the results from the recent DeepMind Paper, "On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Models"
Jupyter Notebook
8
star
5

Optimizer-Zoo

Standardizing test suite for optimizer experiments in the era of transformers by UT Statistical Learning & AI Group
Python
7
star
6

Fake-News-Challenge

Machine Learning in fighting fake news
Python
6
star
7

Awesome_Llama_V2

An aggregated collection of llama_v2 s finetuned on different tasks/domains, sometimes they come with different name
3
star
8

UIUC-CS446

Machine Learning
Java
3
star
9

InfoGAN

Replication of InfoGAN paper
Jupyter Notebook
1
star
10

CS421

UIUC CS412
Haskell
1
star
11

distributed-lion-pytorch

Distributed Lion optimizer that works on extremely low bandwidth and robust against worker drop-out
Python
1
star