Enrico Shippole (@conceptofmind)
github

conceptofmind

Twitter logo Share LinkedIn logo Share Facebook logo Share
  • Stars
    star
    1,829
  • Global Rank 16,893 (Top 0.6 %)
  • Followers 312
  • Registered almost 8 years ago
  • Most used languages
    Python
         94.6 %
    Jupyter Notebook
         5.4 %

Top repositories

1

PaLM

An open-source implementation of Google's PaLM models
Python
805
star
2

LaMDA-rlhf-pytorch

Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
Python
460
star
3

toolformer

Python
336
star
4

t5-pytorch

Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer in PyTorch.
Python
46
star
5

flash-gpt

Add Flash-Attention to Huggingface Models
Python
33
star
6

vit-flax

Implementation of numerous Vision Transformers in Google's JAX and Flax.
Python
19
star
7

PaLM-flax

Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
Python
14
star
8

PaLM-rlhf-jax

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM. Built in collaboration with Lucidrains.
Python
9
star
9

ViT-Patch-Merger

Python
7
star
10

SemDeDup

An unofficial implementation of SemDeDup: Data-efficient learning at web-scale through semantic deduplication.
Python
6
star
11

Huggingface-deduplicate

Python
5
star
12

hf_fsdp

A very basic fsdp wrapper for HF.
Python
5
star
13

Simple-ViT-flax

Python
4
star
14

flan-Llama

Code for training Llama on the Flan Collection
Python
4
star
15

dsp-langchain

Python
4
star
16

Sparrow-rlhf-pytorch

An open-source implementation of DeepMind's Sparrow with RLHF.
Python
4
star
17

Adaptive-Token-Sampling-Flax

Python
4
star
18

Llama-rlhf-pytorch

3
star
19

Perpetrator

An API for Redteaming large language models.
3
star
20

CaiT-Flax

Python
3
star
21

oig-Llama

Open Instruct fine-tuned Llama
3
star
22

jrlx

Python
2
star
23

Twins-SVT-Flax

An open-source implementation of the Twins: Revisiting the Design of Spatial Attention in Vision Transformers research paper in Google's JAX and Flax.
Python
2
star
24

t8t-pytorch

The official repository for Towards 8-bit Transformers. Stable training of LLMs at mixed 8-bit precision.
2
star
25

WebGPT

Combining LangChain with LLMs to build WebGPT.
2
star
26

BloomCoder

Python
2
star
27

podcasts-are-all-you-need

Python
2
star
28

ViT

Python
1
star
29

Crossformer-flax

Python
1
star
30

DeepViT-flax

Implementation of Deep Vision Transformer in Flax
Python
1
star
31

ViT-haiku

Python
1
star
32

LeViT-flax

Python
1
star
33

OPTCode

Python
1
star
34

bpt-pytorch

Python
1
star
35

deep-reinforcement-learning-go

Creation and implementation of an Alpha Go engine from scratch
Jupyter Notebook
1
star
36

Everything-Machine-Learning

1
star
37

Token-to-Token-ViT-flax

Python
1
star
38

ViT-Small-Datasets-flax

Python
1
star
39

job-posting-analysis

Data Science job posting analysis and resume comparison using NLP and Scikit Learn
Jupyter Notebook
1
star
40

charcuterie

A library for sampling Huggingface datasets.
1
star
41

tokenize_hf

Python
1
star
42

annotated-transformer

Python
1
star
43

Orchestrator

An API for different data cleaning tools.
Python
1
star
44

conceptofmind

Config files for my GitHub profile.
1
star
45

unsloth-bert

Python
1
star