jaymody/picoBERT jaymody/picoBERT

  • Stars
    star
    44
  • Rank 634,578 (Top 13 %)
  • Language
    Python
  • Created over 1 year ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
jaymody/picoBERT
github

jaymody

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Like picoGPT but for BERT.

More Repositories

1

picoGPT

An unnecessarily tiny implementation of GPT-2 in NumPy.
Python
2,416
star
2

speculative-sampling

Simple implementation of Speculative Sampling in NumPy for GPT-2.
Python
18
star
3

seq2seq-polynomial

Seq2seq transformer for polynomial expansion in PyTorch.
Python
12
star
4

backpropagation

Simple python implementation of stochastic gradient descent for neural networks through backpropagation.
Jupyter Notebook
11
star
5

gpt-jax

A stupidly simple GPT implementation in JAX.
Python
7
star
6

simpleGPT

Simple implementation of a GPT (training and inference) in PyTorch.
Python
4
star
7

dotfiles

~ sweet ~
Shell
3
star
8

misinformation-detection-with-transformers

Sequence classification and information retrieval via Transformers for misinformation detection.
Jupyter Notebook
3
star
9

rise-and-grind

Discord bot for morning clubs.
Python
3
star
10

spaceship

Rotated Bounding Box Regression using Tensorflow.
Python
3
star
11

seq2seq-sort

Training neural networks to sort because why not.
Python
2
star
12

mlp-visualizer

A simple multilayer perceptron network that classifies clusters of data generated using scikit-learn make_blobs.
Python
2
star
13

rrt

A ray tracer built in Rust that can run in your browser via WebAssembly.
Rust
2
star
14

cs231n

Course notes, assignments, and solutions for cs231n.
Jupyter Notebook
2
star
15

leetcode

Leetcode solutions I've completed (https://leetcode.com/jaymody/)
C++
1
star
16

mlp-pure-jax

Python
1
star
17

nn

Neural networks in PyTorch.
Python
1
star
18

image-edit

This repo contains several image editing functions for OpenCV BGR Mat objects including: grayscale, brightness, contrast, saturation, sharpness, gamma, and hue.
C++
1
star
19

3xa3

Lines Per Minute, a typing tool made for programmers.
Python
1
star
20

website

Liquid
1
star
21

microscan

A microstructure analysis tool.
Jupyter Notebook
1
star
22

udacity-deep-learning

All my Udacity Deep Learning nanodegree projects.
Jupyter Notebook
1
star
23

measure-cpu-cache-size

Empirically measuring CPU caches sizes using a simple C program.
C
1
star
24

nand2tetris

My attempt at https://www.nand2tetris.org
Hack
1
star
25

data-structures-algorithms

Implementations for common data structures and algorithms in C.
C
1
star
26

gitfit

hack the north 2019
JavaScript
1
star