richawo/gpt-transformer-with-self-attention-logic richawo/gpt-transformer-with-self-attention-logic

  • Stars
    star
    1
  • Language Roff
  • Created about 1 year ago
  • Updated about 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
richawo/gpt-transformer-with-self-attention-logic
github

richawo

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This repository contains Python code for implementing a GPT (Generative Pre-trained Transformer) transformer model with self-attention logic. The code is based on Andrej Karpathy's tutorial on creating a transformer from scratch.

More Repositories

1

minimal-llm-ui

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs drastically improves the chatbot experience and works offline.
TypeScript
247
star
2

chain-of-density

Implementing the Chain Of Density text summarisation technique from recent NLP research by researchers at Salesforce, MIT, Columbia, etc. Takes a long text input and iteratively generates increasingly concise, entity-dense summaries using LLMs (default: OpenAI's GPT-4). Feedback and contributions welcome!
Python
65
star
3

framer-motion-cheatsheet

This Framer Motion Cheatsheet is a Next.js project that demonstrates the usage of Framer Motion for creating animations. Framer Motion is a powerful library for creating smooth and interactive animations in React applications.
TypeScript
37
star
4

llm-translator

Translate Markdown files from one language to another using OpenAI's API while retaining original formatting. This Jupyter notebook tokenizes input text, splits into chunks, translates with OpenAI, and reconstructs output to preserve Markdown structure. Useful for localizing documentation, articles, books, and other long-form Markdown content.
Jupyter Notebook
14
star
5

ai-notes

Notes providing a high-level synthesis of key generative AI concepts, applications, limitations, and more based on my own learnings. This repo is predominantly targeted at AI engineers and those interested in the field, but there's beneficial things for everyone.
9
star
6

openai-streaming

Jupyter Notebook
1
star