nrimsky/LM-exp

Stars
67
Rank 460,137 (Top 10 %)
Language
Jupyter Notebook
Created about 1 year ago
Updated about 1 year ago

nrimsky/LM-exp

nrimsky

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces

CAA

Steering Llama 2 with Contrastive Activation Addition

Jupyter Notebook

InfluenceFunctions

Implementation of Influence Function approximations for differently sized ML models, using PyTorch

ActivationDirectionAnalysis

EmbedMap

Generate a 3D map of links based on their embeddings using OpenAI's embedding API

devinterp

Quantifying degeneracy in toy models

mlexperiments

Exploratory work analyzing loss landscapes of neural nets / steering between generalizations / phase transitions

Jupyter Notebook

BehaviorEvals

Scripts for evaluating LLMs

ESP3D-WEBUI

Web App for Paige Braille display and PCB

Feedbackr

Easily collect yes/no feedback on language model outputs from humans

lmexp

Simple starter code for experiments on open-source LLMs. Built for my SPAR project participants.