nrimsky/BehaviorEvals nrimsky/BehaviorEvals

  • Stars
    star
    2
  • Language
    Python
  • Created about 1 year ago
  • Updated about 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
nrimsky/BehaviorEvals
github

nrimsky

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Scripts for evaluating LLMs

More Repositories

1

CAA

Steering Llama 2 with Contrastive Activation Addition
Jupyter Notebook
92
star
2

LM-exp

LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
Jupyter Notebook
75
star
3

InfluenceFunctions

Implementation of Influence Function approximations for differently sized ML models, using PyTorch
Python
15
star
4

ActivationDirectionAnalysis

Python
8
star
5

EmbedMap

Generate a 3D map of links based on their embeddings using OpenAI's embedding API
HTML
5
star
6

devinterp

Quantifying degeneracy in toy models
Python
5
star
7

mlexperiments

Exploratory work analyzing loss landscapes of neural nets / steering between generalizations / phase transitions
Jupyter Notebook
4
star
8

lmexp

Simple starter code for experiments on open-source LLMs. Built for my SPAR project participants.
Jupyter Notebook
3
star
9

ESP3D-WEBUI

Web App for Paige Braille display and PCB
JavaScript
2
star
10

Feedbackr

Easily collect yes/no feedback on language model outputs from humans
Python
1
star