Rulin Shao (@RulinShao)
github

RulinShao

Twitter logo Share LinkedIn logo Share Facebook logo Share
  • Stars
    star
    394
  • Global Rank 71,158 (Top 3 %)
  • Followers 163
  • Following 48
  • Registered almost 5 years ago
  • Most used languages
    Python
         87.5 %
    MATLAB
         12.5 %
  • Location 🇺🇸 United States
  • Country Total Rank 68,541
  • Country Ranking
    Python
         3,202
    MATLAB
         8,759

Top repositories

1

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
Python
188
star
2

retrieval-scaling

Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
Python
114
star
3

on-the-adversarial-robustness-of-visual-transformer

Code for the paper "On the Adversarial Robustness of Visual Transformers"
Python
54
star
4

FastCkpt

Python package for rematerialization-aware gradient checkpointing
Python
22
star
5

RAG-evaluation-harnesses

An evaluation suite for Retrieval-Augmented Generation (RAG).
Python
10
star
6

VL-Instruct

Codes for vision-language instruction tuning. Currently support BLIP2-t5 and BLIP2-vicuna.
Python
3
star
7

Digital-Image-Processing

MATLAB
1
star
8

Llava-doremi

Automatic task-balancing for vision-language instruction tuning using group distributionally robust optimization (Group DRO, the technique used in Doremi)
Python
1
star