Discover @RulinShao Open Source projects

Rulin Shao (@RulinShao)

RulinShao

Stars
244
Global Rank 104,773 (Top 4 %)
Followers 142
Following 49
Registered over 4 years ago
Most used languages

Python
83.3 %

MATLAB
16.7 %
Location 🇺🇸 United States
Country Total Rank 68,541
Country Ranking

Python
4,682

MATLAB
6,671

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

on-the-adversarial-robustness-of-visual-transformer

Code for the paper "On the Adversarial Robustness of Visual Transformers"

FastCkpt

Python package for rematerialization-aware gradient checkpointing

VL-Instruct

Codes for vision-language instruction tuning. Currently support BLIP2-t5 and BLIP2-vicuna.

Digital-Image-Processing

Llava-doremi

Automatic task-balancing for vision-language instruction tuning using group distributionally robust optimization (Group DRO, the technique used in Doremi)