RulinShao/VL-Instruct

Stars
3
Rank 3,963,521 (Top 79 %)
Language
Python
Created over 1 year ago
Updated about 1 year ago

RulinShao/VL-Instruct

RulinShao

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Codes for vision-language instruction tuning. Currently support BLIP2-t5 and BLIP2-vicuna.

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

retrieval-scaling

Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".

on-the-adversarial-robustness-of-visual-transformer

Code for the paper "On the Adversarial Robustness of Visual Transformers"

FastCkpt

Python package for rematerialization-aware gradient checkpointing

RAG-evaluation-harnesses

An evaluation suite for Retrieval-Augmented Generation (RAG).

Digital-Image-Processing

Llava-doremi

Automatic task-balancing for vision-language instruction tuning using group distributionally robust optimization (Group DRO, the technique used in Doremi)