RulinShao/Llava-doremi RulinShao/Llava-doremi

  • Stars
    star
    1
  • Language
    Python
  • License
    Apache License 2.0
  • Created about 1 year ago
  • Updated about 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
RulinShao/Llava-doremi
github

RulinShao

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Automatic task-balancing for vision-language instruction tuning using group distributionally robust optimization (Group DRO, the technique used in Doremi)

More Repositories

1

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
Python
188
star
2

retrieval-scaling

Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
Python
114
star
3

on-the-adversarial-robustness-of-visual-transformer

Code for the paper "On the Adversarial Robustness of Visual Transformers"
Python
54
star
4

FastCkpt

Python package for rematerialization-aware gradient checkpointing
Python
22
star
5

RAG-evaluation-harnesses

An evaluation suite for Retrieval-Augmented Generation (RAG).
Python
10
star
6

VL-Instruct

Codes for vision-language instruction tuning. Currently support BLIP2-t5 and BLIP2-vicuna.
Python
3
star
7

Digital-Image-Processing

MATLAB
1
star