🦜 Ask-Anything [Paper]
|
|
|
|
[VideoChat-7B-8Bit] End2End ChatBOT for video and image.
[VideoChat-7B]End2End ChatBOT for video and image.
[VideoChat-13B]End2End ChatBOT for video and image.
Explicit communication with ChatGPT.
video_chat
by instruction tuning for video & image chatting now! Find its details here. We release instruction data at InternVideo. The old version of video_chat
moved to video_chat_with_chatGPT
.
🎬 [End2End ChatBot]
english.mp4
🎥 [Communication with ChatGPT]
intro.mp4
🔥 Updates
-
2023/05/11 End-to-end VideoChat and its technical report.
-
2023/04/25 Watch videos longer than one minute with chatGPT
- VideoChat LongVideo: Incorporating langchain and whisper into VideoChat.
-
2023/04/21 Chat with MOSS
- VideoChat with MOSS: Explicit communication with MOSS.
-
2023/04/20: Chat with StableLM
- VideoChat with StableLM: Explicit communication with StableLM.
-
2023/04/19: Code release & Online Demo
- VideoChat with ChatGPT: Explicit communication with ChatGPT. Sensitive with time. demo is available!
- MiniGPT-4 for video: Implicit communication with Vicuna. Not sensitive with time. (Simple extension of MiniGPT-4, which will be improved in the future.)
🔨 Getting Started
Build video chat with:
📄 Citation
If you find this project useful in your research, please consider cite:
@article{2023videochat,
title={VideoChat: Chat-Centric Video Understanding},
author={Li, Kunchang and He, Yinan and Wang, Yi and Li, Yizhuo and Wang, Wenhai and Luo, Ping and Wang, Yali and Wang, Limin and Qiao, Yu},
journal={arXiv preprint arXiv:2305.06355},
year={2023}
}
⏳ Ongoing
Our team constantly studies general video understanding and long-term video reasoning:
- Strong video foundation model.
- Video-text dataset and video reasoning benchmark.
- Video-language system with LLMs.
- Artificial Intelligence Generated Content (AIGC) for Video.
- ...
🌤️ Discussion Group
If you have any questions during the trial, running or deployment, feel free to join our WeChat group discussion! If you have any ideas or suggestions for the project, you are also welcome to join our WeChat group discussion!
We are hiring researchers, engineers and interns in General Vision Group, Shanghai AI Lab. If you are interested in working with us, please contact Yi Wang ([email protected]
).