🪄 We turn natural language descriptions of behaviors into machine-executable code.
-
We use large language models (LLMs) to bridge natural language and behavior analysis.
-
For more details, check out our arXiv preprint AmadeusGPT: a natural language interface for interactive animal behavioral analysis by Shaokai Ye, Jessy Lauer, Mu Zhou, Alexander Mathis & Mackenzie W. Mathis.
-
Like this project? Please consider giving us a star ⭐️!
Demo AmadeusGPT🎻
-
We thank Kinematik AI for partnering with us on hosting the demo. This is an academic research project demo 💕
Demo_of_AmadeusGPT_app.mp4
- Please note that you need an openAI API key, which you can easily create here.
License
AmadeusGPT is license under the Apache-2.0 license.
- Please note several key dependencies have their own licensing. Please carefully check the license information for DeepLabCut (LGPL-3.0 license), SAM (Apache-2.0 license), CEBRA (Non-Commercial), etc...
Citation
If you use ideas or code from this project in your work, please cite us using the following BibTeX entry. 🙏
@article{ye2023amadeusGPT,
title={AmadeusGPT: a natural language interface for interactive animal behavioral analysis},
author={Shaokai Ye and Jessy Lauer and Mu Zhou and Alexander Mathis and Mackenzie Weygandt Mathis},
journal={arXiv:2307.04858},
year={2023}}
News
- 🧙♀️ Code coming soon (fall 2023)
- 🔮 arXiv paper and demo released July 2023
- 🪄Contact us