Alpaca-GlassOff🦙🙅♂️🕶️: Image Acceptable Alpaca
Alpaca-GlassOff is a mini image-acceptable Chat AI can run on your own laptop. The chat model is based on stanford-alpaca and alpaca-lora.
Demo
https://76585967ea4dcdca44.gradio.live
Example outputs
Recognization
Image:
Chat: what is in the image
Alpaca-GlassOff: Three people in bathing suits are in a pool.
Image:
Chat: what I can make for dinner if have food ingredients like these, and tell me how to do it
Alpaca-GlassOff: If you have food ingredients like these, you can make a vegetable stir-fry. Start by heating a tablespoon of oil in a large skillet over medium-high heat. Add the vegetables and stir-fry for 2-3 minutes, until the vegetables begin to soften. Add the garlic and ginger and stir-fry for an additional 1-2 minutes. Add the soy sauce and stir-fry for an additional 1-2 minutes, until the vegetables are cooked through. Serve the stir-fry over a bed of...
Generation
Image:
Chat: write a poem for the image
Alpaca-GlassOff:
A woman with a flower in her hair,
A beauty that can't be denied.
The petals of the flower, so bright and fair,
A symbol of life, a symbol of care.
The flower in her hair, a symbol of joy,
A reminder of life's beauty, a reminder of love.
A reminder of life's beauty, a reminder of love.
Image:
Chat: Tell me a story based on the given image
Alpaca-GlassOff: She was a young woman who had just moved into a new apartment. She was excited to explore her new surroundings, but she was also a bit overwhelmed. She decided to take it slow and started by reading the newspaper that had been delivered to her doorstep. As she read, she began to feel more at home in her new home.
Image:
chat: who you think would be the best actor of this character
Alpaca-GlassOff: Tom Hardy
So here is a Tom Hardy fan wants him to be both Antman and Venom :)
Fail examples
Image:
Chat: What is the generation of this iphone?
Alpaca-GlassOff: It is an iPhone 11
wrong, it is iPhone1
Image:
Chat: What's this?
Alpaca-GlassOff: It is a stuffed animal toy with a plant in its mouth
wrong, it is pokemon named Exeggutor.
Usage (Inference on pre-trained model)
- Install dependencies
pip install -r requirements.txt
-
If bitsandbytes doesn't work, install it from source. Windows users can follow these instructions.
-
Run
python generate.py \
--load_8bit \
--base_model 'decapoda-research/llama-7b-hf' \
--lora_weights 'tloen/alpaca-lora-7b'Contribution
Welcome to contribute