nickbild/voice_chatgpt

Stars
320
Rank 131,126 (Top 3 %)
Language
Python
License
Other
Created almost 2 years ago
Updated about 1 year ago

nickbild/voice_chatgpt

nickbild

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

VoiceGPT is a voice assistant that leverages the powerful ChatGPT chatbot to answer your questions.

VoiceGPT

VoiceGPT is a voice assistant that leverages the powerful ChatGPT chatbot to answer your questions. You speak the requests, and VoiceGPT responds with realistic, synthesized speech.

How It Works

I chose a Raspberry Pi 4 single board computer to host the project, because it runs Linux and provides a lot of versatility. A custom Python script collects audio of a speaker's voice using a USB microphone. The Google Cloud Speech-to-Text API is then used to convert that audio file into text. The text is then queried against ChatGPT using an unofficial API that returns a text string of ChatGPT's response. That response is then processed by Google Cloud's Text-to-Speech API to turn it into realistic, synthetic speech that the Raspberry Pi can play through a speaker.

The concept of a voice assistant is well established (e.g. Google Home, Amazon Alexa), but this proof of concept shows how a voice assistant can use ChatGPT, which, in my opinion, provides a far better experience than anything currently on the market.

In the future, I may add a keyword spotting algorithm to the project so that it can always run in the background, waiting for a keyword (e.g. "Hey, ChatGPT") to wake up. Before I have the chance to do much of anything else, there will probably be a commercial product including ChatGPT on the backend — then I'll just buy that because it will be smaller and better. :)

Media

Demonstration video

Bill of Materials

1 x Raspberry Pi 4
1 x USB microphone (I use a webcam with a built-in microphone)
1 x Speaker

About the Author

Nick A. Bild, MS

local_llm_assistant

World's Easiest GPT-like Voice Assistant

shaides

My AI is so bright, I gotta wear shades.

tflite_c64

Run inferences using TensorFlow Lite for Microcontrollers on a Commodore 64.

picoROM

Emulate ROM chips with a Raspberry Pi Pico.

freedom_shield

Freedom Shield was developed to protect the rights of individuals to peaceably assemble and petition their government.

c64_gen_ai

Make creative retro game sprites on the Commodore 64 with generative AI.

vectron_64

Custom-built general purpose, programmable, 6502-based computer and operating system.

speaker_snitch

Speaker Snitch flashes a light when your smart speaker is sending data to the cloud.

browzen

BrowZen correlates your emotional states with the web sites you visit to give you actionable insights about how you spend your time browsing the web.

vectron_vga_plus

Vectron VGA Plus generates a 640x480@60Hz VGA signal and has an interface that works with retro computers or microcontrollers.

c64_watch

C64 Watch is a customized T-Watch 2020 that was inspired by the Commodore 64 computer. It features a C64 theme and a built-in BASIC interpreter.

go_motion

Simplify stop motion animation with machine learning.

doom_air

Play Doom on a giant screen using your body as the controller.

schematic-o-matic

Automatically draw a KiCad schematic for a circuit prototyped on a breadboard.

safe_meeting

Safe Meeting keeps an eye on you during your video conferences, and if it sees business-inappropriate attire, the video is immediately muted.

pico_pong

Play gesture-controlled Pong with a Raspberry Pi Pico!

shaides_v2

ShAIdes 2.0 is a much smaller, more practical, redesign of the original ShAIdes.

vectron_vga

VGA signal generator designed for the Vectron 64 computer.

deepclean

Flag potentially contaminated surfaces for deep cleaning to help prevent the spread of contagious disease.

tipper

Tipper predicts if a pitch will be in or out of the strike zone in real time.

c64_watch_sync

Keep tabs on your fitness with this C64-themed smartwatch that wirelessly syncs data to your Commodore 64 computer.

combat

The 2-player only Atari classic Combat can now be played against an AI opponent. It runs entirely on a 2600 — no external processing or sensors involved!

usb_gpio

Add Python programmable GPIO pins to any computer with USBgpio.

vectron_vga_plus_v2

Vectron VGA Plus v2 generates a 640x480@60Hz VGA signal and has an interface that works with retro computers or microcontrollers.

fpga_rom_emulator

FPGA-based ROM emulator dramatically speeds software development time on computers with ROM-based storage.

vectron_65

The Vectron 65 is a 6502 CPU-based breadboard computer. It supports VGA output, keyboard input, boots into a BASIC interpreter, and has lots of GPIOs.

fpga_vga_text_mode

Generate a 400x300 @ 60Hz 3-bit color VGA signal, addressable as a 50x30 matrix of characters.

ay-3-8910

Control a General Instrument AY-3-8910 sound generator from a Raspberry Pi.

vectron_handheld

Vectron Handheld is a retro handheld gaming console based on the 6502 CPU.

vectron_vr

Virtual Reality Peripheral for Vectron 64

fpga_vga

MiniVGA generates a 200x150 @ 60Hz 3-bit color VGA signal for Arduino or retrocomputer use.

light_brakes

Light Brakes are smart glasses that selectively filter out excessively bright spots (e.g. the Sun, headlights, glare) from a wearer's field of vision in real-time.

gi-pi

Control the classic General Instrument SP0256-AL2 speech chip and AY-3-8910 sound generator with a Raspberry Pi and this Python library.

vectron_vga_plus_text_mode

Vectron VGA Plus Text Mode simplifies displaying text with retro computers and microcontrollers by hiding the pixel-level details.

memory_pill

Memory Pill passively records the last time a medication bottle was opened to prevent over- and underdosing of medications when you cannot remember if you have already taken a scheduled dose.

artemis

Artemis is an eyeglass-mounted device that can be configured to locate a specific type of object, or a person. When the target is found, Artemis will track it with a laser.

laser_blaster

Play the Atari 2600 with a laser gun!

wfh_robot

WFH Bot goes to the office for you so that you can work from home.

arduboy_home

Play Arduboy games on the big screen with the Arduboy Home game console.

pi-64

The Pi64 is a Raspberry Pi 400 that thinks it's a Commodore 64.

sentinel

Sentinel was designed to provide a subtle reminder not to touch your face for infectious disease prevention.

vectron_ai

Train machines like it's 1979! Play Atari 2600 games with gestures.

golf_ace

Learn to putt like your favorite pro golfer with machine learning.

newrons

Smart glasses with a gentle memory assist.

aqua

Aqua turns the underpowered Mattel Aquarius into a respectable computer by adding 32 KB of RAM and SD card mass storage.

gemini

Gemini Project demonstrates a method to create a functionally identical copy of software using deep learning.

vectron_65_plus

Vectron 65 Plus is a 6502 CPU-based computer with keyboard support that can run BASIC. It is highly extensible via 32 GPIO pins.

journey_to_xenos

Homebrew Atari 2600 game.

lcd_display

Control a Hitachi HD44780U compatible LCD character display with a microcontroller.

gaze_estimation

Playing around with NVIDIA's pre-trained models in the Transfer Learning Toolkit on a Jetson.

alt_wii_controller

Mario Kart Wii is a great game, but the controls are awkward. So, I built an alternative controller to play the game with a D-pad.

introvention

Introvention is a wearable device that seeks to diagnose movement disorders earlier than is presently possible by leveraging machine learning.

coleco_adam_usb_keyboard

This adapter enables an unmodified Coleco Adam keyboard to work as a USB keyboard on any modern computer.

eeprom_burner

Burn/read an Atmel AT28C256 EEPROM chip with a microcontroller.

pcjr_gpt3

Ask the world's smartest IBM PCjr anything and it will answer using the GPT-3 deep learning language model.

cura_profile

Ultimaker Cura Config for Monoprice MP Mini Delta 3D Printer

aquarius_cartridge_breakout

This PCB provides access to the Mattel Aquarius' cartridge port via pin headers.

eeprom_burner_mega

Burn/validate 28c256 EEPROMs with an Arduino Mega.

resume

Nick Bild's Resume

tft_lcd_controller

Controller for a TFT LCD display.

graphvr

GraphVR is a virtual reality graphing application for the visualization of genomic data.

6502_monitor

Monitor the address lines of a 6502 processor with a microcontroller.

sonicsight_ar

SonicSight AR provides the hearing-impaired with a visual warning when dangerous sounds (alarms, emergency vehicles, car horns, etc.) are encountered.

eeprom_pi

Raspberry Pi-based EEPROM burner.

vaccine

Vaccine is an early software threat detection system inspired by the adaptive immune system and plant communication. It is designed to work in concert with existing antivirus software. Vaccine is a first line of defense -- it senses new threats as they present themselves in the wild, and provides the information needed to quickly "vaccinate" antivirus software to protect against new threats before they spread.