• Stars
    star
    137
  • Rank 266,054 (Top 6 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 6 years ago
  • Updated 9 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

ReSpeaker 4 Mic Array with builtin VAD, DOA, AEC, Beamforming & NS

ReSpeaker USB 4 Mic Array

Available at Seeed

The ReSpeaker USB 4 Mic Array is the successor of the ReSpeaker USB 6+1 Mic Array. It has better built-in audio processing algorithms than the 6+1 Mic Array, so it has better audio recording quality, although it only has 4 microphones.

Features

  • 4 microphones
  • 12 RGB LEDs
  • USB
  • built-in AEC, VAD, DOA, Beamforming and NS
  • 16000 sample rate

Usage

Audacity is recommended to test audio recording.

Install DFU and LED control driver for Windows

On Linux and macOS, the USB 4 Mic Array will just work. On Windows, audio recording and playback will also work without installing a driver. But in order to upgrade the device's firmware or to control LEDs an DSP parameters on Windows, the libusb-win32 driver is required. We use a handy tool - Zadig to install the libusb-win32 driver for both SEEED DFU and SEEED Control (the USB 4 Mic Array has 4 devices on Windows Device Manager).

Make sure that libusb-win32 is selected, not WinUSB or libusbK

Device Firmware Update

The Microphone Array supports USB DFU. We have a python script - dfu.py to do that.

pip install pyusb
python dfu.py --download new_firmware.bin       #  with sudo if usb permission error
firmware channels note
1_channel_firmware.bin 1 processed audio for ASR
6_channels_firmware.bin 6 channel 0: processed audio for ASR, channel 1-4: 4 microphones' raw data, channel 5: playback

Note: The flash memory of XVF3000 has updated from 90nm to 65nm, the Jedec ID between the 90nm and 65nm flash memories has a 1-bit different. This will cause the new device not upgradable after you download old firmware(v2.0.0 or below) to an new device. The new firmware(v3.0.0 or above) is already compatible with old device and new device, so we advise customers to use the new firmware when DFU. The new 65nm flash memory device will use new part numbers with a suffix 'A' as the following picture:

Summary of programming and dfu scenarios:

hardware factory programmed DFU firmware outcome
1 old device any any DFU succeed, device operates correctly and upgradeable
2 new device (XVF3000 with a suffix 'A') 3.0.0 3.0.0 or above DFU succeed, device operates correctly and upgradeable
3 new device (XVF3000 with a suffix 'A') 3.0.0 2.0.0 or below DFU succeed, device operates correctly, but not upgradeable

How to control the RGB LED ring

The USB 4 Mic Array has on-board 12 RGB LEDs and has a variety of light effects. Go to the respeaker/pixel_ring to learn how to use it. The LED control protocol is at respeaker/pixel_ring wiki.

Tuning

There are some parameters of built-in algorithms to configure. For example, we can turn off Automatic Gain Control (AGC):

python tuning.py AGCONOFF 0i6_firmware.bin

To get the full list parameters, run:

python tuning.py -p

Realtime sound source localization and tracking

ODAS is a very cool project to perform sound source localization, tracking, separation and post-filtering. Let's have a try!

  1. get ODAS and build it
sudo apt-get install libfftw3-dev libconfig-dev libasound2-dev
git clone https://github.com/introlab/odas.git --branch=dev
mkdir odas/build
cd odas/build
cmake ..
make
  1. get ODAS Studio from https://github.com/introlab/odas_web/releases and open it.

The odascore will be at odas/bin/odascore, the config file is at odas.cfg. Change odas.cfg based on your sound card number.

    interface: {
        type = "soundcard";
        card = 1;
        device = 0;
    }
  1. upgrade your usb 4 mic array with 6_channels_firmware_6.02dB.bin (or 6_channels_firmware.bin, 6_channels_firmware_12.04dB.bin) which includes 4 channels raw audio data.

More Repositories

1

seeed-voicecard

2 Mic Hat, 4 Mic Array, 6-Mic Circular Array Kit, and 4-Mic Linear Array Kit for Raspberry Pi
C
472
star
2

mic_array

DOA, VAD and KWS for ReSpeaker Microphone Array
Python
286
star
3

get_started_with_respeaker

This is the wiki of ReSpeaker Core V2, ReSpeaker Core and ReSpeaker Mic Array.
Python
257
star
4

avs

python implementation of alexa voice service app, ζ”―ζŒDuerOS
Python
196
star
5

respeaker_python_library

To build voice enabled objects/applications with Python and ReSpeaker
Python
149
star
6

mic_hat

2 Mic Array for Raspberry Pi
Python
102
star
7

pixel_ring

RGB LED library for ReSpeaker 4 Mic Array, ReSpeaker V2 & ReSpeaker USB 6+1 Mic Array
Python
59
star
8

respeakerd

respeakerd is the server application for the microphone array solutions of SEEED, based on librespeaker which combines the audio front-end processing algorithms.
C++
54
star
9

Alexa

New version is at https://github.com/respeaker/avs
Python
53
star
10

respeaker_for_raspberrypi

Examples to use ReSpeaker series Mic Arrays on Raspberry Pi
Python
41
star
11

4mics_hat

Python
34
star
12

respeaker-feed

C
20
star
13

mic_array_dfu

ReSpeaker Microphone Array DFU tool for firmware upgrade
C
19
star
14

respeaker_arduino_library

C++
18
star
15

pocketsphinx_keyword_spotting

Use Pocketsphinx to detect keywords offline
Python
12
star
16

microsoft_cognitive_services

Not updated, use
Python
11
star
17

Music_Visualizer

Music Player with Spectrum
Python
8
star
18

ok_google

hands-free google assistant with respeaker
Python
8
star
19

respeaker_v2_eval

respeaker v2 评估板ε…₯ε‘ζŒ‡ε—
Python
8
star
20

respeaker.github.io

6
star
21

piano

Turn ReSpeaker into a Piano (with Fruit)
Python
6
star
22

w

Send Wi-Fi settings through sound wave http://respeaker.io/w
Python
6
star
23

googleassistant_respeakerd

Adapt google assistant's gRPC sample app for working with respeakerd
Python
6
star
24

respeaker_frontend

JavaScript
5
star
25

spi_bridge

SPI bridge between Arduino (ATmega32u4) and ReSpeaker (MT7688), ATmega32u4 as a SPI slave
Python
5
star
26

pocketsphinx-data

PocketSphinx's acoustic model, dictionary and keywords
Shell
5
star
27

rkbin

Shell
4
star
28

respeaker_hi

Python
4
star
29

FasterConfig

A faster way to setup wifi
C++
4
star
30

deb_repos

Roff
3
star
31

axol_system_image_changelog

ReSpeaker Core v2 image changelog, TODO and collecting issues.
2
star
32

image_builder

Shell
2
star
33

respeaker_openwrt_files

openwrt files for respeaker
Shell
2
star
34

respeaker_virtualenv

Python
2
star
35

source_builder

Shell
1
star
36

orangerpcd

Shell
1
star
37

mopidy-hallo

Voice Interaction with Mopidy
Python
1
star
38

toolchains

1
star
39

docs

ReSpeaker Documents
HTML
1
star
40

deb

deb package repository for respeaker v2
1
star