• Stars
    star
    690
  • Rank 65,522 (Top 2 %)
  • Language
    C
  • License
    Apache License 2.0
  • Created almost 4 years ago
  • Updated 4 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Applications based on Wi-Fi CSI (Channel state information), such as indoor positioning, human detection

ESP-CSI

The main purpose of this project is to show the use of ESP-WIFI-CSI. The human body detection algorithm is still being optimized. You can get more accurate results through machine learning, neural network and other algorithms based on the original CSI data.

1 Introduction

1.1 Introduction to CSI

Channel state information (CSI) includes specific indicators such as carrier signal strength, amplitude, phase, and signal delay. These indicators reveal the signal scattering, reflection, and power attenuation phenomena that occur with the carrier as the transmission distance changes. It can be used to measure the channel status of the wireless network in Wi-Fi communication. By analyzing and studying the changes in CSI, we can conversely speculate on the changes in the physical environment that cause the changes in the channel state, that is, to achieve non-contact intelligent sensing. CSI is extremely sensitive to environmental changes. In addition to perceiving environmental changes caused by large movements such as walking and running of people or animals, it can also capture subtle movements caused by small movements such as breathing and chewing of people or animals in a static environment.

1.2 The relationship between CSI and RSSI

  1. Level of detail: CSI provides more detailed information about the wireless channel, including amplitude, phase, and frequency response. RSSI, on the other hand, only provides a general measurement of signal strength.

  2. Applications: Wi-Fi CSI is particularly useful for advanced applications that require fine-grained analysis of the wireless channel, such as indoor localization, gesture recognition, and activity detection. RSSI is commonly used for basic tasks like signal strength estimation and basic proximity-based applications.

  3. Accuracy: CSI can offer higher accuracy in certain applications compared to RSSI. It allows for more precise localization and tracking, as well as better differentiation between different actions or gestures.

  4. Hardware support: Both CSI and RSSI can be obtained from standard Wi-Fi receivers, but CSI requires more advanced hardware capabilities to capture and process the detailed channel information. RSSI, being a simpler measurement, can be obtained with most Wi-Fi receivers.

In summary, Wi-Fi CSI provides more detailed and fine-grained information about the wireless channel, while RSSI is a simpler measurement of signal strength. CSI enables more advanced applications but requires more sophisticated hardware and analysis techniques.

1.3 Advantages of CSI

CSI is a physical layer characteristic.Compared with other indicators, CSI amplitude shows some advantages:

  1. Anti-interference: CSI amplitude is essentially the attenuation coefficient of a set of channels. As long as the channel itself does not change, it is quite robust to interference from power adaptors and other jumpers.
  2. More fine-grained: CSI does not use synthetic values ​​(such as RSSI) to measure the channel, but decomposes the entire channel measurement into sub-carriers, and estimates the frequency response of each sub-carrier, so as to determine the channel in the frequency domain. Make a more fine-grained description.

1.4 Espressif CSI Advantage

  1. All ESP32 series support CSI: ESP32 / ESP32-S2 / ESP32-C3 / ESP32-S3 / ESP32-C6.
  2. Powerful ecology: Espressif is a global leader in the field of Wi-Fi MCUs, combining CSI with existing IOT equipment.
  3. More information: Such as RSSI, RF noise floor, reception time and antenna rx_ctrl field.
  4. Bluetooth Assist: ESP32 also supports BLE, for example, it can scan surrounding devices to assist detection.
  5. Powerful processing capability: ESP32 CPU handles dual-core, 240MHz, AI instructions. Can run machine learning and neural networks.

2 CSI Application

2.1 Intruder detection

Select high-sensitivity sub-carrier combinations and signals from non-line-of-sight path directions in different multipath propagation environments, thereby enhancing the sensitivity of passive person detection and expanding the detection range. This method can form "no blind spot" intruder detection in security applications. The multipath propagation characteristics of wireless signals indoors make wireless perception have natural advantages in sensing range and directionality.

2.2 Positioning and ranging

You can learn from the RSSI method and use CSI as a more informative fingerprint (including information on signal amplitude and phase on multiple subcarriers), or rely on a frequency selective attenuation model for more accurate ranging.

2.3 Human activity detection and recognition

Use CSI's high sensitivity to environmental changes to recognize human movements, gestures, breathing and other small movements and daily activities.

3 Getting Started

The Getting Started project can be found in the examples/console_test directory. It will help you build a human activity detection application. See: README.

4 How to get CSI

4.1 Get router CSI

  • How ​​to implement: ESP32 sends a Ping packet to the router, and receives the CSI information carried in the Ping Replay returned by the router.
  • Advantage: Only one ESP32 plus router can be completed.
  • Disadvantages: Depends on the router, such as the location of the router, the supported Wi-Fi protocol, etc.
  • Applicable scenario: There is only one ESP32 in the environment, and there is a router in the detection environment.

4.2 Get CSI between devices

  • How ​​to implement: ESP32 A and B both send Ping packets to the router, and ESP32 A receives the CSI information carried in the Ping Replay returned by ESP32 B, which is a supplement to the first detection scenario.
  • Advantage: Does not depend on the location of the router, and is not affected by other devices connected under the router.
  • Disadvantage: Depends on the Wi-Fi protocol supported by the router, environment.
  • Applicable scenario: There must be more than two ESP32s in the environment.

4.3 Get CSI specific devices

  • How ​​to implement: The packet sending device continuously switches channels to send out packets. ESP32 A, B, and C all obtain the CSI information carried in the broadcast packet of the packet sending device. This method has the highest detection accuracy and reliability.
  • Advantages: The completion is not affected by the router, and the detection accuracy is high. When there are multiple devices in the environment, only one packet sending device will cause little interference to the network environment.
  • Disadvantages: In addition to the ordinary ESP32, it is also necessary to add a special package issuing equipment, the cost is the same and higher.
  • Applicable scenarios: Suitable for scenarios that require high accuracy and multi-device cluster positioning.

5 Note

  1. The effect of external IPEX antenna is better than PCB antenna, PCB antenna has directivity.
  2. Test in an unmanned environment. Avoid the influence of other people's activities on test results.

6 Related resources

  • ESP-IDF Programming Guide is the documentation for the Espressif IoT development framework.
  • ESP-WIFI-CSI Guide is the use of ESP-WIFI-CSI Description.
  • If you find a bug or have a feature request, you can submit it on Issues on GitHub. Please check to see if your question already exists in the existing Issues before submitting it.

Reference

  1. Through-Wall Human Pose Estimation Using Radio Signals
  2. A list of awesome papers and cool resources on WiFi CSI sensing

More Repositories

1

esp-idf

Espressif IoT Development Framework. Official development framework for Espressif SoCs.
C
13,620
star
2

arduino-esp32

Arduino core for the ESP32
C++
13,280
star
3

esptool

Espressif SoC serial bootloader utility
Python
5,521
star
4

ESP8266_RTOS_SDK

Latest ESP8266 SDK based on FreeRTOS, esp-idf style.
C
3,333
star
5

esp-iot-solution

Espressif IoT Library. IoT Device Drivers, Documentations And Solutions.
C
1,856
star
6

esp-who

Face detection and recognition framework
C
1,660
star
7

esp-adf

Espressif Audio Development Framework
C
1,523
star
8

esp32-camera

C
1,259
star
9

vscode-esp-idf-extension

Visual Studio Code extension for ESP-IDF projects
TypeScript
1,032
star
10

ESP8266_NONOS_SDK

ESP8266 nonOS SDK
C
926
star
11

esp-at

AT application for ESP32/ESP32-C2/ESP32-C3/ESP32-C6/ESP8266
C
860
star
12

esp-mdf

Espressif Mesh Development Framework, limited maintain, recommend to use https://github.com/espressif/esp-mesh-lite
C
774
star
13

esp-drone

Mini Drone/Quadcopter Firmware for ESP32 and ESP32-S Series SoCs.
C
766
star
14

esp-box

The ESP-BOX is a new generation AIoT development platform released by Espressif Systems.
HTML
757
star
15

ESP8266_MP3_DECODER

A demo that should be run with ESP8266 Non-OS SDK
C
739
star
16

kicad-libraries

KiCad libraries for Espressif SoCs, modules, and DevKits.
Python
703
star
17

esp-matter

Espressif's SDK for Matter
C++
638
star
18

esp-mqtt

ESP32 mqtt component
C
602
star
19

esp-apple-homekit-adk

This is a port for Apple's Open Source HomeKit ADK
C
599
star
20

esp-skainet

Espressif intelligent voice assistant
C
570
star
21

esp-hosted

Hosted Solution (Linux/MCU) with ESP32 (Wi-Fi + BT + BLE)
C
562
star
22

esp-homekit-sdk

C
552
star
23

esp-sr

Speech recognition
C
551
star
24

esp-now

A connectionless Wi-Fi communication protocol
C
503
star
25

ESP8266_AT

This project is not maintained, please use https://github.com/espressif/esp-at.
C
472
star
26

esp32-nesemu

Proof-of-concept NES emulator for the ESP32
C
471
star
27

esp-dsp

DSP library for ESP-IDF
C
458
star
28

esp-rainmaker

ESP RainMaker Agent for firmware development
C
442
star
29

rust-esp32-example

Example of Rust integration into an ESP-IDF project, for ESP32 series of chips
Rust
432
star
30

esp-serial-flasher

Library for flashing Espressif SoCs from other MCUs.
C
371
star
31

esp-dl

Espressif deep-learning library for AIoT applications
C++
369
star
32

openocd-esp32

OpenOCD branch with ESP32 JTAG support
C
355
star
33

esp-tflite-micro

TensorFlow Lite Micro for Espressif Chipsets
C++
348
star
34

esp-dev-kits

Docs, Schematics, Factory Firmwares for ESP Development Kits
C
343
star
35

esp-aliyun

Aliyun Iotkit-embedded, support esp32 & esp8266.
C
338
star
36

esp-idf-template

Template application for https://github.com/espressif/esp-idf
Makefile
336
star
37

idf-eclipse-plugin

Espressif-IDE (based on Eclipse CDT) for ESP-IDF CMake based projects 4.x and above
Java
306
star
38

esp-usb-bridge

USB to UART&JTAG bridge, implemented on ESP32-S2 or ESP32-S3
C
292
star
39

esp-va-sdk

Espressif's Voice Assistant SDK: Alexa, Google Voice Assistant, Google DialogFlow
C
290
star
40

esptool-js

Javascript implementation of flasher tool for Espressif chips, running in web browser using WebSerial.
TypeScript
276
star
41

esp-aws-iot

AWS IoT SDK for ESP32 based chipsets
C
266
star
42

ESP31_RTOS_SDK

ESP31B SDK based on FreeRTOS. For ESP32 please see http://github.com/espressif/esp-idf
HTML
189
star
43

esp-protocols

Collection of ESP-IDF components related to networking protocols
C
185
star
44

esp-idf-provisioning-android

Android Provisioning application for ESP-IDF Unified provisioning
Java
184
star
45

esp-azure

SDK to connect ESP8266 and ESP32 to Microsoft Azure IoT services
C
174
star
46

esp-jumpstart

Jumpstart from concept to production
C
173
star
47

esp-bsp

Board support components for Espressif development boards
C
172
star
48

esp32-wifi-lib

ESP32 WiFi stack precompiled libraries
Shell
165
star
49

esp-gdbstub

C
157
star
50

esp-iot-bridge

A smart bridge to make both ESP and the other MCU or smart device can access the Internet.
C
153
star
51

idf-extra-components

Additional components for ESP-IDF, maintained by Espressif
C
151
star
52

esp32-doom

A proof-of-concept port of PrBoom to the ESP32. Needs psram hardware.
C++
151
star
53

esp-zigbee-sdk

Espressif Zigbee SDK
C
144
star
54

esp-google-iot

Google Cloud IoT SDK as an ESP-IDF Component
C
142
star
55

esp-nn

Optimised Neural Network functions for Espressif chipsets
Assembly
130
star
56

esp8266-rtos-sample-code

C
129
star
57

esp-idf-provisioning-ios

Swift
125
star
58

esp32-arduino-lib-builder

C
120
star
59

esp-mesh-lite

A lite version Wi-Fi Mesh, each node can access the network over the IP layer.
C
115
star
60

esp-modbus

ESP-Modbus - the officially suppported library for Modbus protocol (serial RS485 + TCP over WiFi or Ethernet).
C
110
star
61

esp-thread-br

Espressif Thread Border Router SDK
C
105
star
62

idf-installer

ESP IDF Windows Installer
Inno Setup
102
star
63

esp-insights

ESP Insights: A remote diagnostics/observability framework for connected devices
C
99
star
64

book-esp32c3-iot-projects

《ESP32-C3 物联网工程开发实战》配套代码
Swift
96
star
65

esp-rainmaker-android

ESP RainMaker Android app sources
Java
87
star
66

usb-pids

Customer-allocated USB PIDs under the Espressif VID
Shell
85
star
67

esp-lwip

Fork of lwIP (https://savannah.nongnu.org/projects/lwip/) with ESP-IDF specific patches
C
83
star
68

pytest-embedded

A pytest plugin that designed for embedded testing
Python
80
star
69

esp-ali-smartliving

阿里云生活物联网平台 & 天猫精灵 IoT 开放平台
C
77
star
70

esp-idf-cxx

C++ wrapper classes for ESP-IDF components.
C++
77
star
71

esp32c3-direct-boot-example

Example of ESP32-C3 (rev. 3 and later) "direct boot" feature.
CMake
68
star
72

esp32-bt-lib

ESP32 Bluetooth stack (below HCI layer) precompiled libraries
67
star
73

esp8266-nonos-sample-code

C
66
star
74

esp-qcloud

基于 ESP-IDF 原生开发接入腾讯 IoT Explorer,支持 ESP32/ESP32S2,快速实现腾讯连连控制。
C
65
star
75

esp-wasmachine

The Machine which can run WASM applications.
C
61
star
76

freertos-gdb

Python module for operating with freeRTOS kernel objects in GDB
Python
56
star
77

esp-moonlight

C
54
star
78

svd

SVD files for Espressif devices
54
star
79

openocd-on-esp32

OpenOCD port running on ESP32-S3 microcontrollers
C
54
star
80

xtensa-isa-doc

TeX
48
star
81

binutils-esp32ulp

Binutils fork with support for the ESP32 ULP co-processor
C
46
star
82

idf-component-manager

Tool for installing ESP-IDF components
Python
43
star
83

esp-rainmaker-ios

ESP RainMaker iOS app sources
Swift
41
star
84

esp-privilege-separation

Espressif Privilege Separation Framework
C
39
star
85

esp-adf-libs

C
38
star
86

esp-launchpad

Configurable Browser-based Image Flasher
CSS
38
star
87

esp-wolfssl

WolfSSL port for ESP-IDF & ESP8266_RTOS_SDK
C
38
star
88

ESP8266_RTOS_ALINK_DEMO

Alink 1.0 早期版本
Assembly
36
star
89

esp-faq

Python
35
star
90

esp-wdf

Espressif WASM Development Framework.
C
34
star
91

esp31-smsemu

C
34
star
92

esp-joylink

Demo project for JD joylink, support esp32 & esp8266.
C
34
star
93

esp8266-alink-v1.0

alink v1.0
C
32
star
94

newlib-esp32

Version of newlib used in ESP32 ROM and ESP-IDF
C
31
star
95

idf-env

idf-env tool helps set up and manage ESP-IDF installations
Rust
31
star
96

esp32-c3-book-en

Read the book here:
HTML
30
star
97

esp32-alink-demo

Demo project for alink, include embed and SDS
C
30
star
98

esp32-iotivity

Guide you to make your ESP32 support OCF/OIC.
C
29
star
99

esp8266-alink-sds

Demo project for alink SDS
C
27
star
100

esp-cryptoauthlib

Release only fork of https://github.com/MicrochipTech/cryptoauthlib
C
27
star