• Stars
    star
    829
  • Rank 55,018 (Top 2 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created over 4 years ago
  • Updated about 1 month ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Experimental projects we've done with DepthAI.

depthai_experiments中文文档

depthai-experiments

Discord Forum Docs

Projects we've done with DepthAI. These can be anything from "here's some code and it works most of the time" to "this is almost a tutorial".

The following list isn't exhaustive (as we randomly add experiments and we may forget to update this list):

Gaze Estimation (here)

Peek.2021-01-28.14-45.mp4

Age and Gender Recognition (here)

Gen2 Age & Gender recognition

Automated Face-Blurring (here)

Blur Face

Spatial Calculation - On Host to Show/Explain Math That Happens in OAK-D for the Spatial Location Calculator (here)

Demo

Multi-camera spatial-detection-fusion (here)

demo

Stereo Depth from Camera and From Host (here)

image

Automatic JPEG Encoding and Saving Based on AI Results (here)

raw_frame example

  • overlay_frame represents a path to RGB frame with detection overlays (bounding box and label)

    raw_frame example

  • cropped_frame represents a path to cropped RGB frame containing only ROI of the detected object

    raw_frame example

An example entries in dataset.csv are shown below

timestamp,label,left,top,right,bottom,raw_frame,overlay_frame,cropped_frame
16125187249289,bottle,0,126,79,300,data/raw/16125187249289.jpg,data/bottle/16125187249289_overlay.jpg,data/bottle/16125187249289_cropped.jpg
16125187249289,person,71,37,300,297,data/raw/16125187249289.jpg,data/person/16125187249289_overlay.jpg,data/person/16125187249289_cropped.jpg
16125187249653,bottle,0,126,79,300,data/raw/16125187249653.jpg,data/bottle/16125187249653_overlay.jpg,data/bottle/16125187249653_cropped.jpg
16125187249653,person,71,36,300,297,data/raw/16125187249653.jpg,data/person/16125187249653_overlay.jpg,data/person/16125187249653_cropped.jpg
16125187249992,bottle,0,126,80,300,data/raw/16125187249992.jpg,data/bottle/16125187249992_overlay.jpg,data/bottle/16125187249992_cropped.jpg
16125187249992,person,71,37,300,297,data/raw/16125187249992.jpg,data/person/16125187249992_overlay.jpg,data/person/16125187249992_cropped.jpg
16125187250374,person,37,38,300,299,data/raw/16125187250374.jpg,data/person/16125187250374_overlay.jpg,data/person/16125187250374_cropped.jpg
16125187250769,bottle,0,126,79,300,data/raw/16125187250769.jpg,data/bottle/16125187250769_overlay.jpg,data/bottle/16125187250769_cropped.jpg
16125187250769,person,71,36,299,297,data/raw/16125187250769.jpg,data/person/16125187250769_overlay.jpg,data/person/16125187250769_cropped.jpg
16125187251120,bottle,0,126,80,300,data/raw/16125187251120.jpg,data/bottle/16125187251120_overlay.jpg,data/bottle/16125187251120_cropped.jpg
16125187251120,person,77,37,300,298,data/raw/16125187251120.jpg,data/person/16125187251120_overlay.jpg,data/person/16125187251120_cropped.jpg
16125187251492,bottle,0,126,79,300,data/raw/16125187251492.jpg,data/bottle/16125187251492_overlay.jpg,data/bottle/16125187251492_cropped.jpg
16125187251492,person,74,38,300,297,data/raw/16125187251492.jpg,data/person/16125187251492_overlay.jpg,data/person/16125187251492_cropped.jpg

Face Mask Detection (here)

COVID-19 mask-no-mask megaAI

Crowd Counting (here)

Image example

Cumulative Object Counting (here)

cumulative object counting

How to Run Customer CV Models On-Device (here)

Concatenate frames

Concat frames

Blur frames

Blur frames

Corner detection

Laplacian corner detection

Semantic Segmentation of Depth (here)

Deeplabv3 Depth GIF

Multi-Class Semantic Segmentation (here)

Multi-class Semantic Segmentation

Depth-Driven Focus (here)

Depth driven focus

Monocular Depth Estimation - Neural Network Based (here)

Image example

Tutorial on How To Display High-Res Object Detections (here)

edit_bb

Running EfficientDet Object Detector On-Camera (here)

Watch the demo

Running EfficientNet Image Classifier On-Camera (here)

result

Facial Expression (Emotion) Recognition On-Camera (here)

Demo

Face Detection On-Camera (libfacedetection) (here)

libfacedetection

Face Recognition On-Camera (here)

Face recognition

Facial Landmarks On-Camera (here)

Facial Landmarks

Fire Detection On-Camera (here)

Fire Detection

Head Posture Detection On-Camera (here)

Head Pose Detection

Human-Machine Safety Example On-Camera (here)

Watch the demo

Human Skeletal Pose Estimation (here)

Gen2 Age & Gender recognition

LaneNet Lane Segmentation On-Camera (here)

LaneNet Lane Segmentation

License Plate Recognition On-Camera (here)

Gen2 License Plates recognition

Lossless Zooming (4K to 1080p Zoom/Crop) On-Camera (here)

Lossless Zooming

Running Mask-RCNN On-Camera (here)

Example

MegaDepth Neural Depth Running On-Camera (here)

MegaDepth

MJPEG Streaming From On-Camera (here)

MJPEG Streaming DepthAI

Class Agnostic Object Detector Running On-Camera (here)

Image example

How to Use Multiple Cameras Simultaneously (here)

Multiple devices per host

How to Sync NN Data with Image Data for Custom Neural Networks (here)

image

Optical Character Recognition in the Wild On-Camera (here)

Text Detection + OCR on DepthAI

Palm Detection On-Camera (here)

Palm Detection

Pedestrian Re-Identification (here)

Pedestrian Re-Identification

People Counting On-Camera (here)

image

People Direction-Tracker and Counter (here)

demo

Playing an On-Camera Encoded Stream on the Host (here)

Encoding demo

Recording and Playing Back Depth in RealSense -Compatible Format (here)

depth gif

Road Segmentation On-Camera (here)

Road Segmentation on DepthAI

Roboflow Integration (here)

oak_roboflow_demo_short.mp4

Social Distancing Example (here)

COVID-19 Social Distancing with DepthAI

Text Blurring On-Device (here)

Text Blurring

Image Classification On-Device (here)

Pedestrian Re-Identification

Facial Key-point Triangulation On-Camera (here)

Stereo Inference GIF

WebRTC Streaming Example (here)

Gen2 WebRTC

YOLO V3 V4 V5 X and P On-Camera (here)

yolo-logo

More Repositories

1

depthai

DepthAI Python API utilities, examples, and tutorials.
Python
933
star
2

depthai-hardware

Altium Designs for DepthAI Carrier Boards
HTML
447
star
3

depthai-python

DepthAI Python Library
C++
357
star
4

depthai-ros

Official ROS Driver for DepthAI Sensors.
C++
255
star
5

depthai-core

DepthAI C++ Library
C++
234
star
6

depthai-unity

DepthAI Unity Library, Unity projects and examples (OAK For Unity)
C#
200
star
7

depthai-ml-training

Some Example Neural Models that we've trained along with the training scripts
Jupyter Notebook
119
star
8

datadreamer

Creation of annotated datasets from scratch using Generative AI and Foundation Computer Vision models
Python
77
star
9

depthai-gui

DepthAI Pipeline Builder GUI
Python
75
star
10

depthai-ros-examples

Python
41
star
11

depthai-tutorials

Source code for DepthAI tutorials published @ https://docs.luxonis.com
Python
40
star
12

depthai-model-zoo

DepthAI Model Zoo is a collection of open-source neural network models and datasets created and maintained by DepthAI developers and community
Python
35
star
13

rae-ros

Implementation of RAE ROS and gazebo stack
Python
32
star
14

esp32-spi-message-demo

ESP32 reference app for interfacing with DepthAI over SPI
C++
31
star
15

tools

Various tools for OAK-D camera
Jupyter Notebook
28
star
16

depthai-docs-website

The documentation site for Luxonis DepthAI
CSS
26
star
17

Factory-calibration-DepthAI

Factory Calibration for DepthAI Stereo-capable models.
Python
17
star
18

depthai-shared

DepthAI Shared code and data
C++
16
star
19

blobconverter

Web-based tool to convert model into MyriadX blob
Python
15
star
20

depthai-core-example

CMake C++ example project using depthai library
CMake
14
star
21

models

Repository of lightweight models for classification, object detection, segmentation and more. Deployable to OAK-D, OpenVINO, and ONNX.
Python
14
star
22

luxonis-ml

Luxonis ML library which abstracts logging, tracking, and other useful functionalities.
Python
13
star
23

XLink

A cross-platform library for communicating with devices over various physical links.
C
12
star
24

DepthAI-PyFlow

OUTDATED, see here - https://github.com/luxonis/depthai-gui
Python
11
star
25

yolo2openvino

YoloV3, YoloV4, YoloV3-tiny, and YoloV4-tiny conversion to Tensorflow and OpenVINO.
Python
10
star
26

luxonis-train

Training framework for easy creation, training and exporting of deep learning models.
Python
10
star
27

depthai-docker

Python
8
star
28

modelconverter

Model converter for Luxonis' cameras. Convert your model from ONNX, TF, ... to a model compatible with any generation of Luxonis camera.
Python
8
star
29

remote-monitoring

JavaScript
7
star
30

depthai-poe-webapp

DepthAI WebApp for PoE devices
Python
7
star
31

robothub-images

Shell
6
star
32

robothub-examples

Python
4
star
33

depthai-spi-api

C++
4
star
34

robothub-public-apps

Python
3
star
35

depthai-boards

Files with hardware descriptions for depthai boards
Python
3
star
36

simulation

3
star
37

depthai-calibration

Python
2
star
38

tusb926x-flash-burner

TUSB926x modern libusb/hidapi Linux flasher
C++
2
star
39

depthai-ros-release

Release repository of depthai-ros
2
star
40

depthai-spi-library

DepthAI SPI Library
C
2
star
41

depthai-bootloader-shared

Shared code and data for depthai-bootloader
C++
2
star
42

depthai-nodes

Python nodes for on-host depthai augmentation.
Python
2
star
43

python-api-analyzer-to-json

Python
1
star
44

robothub

Python
1
star
45

SBR

Library and utility to view and manipulate SBR images
C
1
star
46

depthai-node

CMake
1
star
47

rp2040_u2if

Interface with RP2040 running U2IF FW
Python
1
star
48

rae-unity

RAE Unity plugin and Simulation
1
star