KinectPV2

Kinect v2 library for Processing

Version 0.7.8

Library is curretly on develop with the Windows SDK Version 1409 (9/16/2014)

Library for Mac check out the OpenKinect-for-Processing library.

####Requirements

• A Kinect for Windows v2 Device (K4W2).
• Kinect SDK v2
• 64bit computer with a dedicated USB 3.0.
• Windows 10, 8, 8.1
• Processing 3.0
• Update your latest video card driver.
• Install DirectX 11.

Reference and tutorial

Webpage tutorial with a couple of useful examples.

Install for Processing 3.0

• Install the Kinect for Windows SDK v2
  • Install the library using Processing Contributed Library Manager
  • Manual install, download the latest KinectPV2 version from the releases tab, and copy the KinectPV2 folder into your processing libraries sketch folder.
• Enjoy

For Processing 2.2.1 please use the KinectPV2 0.7.2 version.

Examples

• TestImages, Test all Frames/Images for the Kinect.
• SkeletonMaskDepth, Skeleton positions are mapped to match the depth and body index frames.
• SkeletonColor, Skeleton is mapped to match the color frame.
• Skeleton3d, 3d Skeleton example needs love.
• SimpleFaceTracking, simple face tracking with mode detection.
• PointCloudOGL, Point cloud depth render using openGL and shaders.
• PointCloudDepth, point cloud in a single 2d Image and threshold example.
• PointCloudColor, Point cloud in color, using openGL and shaders.
• MaskTest, Body Index test, and body index with depth.
• Mask_findUsers, find number of users base on body index information.
• MapDepthToColor, depth to color mapping, depth frame is aligned with color frame.
• HDFaceVertex, Face vertices are match with the color frame.
• HDColor, 1920 x 1080 RGB frame.
• DepthTest, Depth test with raw depth data.
• CoordinateMapperRGBDepth, example broken, check 0.7.2 version.
• RecordPointCloud, simple OBJ recording of the point cloud positions.
• OpenCV examples:
  • Live Capture App
  • Find Contours with depth or bodyIndex

Build

To build the KinectPV2 library from source code, look at the Build_libs folder

• KinectPV2_vc2012, builds the .dll library with JNI code.
• KinectPV2_Eclipse, builds the .jar library for processing.

Know issues

• Missing "msvcp110.dll", or "Kinect20.Face.dll: Can't find dependent libraries on thread"
  • Install Visual 2012 C++ Redistributable Packages.
  • Check if the Kinect v2 SDK 2.0 is installed correctly.
• Problems with the video, update your video card driver and install DirectX 11.

Todo

• Heart rate detection
• Multiple Devices
• Kinect Fusion

Simple Device

To include the library into a processing sketch you just need to import it and initialize it.

import KinectPV2.*;
KinectPV2 kinect;

void setup() {
  kinect = new KinectPV2(this);
  //Start up methods go here
  kinect.init();
}

Images

To obtain the color Image, depth Image, infrared Image, bodyIndex Image and long Exposure Image as a PImage you need to active with the following method

 void enableColorImg(boolean toggle);
 void enableDepthImg(boolean toggle);
 void enableInfraredImg(boolean toggle);
 void enableBodyTrackImg(boolean toggle);
 void enableInfraredLongExposureImg(boolean toggle);
 
 PImage getColorImage();
 PImage getDepthImage();
 PImage getInfraredImage();
 PImage getBodyTrackImage();
 PImage getInfraredLongExposureImage();

just initialize in the setup()

  kinect = new KinectPV2(this);
  kinect.enableColorImg(true);
  kinect.init();

get the PImage in the draw()

PImage imgC = kinect.getColorImage();
image(imgC, 0, 0);

Raw Data is only available for the color, depth ad bodytrack frames/images. Once the frames are activated just call them.

  //raw Data int valeus from [0 - 4500]
  int [] rawData = kinect.getRawDepthData();
  
  //values for [0 - 256] strip
  int [] rawData256 = kinect.getRawDepth256Data();
  
  //raw body data 0-6 users 255 nothing
  int [] rawData = kinect.getRawBodyTrack();
  
  //unpacket color values
  int [] colorRaw = kinect.getRawColor();
  

License

MIT License http://en.wikipedia.org/wiki/MIT_License