Fitnect - Interactive Virtual Fitting / Dressing Room application

Kinect Mocap

Ipisoft purpose solution to perform Mocap from "standard" webcam or Kinect devices.



To know more product, Kinect HowTo

Autodesk real time point cloud reconstruction with Kinect

This is the result of the Benjamin Butin student Project in the Autodesk Photofly team

Official Microsoft Kinect SDK is out

"The Kinect for Windows SDK beta is a starter kit for applications developers that includes APIs, sample code, and drivers. This SDK enables the academic research and enthusiast communities to create rich experiences by using Microsoft Xbox 360 Kinect sensor technology on computers running Windows 7."

Source : Microsoft

They have put focus on skeletal recognition and tracking. As sample you will have a game... and more

Official samples:

"Skeletal Viewer—Capturing Data with the NUI API (C++ and C#)
The Kinect sensor includes two cameras: one delivers depth information and the other delivers color data. The NUI API enables applications to access and manipulate this data. The SkeletalViewer sample uses the NUI API to render data from the Kinect sensor’s cameras as images on the screen. The managed sample uses WPF to render captured images, and the native application uses DirectX.

ShapeGame—Creating a Game with Audio and Skeletal Tracking
Displays the tracked skeletons of two players together with shapes falling from the sky. Players can control the shapes by moving and speaking commands.

Audio Capture Raw (C++)
The Kinect sensor’s audio component is a four-element microphone array. The AudioCaptureRaw sample uses the Windows Audio Session API (WASAPI) to capture the raw audio stream from the Kinect sensor’s microphone array and write it to a .wav file.

MicArrayEchoCancellation—Acoustic Echo Cancellation, Beam Forming, and Source Localization (C++)
The primary way for C++ applications to access the Kinect sensor’s microphone array is through the MSRKinectAudio DirectX Media Object (DMO). The MSRKinectAudio DMO supports all standard microphone array functionality, and adds support for beamforming and source localization. The MicArrayEchoCancellation sample shows how to use the KinectAudio DMO as a DirectShow® source to access the Kinect sensor’s microphone array. This sample uses acoustic echo cancellation to record a high-quality audio stream and beamforming and source localization to determine the selected beam and the direction of the sound source.

MFAudioFilter—Media Foundation Audio Filter (C++)
Shows how to capture an audio stream from the Kinect sensor’s microphone array by using the MSRKinectAudio DMO in filter mode in a Windows Media Foundation topology.

RecordAudio—Recording an Audio Stream and Monitoring Direction (C#)
Demonstrates how to capture an audio stream from the Kinect sensor’s microphone array and monitor the currently selected beam and sound source direction.

Speech—Recognizing Voice Commands (C#)
Demonstrates how to use the Kinect sensor’s microphone array with the Microsoft.Speech API to recognize voice commands."


An example made by a user.

Kinect Graffiti

A nice initiative to make Temporary art !

Kinect Graffiti™ from Jean-Christophe Naour on Vimeo.

Thanks to Dlpnet.

Kinect facial capture

Quoted from Youtube
"
This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera (data shown in green). The resulting facial animation is shown in purple. The color video is just shown for reference and not used in the process.

This is work by M. Breidthttp://www.kyb.tuebingen.mpg.de/nc/employee/details/mbreidt.html , H. H. Bülthoff and C. Curiohttp://www.kyb.tuebingen.mpg.de/research/dep/bu/ce.html at the department for Human Perception, Action and Cognition of the Max Planck Institute for Biological Cybernetics, Tübingen, Germanyhttp://www.kyb.tuebingen.mpg.de/?id=43

Thanks to Joachim Tesch and Johannes Lächele for their help in recording raw data from the Kinect!"

Kinect pose recognition Details !

Here some details about the tech used to recognize the pose of the players with Kinect !

The CVPR paper : http://research.microsoft.com/pubs/145347/BodyPartRecognition.pdf

Here a video and some details : http://www.istartedsomething.com/20110319/microsoft-research-reveals-guts-of-kinect-technology/

Kinect Official SDK ... official website

http://research.microsoft.com/en-us/um/redmond/projects/kinectsdk/

The SDK will be available for VB, C# et C++. It will cover all the hardware of the Kinect (color camera, depth, micro network, echo suppresion, acoustic localization, skeletal animation).

Kinect and windows 7

Evoluce

Kinect Hack : Help blind people

NAVI -- Navigational Aids for the Visually Impaired



Source : http://hci.uni-konstanz.de/blog/2011/03/15/navi/?lang=en

Not new idea... Kinect help Motion Capture

Source Kinect hacks

Again a clip done with Kinect and Processing

Moullinex - Catalina from Moullinex on Vimeo.


Source 3DVF.com

More Kinect ( a musical clip )

In the same spirit as the clip with laser point cloud, a music clip with Kinect point cloud :

Echo Lake - Young Silence from Dan Nixon on Vimeo.

Source 3DVF.com

Kinect for fun

Intel Labs RGB-Depth section

RGB-D: Techniques and usages for Kinect style depth cameras A RGBD Project

The RGB-D project is a joint research effort between Intel Labs Seattle and the University of Washington Department of Computer Science & Engineering. The goal of this project is to develop techniques that enable future use cases of depth cameras. Using the Primesense* depth cameras underlying the Kinect * technology, we've been working on areas ranging from 3D modeling of indoor environments to interactive projection systems and object recognition torobotic manipulation and interaction.

Below, you find a list of videos illustrating our work. More detailed technical background can be found in our research areas and at the UW Robotics and State Estimation Lab. Enjoy!

3D Modeling of Indoor Environments

Depth cameras provide a stream of color images and depth per pixel. They can be used to generate 3D maps of indoor environments. Here we show some 3D maps built in our lab. What you see is not the raw data collected by the camera, but a walk through the model generated by our mapping technique. The maps are not complete; they were generated by simply carrying a depth camera through the lab and aligning the data into a globally consistent model using statistical estimation techniques.

3D indoor models could be used to automatically generate architectural drawings, allow virtual flythroughs for real estate, or remodeling and furniture shopping by inserting 3D furniture models into the map.

Interactive Flythrough

Here we show interactive navigation through a 3D model. The visualization can be done in stereoscopic 3D using shutter glasses (just like in the movie Avatar). The system uses a depth camera to control the navigation.

3D Mapping

This video demonstrates the mapping process. Shown is a top view of the 3D map generated by walking with the depth camera through the lab. The system automatically estimates the motion of the camera and detects loop closures, which help it to globally align the camera frames. No external information or sensor is used.

Interactive Mapping

We want to enable novel users to build 3D maps with depth cameras. Here you see our interactive mapping system. The system processes the depth camera data in real time and warns the user when the collected data is not suitable for a map. The approach also suggests areas that have not yet been modeled appropriately.

To know more : Intel Labs RGBD

Kinect Hack to play to Cube 2

This guy develop a hack that allow to take control of the Cube 2 game.
The depth map is simply thresholded and the localization of the blob is used to set the direction of the game character.

Asus Wavi Depth Map and Demo

A short video that show the Depth Map and usage of the Asus Wavi (Kinect clone from Asus)



To see the depth map => (2:55 min) or follow the link
http://www.youtube.com/watch?v=wAXdgXOMl8I&feature=player_embedded#t=175s

Kinect to control humanoid robot

Kinect 3D reconstruction of interior

The first prototype :



A evolution of the first prototype :



And the navigation in a reconstructed scene :



But reconstruct exterior is not possible with such technology ... Due to the active infrarouge 3D depth sensor.
 

Kinect hardware alternative from Asus

Wavi Xtion. Its the name of the Asus product to make a "clone" of the Kinect Tech for the PC world. It's seems that the tech is based on PRIMESENSE tech.

If you want to know more : Here