Home » Digital Economy, Video & Gaming

Kinect modified to capture true 3D video

By 15 November 2010 4 Comments

University of California Davis researcher Oliver Kreylos has produced one of the most amazing demonstrations of true 3D video I’ve ever seen using an off-the-shelf Microsoft Kinect (a Microsoft Xbox360 accessory).  This is not the cheesy stereoscopic tacky “3D” moniker being affixed to recent movie titles but actual video footage that you can rotate in three dimensional space.  See the video sample below from Mr. Kreylos.  My jaw dropped when he rotated the entire scene.

The way this is working is that the Kinect camera has a depth sensor which allowed Kreylos render a 3D image of himself with the color values mapped onto them.  Kreylos used an unauthorized Open Source driver for the Kinect, but Microsoft should really considering hiring Kreylos rather than suing him.

Now if he could just get 3 more Kinects covering his sides and back and another Kinect from up top looking down, we could get something that would almost cover the entire room.  Just imagine television coverage doing this for popular events.  Bandwidth requirements would likely double and computer processing would need to increase dramatically to render 1080P in true 3D, but this would be a huge boon for networking and processing technology and it should be of great interest to companies like Cisco and Intel.

Via CrunchGear.

Update 11/16/2010 – Here is a second video showing the measuring accuracy of the system.

4 Comments »

  • Kinect modified to capture true 3D video | Technology for Mortals said:

    […] Kinect modified to capture true 3D video Oliver Kreylos has produced one of the most amazing demonstrations of true 3D video I’ve ever seen using an off-the-shelf Microsoft Kinect. This is not the cheesy stereoscopic tacky “3D” moniker being affixed to recent movie titles but actual video footage that you can rotate in three dimensional space. […]

  • Garrett said:

    WOW!! That is awesome.

    George I have been loving your posts as of late and have really been impressed by some of the things you have been showing off! I had seen quite a few kintect videos so far but this one here is the coolest of them all to date. Thank you for sharing such great content!

  • George Ou (author) said:

    @Garrett,

    I’m happy you’re enjoying the content.

    This particular video had my jaw hitting the table when he rotated the video. The idea that you could just add depth data to video to make it true 3D is insanely cool. Imagine sporting events covered like this like a Manny Pacquiao fight. That would be easier to do because of the small ring size. Then maybe more ambitious events like American football and international football (that’s soccer for the American audience).

    How cool would it be if you could rotate the scene 360 degrees left-right and 180 degrees up and down (no cameras below the players for obvious reasons). Though I would think they might not have the overhead cameras for womens tennis :). Then again the ratings would go through the roof if they did.

  • Digital Society » Blog Archive » CES 2011 – Microsoft Kinect implements 3D Avatar said:

    […] just as cool and related was the true 3D models of live video captured by the Kinect. jQuery(document).ready(function($) { […]