3d Video from Kinect on the iPad

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect.

Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.

Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.

Posted on July 1, 2011 in Uncategorized

Share the Story

About the Author

Responses (24)

  1. erik vos
    July 2, 2011 at 1:22 am · Reply

    Great experiment showing the future and makes you think of the diversity of possibilities to augment people in a new reality. We have put it on the augmented reality overview. Thanks for sharing.

  2. john
    July 3, 2011 at 3:13 am · Reply

    Hi.

    Can you guys describe the process on how you made video to play on StringAR. I so far only have managed to display 3D objects.

  3. [...] Original:3d Video from Kinect on the iPad [...]

  4. [...] Source: Kinect / iPad hack should help you get Obi-Wan’s attention (video) — Engadget, 3d Video from Kinect on the iPad | the labs @ laan [...]

  5. [...] [LaanLabs via Engadget] [...]

  6. [...] LaanLabs via Engadget [...]

  7. [...] Kinect / iPad hack should help you get Obi-Wan’s attention (video) — Engadget, 3d Video from Kinect on the iPad | the labs @ laan Share this:FacebookEmail Posted by asanz at 11:29 [...]

  8. [...] [LaanLabs via Engadget] [...]

  9. iHackBLOG
    July 5, 2011 at 4:12 am · Reply

    [...] [LaanLabs via Engadget] [...]

  10. FarMcKon
    July 5, 2011 at 10:01 am · Reply

    Dudes, that is just sick! Awesome work, I hope to see it in person sometime.

  11. The web today (2) | BONDT.ME
    July 5, 2011 at 10:47 am · Reply

    [...] More about the project can be found here: http://labs.laan.com/wp/2011/07/3d-video-from-kinect-on-the-ipad/ [...]

  12. [...] Holy check out Laan Labs’ 3D augmented reality treat. A hundred thousand views can’t be wrong. [...]

  13. ilker Aktuna
    July 7, 2011 at 2:04 am · Reply

    can we (ordinary people :) ) do the same at home ?
    is there some tools to work on this ? maybe someone can explain the steps of recording the video…

    thanks.

  14. [...] Some technical detail from the Brothers Laan, the engineers who did the work: We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect. Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects. Using the String SDK, we projected it back onto a printed image marker in the real world.” – source, Laan Labs blog. [...]

  15. [...] fonte [...]

  16. [...] the QR code seeing seamless 3D video… I suspect we’ll see that demo shortly!Created by Laan Labs. Via the new Saatchi London Blog… Share This Digital Buzz Post:Related Digital Buzz [...]

  17. [...] by Laan Labs. Via the new Saatchi London [...]

  18. iPad üzerinde 3D Video « Faruk Erman
    July 17, 2011 at 7:53 pm · Reply

    [...] Laan Labs tarafından hazırlanan 3D Augemented Reality videosu. Uygulama hazırlanırken Xbox Kinect ile video verilerinin haritası çıkartılmış, ardından String Augmented Reality SDK ile de 3D olarak nasıl görüneceğine karar verilmiş ve QR kodu ile aktive edilmiş. [...]

  19. [...] this might take us. Let’s just hope it’s not in the direction of a 3D Chatroulette. [Laan Labs via Crave] Tagged:auclipshacksipad 2kinectlaan [...]

  20. Weekly Digest for September 8th | BiscuitJam Blog
    September 7, 2011 at 11:02 pm · Reply

    [...] Shared 3d Video from Kinect on the iPad | the labs @ laan. [...]

  21. [...] LaanLabs [...]

  22. mobile application developer
    July 13, 2013 at 10:10 pm · Reply

    Great beat ! I would like to apprentice while you amend your site,
    how can i subscribe for a blog site? The account aided me a acceptable deal.
    I had been a little bit acquainted of this your broadcast provided bright clear idea

Leave a reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Back to Top