3d Video from Kinect on the iPad

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect.

Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.

Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.

This entry was posted in Uncategorized. Bookmark the permalink. Follow any comments here with the RSS feed for this post.

23 Responses to 3d Video from Kinect on the iPad

  1. erik vos says:

    Great experiment showing the future and makes you think of the diversity of possibilities to augment people in a new reality. We have put it on the augmented reality overview. Thanks for sharing.

  2. john says:

    Hi.

    Can you guys describe the process on how you made video to play on StringAR. I so far only have managed to display 3D objects.

  3. Pingback: 3DレコーディングをiPadでAR再生(3d Video from Kinect on the iPad) : monogocoro ものごころ

  4. Pingback: Kinect Plus iPad Equals Cool 3D Augmented Reality! | All About iStuff

  5. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video « Apple « ConsoleXXX.com

  6. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video |

  7. Pingback: » Kinect Plus iPad Equals Cool 3D Augmented Reality! » Client Technology Focus

  8. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | APPROVED LINKS

  9. Pingback: iHackBLOG

  10. FarMcKon says:

    Dudes, that is just sick! Awesome work, I hope to see it in person sometime.

  11. Pingback: The web today (2) | BONDT.ME

  12. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | iPhone5 news, updates, articles, apps

  13. Pingback: Startup Roundup: There’s the talent — Technically Philly

  14. ilker Aktuna says:

    can we (ordinary people :) ) do the same at home ?
    is there some tools to work on this ? maybe someone can explain the steps of recording the video…

    thanks.

  15. Pingback: Virtual recipe stirs in Apple iPad, Microsoft Kinect « Shepherd’s Pi

  16. Pingback: Come ottenere un video in 3D con un iPad ed il Kinect (video)

  17. Pingback: 3D Augmented Reality Video With Kinect + iPad | Digital Buzz Blog

  18. Pingback: Caboodle Studio Blog | South Wales Creative and Marketing Studio and Design Agency | © 2011 Caboodle Studio - Cardiff Graphic Design & Digital Agency » Blog Archive » 3D Video Experiment

  19. Pingback: Kinect & iPad Augmented Reality « CreativeBrainFactory

  20. Pingback: iPad üzerinde 3D Video « Faruk Erman

  21. Pingback: Kinect + iPad = Star Wars-Like 3D Augmented Reality Video | Gizmodo Australia

  22. Pingback: Weekly Digest for September 8th | BiscuitJam Blog

  23. Pingback: Aplicaciones en visión 3D y control de gestos usando Kinect SDK | Technoreeze

Leave a Reply

Your email is never published nor shared. Required fields are marked *

*

You may use these HTML tags and attributes:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> <pre lang="" line="">