3d Video from Kinect on the iPad

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect.

Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.

Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.

This entry was posted in Uncategorized. Bookmark the permalink. Follow any comments here with the RSS feed for this post.

28 Responses to 3d Video from Kinect on the iPad

  1. erik vos says:

    Great experiment showing the future and makes you think of the diversity of possibilities to augment people in a new reality. We have put it on the augmented reality overview. Thanks for sharing.

  2. john says:


    Can you guys describe the process on how you made video to play on StringAR. I so far only have managed to display 3D objects.

  3. Pingback: 3DレコーディングをiPadでAR再生(3d Video from Kinect on the iPad) : monogocoro ものごころ

  4. Pingback: Kinect Plus iPad Equals Cool 3D Augmented Reality! | All About iStuff

  5. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video « Apple « ConsoleXXX.com

  6. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video |

  7. Pingback: » Kinect Plus iPad Equals Cool 3D Augmented Reality! » Client Technology Focus

  8. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | APPROVED LINKS

  9. Pingback: iHackBLOG

  10. FarMcKon says:

    Dudes, that is just sick! Awesome work, I hope to see it in person sometime.

  11. Pingback: The web today (2) | BONDT.ME

  12. Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | iPhone5 news, updates, articles, apps

  13. Pingback: Startup Roundup: There’s the talent — Technically Philly

  14. ilker Aktuna says:

    can we (ordinary people :) ) do the same at home ?
    is there some tools to work on this ? maybe someone can explain the steps of recording the video…


  15. Pingback: Virtual recipe stirs in Apple iPad, Microsoft Kinect « Shepherd’s Pi

  16. Pingback: Come ottenere un video in 3D con un iPad ed il Kinect (video)

  17. Pingback: 3D Augmented Reality Video With Kinect + iPad | Digital Buzz Blog

  18. Pingback: Caboodle Studio Blog | South Wales Creative and Marketing Studio and Design Agency | © 2011 Caboodle Studio - Cardiff Graphic Design & Digital Agency » Blog Archive » 3D Video Experiment

  19. Pingback: Kinect & iPad Augmented Reality « CreativeBrainFactory

  20. Pingback: iPad üzerinde 3D Video « Faruk Erman

  21. Pingback: Kinect + iPad = Star Wars-Like 3D Augmented Reality Video | Gizmodo Australia

  22. Pingback: Weekly Digest for September 8th | BiscuitJam Blog

  23. Pingback: Aplicaciones en visión 3D y control de gestos usando Kinect SDK | Technoreeze

  24. Cleta Rieve says:

    As a website owner I believe the subject matter here is reallyexcellent. I thank you for your hard work. You should keep it up forever! Best of luck…

  25. If you are receiving a fatal exception error message or BSOD with
    error message while installing or playing Real – Arcade games, take note
    of the stop error code and then temporary disable avast or turn on Gaming or Silent mode in the Avast progr am.

    Learn slowly and one at the time, don’t overwhelm yourself with information. Having the ability to move and management an entire army and individual troopers, build them move across the map and chop and hack at can captures the kid hood imagination bringing the game of toy troopers to life.

  26. jaxov.com says:

    I loved as much as you will receive carried out right here.
    The sketch is attractive, your authored material stylish. nonetheless, you command get bought an impatience over that you wish
    be delivering the following. unwell unquestionably come further formerly again since exactly the
    same nearly a lot often inside case you shield
    this increase.

  27. Great beat ! I would like to apprentice while you amend your site,
    how can i subscribe for a blog site? The account aided me a acceptable deal.
    I had been a little bit acquainted of this your broadcast provided bright clear idea

  28. it ulkoistus says:

    It is really an great experiment ,in fact i did not yet try that in my iPad even though i am an IT in a IT services in Finland.But then good to see the video.

Leave a Reply

Your email is never published nor shared. Required fields are marked *


You may use these HTML tags and attributes:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> <pre lang="" line="">