We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect.
Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.
Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.
Great experiment showing the future and makes you think of the diversity of possibilities to augment people in a new reality. We have put it on the augmented reality overview. Thanks for sharing.
Hi.
Can you guys describe the process on how you made video to play on StringAR. I so far only have managed to display 3D objects.
Pingback: 3DレコーディングをiPadでAR再生(3d Video from Kinect on the iPad) : monogocoro ものごころ
Pingback: Kinect Plus iPad Equals Cool 3D Augmented Reality! | All About iStuff
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video « Apple « ConsoleXXX.com
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video |
Pingback: » Kinect Plus iPad Equals Cool 3D Augmented Reality! » Client Technology Focus
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | APPROVED LINKS
Pingback: iHackBLOG
Dudes, that is just sick! Awesome work, I hope to see it in person sometime.
Pingback: The web today (2) | BONDT.ME
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | iPhone5 news, updates, articles, apps
Pingback: Startup Roundup: There’s the talent — Technically Philly
can we (ordinary people
) do the same at home ?
is there some tools to work on this ? maybe someone can explain the steps of recording the video…
thanks.
Pingback: Virtual recipe stirs in Apple iPad, Microsoft Kinect « Shepherd’s Pi
Pingback: Come ottenere un video in 3D con un iPad ed il Kinect (video)
Pingback: 3D Augmented Reality Video With Kinect + iPad | Digital Buzz Blog
Pingback: Caboodle Studio Blog | South Wales Creative and Marketing Studio and Design Agency | © 2011 Caboodle Studio - Cardiff Graphic Design & Digital Agency » Blog Archive » 3D Video Experiment
Pingback: Kinect & iPad Augmented Reality « CreativeBrainFactory
Pingback: iPad üzerinde 3D Video « Faruk Erman
Pingback: Kinect + iPad = Star Wars-Like 3D Augmented Reality Video | Gizmodo Australia
Pingback: Weekly Digest for September 8th | BiscuitJam Blog
Pingback: Aplicaciones en visión 3D y control de gestos usando Kinect SDK | Technoreeze