We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect.
Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.
Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.
Great experiment showing the future and makes you think of the diversity of possibilities to augment people in a new reality. We have put it on the augmented reality overview. Thanks for sharing.
Hi.
Can you guys describe the process on how you made video to play on StringAR. I so far only have managed to display 3D objects.
Pingback: 3DレコーディングをiPadでAR再生(3d Video from Kinect on the iPad) : monogocoro ものごころ
Pingback: Kinect Plus iPad Equals Cool 3D Augmented Reality! | All About iStuff
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video « Apple « ConsoleXXX.com
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video |
Pingback: » Kinect Plus iPad Equals Cool 3D Augmented Reality! » Client Technology Focus
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | APPROVED LINKS
Pingback: iHackBLOG
Dudes, that is just sick! Awesome work, I hope to see it in person sometime.
Pingback: The web today (2) | BONDT.ME
Pingback: Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video | iPhone5 news, updates, articles, apps
Pingback: Startup Roundup: There’s the talent — Technically Philly
can we (ordinary people
) do the same at home ?
is there some tools to work on this ? maybe someone can explain the steps of recording the video…
thanks.
Pingback: Virtual recipe stirs in Apple iPad, Microsoft Kinect « Shepherd’s Pi
Pingback: Come ottenere un video in 3D con un iPad ed il Kinect (video)
Pingback: 3D Augmented Reality Video With Kinect + iPad | Digital Buzz Blog
Pingback: Caboodle Studio Blog | South Wales Creative and Marketing Studio and Design Agency | © 2011 Caboodle Studio - Cardiff Graphic Design & Digital Agency » Blog Archive » 3D Video Experiment
Pingback: Kinect & iPad Augmented Reality « CreativeBrainFactory
Pingback: iPad üzerinde 3D Video « Faruk Erman
Pingback: Kinect + iPad = Star Wars-Like 3D Augmented Reality Video | Gizmodo Australia
Pingback: Weekly Digest for September 8th | BiscuitJam Blog
Pingback: Aplicaciones en visión 3D y control de gestos usando Kinect SDK | Technoreeze
As a website owner I believe the subject matter here is reallyexcellent. I thank you for your hard work. You should keep it up forever! Best of luck…
If you are receiving a fatal exception error message or BSOD with
error message while installing or playing Real – Arcade games, take note
of the stop error code and then temporary disable avast or turn on Gaming or Silent mode in the Avast progr am.
Learn slowly and one at the time, don’t overwhelm yourself with information. Having the ability to move and management an entire army and individual troopers, build them move across the map and chop and hack at can captures the kid hood imagination bringing the game of toy troopers to life.