Merging multiple 3D Realities with the Kinect camera

[mattbell]

I wrote some software to merge multiple 3D video streams captured by the Kinect into a single 3D space. Objects from each video stream are superimposed as if they occupy the same physical space, with nearby objects from one video occluding more distant ones from another. Sometimes objects overlap, creating interesting mutant forms.

Next, I want to make 3D-merges of cats, dancers, silk aerialists, martial arts experts, that painting Nude Descending a Staircase, that scene from Alien, and much more...

Also, I want to take a moment to send some hate in the direction of WMG for blocking the original audio track on this video (KT Tunstall's Black Horse and the Cherry Tree, which was *perfect*), forcing me to re-edit the whole thing with a new song. They need to get with the internet age and realize that they shouldn't say no to awesome free advertising.

Comments

multiple you

[brad-templeton.livejournal.com]

Try changing clothes each time you put another iteration of yourself into the scene.

Re: multiple you

[nasu-dengaku.livejournal.com]

Could be interesting. I like the clone look, but the different clothing would help distinguish the bodies as they pass through each other.

[proctologiste.livejournal.com]

Here's an idea:

One of HighlightCam's erstwhile competitors (since we got out of security) is the Israeli firm BriefCam. They do object tracking, and replay all object tracks at once, but minimize collisions.

Meaning, if two objects are slated to collide, the one that occured earlier chronologically gets right of way, while the other slows down or pauses (not sure what they do exactly).

You could easily do this by using existing OpenGL collision libraries. Well, easily if you don't have to do route planning, but instead just cause one of the 3D Matts to pause while the other one passes through the region.

Not as cool in terms of straight up visual art as the stuff you've been posting, but can make creating single-actor videos easier and less overlappy (which is a virtue sometimes).

[nasu-dengaku.livejournal.com]

That's an interesting idea.

[radven.livejournal.com]

Your creativity and awesomeness always delights me. Go you!

[spoonless.livejournal.com]

Awesome!

The last scene reminds me of the Agent-Smith battle in Matrix Reloaded.