mattbell: (Default)
I've been working on other things with the Kinect, but I do want to keep making multiple reality videos.

I got a couple of friends who do acroyoga to come over.  Here's what we made:


In case you haven't been following along:

I wrote some software to merge multiple 3D video streams captured by the Kinect into a single 3D space. Objects from each video stream are superimposed as if they occupy the same physical space, with nearby objects from one video occluding more distant ones from another. Sometimes objects overlap, creating interesting mutant forms.
mattbell: (Default)
A friend of mine saw my Kinect videos and contacted me about filming him doing Iaido.  

Iaido is a highly stylized Japanese martial art in which practitioners fight imaginary opponents in a scripted battle, playing each of the positions in the battle one at a time.  A lot of importance is paid to the position and timing of the movements, ensuring that they align with one another.  Basically, the Kinect software I wrote was perfect for assessing how well he did.  The filming conditions were not so good and I didn't have much time, so this is more like a proof of concept. Hopefully I'll get something better when he's next in town.

mattbell: (Default)
I wrote some software to merge multiple 3D video streams captured by the Kinect into a single 3D space. Objects from each video stream are superimposed as if they occupy the same physical space, with nearby objects from one video occluding more distant ones from another. Sometimes objects overlap, creating interesting mutant forms.


Next, I want to make 3D-merges of cats, dancers, silk aerialists, martial arts experts, that painting Nude Descending a Staircase, that scene from Alien, and much more...

Also, I want to take a moment to send some hate in the direction of WMG for blocking the original audio track on this video (KT Tunstall's Black Horse and the Cherry Tree, which was *perfect*), forcing me to re-edit the whole thing with a new song. They need to get with the internet age and realize that they shouldn't say no to awesome free advertising.
mattbell: (Default)
I set up my Kinect video superimposition software at a friend's party, and invited people to play with it.  Most of the good stuff never got recorded, but here are a couple of 3D self-superimpositions:

  

My friend on the right apparently needed to send a picture of herself kissing a girl to some guy, so I set it up so she could make out with herself.   People were "surprisingly" willing to grope the augmented-reality-captured models of their friends.  Who knew...
mattbell: (Default)

I decided that merging multiple 3D videos was more interesting than merging a 3D video with a still image, so I wrote some software today that did exactly that.  I like the patterns I get out of superimposing multiple 3D video streams in space.  However, it's still very rough and needs a lot of work.

I don't normally put up content that is this rough, but I'm doing it because I WANT YOUR HELP.

Through a night of experimentation, I've determined that the following things need to be true to make a good 3D merged cat video:

- Kittens with boundless energy are better than mature cats that are harder to entice into action.  After a mature cat has had some of its favorite toy, some kitty treats, some wet food, and some catnip, it really doesn't give a crap about your little video project.  Kittens, on the other hand, are much easier to remotely control with a laser pointer. 
- Short hair cats work better than long hair cats.  (It has to do with how the 3D camera deduces texture)
- Multicolor cats are the best -- solid color fur, especially if it's dark, does not work so well. 

So please hook me up with some energetic short-haired multicolored kittens!  Please!
mattbell: (Default)
 I want to make a lot more 3D sculptures with Kinect. Anyone want to help? I want to film:
- Acrobatics,
- Martial arts
- Basketball
- Silk dancing
- Dancing, specifically couples dancing
- Cats and dogs (short hair needed)
- People wandering through forests of large houseplants (you only need one)
- Fun tricks with pose matching and intersecting bodies (small groups needed).
- Re-enacting that birth scene from Alien...
- A large flag waving in the wind (must be close, not 20 feet up)
- Paper airplanes flying.
- (not)-Nude Descending a Staircase
- a 1-woman Busby Berkeley movie
- More stuff we'll probably think up as we start to play...
mattbell: (Default)
 Lest I be getting lazy on a Friday night, I made a 3rd Kinect video.   Here is another fun thing you can do with your own software on a 3D camera:



By taking a 3D snapshot of the room with furniture in it, I can remove the furniture and then wander in the 3d "ghost" space left behind.
mattbell: (Default)
 


I made some improvements to my program from yesterday.  Now I can control how multiple RGB/Depth images are merged together to create a virtual 3D sculpture I can walk through.  This stuff is seriously fun.

mattbell: (Default)
 

I believe that consumer-level 3D cameras will have a huge impact on a variety of industries and will lead to the creation of many types of new products.  I've started to play around with the Kinect using the OpenKinect hack & open source codebase.  

For my first project I created a 3D sculpture tool.  In the video, parts of the sculpted image become updated when an object in that area moves closer to the camera than any other object has been in the past.  This lets you carve images in space by moving them closer to the camera.  This took a day of intense work -- I'm planning on making some upgrades to it over the next few days to make it even more interesting.

I also would love to shoot some more videos.  In particular, I want to do the following, though I'm totally up for experimenting and playing with different things:
- People doing acrobatics
- Dancing (especially couples dancing, like waltz)
- Recreating the painting Nude Descending a Staircase (nude or not-nude).  I need a better staircase than the one in my house
- A playful cat chasing things (preferably light or multicolored cat with short hair.  I don't think the camera would do as well with cats with long black hair)
- Moving the camera through lots of houseplants, or just one that is blowing in the wind.

Also, if anyone has a recommendation for a better Mac screencapture program, I'd love to hear it.  The one I downloaded last night hiccups and causes other issues.

Profile

mattbell: (Default)
mattbell

February 2011

S M T W T F S
   123 45
67 89101112
13141516171819
20212223242526
2728     

Syndicate

RSS Atom

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Sep. 25th, 2017 01:24 pm
Powered by Dreamwidth Studios