New Media



Cognitive Resonance

smallLock
My good friend Josh Goldberg organized a great event this weekend. The name of the night was Cognitive Resonance, the venue was Monkey Town in Brooklyn. I performed with Dave Della Costa, he built his sound live using SuperCollider and I built and application coded with openFrameworks.

The app load a series of type images that I created. They are analyzed in realtime in order to fide the whole words and then each individual letter. I created many particle system that react to the each letter. I hope to work on the piece some more and do more of these events. Thanks Josh for getting this together, next stop Boston.

Q6M
Type
0J4I
Type
907
Type
HG8
Type

see all photos here

The Vision Show

The Vision Show was in Boston this week. What an interesting conference, most people were there to find the latest in machine vision solutions. We were there to find the best hardware solutions for our tables and pieces, Ohh man we did! People were so helpful to figure out what we could use in our work. Imagine Source taught us a ton and evan gave us a free camera. Can’t wait to try out some of the things we found.
Vision Show Boston
Vision Show Boston
This is the camera that Imagine Source gave us. It is unreal, 1024 x 768 resolution capturing at a solid 30 fps.
Vision Show Boston
The had some funky face tracking set up. haha Check out all the photos from the show here buy cialisbuy cialisbuy levitrabuy levitrabuy propeciabuy propeciabuy somabuy somabuy levitrabuy cialisbuy propeciabuy levitrabuy somabuy cialisbuy propeciabuy levitrabuy somabuy cialisbuy levitrabuy propeciabuy soma

Interactive Mural Atlanta

Just go back from Atlanta doing an installation for the SCMX music festival. The piece was installed under a tent on two HD 52″ LCD displays. The image was beautiful 1080p and super bright.

As people stand in front of the displays they were able to interactive with drifting bubbles filled with other small bubbles. You were able to pop the bubbles and have the inside bubbles pour over your contour. As you would move around dust would float off of you and every so often a ribbon would fly away based on your movement.

It was a interesting installation, our first time dealing with the sun and the elements of the outdoors. The piece will be touring around to the rest of the SCMX. More and better documentation to follow.
Interactive Mural
Interactive Mural
Interactive Mural

Video
Photo set
Application Renderings

Kids & Interaction

We had some kids come in today, they got to see what we do and try out some of the toys. You can learn a ton watching kids interact with this table. It was amazing watching them learn how to use the table with no explanation. They would teach each other as they figured out new features. I have a ton of new ideas to take from this.
Kids and Multitouch Table
Kids and Face Tracking

Some particle experiments

Made with OF

This is where all the magic is made. OF will take over the world.

Reel


Posted a reel of some current work check it out.

Flow

This is a rough example of flocking and obstacle avoidance. The creatures will ovoid the contours of any shape that is on the table. They also follow the rules of flocking separation, alignment, cohesion. Read more about Boids here.
Flocking

Fungi

Fungi
Fungi

These creatures are attracted to people; they are curious. As you get closer they will jump out and have a taste. This piece is projected over a stairwell 10′x18′.

update:
Seen on:
http://www.vimeo.com/videoart

I want to get some feedback on how to do a proper and simple calabration for a multitouch system. I am going to try and walk you through the process and construction of the table. Here is the main setup for the table. For the most part the table is working check out latest video. The blobs are showing up and somewhat consistent. Better adjustment of IR would fix this.
Multitouch Main Setup
This is what the projection looks like. The throw of the projection is much larger than the table top. This is where the problem I think starts. I need to align the physical touch points to the projected touch points.
Multitouch Projection Throw
To get the correct image to track I perform a warping technique. I drag the four points of a quad to the four corners of the table. This creates a 640 x 480 warped image where pixel 0,0 is the top left hand corner. I think that this works well and does the job for the most part. It is on the other hand the most processor intensive part of the application. The distortion of the image is not terrible. I have tried Stefanix’s checkerboard calibration but do not completely understand how it applies other than compensate for wide angle distortion in the camera.
Camera Warping
More info in photo notes

So now that we have a corrected image to track I need to match the projection to the tabletop. We do a very simalar calibration, this does not feel correct but works. You drag the four points of a quad warping the openGL world to the table. This for the most part works but the distortion of the GL world is weird. There must be a better way to do this.
OpenGL Warp

I have been looking into all the techniques done by other systems like TouchLib and Reactivision. Most are a four point or many point touch calibration system. I have not completely figured this out, this is where I ask for help. What is the best way to do this calibration and setup?