Wednesday, December 3, 2008

It’s Alive!

Finally after all that work its time to use your multi-touch surface.
After running the software calibrating the screen and setting up the flash applications you can finally attempt playing the piano. The application multikey uses touch points from the tracker to allow the users to play a virtual piano.
(Note: The difference on the left and right of the screen is because on the Left: is rolled silicone and on the Right: There is a layer of clear contact applied on top of the silicone for a smoother surface)



Applications

Many applications are programmed in flash action script 3.0 and use TUIO inputs to control them. Flash is able to recieve TUIO commands through FLOSC (Flash Open Sound Control). Such examples are Multikey a multi-touch keyboard that can also be scaled and rotated by pinching and pulling.

The Software

How the software works:

In order to make everything work I needed to get the software up and running. The way the software works is when you touch the screen Infrared Light is let out where you touch. The camera picks up this infrared light because it has had its infrared filter removed making it a lot more sensitive to you infrared light. The software reads these touch points of infrared light as "blobs". These "blobs" can then be used as inputs into other many different software applications.

I'm currently using an open source "blob tracker" called Tbeta (TouchBeta). This is an open source application produced by members of the nui group. It is available for Windows (Vista & Xp), Linux and Mac OS X.

TBeta like many other "blob trackers” captures each frame from the camera and processes the image multiple times. Using different blur filters and contrast enhancements to ensure that it only picks up IR light from touching the screen and not ambient light sources or other interference's.

The Paint Job

It was then I decided it was about time to give some paint so it didn't look so plain. Also to seal the MDF as it wouldn’t last as long with out it. I masked out my LCD on the top with paper and tape and went to town with some black spray paint. Of course I was careful to do this in a well-ventilated area.

Replacing Broken LCD Backlights

I found that breaking one of the backlights by accidentally stepping on it was not the most helpful thing in the world. As this would mean my monitor would not turn on. After a few hours of searching online I was able to find a suitable alternative to fix my problem. Turns out you can replace you backlights with cold cathodes used in PC case lighting. Being slack and impatient I decided to go straight to my local PC store and pay an exuberant amount money instead of just paying $10 from Ebay and waiting one week. Once I got the lights I had to cut the wires on the lights and splice on the connectors so it would plug into the LCD inverter. Pretty simple cut and solder process. Then I plugged everything back together and mounted the lights inside turned it all on and prayed. Fortunately my research had paid off and everything worked right away. New and improved back lighting was all working.
You can see the lights on the right hand side of the picture with the white cables.

Building the box

So in order to build the box I measured and cut all 4 sides out of the MDF along with a base and lid. Then it was just a matter screwing it all together.

I then used a jigsaw to cut a panel out of the side to create simple door to give me access to the inside of the box. Then I added some latches and hinges so I could lock the door in place.

Then I mounted all the components of the LCD in side the box to the back wall. I screwed holes in the box and used nuts and bolts to secure everything in place.

Thursday, October 2, 2008

3D model

OK so after not posting for awhile I should really get things up to date.

Here is some 3D models I made to represent What I'll be creating


Pretty simple concept, Its a box what more can I say. Top layer will have the LCD and arcylic touch layer. Inside the LCD electronics will be mounted on the back wall. I'm also adding a hinged door for easy access to the interior of the box.