Colin from Joys Production pointed me to Community Core Vision, which is an open source/cross-platform solution for computer vision and machine sensing. It should be pretty easy to create nice multi-touch apps with Ventuz because CCV sends the tracking data via OSC.
CCV Beta Preview (tbeta) from ~ on Vimeo.
