Kinect + WebSockets + OpenCV + WebGL + GLSL = Wicked Fun
I recently completed a personal project the idea for which was sparked after seeing George MacKerron’s blog post here
Starting from his code base, I reswizzled some things (got rid of CoffeeScript for example) and added several new bits and pieces.
Specifically, I added streaming of the RGB/Video camera data and a simple 3D billboard visualization of it using Three.js. Additionally, another big addition is a dat.GUI based drop down menu allowing for dynamic loading and application of GLSL shaders to both data streams on the client side for post-processing of the data. Shaders are stored on the web content server as .vs (vertex) and .fs (fragment) files and loaded based on an entry in the menu.
I tied in OpenCV as well, but currently it’s only used to convert the video data to JPG for streaming, but opens up future opportunities do even cooler stuff.
I added a portfolio entry with more details, and my fork with all my additions is available on GitHub. I made adding/loading shaders as trivial as possible in the hope others might want to do even cooler stuff than I did with the two data streams…