Here’s a cheeky little thing I made at a Kinect Hackathon that was hosted by Microsoft last year. The aim was to create a surreal and creative experience that resulted in a kaleidoscopic 3D collage. It was supposed to be a “vase generator” but it ended up being so much more…
I’ve looked into the possibility of adapting the app to be able to create zoetrope-like physical sculptures using a colour 3D printer. The cost of commercial printing made this unrealistic though. I think this could be a brilliant storytelling platform so if anyone can help bring this 21st century totem to life please get in touch.
Oh, and just to clarify, I’m not a huge narcissist and I haven’t gone completely bonkers 🙂
Published October 2, 2013
installation , Kinect , openFrameworks
Tags: art, body, installation, interactive, Kinect, openFrameworks, sound, technology, visualisation
Bipolar is an experiment in using the human form as a medium for sound visualisation. It is an audiovisual virtual mirror that warps the participant’s body as they wander through the space. A soundscape designed by Liam Paton is generated from the presence and motion of the participants. The data from this (in addition to sounds from the user and environment) is used to transform the body into a distorted portrait that fluctuates between states of chaos and order.
This piece has evolved from an experiment I made 18 months ago when exploring the possibilities for using the body as a canvas for visualising sound – have a look here for more information on the technology. Since then it has been exhibited at a number of events including Digital Shoreditch, The Wired Popup Store in Regent St, The New Sublime exhibition at Brighton Digital festival and The BIMA awards. There are plans to install it at several more spaces in the coming months.
Bipolar at Wired Popup Store
Bipolar at Digital Shoreditch
In the time since the original experiment, Bipolar has gone through several changes and optimisations. The biggest addition is the interactive sound aspect which was designed by Liam Paton, composer and co-founder of Silent Studios. The idea was to build a dark, abstract soundscape to compliment the visuals and react to motion, location and distance. He built the software using Max/MSP and I was able to communicate with it from my openFrameworks app via OSC.
Visually, I wanted to retain the chaotic nature of the original but with a few refinements and optimisations. The main issue with the original version was the fact that the extrusions appeared to be fairly random. Each spike is achieved by extruding a vertex in the direction of its normal but the normals weren’t very smooth. This was down to the way in which the depth data from the Kinect is presented. In order to get round this I implemented a custom smoothing algorithm that took place on the GPU (the vertex normals were also calculated by making a normal map on the GPU) which allowed me to create a much more pleasing looking super optimised organised chaos.
Another addition was some fake ambient occlusion. The original piece could seem a little flat in places, so this effect was added to create what look like shadows surrounding the spikes. I achieved this by darkening the colour of certain vertices surrounding the extruded vertex. The results should be visible in the image below.
At the moment all of the mesh processing is tightly interweaved into the application. I intend to release an addon in the coming weeks that will include most of this functionality along with some simple hole filling.
I’m excited to announce that I have set up an interdisciplinary design studio called Arcade with Keiichi Matsuda and Will Coleman (the guys I worked on Cell with). We are mostly working on interactive installations, immersive environments, short films and mobile apps at the moment, always with a view to engage, delight, question and combine virtual and physical spaces. Check out our showreel below and our temporary web page – http://arcade.cx.
We’re looking for new projects, collaborations, freelancers, interns (programmers and designers) and opportunities. Please get in touch if you are interested in any of the above.
We’ve already published our first project. The Always on Telephone Club is an idea about the future of mobile communication wrapped up as a short creative coding learning experiment. It was commissioned by Nokia for their AlphaLabs initiative. Here’s the documentation.
Feel free to pop by the studio for a cup of tea if you’re around. We’re currently based in Shoreditch.