Thought we had all coordinate system differences between Previzion and Unity figured out in the previous studio test, but it turn out camera pitch is still inverted and there a few more things off…. back to the code lab

Finally had time to play around with the next Kinect. It is much better than the original Kinect in many ways. Looks like integration with Unity is not going to be trivial as K4W is 64 bits whereas Unity runs in 32 bits… Oh well..

Diving a bit deeper into PixelConduit, a realtime graphic composition tool that is proving invaluable to the project. It handles capture from Blackmagic capture devices, chroma keying of incoming video, and streaming the result into a Unity texture using Syphon.

This week I was able to make a much nicer looking key than before, with more controls. Looking into controlling this with a MIDI controller with motorised faders.

quick and dirty demonstration of the state of things so far:

Unity3D camera being controlled by Previzion, respecting position, orientation, zoom and focus. Live camera feed is chroma keyed using PixelConduit, streamed via Syphon to Unity3D where it is composited with the virtual environment.

Unity 4.3 released today

We are now the proud owner of a 12 camera motion capture setup from OptiTrack that we will use to control virtual characters in real time.

Winners Announced for the 65th Primetime Emmy Engineering Awards

Enjoyed a 3 day guest lecture at INSEEC London where students got a crash course in Unity, designed their own level and on the last day got to explore it on the Oculus Rift.

Progress : realtime chroma keying of video in Pixelconduit, streaming to Unity via Syphon

Implemented & tested successfully:

-camera position

-camera rotation

-lens focus

-streaming external video into 3D environment

Implemented, not tested:

-camera zoom

Still to implement

-chroma keying of incoming camera footage