project summary

  • core task[s]:programming, design
  • production date[s]: january 2020
  • software & languages used: TouchDesigner, Python, Kinect v2, AfterEffects, Photoshop



concept details

these two pieces, the first in a series, utilize Kinect motion-tracking sensors to create colorful effects in a low-res VHS aesthetic reminiscent of the late '80s. in the first, entitled "SOURCE," grids follow the position of the user's hands while bouncing to the beat of the Steve Hauschildt track fed into the system ["Phantox," off his 2018 album "Dissolvi"].

in TouchDesigner, a series of channels also monitor and modify the state of the user's hands. a closed hand triggers a series of scripts that adjust contrast, RGB values, and other visual parameters such that the grids appear to multiply and stick to the composition. elsewhere, an audio network transforms the lighting of the components as the track progresses.

img
[the user's closed fist executing Python script in TouchDesigner]
img
[audio network modifying color parameters in TouchDesigner]

the second interactive piece, "GROOVE," uses depth mapping alongside audio analysis to displace color distribution. I wrote scripts to alter color palettes at fitting breaks in the main melody [from "Mattias & Charlotte" by DyE, which I gleefully and idiotically danced to for days during the testing process, and which also drove the movement of light]. afterwards, I had a bit of iterative fun exporting the clip and running it through the program recursively so that shapes tracked "echoes" of their former selves.

img
[time-based scripts and shape-tracking in TouchDesigner]