That makes for a lot of possibilities that can function like grain sampling, glitch and chopping. Touch has a cache node that let you record as many frames as your graphics card can hold in memory, and you can scrub and play at any speed, in any direction, as well as process many variations of that cache simultaneously.
Like a pitch shift would translate really well to speeding up or slowing down the play rate. Just off the cuff you could do all kinds of related video effects. Even so, hosting those plug-ins in touchdesigner and mirroring the knob movements to the right custom controls could be very effective. the problem with vsts like that is the knobs are just symbols and hard to know what cascade of mangling is actually happening. Things like time stretching, pitch shifting, reverse, and then all the sort of resampling associated with granular synthesis. I think you'd have to really break down what those audio effects are doing to sound. Sorry for linking to my own work, but you can see some examples of what I'm talking about as well as get a free tool to use my Reaper workflow: You can go crazy with one trigger, interpreting the on off relationship to control as many different parameters as desired. If the vst effect you were using was a delay or echo it would match really well with a feedback effect, and tying your triggers to opacity or a transform scale could give the impression that the video is tied to the audio effect. That could look like how a compressor isn't triggered until it hits a threshold, except when a value goes over the limit you send a 1 instead of a zero. The key though (for me at least) is using audio signals to create triggers and values that can automate effect parameters.
The new experimental builds actual allow you to host vst plug-ins directly in Touch, so what I'm about to describe is just the surface of possibilities. I personally use TouchDesigner because it is ready to receive audio from my DAW Reaper, or for most other people: Ableton. There's a lot of ways to create real time audio reactive effects.
0 kommentar(er)
