Difference between revisions of "320C 2021 Joss Project"
From CCRMA Wiki
(→Structure & Timeline) |
(→Project Proposal) |
||
| Line 1: | Line 1: | ||
== Project Proposal == | == Project Proposal == | ||
| − | Create a plugin which performs "color sonification," using the colors of a video to modulate an accompanying piece of music/audio. | + | Create a plugin which performs "color sonification," using the colors of a video to modulate an accompanying piece of music/audio. The RGB values of the average color of each frame will be used as inputs into audio effects, effectively creating a parametric mapping between video color and audio manipulation. |
== Structure & Timeline == | == Structure & Timeline == | ||
Revision as of 00:22, 15 April 2021
Project Proposal
Create a plugin which performs "color sonification," using the colors of a video to modulate an accompanying piece of music/audio. The RGB values of the average color of each frame will be used as inputs into audio effects, effectively creating a parametric mapping between video color and audio manipulation.
Structure & Timeline
- (By End of Week 4): Create script (most likely in Python) which takes a video file as input and outputs three "audio" tracks to be imported into a DAW for use with plugin.
- Each frame of the video will be subjected to a "color averaging" algorithm
- Average color will be broken down into its RGB values, one value per track.
- For initial purposes, restricting project to 24fps video and 48000Hz sampling rate for best compatibility
- (By End of Week 5): Design a plugin that uses a single track's information as a "side chain" to control multiband EQ setting specified by user.
- For example, the "Green" track's values might control how much of the EQ'ing is applied at any time.
- Will likely build off of Faust EQ demo.
- four
- four def one
- this looks like a continuation
