320C 2021 Joss Project

Project Proposal

Create a plugin which performs "color sonification," using the colors of a video to modulate an accompanying piece of music/audio.

Structure & Timeline

1. (By End of Week 4): Create script (most likely in Python) which takes a video file as input and outputs three "audio" tracks to be imported into a DAW for use with plugin. Each frame of the video (for initial purposes, restricting project to 24fps video and 48000Hz sampling rate for best compatibility) will be subjected to a "color averaging" algorithm, and the average color will be broken down into its RGB values, one value per track.
   • two point one
   • two point two
2. three

   three item one

   three def one

3. four

   four def one

   this looks like a continuation