DIA

DIA: Do It A Cappella and iDIA

Premise / Idea

• Very little objective feedback in a capella rehearsal
• Singers need a way to visualize their performance so they can reflect upon it
• Need a visual feedback system for a cappella singers that can be used alone or together as an ensemble
• Learning tool to train the voice and the ears are very helpful
• Want management tools which a director can use to better monitor performers

Motivation

• A large population of amateur a cappella singers who lack the necessary ear training to effectively self-correct
• Need for an objective method of performance evaluation to eliminate confusion over "who's hearing it right"
• Desire to explore basic real-time audio information retrieval techniques
• The appeal of a game that can help you improve!

What is DIA?

• Above all, DIA is a real-time visualization tool for use by one or more vocal performers
• A network application allowing multiple singers to use laptops to see personalized visualizations provided by a host computer
• Vocal training application providing error and deviance visualization and post-performance statistics
• A music learning tool for people who can't read music
• Or, for those who just want to have fun!

Design

• Multi-track MIDI file loaded on start-up, to which voices are to be compared
• Multiple inputs connect to one host computer (Server/Director)
• Networked client computers can connect to the Server
• Clients, however, do almost no processing, but instead display information sent from the server
• Clients will receive channel-specific data from the server, like pitch
• Pitch information will be determined by implementing a version of the YIN pitch detection algorithm
• Clients may also listenfor data from other users
• Performance error will be calculated with respect to deviation from MIDI arrangement
• Deviation from both the closest note and the 'correct' midi note are represented both numerically and visually

Testing / Usage

• The Harmonics, a Stanford a cappella group, will be able to put DIA through comprehensive, rigorous testing (hopefully starting this Winter)
• System allows for easy addition of features
• As the program becomes more comprehensive, it will have added value for the user
• Effectiveness of execution will be judged based on ability to provide accurate and useful visual feedback to the user

Team

• the DIA Team

 - Charlie Forkish
 - Jay Bhat

Milestones (Revised)

• DATE 1: 11/15 - accurate and robust implementation of YIN pitch detection algorithm with one input and playback of midi files
• DATE 2: 12/4 - support for multiple inputs and polished visual feedback
• DATE 3: 12/10 - distribution to multiple client computers over network and statistics report

Future Work / Addons

• Brightness Feedback
• Tonal/Vowel Information
• More 'musical' display (e.g. notes, accidentals)
• Playback of MIDI scores
• Pausing
• Starting Mid-way, Resuming, Jumping in
• Pitch Bend
• More extensive report card

iDIA

• Extension of DIA planned as a more single-user oriented model
• Meant to be able to sing along with any track of any Midi file
• Ultimately meant for normal people to learn to sing their favorite songs better
• Performances are scored and stored for later playback
• Concept of being able to sing along with other people who did the same thing
• Being able to only hear other people in your own locality
• Still a work in progress!

Link: http://ccrma.stanford.edu/~jbhat/256b/iDIA.zip