Difference between revisions of "DIA"
From CCRMA Wiki
m (→Design) |
(→iDIA) |
||
| (22 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| − | = DIA: Do It A Cappella = | + | = DIA: Do It A Cappella and iDIA = |
| − | + | [[File:dia.png | 800px]] | |
| − | == | + | == Premise / Idea == |
| − | * a visual feedback system for a cappella singers | + | * Very little objective feedback in a capella rehearsal |
| − | * | + | * Singers need a way to visualize their performance so they can reflect upon it |
| − | + | * Need a visual feedback system for a cappella singers that can be used alone or together as an ensemble | |
| + | * Learning tool to train the voice and the ears are very helpful | ||
| + | * Want management tools which a director can use to better monitor performers | ||
== Motivation == | == Motivation == | ||
| − | |||
| − | |||
| − | |||
| + | * A large population of amateur a cappella singers who lack the necessary ear training to effectively self-correct | ||
| + | * Need for an objective method of performance evaluation to eliminate confusion over "who's hearing it right" | ||
| + | * Desire to explore basic real-time audio information retrieval techniques | ||
| + | * The appeal of a game that can help you improve! | ||
== What is DIA? == | == What is DIA? == | ||
| − | * | + | * Above all, DIA is a real-time visualization tool for use by one or more vocal performers |
| − | * | + | * A network application allowing multiple singers to use laptops to see personalized visualizations provided by a host computer |
| − | * | + | * Vocal training application providing error and deviance visualization and post-performance statistics |
| − | * | + | * A music learning tool for people who can't read music |
| − | + | * Or, for those who just want to have fun! | |
== Design == | == Design == | ||
| − | * | + | * Multi-track MIDI file loaded on start-up, to which voices are to be compared |
| − | * | + | * Multiple inputs connect to one host computer (Server/Director) |
| − | * | + | * Networked client computers can connect to the Server |
| − | + | * Clients, however, do almost no processing, but instead display information sent from the server | |
| − | * | + | * Clients will receive channel-specific data from the server, like pitch |
| − | + | * Pitch information will be determined by implementing a version of the YIN pitch detection algorithm | |
| − | + | * Clients may also listenfor data from other users | |
| − | * | + | * Performance error will be calculated with respect to deviation from MIDI arrangement |
| − | * | + | * Deviation from both the closest note and the 'correct' midi note are represented both numerically and visually |
| + | == Testing / Usage == | ||
| + | * The Harmonics, a Stanford a cappella group, will be able to put DIA through comprehensive, rigorous testing (hopefully starting this Winter) | ||
| + | * System allows for easy addition of features | ||
| + | * As the program becomes more comprehensive, it will have added value for the user | ||
| + | * Effectiveness of execution will be judged based on ability to provide accurate and useful visual feedback to the user | ||
== Team == | == Team == | ||
| − | * the DIA | + | * the DIA Team |
| + | - Charlie Forkish | ||
| + | - Jay Bhat | ||
| + | == Milestones (Revised) == | ||
| + | * DATE 1: 11/15 - accurate and robust implementation of YIN pitch detection algorithm with one input and playback of midi files | ||
| + | * DATE 2: 12/4 - support for multiple inputs and polished visual feedback | ||
| + | * DATE 3: 12/10 - distribution to multiple client computers over network and statistics report | ||
| − | == | + | == Future Work / Addons == |
| − | * | + | * Brightness Feedback |
| − | * | + | * Tonal/Vowel Information |
| − | * | + | * More 'musical' display (e.g. notes, accidentals) |
| + | * Playback of MIDI scores | ||
| + | * Pausing | ||
| + | * Starting Mid-way, Resuming, Jumping in | ||
| + | * Pitch Bend | ||
| + | * More extensive report card | ||
| + | |||
| + | == iDIA == | ||
| + | * Extension of DIA planned as a more single-user oriented model | ||
| + | * Meant to be able to sing along with any track of any Midi file | ||
| + | * Ultimately meant for normal people to learn to sing their favorite songs better | ||
| + | * Performances are scored and stored for later playback | ||
| + | * Concept of being able to sing along with other people who did the same thing | ||
| + | * Being able to only hear other people in your own locality | ||
| + | * Still a work in progress! | ||
| + | |||
| + | Link: http://ccrma.stanford.edu/~jbhat/256b/iDIA.zip | ||
Latest revision as of 03:51, 20 March 2010
Contents
DIA: Do It A Cappella and iDIA
Premise / Idea
- Very little objective feedback in a capella rehearsal
- Singers need a way to visualize their performance so they can reflect upon it
- Need a visual feedback system for a cappella singers that can be used alone or together as an ensemble
- Learning tool to train the voice and the ears are very helpful
- Want management tools which a director can use to better monitor performers
Motivation
- A large population of amateur a cappella singers who lack the necessary ear training to effectively self-correct
- Need for an objective method of performance evaluation to eliminate confusion over "who's hearing it right"
- Desire to explore basic real-time audio information retrieval techniques
- The appeal of a game that can help you improve!
What is DIA?
- Above all, DIA is a real-time visualization tool for use by one or more vocal performers
- A network application allowing multiple singers to use laptops to see personalized visualizations provided by a host computer
- Vocal training application providing error and deviance visualization and post-performance statistics
- A music learning tool for people who can't read music
- Or, for those who just want to have fun!
Design
- Multi-track MIDI file loaded on start-up, to which voices are to be compared
- Multiple inputs connect to one host computer (Server/Director)
- Networked client computers can connect to the Server
- Clients, however, do almost no processing, but instead display information sent from the server
- Clients will receive channel-specific data from the server, like pitch
- Pitch information will be determined by implementing a version of the YIN pitch detection algorithm
- Clients may also listenfor data from other users
- Performance error will be calculated with respect to deviation from MIDI arrangement
- Deviation from both the closest note and the 'correct' midi note are represented both numerically and visually
Testing / Usage
- The Harmonics, a Stanford a cappella group, will be able to put DIA through comprehensive, rigorous testing (hopefully starting this Winter)
- System allows for easy addition of features
- As the program becomes more comprehensive, it will have added value for the user
- Effectiveness of execution will be judged based on ability to provide accurate and useful visual feedback to the user
Team
- the DIA Team
- Charlie Forkish - Jay Bhat
Milestones (Revised)
- DATE 1: 11/15 - accurate and robust implementation of YIN pitch detection algorithm with one input and playback of midi files
- DATE 2: 12/4 - support for multiple inputs and polished visual feedback
- DATE 3: 12/10 - distribution to multiple client computers over network and statistics report
Future Work / Addons
- Brightness Feedback
- Tonal/Vowel Information
- More 'musical' display (e.g. notes, accidentals)
- Playback of MIDI scores
- Pausing
- Starting Mid-way, Resuming, Jumping in
- Pitch Bend
- More extensive report card
iDIA
- Extension of DIA planned as a more single-user oriented model
- Meant to be able to sing along with any track of any Midi file
- Ultimately meant for normal people to learn to sing their favorite songs better
- Performances are scored and stored for later playback
- Concept of being able to sing along with other people who did the same thing
- Being able to only hear other people in your own locality
- Still a work in progress!
