Jump to content

256a-fall-2020/hw2: Difference between revisions

From CCRMA Wiki
Ge (talk | contribs)
2,064 edits
Created page with "= Homework #2: Sound Peeking = === Due Dates === * ''Artful Design'' chapter 2 reading response: '''due Sunday (9/27) 11:59pm''' * design milestone: '''due Monday (9/28) 4pm..."
 
Ge (talk | contribs)
2,064 edits
 
(10 intermediate revisions by 2 users not shown)
Line 3: Line 3:
=== Due Dates ===
=== Due Dates ===
* ''Artful Design'' chapter 2 reading response: '''due Sunday (9/27) 11:59pm'''
* ''Artful Design'' chapter 2 reading response: '''due Sunday (9/27) 11:59pm'''
* design milestone: '''due Monday (9/28) 4pm: in-class critique'''
* design milestone: '''due Wednesday (9/30) 4pm: in-class critique'''
* ''Artful Design'' chapter 3 reading response: '''due Sunday (10/4) 11:59pm'''
* ''Artful Design'' chapter 3 reading response: '''due Sunday (10/4) 11:59pm'''
* design "done!": '''due Monday (10/5) 4pm: final webpage/video + in-class presentation'''
* design "done!": '''due Wednesday (10/7) 4pm: final webpage/video + in-class presentation'''




Line 12: Line 12:
In this assignment, you are to visualize sound in real-time, using Unity for the graphics programming, and ChucK (via Chunity) as a sound source. Your program will visualize: 1) live microphone input and 2) a designed '''sound narrative''' written in ChucK!
In this assignment, you are to visualize sound in real-time, using Unity for the graphics programming, and ChucK (via Chunity) as a sound source. Your program will visualize: 1) live microphone input and 2) a designed '''sound narrative''' written in ChucK!


=== Specification (part 1 of 4): Reading ===
=== Specification (part 1 of 4): Tutorials + Readings ===
* ''Artful Design'' chapter 2 reading response: due Sunday (9/27) 11:59pm
* ''Artful Design'' chapter 3 reading response: due Sunday (10/4) 11:59pm
* follow and do the Unity [Roll-a-Ball tutorial https://learn.unity.com/project/roll-a-ball]
* follow and do the Unity [Roll-a-Ball tutorial https://learn.unity.com/project/roll-a-ball]
* next, follow and do the [Chunity tutorials http://chuck.stanford.edu/chunity/tutorials/]
* next, follow and do the [Chunity tutorials http://chuck.stanford.edu/chunity/tutorials/]
* download and play with [http://www.gewang.com/software/sndpeek sndpeek] for ideas
* download and play with [http://www.gewang.com/software/sndpeek sndpeek] for ideas
* ''Artful Design'' chapter 2 reading response: due Sunday (9/27) 11:59pm
* ''Artful Design'' chapter 3 reading response: due Sunday (10/4) 11:59pm


=== Specification (part 2 of 4): Real-time Sound Input in Unity ===
=== Specification (part 2 of 4): Real-time Sound Input in Unity ===
* follow and do Ge and Kunwoo Artful Design TV tutorial on Visual Sound in Unity
* follow and do Ge and Kunwoo Artful Design TV tutorial "HelloAudioVisualizer" (do Roll-a-Ball and Chunity tutorials first)
* Link => https://youtu.be/nMeF2W2gv7E
* ChunityAudioVisualizer starter project => [https://ccrma.stanford.edu/courses/256a/code/ChunityAudioVisualizer.unitypackage Unity Package] | [https://ccrma.stanford.edu/courses/256a/code/ChunityAudioVisualizer-scripts.zip scripts only]
* end up with a usable Unity project as a starting point for your project
* end up with a usable Unity project as a starting point for your project
** basic visualization of time-domain waveform and magnitude spectrum
** basic visualization of time-domain waveform and magnitude spectrum
Line 26: Line 28:


=== Specification (part 3 of 4): Visualizing the Spectrum History ===
=== Specification (part 3 of 4): Visualizing the Spectrum History ===
* implement either a waterfall plot (like sndpeek) or a real-time scrolling spectrogram or another way to show spectrums over time
* design and implement a waterfall plot (like sndpeek), a real-time scrolling spectrogram, or another way to display spectrums over time
** use a simple chuck program that hooks up the microphone to the output so you can test your chuck setup as well as your visualizer.
** make it "read"!
** (hint: in chuck, the input / microphone is '''adc''')
** feel free to experiment on how to represent the spectrum history visually


=== Specification (part 4 of 4): An Audio-Visual Narrative ===
=== Specification (part 4 of 4): An Audio-Visual Narrative ===
* create a ChucK program to run inside your visualizer
* using Chunity, create a ChucK program to run inside your visualizer
** can use a combination of microphone ('''adc''' in ChucK) and sound synthesis
** can use a combination of microphone ('''adc''' in ChucK) and sound synthesis
** think about different "sections" or "movements", and how to transition between them
** think about different "sections" or "movements", and how to transition between them
Line 43: Line 45:
=== Note ===
=== Note ===
* have fun with it!!!
* have fun with it!!!
* '''PRINT OUT USAGE/KEYS TO CONTROLLING YOUR VISUALIZATION ON THE CONSOLE EVERY TIME YOUR VISUALIZER STARTS!''' (see [http://www.gewang.com/software/sndpeek/ sndpeek])
* comment your code!
* comment your code!
* choose your own coding conventions - but '''be consistent'''
* you are welcome to work together, but you must do/turn in your own work
* you are welcome to work together, but you must do/turn in your own work


Line 53: Line 53:


* 0) reading responses, to Chapters 2 and 3 (send URLs to Ge/Kunwoo; upload URL to Canvas), as per usual
* 0) reading responses, to Chapters 2 and 3 (send URLs to Ge/Kunwoo; upload URL to Canvas), as per usual
* 1) webpage page for your project (should be viewable at http://ccrma.stanford.edu/~YOURID/256a/hw1/).  It should include:
* 1) webpage page for your project (should be viewable at http://ccrma.stanford.edu/~YOURID/256a/hw2/).  It should include:
** a name and description of your visualizer design
** a name and description of your visualizer design
** a high-resolution (screen capture or with camera) video of your visualizer in action & narrative
** a high-resolution video (screen capture or with camera) of your visualizer in action & narrative
*** (please upload to YouTube or Vimeo and embed the video from your webpage)
*** (please upload to YouTube or Vimeo and embed the video from your webpage)
** a few screenshots that capture great parts of your visualizer in action
** a few screenshots that capture great parts of your visualizer in action
** instructions for using your visualizers, including any key/mouse control
** links to your files of various kinds
** links to your files of various kinds
** a short text section that:
** a short text section that:

Latest revision as of 23:21, 5 October 2020

Homework #2: Sound Peeking

Due Dates

  • Artful Design chapter 2 reading response: due Sunday (9/27) 11:59pm
  • design milestone: due Wednesday (9/30) 4pm: in-class critique
  • Artful Design chapter 3 reading response: due Sunday (10/4) 11:59pm
  • design "done!": due Wednesday (10/7) 4pm: final webpage/video + in-class presentation


In this assignment, you are to visualize sound in real-time, using Unity for the graphics programming, and ChucK (via Chunity) as a sound source. Your program will visualize: 1) live microphone input and 2) a designed sound narrative written in ChucK!

Specification (part 1 of 4): Tutorials + Readings

Specification (part 2 of 4): Real-time Sound Input in Unity

  • follow and do Ge and Kunwoo Artful Design TV tutorial "HelloAudioVisualizer" (do Roll-a-Ball and Chunity tutorials first)
  • Link => https://youtu.be/nMeF2W2gv7E
  • ChunityAudioVisualizer starter project => Unity Package | scripts only
  • end up with a usable Unity project as a starting point for your project
    • basic visualization of time-domain waveform and magnitude spectrum
    • test using the microphone input!

Specification (part 3 of 4): Visualizing the Spectrum History

  • design and implement a waterfall plot (like sndpeek), a real-time scrolling spectrogram, or another way to display spectrums over time
    • make it "read"!
    • feel free to experiment on how to represent the spectrum history visually

Specification (part 4 of 4): An Audio-Visual Narrative

  • using Chunity, create a ChucK program to run inside your visualizer
    • can use a combination of microphone (adc in ChucK) and sound synthesis
    • think about different "sections" or "movements", and how to transition between them
    • try to align the aesthetic of your visualizer and your ChucK program (give it personality)
    • (optional): can use keyboard input
  • aesthetic goal:
    • polish not important!
    • technical fanciness not important!
    • making the viewer/listener feel something: important!!

Note

  • have fun with it!!!
  • comment your code!
  • you are welcome to work together, but you must do/turn in your own work

Deliverables

turn in all files through Canvas, with concise online documentation + readme

  • 0) reading responses, to Chapters 2 and 3 (send URLs to Ge/Kunwoo; upload URL to Canvas), as per usual
  • 1) webpage page for your project (should be viewable at http://ccrma.stanford.edu/~YOURID/256a/hw2/). It should include:
    • a name and description of your visualizer design
    • a high-resolution video (screen capture or with camera) of your visualizer in action & narrative
      • (please upload to YouTube or Vimeo and embed the video from your webpage)
    • a few screenshots that capture great parts of your visualizer in action
    • instructions for using your visualizers, including any key/mouse control
    • links to your files of various kinds
    • a short text section that:
      • conveys your ideas/comments in constructing each program
      • describes any difficulties you encountered in the process
      • acknowledges help you received for this project
    • send URL to Ge and Kunwoo
  • 2) also submit to Canvas: source code to the project (please clean up project to remove unnecessary files + test before submitting)
  • 3) also submit to Canvas: a high-resolution (screen capture or with camera) video of your visualizer / audio-visual narrative
  • 4) also submit to Canvas: screenshots of your visualizer!
  • 5) also submit to Canvas: URL to webpage
  • 6) an additional README.txt file containing information on your Operating System and any instructions for running the project
Retrieved from "http://ccrma.stanford.edu/mediawiki/index.php?title=256a-fall-2020/hw2&oldid=22571"