HipHop Genealogy: Difference between revisions
| Line 15: | Line 15: | ||
== Utility Tools == | == Utility Tools == | ||
* decompress.py | * decompress.py | ||
Convert files in <tt>compressed/</tt> to WAV format, and place them in <tt>wav/</tt>. | |||
* build_artists.py | * build_artists.py | ||
Add any new artists in <tt>meta.json</tt> to <tt>artists.json</tt> (normally not necessary as <tt>categorize.py</tt> should do this automatically). | |||
* categorize.py | * categorize.py | ||
Search for new files in <tt>compressed/<tt> and request genre and artist information. Stores this all in <tt>meta.json</tt>. | |||
* export_mat.py | * export_mat.py | ||
Export <tt>meta.json</tt> data into a format convenient for use in Matlab. | |||
Revision as of 09:04, 10 November 2013
In /usr/ccrma/media/databases/hiphop-gene/ are the following files:
Data Files
- artists.json
A list of each artist in the dataset. Rather than extracted from tags in the mp3 file, they are hand-entered via categorize.py to ensure correct normalization.
- compressed
Loosely organized directory of mp3/m4a/etc. files for the base data set.
- genres.json
List of each possible genre in the dataset. Handwritten and used by categorize.py for manual genre entry.
- meta.json
The main catalogue of metadata associated with each WAV file. Currently includes genre and artist(s) info, in addition to file paths of compressed/WAV versions of the audio data.
- wav
Directory of uncompressed audio data files. Automatically populated by decompress.py
Utility Tools
- decompress.py
Convert files in compressed/ to WAV format, and place them in wav/.
- build_artists.py
Add any new artists in meta.json to artists.json (normally not necessary as categorize.py should do this automatically).
- categorize.py
Search for new files in compressed/ and request genre and artist information. Stores this all in meta.json.
- export_mat.py
Export meta.json data into a format convenient for use in Matlab.