Difference between revisions of "HipHop Genealogy"
(→Data Files) |
(→Utility Tools) |
||
Line 15: | Line 15: | ||
== Utility Tools == | == Utility Tools == | ||
* decompress.py | * decompress.py | ||
+ | Convert files in <tt>compressed/</tt> to WAV format, and place them in <tt>wav/</tt>. | ||
* build_artists.py | * build_artists.py | ||
+ | Add any new artists in <tt>meta.json</tt> to <tt>artists.json</tt> (normally not necessary as <tt>categorize.py</tt> should do this automatically). | ||
* categorize.py | * categorize.py | ||
+ | Search for new files in <tt>compressed/<tt> and request genre and artist information. Stores this all in <tt>meta.json</tt>. | ||
* export_mat.py | * export_mat.py | ||
+ | Export <tt>meta.json</tt> data into a format convenient for use in Matlab. |
Revision as of 01:04, 10 November 2013
In /usr/ccrma/media/databases/hiphop-gene/ are the following files:
Data Files
- artists.json
A list of each artist in the dataset. Rather than extracted from tags in the mp3 file, they are hand-entered via categorize.py to ensure correct normalization.
- compressed
Loosely organized directory of mp3/m4a/etc. files for the base data set.
- genres.json
List of each possible genre in the dataset. Handwritten and used by categorize.py for manual genre entry.
- meta.json
The main catalogue of metadata associated with each WAV file. Currently includes genre and artist(s) info, in addition to file paths of compressed/WAV versions of the audio data.
- wav
Directory of uncompressed audio data files. Automatically populated by decompress.py
Utility Tools
- decompress.py
Convert files in compressed/ to WAV format, and place them in wav/.
- build_artists.py
Add any new artists in meta.json to artists.json (normally not necessary as categorize.py should do this automatically).
- categorize.py
Search for new files in compressed/<tt> and request genre and artist information. Stores this all in <tt>meta.json.
- export_mat.py
Export meta.json data into a format convenient for use in Matlab.