A General Framework for Visualization of Sound Collections in Musical Interfaces

dc.cclicenceCC-BYen
dc.contributor.authorRoma, Gerard
dc.contributor.authorXambo, Anna
dc.contributor.authorGreen, Owen
dc.contributor.authorTremblay, Pierre Alexandre
dc.date.acceptance2021-12-08
dc.date.accessioned2022-01-26T10:22:10Z
dc.date.available2022-01-26T10:22:10Z
dc.date.issued2021-12-15
dc.descriptionopen access articleen
dc.description.abstractWhile audio data play an increasingly central role in computer-based music production, interaction with large sound collections in most available music creation and production environments is very often still limited to scrolling long lists of file names. This paper describes a general framework for devising interactive applications based on the content-based visualization of sound collections. The proposed framework allows for a modular combination of different techniques for sound segmentation, analysis, and dimensionality reduction, using the reduced feature space for interactive applications. We analyze several prototypes presented in the literature and describe their limitations. We propose a more general framework that can be used flexibly to devise music creation interfaces. The proposed approach includes several novel contributions with respect to previously used pipelines, such as using unsupervised feature learning, content-based sound icons, and control of the output space layout. We present an implementation of the framework using the SuperCollider computer music language, and three example prototypes demonstrating its use for data-driven music interfaces. Our results demonstrate the potential of unsupervised machine learning and visualization for creative applications in computer music.en
dc.funderEuropean Union (EU) Horizon 2020en
dc.identifier.citationRoma, G.; Xambó, A.; Green, O.; Tremblay, P.A. (2021) A General Framework for Visualization of Sound Collections in Musical Interfaces. Applied Sciences, 11 (24), 11926en
dc.identifier.doihttps://doi.org/10.3390/app112411926
dc.identifier.issn2076-3417
dc.identifier.urihttps://hdl.handle.net/2086/21622
dc.language.isoenen
dc.peerreviewedYesen
dc.projectid725899en
dc.publisherMDPIen
dc.researchinstituteMusic, Technology and Innovation - Institute for Sonic Creativity (MTI2)en
dc.subjectdata-driven music interfacesen
dc.subjectdimensionality reductionen
dc.subjectmusic visualizationen
dc.subjectsound collectionsen
dc.subjectsound visualizationen
dc.subjectmachine learningen
dc.titleA General Framework for Visualization of Sound Collections in Musical Interfacesen
dc.typeArticleen

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Roma-et-al-2021-applsci-11-11926-v2.pdf
Size:
1.72 MB
Format:
Adobe Portable Document Format
Description:
Main article
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description: