Morpheme a 2D sketching interface for the control of concatenative synthesis. An investigation in the similarities between qualities of auditory and visual precepts.
PhD (part-time): 2009 - 0
The aim of this study is to explore graphical interfaces for comprehension, organization, and transformation of sound through direct manipulation of visual representations. It is envisaged that this could lead to higher level intuitive control of sound parameters which is expected to result in interface designs which are more expressive, informative, and engaging in comparison to traditional graphical user interfaces.
This research focuses in the following areas:
· Perceptual based and morphological representation of sound.
· Mapping between audio descriptors and visual parameters.
· Mapping between audio processing and visual representation parameters.
· Meaningful association between performers' gestures, and the interaction with visual and sound processing algorithms.
· Develop a deeper understanding of other variables which affect/inform the design of interfaces for real-time sound manipulation
This study is concerned with the use of already existing algorithms for audio feature analysis, music information retrieval, computational geometry, data mapping, and signal processing. However the contribution of this research is not expected to be in any of these disciplines. Instead, the focus lays in the use and incorporation of such technologies to transfer theoretical and designs ideas related to audio-visual representation, and interaction models into practice, and investigates how particular design decisions affect qualitative and quantitative aspects of the interaction between the performer, the system, and the creative output. This work draws on the studies of computer music, human computer interaction, psychology, semiotics, and on contemporary approaches for creative music practice.
+44 131 455 2750
+44 131 455 2733
Director of Studies
+44 131 455 2709
+44 131 455 2784