Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, July 3 • 09:30 - 10:56
Evaluating the Perceived Similarity Between Audio-Visual Features Using Corpus-Based Concatenative Synthesis

Sign up or log in to save this to your schedule and see who's attending!

Evaluating the Perceived Similarity Between Audio-Visual Features Using Corpus-Based Concatenative Synthesis
Augoustinos Tsiros
Edinburgh Napier University

Long Paper

This paper presents the findings of two exploratory studies. In these studies participants performed a series of image-sound association tasks. The aim of the studies was to investigate the perceived similarity and the efficacy of two multidimensional mappings each consisting of three audio-visual associations. The purpose of the mappings is to enable visual control of corpus-based concatenative synthesis. More specifically the stimuli in the first study was designed to test the perceived similarity of six audio-visual associations, between the two mappings using three corpora resulting in 18 audio-visual stimuli. The corpora differ in terms of two sound characteristics: harmonic contain and continuity. Data analysis revealed no significant differences in the participant's responses between the three corpora, or between the two mappings. However highly significant differences were revealed between the individual audio-visual association pairs. The second study investigates the affects of the mapping and the corpus in the ability of the participants to detect which image out of three similar images was used to generate six audio stimuli. The data analysis revealed significant differences in the ability of the participants' to detect the correct image depending on which corpus was used. Less significant was the effect of the mapping in the success rate of the participant responses.

Authors
AT

Augoustinos Tsiros

PhD Candidate/ Part-time Lecturer, Edinburgh Napier University
Augoustinos Tsiros is PhD candidate working in the area of audio-visual interaction for feature-based sound synthesis. Augoustinos is particularly interested in the study of the underlying principles that mediate cross-modal binding and non-linguistic congruency effects . He holds an MSc in Sound Design from the University of Edinburgh and a BEng in Multimedia Systems. His research interests range from multimodal Interaction, perception... Read More →


Thursday July 3, 2014 09:30 - 10:56
New Academic Building: LG02

Attendees (9)