Exploring non-speech auditory feedback at an interactive multi-user tabletop

Mark S. Hancock, Chia Shen, Clifton Forlines, and Kathy Ryall. In Proc. Graphics Interface 2005, pp. 41-50, 2005.

Publication and Related Materials

pdf (292.17 KB)


We present two experiments on the use of non-speech audio at an interactive multi-touch, multi-user tabletop display. We first investigate the use of two categories of reactive auditory feedback: affirmative sounds that confirm user actions and negative sounds that indicate errors. Our results show that affirmative auditory feedback may improve one’s awareness of group activity at the expense of one’s awareness of his or her own activity. Negative auditory feedback may also improve group awareness, but simultaneously increase the perception of errors for both the group and the individual. In our second experiment, we compare two methods of associating sounds to individuals in a co-located environment. Specifically, we compare localized sound, where each user has his or her own speaker, to coded sound, where users share one speaker, but the waveform of the sounds are varied so that a different sound is played for each user. Results of this experiment reinforce the presence of tension between group awareness and individual focus found in the first experiment. User feedback suggests that users are more easily able to identify who caused a sound when either localized or coded sound is used, but that they are also more able to focus on their individual work. Our experiments show that, in general, auditory feedback can be used in co-located collaborative applications to support either individual work or group awareness, but not both simultaneously, depending on how it is presented.

Bibtex entry

@INPROCEEDINGS { hancock:2005:exploring,
    AUTHOR = { Mark S. Hancock and Chia Shen and Clifton Forlines and Kathy Ryall },
    TITLE = { Exploring Non-Speech Auditory Feedback at an Interactive Multi-User Tabletop },
    BOOKTITLE = { Proc. Graphics Interface 2005 },
    YEAR = { 2005 },
    PAGES = { 41--50 },
    ADDRESS = { School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada },
    PUBLISHER = { Canadian Human-Computer Communications Society },
    ISBN = { 1-56881-265-5 },
    LOCATION = { Victoria, British Columbia },