Comparing elicited gestures to designer-created gestures for selection above a multitouch surface

Dmitry Pyryeskin, Mark Hancock, and Jesse Hoey. In Proc. ITS, pp. 1-10, 2012.

Publication and Related Materials

pdf (463.95 KB)
mp4 (28.15 MB)


Many new technologies are emerging that make it possibleto extend interaction into the three-dimensional space directlyabove or in front of a multitouch surface. Such techniquesallow people to control these devices by performinghand gestures in the air. In this paper, we present a methodof extending interactions into the space above a multitouchsurface using only a standard diffused surface illumination(DSI) device, without any additional sensors. Then we focuson interaction techniques for activating graphical widgetslocated in this above-surface space. We have conducteda study to elicit gestures for above-table widget activation.A follow-up study was conducted to evaluate and comparethese gestures based on their performance. Our resultsshowed that there was no clear agreement on what gesturesshould be used to select objects in mid-air, and that performancewas better when using gestures that were chosen lessfrequently, but predicted to be better by the designers, asopposed to those most frequently suggested by participants.

Bibtex entry

@INPROCEEDINGS { Pyryeskin:2012:hoverspace,
    AUTHOR = { Dmitry Pyryeskin and Mark Hancock and Jesse Hoey },
    TITLE = { Comparing Elicited Gestures to Designer-Created Gestures for Selection above a Multitouch Surface },
    BOOKTITLE = { Proc. ITS },
    YEAR = { 2012 },
    PAGES = { 1-10 },
    NUMPAGES = { 10 },
    DOI = { 10.1145/2396636.2396638 },