TabletInVR: Exploring the design space for using a multi-touch tablet in virtual reality

 Hemant Bhaskar Surale,  Aakar Gupta,  Mark Hancock, and  Daniel Vogel. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 13:1-13:13, 2019.

Publication and Related Materials


Complex virtual reality (VR) tasks, like 3D solid modelling, are challenging with standard input controllers. We propose exploiting the affordances and input capabilities when using a 3D-tracked multi-touch tablet in an immersive VR environment. Observations gained during semi-structured interviews with general users, and those experienced with 3D software, are used to define a set of design dimensions and guidelines. These are used to develop a vocabulary of interaction techniques to demonstrate how a tablet's precise touch input capability, physical shape, metaphorical associations, and natural compatibility with barehand mid-air input can be used in VR. For example, transforming objects with touch input, "cutting" objects by using the tablet as a physical "knife", navigating in 3D by using the tablet as a viewport, and triggering commands by interleaving bare-hand input around the tablet. Key aspects of the vocabulary are evaluated with users, with results validating the approach.

Bibtex entry

@INPROCEEDINGS { Surale:2019:TED:3290605.3300243,
    AUTHOR = { Surale, Hemant Bhaskar and Gupta, Aakar and Hancock, Mark and Vogel, Daniel },
    TITLE = { {TabletInVR}: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality },
    BOOKTITLE = { Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems },
    SERIES = { CHI '19 },
    YEAR = { 2019 },
    ISBN = { 978-1-4503-5970-2 },
    LOCATION = { Glasgow, Scotland Uk },
    PAGES = { 13:1--13:13 },
    ARTICLENO = { 13 },
    NUMPAGES = { 13 },
    DOI = { 10.1145/3290605.3300243 },
    ACMID = { 3300243 },
    PUBLISHER = { ACM },
    ADDRESS = { New York, NY, USA },
    KEYWORDS = { interaction techniques, touch interaction, virtual reality },