What is it about?

This paper presents a survey and novel categorization framework for virtual, augmented, and mixed reality interfaces for human-robot interaction (VAM-HRI) as well as our online survey visualizer website accessible at: vamhri.com. We explain how current VAM-HRI interfaces are composed of four main categories of virtual design elements (VDEs). We present and justify our taxonomy and explain how its elements have been developed over the past 30 years as well discuss the current directions VAM-HRI is headed in the coming decade.

Featured Image

Why is it important?

This Virtual Design Element (VDE) taxonomy can be used as a catalogue and/or cookbook for robot designers interested in enhancing their robots and their interactions through VAM technology. Developers are presented with all of the known state-of-the-art VDEs and being able to pick and choose the VDE(s) that best addresses their VAM-HRI system's challenges and purpose. Additionally, the taxonomy highlights potential design elements that have yet to appear in the research literature, which may serve as fertile ground for future research.

Perspectives

In this paper we explore a wide range of research that demonstrates that VAM-HRI is an active and rapidly growing research area. We believe, however, that this field is currently hindered by a lack of precise terminology and theoretical models that explain how work in the field may connect and build off each other. The taxonomy we have presented for identifying, grouping, and classifying key design elements across VAM-HRI systems helps to address this issue. It is our hope that other researchers are able to use the table in a similar fashion to guide their own efforts, and that our work will help VAM-HRI grow into a mainstream field by providing researchers in the community with the necessary lexicon for easily understanding, describing, and referencing the designs in their own systems with other relevant work being performed, while also helping researchers reason about what areas require further exploration or represent entirely novel areas of inquiry.

Michael Walker
University of North Carolina at Chapel Hill

Read the Original

This page is a summary of: Virtual, Augmented, and Mixed Reality for Human-Robot Interaction: A Survey and Virtual Design Element Taxonomy, ACM Transactions on Human-Robot Interaction, May 2023, ACM (Association for Computing Machinery),
DOI: 10.1145/3597623.
You can read the full text:

Read

Resources

Contributors

The following have contributed to this page