What is it about?
We used the built in Oculus hand tracking to detect hand gestures. We then correlated those hand gestures with different types of audio feedback for the user. We used a mix of sounds and descriptions to make VR environments more accessible for blind and low vision users.
Featured Image
Photo by charlesdeluvio on Unsplash
Why is it important?
VR is currently a very visually dominant field. We want to use alternative types of feedback to make VR more accessible for people who can't use the visual aspect of it. We also want to give the user more control over the feedback they receive, hence the gesture based control system.
Perspectives
As my first published research project, the whole process of submitting this paper was really valuable for me and my career. I gained a lot of insight into how people with visual impairments interact with the world and how to write a research demo paper.
Wren Poremba
University of Maryland at College Park
This was such an interesting subject matter to do research on especially as a first time research intern. I learned so much regarding accessibility for people with visual impairments. I hope this demo inspires more people to make VR accessible.
Christina Trice
Read the Original
This page is a summary of: Hands-On: Using Gestures to Control Descriptions of a Virtual Environment for People with Visual Impairments, October 2022, ACM (Association for Computing Machinery),
DOI: 10.1145/3526114.3558669.
You can read the full text:
Contributors
The following have contributed to this page
