What is it about?
We introduce EarHover, an innovative system that enables mid-air gesture input for hearables. The signal leaked to the outside of the device due to sound leakage can be measured by an external microphone, which detects the differences in reflection characteristics caused by the hand’s speed and shape during mid-air gestures. Among 27 types of gestures, we determined the seven suitable gestures for EarHover in terms of signal discrimination and user acceptability. We then evaluated the gesture detection and classification performance of two prototype devices (in-ear type/open-ear type) for real-world application scenarios.
Featured Image
Photo by Harry Cunningham on Unsplash
Why is it important?
Mid-air gesture input, which eliminates the need to touch the device and thus helps to keep hands and the device clean. However, existing mid-air gesture input methods for hearables have been limited to adding cameras or infrared sensors. By focusing on the sound leakage phenomenon unique to hearables, we have realized mid-air gesture recognition using a speaker and an external microphone that are highly compatible with hearables.
Perspectives
I hope this study contributes to the rapidly advancing field of hearables technology. In particular, gesture recognition using sound leakage signals is a unique idea from my co-author, with whom I have conducted research, and I hope this technology garners attention.
SHUNTA SUZUKI
Read the Original
This page is a summary of: EarHover: Mid-Air Gesture Recognition for Hearables Using Sound Leakage Signals, October 2024, ACM (Association for Computing Machinery),
DOI: 10.1145/3654777.3676367.
You can read the full text:
Resources
Contributors
The following have contributed to this page
