What is it about?

The paper focuses on the psychological effect of adding pseudo-haptics to the act of reading descriptive Japanese text, specifically onomatopoeia. By having participants perform finger-point tracing of sentences containing words like puru-puru (jiggling) and sara-sara (smooth/flowing) under various haptic conditions, we sought to quantify the degree to which this simulated touch affects the semantic perception of the words, using the Semantic Differential (SD) method for evaluation.

Featured Image

Why is it important?

This research is important because it contributes to the development of more immersive and expressive digital reading experiences. Japanese onomatopoeia are a powerful linguistic tool for conveying vivid sensory information, and the ability to augment this experience digitally with haptic feedback opens up new possibilities for Human-Computer Interaction (HCI). The findings can inform the design of next-generation e-reading platforms, making digital content more engaging and facilitating a deeper connection between the reader and the text, particularly for descriptive or literary works. It advances the boundary of how we integrate the sense of touch into digital literacy.

Perspectives

From a future perspective, this study lays the groundwork for several exciting avenues. One promising direction is the potential for haptic-augmented language learning, where foreign language learners can feel the texture or sensation described by a new word. Another is in accessibility, using tailored haptic patterns to convey the sensory meaning of text to users with reading difficulties or visual impairments. Academically, future research should explore mapping a broader range of pseudo-haptic parameters to various semantic dimensions beyond simple texture, and investigate the long-term cognitive effects of consistently receiving multi-sensory input during reading. Furthermore, applying this technique to interactive narratives could create truly multi-sensory storytelling experiences.

Prof. Satoshi Saga
Kumamoto Daigaku

Read the Original

This page is a summary of: Investigating the Effect of Pseudo-Haptics on Perceptions Toward Onomatopoeia Text During Finger-Point Tracing, Multimodal Technologies and Interaction, September 2025, MDPI AG,
DOI: 10.3390/mti9100100.
You can read the full text:

Read

Contributors

The following have contributed to this page