What is it about?

This study investigates how using different sensory modalities—like sight, sound, and touch—can enhance our ability to remember and express personal memories. By interviewing participants and allowing them to use various materials and methods to express their memories, the research aims to develop a better understanding of how senses contribute to memory recall and expression. This could lead to improved technologies for memory support, particularly for those with memory impairments (e.g., dementia, Alzheimer's).

Featured Image

Why is it important?

This research is pioneering in its exploration of multimodal/ multisensory memory expression—how we use our various senses to recall and express memories. This is timely given our increasing reliance on technology in daily life to remember our memories, which often engages only one or two senses such as pictures, or videos. By understanding the full spectrum of sensory engagement, we can create tools that support richer, more vivid memory recall and expression, potentially aiding those with memory challenges like dementia. For instance, in the study, touch (tactile) was very important to remember the memories, and it can be included in future memory systems.

Perspectives

I have always been intrigued by the role of senses in memory recall. Our findings underline the significant impact of (touch) tactile sensations in remembering memories. Additionally, we observed that participants often found multimodal (involving multiple senses) representations to be the most effective way to recall and express their memories, especially their positive memories. This suggests that incorporating a multisensory approach could enhance memory-aiding technologies, making them more effective in helping individuals relive and share their cherished memories. The consensus that memories are best represented through a combination of senses rather than a single modality is a crucial insight for future technology development in this field.

Ege Otenen
Indiana University Bloomington

Read the Original

This page is a summary of: Towards Designing for Multimodal Remembering: Findings from an Interview Study, May 2024, ACM (Association for Computing Machinery),
DOI: 10.1145/3613905.3647965.
You can read the full text:

Read

Contributors

The following have contributed to this page