What is it about?
This study explores how people understand stories told through both text and pictures. The researchers examined how switching between text and images affects comprehension. They found that combining these two forms of communication requires extra mental effort, especially when switching between them, compared to stories told entirely in pictures. However, this integration of text and images is still manageable and helps people make sense of the narrative.
Featured Image
Photo by Markus Spiske on Unsplash
Why is it important?
This study highlights the mental challenges of integrating text and images in storytelling, a common feature in modern media like comics, graphic novels, and multimedia content. By addressing how people process cross-codal narratives (stories told through different types of information), this research contributes to our understanding of how to design effective educational and entertainment media.
Perspectives
This research highlights the complexity of processing narratives using text and images. It shows how the human mind adapts to combine different types of information into a cohesive story but at the cost of additional mental effort. This work is a valuable intersection of psychology and communication studies, providing insights that can help improve the design of educational tools, comics, and multimedia storytelling.
Prof. Dr. Markus Huff
Eberhard Karls Universitat Tubingen
Read the Original
This page is a summary of: Cross-codal integration of bridging-event information in narrative understanding, Memory & Cognition, April 2020, Springer Science + Business Media,
DOI: 10.3758/s13421-020-01039-z.
You can read the full text:
Contributors
The following have contributed to this page
