What is it about?

This paper introduces Ajna, a wearable system designed to help people better understand and navigate their surroundings in emergency situations. Ajna overcomes some of the problems found in current Augmented Reality (AR) devices, like the limited ability to detect far-away objects, hidden behind walls, or on different floors. By using sensors already built into AR devices, Ajna allows multiple users to share what they detect, even if obstacles like walls are in the way. We tested Ajna in a simulated emergency with 15 people inside a multi-story building and found it improved how quickly and accurately first responders could detect objects and understand their environment. Ajna reduced search times by 15% and showed great promise for use in situations like law enforcement, search and rescue, and managing infrastructure.

Featured Image

Why is it important?

Ajna is important because it offers a novel solution to a common challenge in emergency response: the limited ability of current AR devices to detect objects beyond immediate surroundings, like through walls or across floors. By enabling users to share their perspectives with each other, Ajna enhances situational awareness in real time, which is critical for saving lives and managing emergencies effectively. The technology’s focus on collaborative perception in difficult environments makes it a timely tool for improving outcomes in law enforcement, search and rescue, and infrastructure management. Its ability to reduce search times by 15% highlights its practical value in critical scenarios.

Perspectives

The combination of AI and AR in Ajna provides a unique opportunity for first responders to access enhanced real-time information about their surroundings. This system can significantly speed up decision-making and coordination in high-pressure situations by improving object detection and allowing for better communication between team members. In my view, Ajna is not only a technological innovation but a critical advancement that has the potential to save lives by empowering responders with faster, more reliable situational awareness. This project highlights the importance of integrating emerging technologies to address real-world challenges.

Matthew Wilchek
Virginia Polytechnic Institute and State University

Read the Original

This page is a summary of: Ajna: A Wearable Shared Perception System for Extreme Sensemaking, ACM Transactions on Interactive Intelligent Systems, September 2024, ACM (Association for Computing Machinery),
DOI: 10.1145/3690829.
You can read the full text:

Read

Contributors

The following have contributed to this page