What is it about?

This research introduces TOM (The Other Me), an open-source platform designed to develop wearable intelligent assistants. These assistants use augmented reality (AR), artificial intelligence (AI), and smart devices like AR glasses and smartwatches to provide real-time guidance and support. TOM helps users complete everyday tasks more efficiently by understanding their environment, actions, and needs. Whether it’s coaching a runner, answering real-time questions, or helping recall past experiences, TOM makes AI-driven assistance more practical and accessible. For developers and researchers, TOM offers a flexible, easy-to-use system for building and testing intelligent AR applications. It integrates multiple devices, records user interactions for analysis, and allows for customization based on different tasks. This could help shape the future of smart, wearable assistants that go beyond simple voice commands to truly understand and assist users.

Featured Image

Why is it important?

TOM is an initial step toward smarter, wearable digital assistants. Unlike existing AI-powered tools (such as voice assistants or smartphone apps), TOM combines context-awareness, real-time feedback, and multimodal interaction (voice, gestures, and gaze tracking). This makes AI assistance more natural and effective for everyday use. Its open-source nature also makes it unique—developers and researchers can customize, improve, and expand its capabilities, making it adaptable for various applications. As wearable technology and AR devices become more mainstream, TOM provides a strong foundation for future advancements in AI-powered personal assistants. This work is especially timely as industries explore human-AI collaboration, augmented reality applications, and smart wearable technology. TOM could influence healthcare, education, productivity, and accessibility tools by enabling more personalized and proactive AI assistance.

Perspectives

As AI assistants become more embedded in our daily lives, we need systems that are truly intelligent, context-aware, and user-friendly. TOM is an exciting step in that direction. It allows AI to assist people in meaningful ways—whether it’s guiding someone through a workout, answering questions in a store, or helping users remember important details. What excites me most about TOM is its potential for real-world impact. Imagine a future where AR glasses seamlessly overlay helpful information as you go about your day, or a smart assistant that understands what you need before you even ask. This research brings us closer to that reality. At the same time, TOM highlights challenges that we still need to address—such as privacy concerns, AI hallucinations, and the need for better real-time processing. But with continuous development and collaboration, wearable AI assistants like TOM could soon become an indispensable part of our daily lives.

Nuwan Janaka
National University of Singapore

Read the Original

This page is a summary of: TOM: A Development Platform For Wearable Intelligent Assistants, October 2024, ACM (Association for Computing Machinery),
DOI: 10.1145/3675094.3678382.
You can read the full text:

Read

Resources

Contributors

The following have contributed to this page