AI-based Assistance for Novice DIYers

What is it about?

We present Robert, a prototypical assistant system that helps users with DIY projects. Robert uses an AI planner to compute the necessary steps, and provides instructions and informations related to these work steps. Robert uses hierarchical task network planning, so that complex steps can be broken down to smaller steps. Furthermore, Robert communicates with the user using speech (in addition to a touch-based GUI).

Featured Image

Why is it important?

This is an unique example of seamlessly integrating hierarchical task network planning with an ontology-based knowledge representation. The prototypical system was tested with DIY novices who interacted with the system for the first time, and this paper reports the results.