An interactive technology to support education of children with hearing problems

What is it about?

The paper presents a "design and simulation of gesture"-based model to support education of children with hearing problems. To engage the child's attention and control their own learning according to the individual skills, a framework is proposed for interaction with an artificial hand in the form of a game with rewards for correct answers. The anthropomorphic hand, designed for the purpose in 3D, is both realistic and able to produce all fingerspelling signs of the international sign language. The novelty of the present work is in the proposed integration of biologically feasible movements of the hand and the cognitive ability to display meaningful signs to support teaching novel concepts to children with hearing problems.

Featured Image

Photo by Franck V. on Unsplash

Photo by Franck V. on Unsplash

Why is it important?

The contributions of the proposed work are: 1) An attractive and interesting way of teaching children in the form of a game; 2) Personalization of learning according to the child's time preference and perception abilities; 3) Setting the time for simulation and the possibility of multiple repetition of a movement supports the way of studying through imitation of the fingerspelled signs according to the perception abilities of the child. The proposed gesture-based method of teaching promotes the design of children-focused technology rather than teacher-centred. The framework will be tested with real children in the future. The proposed method is sufficiently general to be applied in other learning activities related to gesture-based computing and its future role in education