Infinity yoga tutor: yoga posture detection and correction system

Abstract

Popularity of yoga is increasing daily. The reason for this is the physical, mental and spiritual benefits that could be obtained by practicing yoga. Many are following this trend and practicing yoga without the training of an expert practitioner. However, following yoga in an improper way or without a proper guidance will lead to bad health issues such as strokes, nerve damage etc. So, following proper yoga postures is an important factor to be considered. In this proposed system, the system is able to identify poses performed by the user and also guide the user visually. This process is required to be completed in real-time in order to be more interactive with the user. In this paper, the yoga posture detection was done in a vision-based approach. The Infinity Yoga Tutor application is able to capture user movements using the mobile camera, which is then streamed at a resolution of 1280 × 720 at 30 frames per second to the detection system. The system consists of two main modules, a pose estimation module which uses OpenPose to identify 25 keypoints in the human body, using the BODY_25 dataset, and a pose detection module which consists of a Deep Learning model, that uses time-distributed Convolutional Neural Networks, Long Short Term Memory and SoftMax regression in order to analyze and predict user pose or asana using a sequence of frames. This module was trained to classify 6 different asanas and the selected model which uses OpenPose for pose estimation has an accuracy of 99.91%. Finally, the system notifies the users on their performance visually in the user interface of the Mobile application.