Sign Language to Audio Conversion for Sinhala Language with a Guided Framework

Abstract

Communication is an essential part of all the people in their day today life. We can see various modes of communication with one another in our society. Ordinary people can communicate with each other using any language in the world if they are capable of that language. However, for the hearing impaired people communication is a difficult task as they are limited to the sign language. Many studies and applications have attempted to overcome this barrier with the usage of image processing and hardware technologies. Nevertheless there are very few solutions that support for the Sinhala language. Our system provides a solution for the above- mentioned matter by developing a system, which converts Sinhala sign language into Sinhala audio with the use of image processing technologies and a guided framework. We detect the hand gestures through a colored glove and the relevant word for a particular symbol can be retrieved from the XML file. The audio output is generated by using the festival framework. Our system has 80% accuracy for detecting Sinhala sign symbols.