A novel rule based speech to Pakistan sign language translation pipeline
Loading...
Date
2021-10-13
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
UMT Lahore
Abstract
Communication between the hearing disable person using gestures are known as sign language (SL). It is the fundamental way of communication between hard of hearing persons. As the gestures of sign language is varying from country to country.
There are various sign languages according to their own sign gestures like American sign language (ASL), British sign language (BSL), German sign language (GSL), French sign language (FSL), Indian sign language (ISL) and many more sign languages available but in Pakistan, there is no significance work done for hearing disable persons in sign language. So this project aims to develop an application to reduce the communication gap between normal people and deaf community.
In this project, we develop an Android application for deaf community. So they can communicate easily. In this application, we use speech as an input using API for translating speech-to-text then perform some actions like translate this English input sentence to Pakistan sign language sentence and then perform gestures by using avatar animations on Android interface.
Another significant dimension of this application is learning signs for the normally abled persons. Various categories are introduced of most commonly use daily life words. This way a person learns to communicate with the deaf community.