An NLP based machine translation model for the deaf students of computer science of intermediate
Loading...
Date
2022
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
UMT, Lahore
Abstract
The deaf and hard-of-hearing people face many difficulties in almost every phase of their life whether they want to communicate with each other or want to learn education. The method they use to communicate with each other or with hearing people is known as sign language. Every country has its sign language according to its language and dialects, following the respective set of characters, vocabulary and general structures. This research work has proposed an intelligent system for the deaf and hard-of-hearing students that comprise a machine translation framework after implementing the core Natural Language Processing techniques. Unfortunately, as our country does not have proper medium, deaf and hard-of-hearing students always face a barrier in their education. By using these state-of-the-art NLP techniques, an avatar system has been created that translates a natural language into Pakistan Sign Language to facilitate the students so that they can learn the basic computer fundamentals and improve their knowledge in the domain of Computer science. The standardized curriculum of the Punjab Curriculum and Textbook Board has been used for the research work. The proposed machine translation model is able to work on word-level and sentence-level translation. This language model is a 3D avatar that translates the English language after understanding and analyzing all the features together with word orderings, words meanings, number features. HamNoSys notation has been used as it contains both manual and non-manual features. This notation provides the source language in the form of SiGML and then generates the streams of signs in the form of gestures like a human interpreter for the Pakistan Sign Language. This framework will perform as a robust medium for the hard-of-hearing students in Pakistan to learn applied subjects like computer science and provide them a way for choosing their path of interest in the technological field.