NMIMS MPSTME Student Develops AI Model for Sign Language Translation, Empowering the Hearing and Speech-Impaired Community

Preeyaj Safary, a talented and compassionate 19-year-old BTech student at NMIMS Mukesh Patel School of Technology Management & Engineering (MPSTME), Mumbai, has created a groundbreaking artificial intelligence (AI) model that translates sign language into text, revolutionizing communication for individuals with hearing and speech impairments. Preeyaj’s innovative technology utilizes the power of AI to bridge the communication gap, enabling seamless interaction with the larger society.

Inspired by a visit to a restaurant where he witnessed the challenges faced by deaf and mute individuals in communicating with the outside world, Preeyaj embarked on a mission to develop a solution that would make their lives easier. The AI model captures sign language gestures through a camera, and by comparing them to a comprehensive database of sign language images, it accurately translates the gestures into written text displayed on a connected screen. The model not only provides the words corresponding to the signs but also indicates the accuracy level of the translation, ensuring effective communication.

Preeyaj collected a diverse range of sign language images from various sources, including online platforms and interactions with individuals associated with NGOs working in this sector. The AI model’s database continues to expand as he works diligently to include more signs, and the increased usage of the technology will further contribute to enhancing the database’s accuracy and completeness.

Reflecting on the motivation behind his work, Preeyaj said, “I was deeply moved by the challenges faced by individuals with hearing and speech impairments while interacting with the public. Witnessing the inclusive nature of society inspired me to explore the potential of technology in facilitating smooth communication. I began working on this project during the lockdown, driven by the belief that technology can bring about positive change.”

In addition to his remarkable achievements in sign language translation, Preeyaj had previously developed a computer program to assist elderly individuals in booking vaccination slots during the COVID-19 pandemic. His commitment to leveraging technology for the betterment of society is evident in his tireless efforts to address critical societal needs through innovative solutions.

Preeyaj’s journey toward making a meaningful impact has been greatly supported by MPSTME Mumbai and its dedicated faculty. The institution’s nurturing environment and encouragement have played a vital role in his success, providing an atmosphere where students can thrive and contribute to society. NMIMS MPSTME is proud to provide a platform that enables students like Preeyaj to achieve significant accomplishments. “MPSTME and its faculty have always helped me and motivated me to achieve greater heights and also do something which can be useful for a larger audience. I am glad to be a part of such an institution,” he says proudly.

Looking ahead, Preeyaj envisions a future where technology continues to drive positive social change. With a motto centred around doing good for society, Preeyaj intends to explore new technologies and identify innovative use cases that address pressing societal needs. His passion for technology and dedication to academic excellence demonstrate his commitment to making a lasting impact.

As Preeyaj’s story exemplifies the transformative power of technology and innovation, MPSTME remains committed to nurturing the talents of its students and providing them with the necessary tools and support to create a better world.