Project 6C Problem Statement
Project 6C Problem Statement
Team ID: 6C
Project Title: Capturing Non-Manual Features of Indian Sign Language and
Converting it into Text
Problem Statement:
Develop an advanced system capable of capturing the nuanced non-manual features (NMFs) of Indian
Sign Language (ISL), such as facial expressions, head movements, and body posture, and accurately
converting them into written text.
This system should enhance the translation of ISL by including these essential components of sign
language communication, which provide critical context and meaning beyond manual signs.
1. High-precision recognition of NMFs using advanced image processing and machine learning
techniques. Real-time conversion of recognized NMFs into contextually appropriate text.
2. A comprehensive database of NMFs associated with ISL, including regional variations.
3. User-friendly interface for both sign language users and those learning ISL.
4. Capability to integrate with existing ISL to text translation systems to provide a more
complete translation experience.
5. Offline functionality to ensure accessibility and usability in various environments.
Challenges to Address:
1. Creating a recognition system sensitive enough to capture the subtleties of NMFs in ISL.
2. Ensuring the system can operate in diverse lighting and background conditions.
3. Developing an extensive and representative database of NMFs in ISL.
4. Balancing system performance with the need for real-time processing and output.
This problem statement addresses the need for a more holistic approach to ISL translation by
incorporating NMFs, which are often overlooked in current translation technologies.
It presents an opportunity for innovation in the field of sign language recognition and translation,
aiming to improve communication accessibility for the deaf and hard-of-hearing community.
Note: Teams are expected to include all features and address the challenges towards fulfilment of
Project submission.
Project Guide
S Mahaboob Hussain,
Asst. Prof, CSE