Open Access Open Access  Restricted Access Subscription or Fee Access

Sign To Speech Converter For Hard To Hear And Speech Impaired People

Shweta Patil, Swapnaja Jagade, Satish Shinde, Manish Bhosle, Sheetal Bhujade

Abstract


An enormous populace in India alone is of the hard of hearing and disabled individuals. So the framework is dealing with a glove based gadget which will be utilized for change of communication through signing to discourse. The gesture-based communication glove comprise of a straightforward hand gloves fitted with flex sensors which is being utilized for the checking how much curve on the fingers. Flex implies bend, this is the sensors that change the obstruction relying upon how much curve on the sensor. Information from the sensors is ship off the control unit which is the Arduino the simple signs from the sensors are carefully changed over and contrasted and the put away worth of the acknowledgment of sign and afterward showed as a text on the 16x2 LCD. Further the message yield is wirelessly sent to a mobile phone which comprise of text to speech conversion software. Right now this undertaking dealing with a straightforward model that will change over hand gesture to text. So the framework is an extension among typical and hard of hearing individuals; it fills the gaps of communication among hard of hearing and ordinary individuals.


Keywords


Sign language, Arduino, Gloves, Flex sensor, Deaf people, Gesture recognition. microcontroller

Full Text:

PDF

References


Fauzan Khan, Akshata Surve , Faiz Shaikh , Prof. Amjed Ali.”Sign Language Glove using Arduino”, International Journal for Research in Applied Science & Engineering Technology. Volume 5 Issue 3, March 2017.

P. Jahnavi, Dr. E. Vamsidhar, Dr. C. Karthikeyan.”Facial expression detection of all emotions and face recognition system”. International Journal of Emerging Trends in Engineering Research Volume 7, No. 12 December 2019 pp 778-783

V. Padmanabhn M. Somalatha. “Hand gesture recognition and voice conversion system for mute people”. International Journal of Scientific & Engineering Research, Volume 5, Issue 5, May-2014.

Kirsten Ellis and Jan Carlo Barca. Exploring “Sensor Gloves for Teaching Children Sign Language”. Advances in Human-Computer Interaction. Pp1-8, 2012.

Yun Li, Xiang Chen et al, Sign-Component- Based Framework for Chinese Sign Language Recognition Using Accelerometer and sEMGData, IEEE Transactions On Biomedical Engineering, VOL. 59, NO. 10, pp. 2695- 2704, 2012.

Shital P.Dawane, Prof. Hajiali G.Sayyed. A Review on “Hand Gesture Recognition for Deaf and Dumb People” Using GSM Module, International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering Vol. 5, Issue 11, November 2016.

M. S Kasar, Anvita Deshmukh, Akshada Gavande, and Priyanka Ghadage, “Smart Speaking GloveVirtual tongue for Deaf and Dumb”, Internaltional Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering, vol. 5, no. 3, p. 7, Mar. 2016.

Starner, T., Weaver, J., Pentland, A. “Real- Time American Sign Language Recognition using Desk and Wearable Computer Based Video”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, No. 12. 1998.

M. Khan, S. Chakraborty, R. Astya and S. Khepra, "Face Detection and Recognition Using OpenCV", 2019 International Conference on Computing Communication and Intelligent Systems (ICCCIS), pp. 116-119, 2019.

H. Lin, M. Hsu and W. Chen, "Human hand gesture recognition using a convolution neural network", 2014 IEEE International Conference on Automation Science and Engineering (CASE), pp. 1038-1043, 2014.

N. Mukai, N. Harada and Y. Chang, "Japanese Fingerspelling Recognition Based on Classification Tree and Machine Learning", 2017 Nicograph International (NicoInt), pp. 19-24, 2017.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Journal of Microcontroller Engineering and Applications