Computer Science & Electrical

Computer Science & Electrical

Character Recognition in a Human-Computer Interface Environment for Users with Motor disabilities

Pages: 11  ,  Volume: 34  ,  Issue: 1 , August   2019
Received: 14 Aug 2019  ,  Published: 14 August 2019
Views: 162  ,  Download: 66


# Author Name
1 Andrea Piroddi


The aim of this research is to explore a possible method for identifying an alphanumeric character produced by an individual with motor and vocal disabilities and whose possibilities to interact with the surrounding environment are limited to the movement of the face. The reason behind the creation of an alphanumeric character interpretation algorithm is linked to the fact that attempts to use existing algorithms (such as Tesseract) gave poor results in this scenario. The reason of the low success rate was not investigated; the focus was on finding a functional solution to the objective. Obviously subsequent studies in this sense are desirable. A Human-Computer Interaction algorithm has been developed in order to allow a person with limited mobility to interact with a computer, to which commands can be given.  This project is based on three main elements: the identification of facial parameters, their tracking and the interpretation of the word expressed. A Linux based Python application has been coded to elaborate information from a camera. The main action is to identify the face of the potential user, activate tracking when the subject closes his eyes for a defined numbers of times, then follow the trajectory of a point of the face (in our case the tip of the nose), interpret the letter thus drawn, buffer the letters and finally convey the command (entire word) thus obtained. At the end, statistics on the success percentage are provided.


  • pearson correlation
  • character recognition
  • image tracking
  • References

    Bristow, H., & Lucey, S. (2012). V1-Inspired features induce a weighted margin in SVMs. European Conference on Computer Vision (ECCV), (pp. 1,2,5). Bristow, H., & Lucey, S. (2014). Why do linear SVMs trained on HOG features perform so well? arXiv, 8. Hyvarinen, A., & Koester, U. (2007). Complex cell pooling and the statistics of natural images. Network, 1. Piroddi, A. L., Borgna, C., & Landoni, R. (2015). Facial Image Recognition And Motion Tracking Haar Technique. International Journal of Advancements in Digital Signal Processing, 1-5. Soukupova, T., & Cech, J. (2016). Real-Time Eye Blink Detection using Facial Landmarks. 21st Computer Vision Winter Workshop. Rimske Toplice, Slovenia.