EYE TRACKING AND VOICE CONTROL FOR COMPUTER APPLICATION
DOI:
https://doi.org/10.61841/p0gtnz11Keywords:
Digital Image Processing, Voice Recognition, Human Computer InteractionAbstract
The concept of digital image processing and speech recognition can be used for tracking the eye movement which can help in controlling the mouse on the screen and performing the specified function using voice commands. To track eye a macro lens camera is used, which will be placed close in front of the user’s eye. A human eye has 3 visible regions – Sclera, Iris and Pupil. Sclera is white in color, color of Iris varies from person to person, but Pupil is black in color. This allows us to track the pupil’s movement on the eye. The second camera will be positioned on the user’s head which will track the screen edges and determine the distance between user and screen, it will also track the head rotation to determine the exact cursor position. The pupil’s position can be then mapped on to the screen so that the mouse moves relative to the eye. The mapping is done by resizing the screen frame to fit the eye frame and tracking the center of the eye relative to the screen edges. After finding the cursor coordinates it is important to remove noise. Noise can be in the form of non-continuous cursor movement or cursor moving back and forth even if the user is idle. The voice recognition system will process the user’s voice and converts it into text which can be used as commands for computer operation. These operations involve clicking, double-clicking, right-clicking, typing, etc. The main idea of this project is to minimize the number of input devices and increase the ease of human computer interaction. It will be useful for people who are suffering from amputation or who want an ergonomic work space, as it minimizes the use of hands for interacting with the computer.
Downloads
References
[1] Veena N. Hegde, Ramya S. Ullagaddimath, S. Kumuda: “Low cost eye based human computer interface system”
- 2016 IEEE Annual India Conference (INDICON).
[2] Tibor Ujbányi: “Examination of eye-hand coordination using computer mouse and hand tracking cursor control”
- 2018 9th IEEE International Conference on Cognitive Infocommunications.
[3] Prashant Salunkhe, Ashwini R. Patil: “A device controlled using eye movement” - 2016 International Conference on Electrical, Electronics, and Optimization Techniques.
[4] Z. A. Sasinas Alias Haritha, P. V. Raveena, K. S. Arun, P. N. Nithya, M. Vishnu Balan, Sabareesh Krishnan: “Eye tracking system using isophote eye center detection with blink perception” - 2016 International Conference on Signal Processing, Communication, Power and Embedded System.
[5] Pawel Kasprowski, Katarzyna Harezlak, Michał Niezabitowski: “Eye movement tracking as a new promising modality for human computer interaction” - 2016 17th International Carpathian Control Conference.
[6] Eun Yi Kim, Sin Kuk Kang, Keechul Jung, Hang Joon Kim: “Eye mouse: mouse implementation using eye tracking” - 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE.
[7] Robert Gabriel Lupu, Florina Ungureanu, Valentin Siriteanu: “Eye tracking mouse for human computer interaction” - 2013 E-Health and Bioengineering Conference.
[8] Shahram Jalaliniya, Diako Mardanbeigi; Thomas Pederson, Dan Witzner Hansen: “Head and Eye Movement as Pointing Modalities for Eyewear Computers” - 2014 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops.
[9] Tomasz Kocejko, Adam Bujnowski, Jerzy Wtorek: “Eye mouse for disabled” - 2008 Conference on Human System Interactions.
[10] Chairat Kraichan, Suree Pumrin: “Face and eye tracking for controlling computer functions” - 2014 11th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
