Smart eye-tracking system

Abstract

This project is a smart eye tracking system which is designed for people with disabilities and elderly people. The concept of this research is to apply eye movement to control appliances, wheelchair and communicate with caretaker. This system comprises four components, imaging processing module, wheelchair-controlled module, appliances-controlled module and SMS manager module. The image processing module consists of webcam and C++ customized image processing, the eye movement image is captured and transmitted to Raspberry Pi microcontroller for processing with OpenCV to derive the coordinate of eye ball. The coordinate of eye ball is utilized for cursor control on the Raspberry Pi screen to control the system. Besides the eye movement, the eye blink is applied in this system for entering a command as when you press Enter button on keyboard. The wheelchair-controlled module is a cradle with two servos that can be moved to two dimensions and also adaptable to other wheelchair joysticks. This system also remotely controls some appliances and communicate with caretaker via send message to smartphone.