Smart wheelchair based on eye tracking

Abstract

This project is a smart wheelchair based on eye tracking which is designed for people with locomotor disabilities. The add-on controlled module can be used with any electrical wheelchair. The smart wheel chair consists of four modules including imaging processing module, wheelchair-controlled module, SMS manager module and appliance-controlled module. The image processing module comprises of a webcam installed on the eyeglass and C++ customized image processing software. The captured image which is transmitted to raspberry Pi microcontroller will be processed using OpenCV to derive the 2D direction of eye ball. The coordinate of eyeball movement is then wirelessly transmitted to wheelchair-controlled module to control the movement of wheel chair. The wheelchair-controlled module is two dimensional rotating stages that installed to the joystick of the electrical wheelchair to replace the manual control of the wheelchair. The motion of eyeball is also used as the cursor control on the raspberry Pi screen to control the operation of some equipped appliance and send message to smart phone.