The Eye Mouse

1. Vertical Axis Horizontal Axis Budget and Personnel Effort Client: Senior Design Project: May 03-24 Faculty Advisors: Dr. J. Davidson, CprE Dr. A. Dogandžic, CprE The Eye Mouse John Guy Electrical Engineering Brian Figueroa Computer Engineering Jeff Tott Computer Engineering Brian Reed Electrical Engineering James Loftus Computer Engineering Abstract Use of the human eye as a input device for personal computing remains a largely untapped field. This design project shall attempt to explore this field further by developing a low-cost input device to be usable by an average PC user. The team shall attempt to combine electro-oculography (EOG, or potential difference across the face) measurements and optical image processing to emulate a basic PC mouse. An apparatus shall be designed and built to perform this tracking and emulate a standard PC mouse via serial, PS/2, or USB interface. This device will comprise electrodes attached to the subject’s face to measure potential difference changes along with a camera component to provide auxiliary data to a signal-processing box. Hopefully, such an apparatus will allow for alternative pointer control options for the PC. End-Product Description The “eye mouse” tracking device will offer a viable alternative to traditional manual mice for manipulation of popular PC graphical user interfaces. The device shall utilize both direct measurement of movement of a user’s eyes as well as a vision camera system to track movements visually and shall interface to common PCs via USB, PS/2 or serial ports. The end product will consist of electrodes, a camera fixture, and a external box containing signal processing and PC interface components. • Technical Approach • Electrodes • The retina is electrically active compared to the rest of the eyeball, so there is a measurable potential difference between it and the cornea. Electrodes will be placed on the skin around the eye socket, and measures of changes in the orientation of this potential differences will be made In combination with software and an optical approach described below it is hoped the accuracy of responses to eye movements can be heightened. • Optical Processing • In combination with the electrodes a non-contacting camera that observes the eyeball plus image processing techniques to interpret the picture will be used. By tracking a visible feature of the eyeball the position of the eyeball can be identified. This can be done with sophisticated image processing and pattern recognition techniques. • Introduction • General Background • This project is intended to develop a computer “mouse” system that is controlled by the user’s eye movement. The envisioned system will allow a person to use applications such as Microsoft Word to perform usual tasks easily and efficiently. • Technical Problem • System accuracy • Implementation of auto-recalibration • Head movement • How to analyze and interpret data optimally from electrodes • Operating Environment • Normal household conditions • Personal computer running Microsoft Windows • Intended Users and Uses • Handicapped and non-handicapped users • Take place of an ordinary mouse • Assumptions and Limitations • User has eyes that can be detectable by imaging device • Imaging device does not have infinite refresh rate • Design Requirements • Design Objectives • Emulation of PC mouse • Cost effective hardware • Combine electro-oculography with image processing • Intuitive / automatic calibration routines • Functional Requirements • Movement of cursor via eye tracking alone • Method of “clicking” the mouse • Interface for calibration/configuration • Design Constraints • Comfortable for long-term use • Suitable for office use • Measurable Milestones • Capture electro-oculography data to PC • Add calibration routines • Add image processing component • Polish software and hardware for release • Testing Approach • The software will be tested before integration with eye tracking device • Eye movements will be tested to see affects on cursor movements • Testing on affect of head movement will be made