WP 5: Eye tracker development

1. WP 5: Eye tracker development Bjarne Kjær Ersbøll http://www.imm.dtu.dk/ COGAIN Kick-Off 5.-6.9.2004 Tampere, Finland

2. Objectives • Assist development of eye tracking hardware and software and provide reference catalogue • Study and develop algorithmes: image/signal processing, synthesis, visualisation, coding&transmission • Possibility to select off-the-shelf or custom designed solution

3. Tasks T5.1 • T5.1State of the art catalogue • Working principles • Development status • Application environments • User friendliness • Robustness • Price http://ibs.derby.ac.uk/emed/ http://www.hhi.fraunhofer.de/german/im/products/CeBit/videotracker/videotracker.html http://www.eyetechds.com/qglance2.htm http://www.cs.bu.edu/faculty/betke/research/hci.html http://digital.ni.com/worldwide/bwcontent.nsf/web/all/35878450D61F549886256EE70051865A http://www.aac-input.org

4. Tasks T5.2 • T5.2Developing image and signal processing • Development of low-cost high-end CMOS camera technology • COGAIN WP5 UNIZH work months 1-18.doc, Tobias, UNIZH • Robust algorithms to handle broad range of environments (indoor, outdoor, various lightings) and different users (skin, glasses, make-up) • Open Source – Intel OpenCV – Dan, ITU • Exploit cues from other modalities (eye-, head-, lip-movement, sound, tactile) • Anticipate/predict user’s next action

5. Tasks T5.3 • T5.3 Hardware design and development • Low-cost off-the-shelf • Experiments combining different types of hardware • Hardware to support custom-designed solutions

6. Deliverables • D5.1 Catalogue of currently available eye-trackers (Month 6 – February 2005) • D5.2 Development and implementation of new image analysis algorithms + integration with other types of information (Month 18 –February 2006) • D5.3 Design considerations for dedicated eye-tracker hardware (Month 18 – February 2006)

7. Milestones • M5.1Eye-tracker catalogue with recommandations (Month 6 – February 2005) • M5.2Preliminary implementations of eye-tracker algorithms in off-the-shelf hardware (Month 18 – February 2006)

8. Measurable Indicators Indicator Year 1 Year 2 Year 3 Year 4 Year 5 Number of program libraries/software modules 2 5 8 15 20available on portal Number of reportsand publications1020355080available on portal Number of studentsinvolved in joint 4 8 15 20 25educational programs White papers andmanuscripts 5 8 10 10 10peer reviewed Number of jointlywritten publications 0 1 3 5 7

9. Current Status • Joint Danish application for funding • GACOVICS – A low-cost gaze controlled video conference system for disabled people. Danish National Science Foundation. ITU, Risø, DTU • PhD-students orienting their work towards COGAIN • Masters thesis students • Status from other partners missing

10. Estimated Involvement (first 18 months) Partner Months ITU 2 RISOE 0,5 DTU 3,5 TU-DRESDEN 1 UNI KO-LD 1 UzL 5 POLITO 2 SU 2,5 PAB 1 Tobii 2,5 UOD 2 TIT 2 UNIZH 1 Total 26 man-months = 16% of COGAIN effort

11. To Do • State-of-the-art catalogue • Possible publication? • Image Analysis / Signal Processing • Information (update) on status of COGAIN activities of the partners • Up-coming projects/proposals • Hardware considerations • Information (update) on status of COGAIN activities of the partners • Up-coming projects/proposals

12. To Do • Inspired by Hans: Your involvement in WP5? (1-2p by 1/10) • Research retreat? • Mid-end November? 2-3 days? DTU? • Useful to link with other eg. WP4? • Reporting: • End November – COGAIN Steering Committee • End February – COGAIN SC and EC • Durable integration: WP5 contributions?

13. Discussion • Comments, ideas? • Contact person for this WP: Bjarne Kjær Ersbøll • Email address: wp5@cogain.org (?) be@imm.dtu.dk