Affective Computing

1. Affective Computing – A Rationale for Measuring Mood with Mouse and Keyboard 4/12/04 Based on a fine paper byPhilippe Zimmermann Affective Computing

2. Outline • Introduction • Affect, Emotion, Mood • Structure and Labeling of Affect • Mood Measurement Methods • Mood Induction Methods • Discussion • Method • Analysis • Conclusions

3. Introduction • Measure User Affect • Use non-invasive, unobtrusive measurement method • Use standard computer devices (Mouse, Keyboard) • Extract data from log files of mouse and keyboard movements to analyze correlations with affective state

4. Affect, Emotion, Mood • Affect- refers to either an emotion or a mood • Emotion – A reaction to a specific cause or stimulus. An intense experience of short duration. Can cause moods • Mood – Subtle, longer lasting, more in the background affective state of the user • An affective computer can take advantage of mood by presenting stimuli that sustain a certain mood, or counteract undesired moods. • Frustrated users could be prompted to take a break • E-Commerce website could take advantage of the study that said a low-risk purchase is more likely while in a good mood, and a high-risk purchase is more likely in a neutral or negative mood

5. Structure and Labeling of Affect • Three basic emotional dimensions • Affective Valence (pleasure) • Positive (Pleasant) to Negative (unpleasant) • Arousal • Calm (low-arousal) to Excited (high-arousal) • Dominance (control) • Controlled to In Control

6. Mood Measurement Methods • Physiological • Heart Rate, Blood Pressure, Respiration, Muscle Action • Psychological • Self Reports - Verbal, Ckecklists, Questionaires • Behavioral • Facial expressions, Gestures, Movement • Studies show relation of mouse click patterns to user frustration

7. Mood Induction Methods • Mood changed by reading statements • This method results in a short term mood change • Mood changed by watching video with audio • This results in a longer mood change

8. Discussion • Physiological Signals will distract the user too much (You need wires connected to you to gather data such as heart rate and blood pressure) • Self Reports of current mood can be inaccurate as the questions asked of the user to determine mood might invoke a mood. • Using only a keyboard and a mouse will be non-invasive, and should not have the ability to change the users mood.

9. Method • Film clips were used to induce moods. • After watching the clip, the users were prompted with a brief survey on their computer to rate their current mood. • Users were required to shop on an e-commerce website. • Physiological (pulse, respiration, etc) data was taken. • Mouse and keyboard movements were recorded in the background to a log file. Button Up/Down, mouse coordinates, and what key pressed were logged

10. Method (2) • Users Filled out the mood survey, watched the clip, shopped the e-commerce site, and then filled out the survey again. • The experiment lasted 1.5 to 2 hours

11. Analysis • Using the physiological data and the surveys, the user's mood will be verified to be one of the 5 different affective states • The log files with the Keyboard and Mouse log files will be examined with the known mood changes to look for patterns. • Number of mouse clicks per minute • Duration of mouse clicks • Distance of a single mouse movement • Number and length of pauses in movement • Minimum/Maximum/Average mouse speed • Keystroke rate per second • Average Duration of Keystroke

12. Conclusion • If a system knows how a user feels it can appropriately react to those moods • Questions • Should a system try to change your mood? • What emotions should Human Computer Interaction be concerned? • How Accurate does the measurement have to be?