1 / 22

Monday March 3

Monday March 3. Situation Awareness Assessment for the lab Situation Assessment Rating Technique Freeze Technique Criteria for evaluating measures Sensemaking. Situation Awareness Assessment: Part I. SA Measures to Know for Lab . Situation Awareness Rating Technique (SART)

luyu
Download Presentation

Monday March 3

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Monday March 3 • Situation Awareness Assessment for the lab • Situation Assessment Rating Technique • Freeze Technique • Criteria for evaluating measures • Sensemaking

  2. Situation AwarenessAssessment: Part I

  3. SA Measures to Know for Lab • Situation Awareness Rating Technique (SART) • Robert M. Taylor • 3D and 10D Versions • The Freeze Technique • Situation Awareness Global Assessment Technique • Mica Endsley

  4. SART Score = Understanding – (Demand – Supply)

  5. SART Score = Understanding – (Demand – Supply)

  6. For the Lab: SART • Choose a SART version: 3D or 10D • Choose your SART response type: • Rating on a 7-pt Likert Scale • Choice of contrasting categories: e.g., High vs. Low • Pairwise comparisons • Is your SA higher when using Display X or Y? • Is your SA higher when using Display Y or Z? • Is your SA higher when using Display Z or X? • Determine when ratings will be made • During vs After? • If during, at what times or in response to what events

  7. For the Lab: SAGAT • Develop a brief script that you use to warn participants about the freezes and what they should do. • Choose your freeze times or trigger events • Times can be predetermined or randomly chosen • Choose your SAGAT queries • Perception queries • Comprehension queries • Projection queries

  8. Example SAGAT Measures What do you see? • % of aircraft locations reported correctly

  9. Example SAGAT Measures What do you understand? • % of aircraft for which weather impact (yes/no) was correctly assessed • % aircraft with incomplete clearances

  10. Example SAGAT Measures How well can you project what will happen next? • Which sector is the aircraft heading to? • To which player is she about to pass the ball?

  11. Criteria for Choosing & Evaluating Measures On Wednesday, use these criteria to evaluate 2 measures described by our guest lecturer, Dr. Cuevas. Assess each measure on 4 criteria; give a brief explanation for each assessment. Due at the end of Wed. class.

  12. Evaluating & Choosing Measures

  13. How Do We Build SA? How Do We Measure/Assess that Process?

  14. Is SA Built Like This? Should SA Development Be Measured in terms of information flow and capacity?

  15. Is SA Built Like This? Should SA development be measured in terms of linked knowledge nodes and link weights?

  16. Data/Frame Theory of Sensemaking - Klein, Phillips, Rall, & Paluso, 2007

  17. What are the Measures of SA Development? • Does cue lead to change of frame? • Is unusual information (inconsistency) perceived and recognized? • Is chosen frame elaborated with situation data? • Are inconsistent data explained away? • Is attention placed on the correct aspects of the situation? • Aware of data quality? • Original frame vs elaborated frame

  18. Back Up Slides

  19. Categories of SA Assessment Methods • Explicit Measures • Implicit Measures • Subjective Measures

  20. Explicit Measures • Retrospective Self- Report Methods • Concurrent Self-Report Methods • Think-Aloud Protocol • Confederate Probing • Freeze Technique

  21. Implicit Measures • Global Measures • External Task Measures • Embedded Task Measures

  22. Subjective Measures • Direct Self-Ratings • Comparative Self-Ratings • Observer Ratings

More Related