Press Kit II: Unit Effectiveness Inspection (UEI)

1. Press Kit II:Unit Effectiveness Inspection (UEI) SAF/IGI Office of The Inspector General 24 June 2013

2. UEI Basics • What is the UEI? • One of the new Air Force Inspection System (AFIS) levels of inspection—all-inclusive picture of unit overall effectiveness • UEI conducted by MAJCOM/IG to assess Wing/Wing-equivalents • Continual evaluation of unit performance – “photo album vs. snapshot” • UEI inspection period begins immediately after previous UEI report • Major Graded Areas (MGA) • Managing Resources • Leading People • Improving the Unit • Executing the Mission

3. Structure of Unit Effectiveness Inspection (UEI) and CC’s Inspection Program (CCIP) These are the 4 Major Graded Areas and sub-areas for the UEI and wing CCIP 1 4 3 2 Commanders can tailor the methods, scope and depth with which their IGs inspect these areas based on the unique missions and operating environment of each wing

4. Catalyst How It Will Work Return to main brief Wing IG and the finds and reports deficiencies to the So the Wing IG builds an inspection plan, that requires Wing CC who asks Gp/CCs to do RCA, and fix the problems and improve. and exercises, inspectors and MESLs & SOEs, and Exercise Controllers and this OODA loop starts again and injects But the Wing IG is not responsible for the Wing IG to inspect the wing’s execution of XP’s plans the wing’s plans or teaching the wing how to execute them or fixing the problems they find Then the Wing CC asks or prepping for an inspection to build, brief and publish these wing plans Capabilities Execute primary mission(s) Then the XP works with SMEs across the wing Deploy AEF Airmen wants these so he directs XP to build plans to direct& synchronize the wing’s muscle movements to produce these required capabilities Command & control Many threats Mission Assurance Wing CC

5. MGA 1 Drilldown • Dual-purpose inspection • HAF/MAJCOM staff grade: • Is the unit resourced at the level prescribed by HHQ? • Is that level of resourcing adequate for the actual mission? • Unit grade: • Is the unit a good steward of scarce resources, including Airmen’s Time?

6. MGA 2 Drilldown Incorporated concepts AFI 36-3401 Mentoring • Resiliency • Comprehensive Airmen Fitness (CAF) Pillars: • Physical • Mental • Spiritual • Social CSAF Health and Wellness

7. MGA 3 Drilldown Incorporated concepts Root Cause Analysis (8-step) • CJCS White Paper: Mission Command • Commander’s intent • Trust but verify • “White space” • Micromanagement AFI 90-901 Operational Risk Management • Baldrige criteria • Workforce focus • Customer focus

8. MGA 4 Drilldown Incorporated concepts • Primary mission • “Do it today” mission • Expeditionary mission • Applies to ALL Wings, FOAs, DRUs • Mission-Assurance Command and Control • All-risk, all-hazard continuity planning • Applies to ALL Wings, FOAs, DRUs • Communications outages • Unit recall rosters

9. UEI Execution • Continuous Evaluation via all available unit performance data • Wing-reported data (FAM databases) • Self Assessment Checklists (enabled through MICT data) • Internal & External inspection results • Limited & no-notice observation of real-world and/or local readiness & surety exercises • Pre-visit Surveys: • 90 days prior to on-site visit IG will administer a survey to capture data relevant to the four UEI MGA’s • On-Site Inspection • Sample unit per MAJCOM Sampling Strategy to validate & verify CCIP • Independently assess unit effectiveness • IG will conduct Airmen-To-IG Sessions (ATIS) • Collect data through individual and group discussions

10. UEI Flow:Photo Album vs. Snapshot On-site IG visit UEI Report To Unit CC & MAJCOM CC Done in ~ 1 week Begin new UEI

11. Continual Eval • Data collected continually from multiple sources: • FAM analysis of MICT data (Wings conduct ~ One CCIP/month) • IG analysis of MICT data • IG observation of Wing exercise/training events and real world ops • MAJCOM HQ Battle Rhythm (FAMs & IG personnel) • Monthly – FAMs analyze MICT data and other functional metrics • Quarterly – IG-led Inspection Working Group • Members include Wing IGs and Deputy Directors • Semi-Annual – CV-led Inspection Council • Members include Wing CCs, HQ Directors & Special Staff • Opportunities for IG to inspect unit’s mission execution • Small teams to inspect exercises, deployments & real-world operations • Inspect ALL units’ mission execution: doing it now or ready to do it

12. UEI Survey • Objectives: • Capture anonymous, candid, representative sample of wing attitudes, beliefs and opinions related to the UEI MGAs • Help shape and focus IG’s on-site UEI visit • Approx 140 questions related to the 4 MGAs • Includes basic demographic data to disaggregate down to the squadron level while keeping survey anonymous • MAJCOM may add up to 5 questions to end of survey • Responses may be: • Yes, No • Likert scale (Strongly Agree, Agree, etc.) • Multiple choice • Open ended

13. Airmen-To-IGSessions (ATIS) • Composed of two collection methods • Focus Groups • Interviews • Gathers Airmen’s perceptions, attitude, and beliefs • ATIS Groups (ATIS-G) • 3 Questions: Quality of Work Life, Quality of Home Life, and “if you could change anything in the AF, what would it be?” • 10-15 personnel (optimal 12) • 3-person Teams: 1 Facilitator, 1 “white-boarder”, 1 note-taker • One Hour in duration, highly scripted • ATIS Interviews (ATIS-I) • Facilitator, Note taker and interviewee • One Hour in duration

14. ATIS Groups Notional • Different Focus Group Audiences Separate Groups • Junior Enlisted (E-4 and below) 6 • Mid Level Enlisted (E-5/6) 5 • Senior Enlisted (Top Three) 4 • E-9s 1 • Company Grade Officers 5 • Field Grade Officers 4 • Spouses (various grades) 4 • Lower Level Civilians (GS09 and below) 3 • Higher Level Civilians (GS10 and above) 2 • Commanders 1 35 Each group consists of 10-15 participants, 1 IG facilitator and 3 IG recorders

15. ATIS Interviews Notional • Individual Interviews Audiences Separate Interviews • Wing CC 1 • Wing CV 1 • Wing CEM 1 • Ops GRP CC and One other GRP CC 2 • At least one SQD CC from each GRP 4 • Two GRP Senior Enlisted 2 • Four SQD Shirts 4 • Two Lower Level Civilians 2 • Two Higher Level Civilians 2 • Four random Spouses 4 • Six random E4 and below 6 29

16. CCIP val/ver:Risk-based Depth and Scope Purpose: Help Wing CC reduce risk of undetected non-compliance Inputs Outputs Functional Inspections • Consequences of undetected non-compliance • SecAF & CSAF • MAJCOM CC • TIG and MAJCOM IG • HAF Functional Authoritiesand FAMs • MICT data and other metrics • Wing CC’s Inspection Reports • Maturity and reliability of CCIP • Inspection resource availability • Optimum scope, depth and methodology • Tailored sample areas • Team composition • Inspection schedule of events IG will develop a risk-based sample strategy to validate and verify each CCIP Wing CCIP CCIP Val/Ver Scope/Depth of Compliance Inspection Tailored Samples Core Samples MAJCOM IG Maturity

17. Task Eval, Audit & Observation • Risk-Based Sampling Strategy across the 4 MGAs using notice and no-notice methods • Task Evals • Audit • Observation • Pulling threads based on ATIS and observations

18. Notional UEI Report Photo album vs. snapshot Inspection of mission execution throughout the inspection period Congruence between UEI and CCIP allows val/ver of wing CCIP RCA on this assessment and correlation with MI will provide useful data for MAJCOM/CC & staff, and for CSAF & HAF

19. UEI: to sub-sub MGA

20. Key Takeaway MAJCOM/IG conducts this

21. Questions?