1 / 34

System Accuracy Status (SAS) Monthly Assessment Procedures

System Accuracy Status (SAS) Monthly Assessment Procedures. (Version 16FEB12). MCO 3125.1B Excerpt M-SHARP Data accuracy & Level 1/Green Assessment.

lorne
Download Presentation

System Accuracy Status (SAS) Monthly Assessment Procedures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. System Accuracy Status (SAS) Monthly AssessmentProcedures (Version 16FEB12)

  2. MCO 3125.1B ExcerptM-SHARP Data accuracy & Level 1/Green Assessment • This excerpt of the MCO highlights the requirement for an objective assessment of each unit by the MCAS M-SHARP Support Representative in coordination with the Commander’s own assessment of his unit to achieve Level 1/Green System Accuracy Status.

  3. System Accuracy Status Level (SAS) https://msharpsupport.com/fly_usagestatus.asp • This guidance from MCO 3125.1B indicates a unit’s progression toward achieving initial data accuracy in M-SHARP. • A unit’s initial SAS level is a snap shot in time, as it changeswith each new change in aircrew or in the given T&R syllabus. • Each unit is required to conduct the assessment each month to ensure SAS remains at Level 1.

  4. System Accuracy Status Level (SAS) Unit SAS Level is available on the Support Site: https://msharpsupport.com/fly_usagestatus.asp

  5. M-SHARP Implementation Officer (MIO)and the Operations Chief • Trainedand competent squadron Implementation Officers and Operations Chiefs are the keys to maintaining M-SHARP System Data Accuracy! • All MIOs must have complete familiarity and understanding of Chapters 1 & 2 of the Program Manual, as well as all T&R syllabus manuals within his or her command. (The M-SHARP Support Rep is the local SME to assist the MIO.)

  6. System Data Accuracy Level (SAS) versus Unit Readiness. • SAS Level is NOT a measure of Unit Readiness, HOWEVER, M-SHARP may present skewed readiness metrics if data accuracy is NOT maintained. • SAS Level is only a measure of current M-SHARP data accuracy. • Units must pay close attention to their M-SHARP data accuracy, understanding that T&R changes and aircrew changes affect SAS Level. • The following assessment process will ensure M-SHARP System Accuracy Status IAW the SBTP/FHP Order and the Program Manual. NAVMC 3500.14C (Program Manual); Chapter 8; Page 804 “Each unit’s System Accuracy Status is objectively assessed by M-SHARP Support Representatives for all levels except Level 1/Green which requires the unit commander’s assessment. The M-SHARP System Accuracy Status Report of all units and M-SHARP System Accuracy Status assessment procedures can be found at https://msharpsupport.com.”

  7. Squadron SBTP Execution (Crew) Report • The “Crew” page of this report is designed to indicate the CSP, MSP, & Combat Leadership Designation status for the unit. • The accuracy of the SBTP “Crew page” is a critical indicator of SAS!!! • The T&R Program Manual, NAVMC 3500.14B, defines the business rules for the calculated values displayed on this report. • The report is entirely reliant upon two inputs from Marine users: • Logged T&R codes after flights, simulators, or academics. • Baseline entries to account for all the archived T&R execution data for every aviator in the squadron who does not have a complete flight history in the M-SHARP database. It is critical that Flight Logging standards are addressed at Aircrew Training, i.e. SBTP categories, environmental conditions, FLSE, etc.

  8. What is meant by “Baseline”? • Baseline entries are required for every single metric that is missing from the M-SHARP database – for every single aviator…for every single calculation of core/mission skill…T&R designation…T&R qualification…individual T&R event proficiency…flight hours, etc. • The baseline status of a unit is defined by the collective baseline status of all aircrew in the unit. • Every single change in assigned permanent, TAD, or augmenting squadron aircrew can change the baseline status of the unit., and turnover of personnel occurs daily. • Only the Squadron Ops O and his training officers, as the squadron’s T&R subject matter experts, can effectively manage the status of the squadron’s baseline data accuracy by carefully auditing the individual flight history of every existing and potential aircrew in the unit’s M-SHARP database. Note: New joins, regardless of rank, require a COMPLETE baseline review of Personnel Profile, T&R status and Log Books within the 1st week of joining the squadron, specifically, before the Marine begins logging T&R codes with the unit.

  9. SAS Monthly Assessment Process • The MSP/CSP, Qualification, and Designation discreet reports in M-SHARP are the objective source of all Aircrew Core Competency data related to Readiness. • The SAS assessment requires a cooperative effort between the Squadron M-SHARP Officer and the MCAS M-SHARP Support Representative. • It is important to understand that the Support Rep cannot assess the intent of the unit’s training plan, since only the Ops department is aware of who should be MSP in a given MET, or designated as combat leader, etc. • The unit’s focus during the assessment is to identify whether their data appears to be accurately portrayed in M-SHARP. • The M-SHARP Support Representative will provide guidance on T&R business rules, and teach the mechanics of analyzing and correcting data accuracy issues in M-SHARP, thus assisting the unit achieving the goal of intentmatching reality.

  10. Monthly SAS Assessment – Steps • Step 1 – Review Unit Personnel Roster • Step 2 – Review SBTP “Crew” Page • Step 3 – Review Core and Mission Skills • Step 4 – Review Leadership Designations • Step 5 – Review Instructor DESGs & QUALs • Step 6 – Confirm Data Accuracy with Support Rep • Step 7 – SAS is communicated to ATD/APP

  11. Step 1 – Review Unit Personnel Roster • Go to Reports>Standardized Reports>Unit Roster • The Unit Roster represents the squadron’s “M-SHARP alpha roster” • Units must ensure that all T&R syllabus Marines are: • Assigned to the proper M-SHARP Personnel Status • Assigned to Permanent Unit = T/O assigned Marines • Assigned to Temporary Unit = Marines assigned outside of home unit; only used for detachments to MEU • Augmenting Temporary unit = ONLY CAT 1 Marines assigned to HHQ; (review MCO 3125.1B) • Assigned to the right primary and/or secondary syllabi • Assigned to the right POI (Program of Instruction) • Basic / Refresher / Series Conversion / Transition etc. (review T&R Program Manual for guidance) • Assigned the right Special Qualification • Assigned the right Service Code • Inaccurate Unit Roster personnel profiles can have a profound impact on unit T&R metrics if Marines are improperly managed. • This report must be reviewed weekly by Ops/Training Officers/MIO to ensure that operations clerks are properly entering aircrew data.

  12. Step 1 – Review Unit Roster cont. • Reports>Standardized Reports>Unit Roster • Review top of this report to see if the “Assigned To” numbers make sense? • Does this Augment form USMC make sense?

  13. Step 1 – Review Unit Roster cont. All squadron aircrew must be reviewed and accurate! Legend for “Syllabus Info”. Reports>Standardized Reports>Unit Roster • Possible areas of concern: • Flight Surgeon counts for readiness as an AO; also Service Code of 3 = “USMC Pilot”. • LtCol, presumably the CO, is Basic POIand undefined crew seat. • Examples of field grade pilots assigned to primary AH and UH syllabi ,but “Basic” POI? Senior pilots in UH-1Y are usually SC POI from the UH-1N to the “Y”. • Maj RICHIE is Special Qual “C” for copilot – not a PIC? Your Ops Clerks make these entries – who is checking their work?

  14. Step 1 – Review Unit Roster cont. • Review of “POI” – Program Of Instruction (details in the slide notes) Program Manual Rule: “Only those events that are proficient are updated via chaining.”

  15. Step 2 – Review SBTP “Crew” Page • Go to Reports>SBTP Execution (Crew) page • SBTP “Crew” page provides the calculated numbers of Combat Leadership Designations, CSPs, and MSPs achieved for the month. • Top row shows the number assigned to the syllabus – 38. • The “Act” (actual) numbers in Yellow are what this unit has achieved as of 31JAN12. • The values are LOCKED as of COB the last day of the month. • These values are “pulled” from each unit by HHQ after the 5th working day of the month as primary SBTP / Training and Readiness metrics. • DO THESE NUMBERS APPEAR AS THE UNIT EXPECTS?

  16. Step 3 – Core and Mission Skills • Go to Reports>T&R Report>Core/Mission Skill Proficiency • Filter to the first syllabus in your unit, select all personnel, select CSP & MSP in “CSP Types”, and run the report for the last day of the reporting month. • If you are expected to perform CSP + or MSP +, then select those as appropriate. • Export the report to MS Excel and Save it as “HMLA-XXX CSP-MSP 31JAN12”, for example. • Filter out all Marines who are TAD to another unit, and all External Personnel as they do not contribute to your readiness. • Marines TAD or Augmented “from” your unit have an asterisk next to their names “*”. • External Personnel are highlighted at the bottom of your report in . • Note: Marines in are Category One Augments “to” your unit, and DO COUNT toward your readiness. (make sure that your CO expects to take these Marines to war; review MCO 3125.1B if not sure of CAT I status). Yellow Blue

  17. Step 3: Mission Skill Report (total counts) • Review this page to ensure MSP achievement matches expectation. • Export to MS Excel allows for easy comparison to SBTP Crew report. • Mission Skill total numbers MUST match the SBTP Crew Report exactly! Excerpt from Step 1, SBTP Crew report.

  18. Step 3: Mission Skill Report (assessment) • Assessing why “expectations” don’t match reality. • You may have expected, for example, that Maj Wolcott counted as MSP for EXP, but he has no proficiency in the 3601 as of 31JAN12. • Same is true for Capt Begley’s ESC status, as he has no proficiency in the 3102.

  19. Step 3 – Core and Mission Skills (review) AH-1W T&R Excerpts • METLs are on the left • Each MET has a corresponding “Mission Skill” (3000 Phase) • Each Mission Skill has its prerequisite “Core Skills” (2000 Phase) Core Skill Attain Tables Mission Skill Attain Tables

  20. Step 3 – Core and Mission Skills (review) AH-1W T&R Excerpts • How do you achieve an “X” in each Mission Skill (MET) box? • Complete the Core Skill Prerequisites for each Mission Skill for each aircrew. • For each Mission Skill, the unit must achieve the required number of total “MET Capable” Crews. Note: AH-1W syllabus allows for MSP Pilots to be teamed with non-MSP Copilots. Thus, only 12 MSP Pilots are required to build 12 combat crews.

  21. Core versus Mission Skills (example comparison) Program Manual: “Mission Skills enable a unit to execute a specific MET. They are comprised of advanced event(s) that are focused on MET performance and draw upon the knowledge, abilities, and situational awareness developed during Core Skill training.” Example of a Mission Skill 3000 level event that DOES NOT meet the Program Manual standard above. The 3302 code will not maintain proficiency of all the Core Skills required for CAS, as it is an “Intro to HLL CAS” event. Unit must ensure Core Skills remain proficient for each Mission Skill.

  22. Have you achieved ALL CSP prerequisites for your METs? • Notice how many aviators HAVE NOT satisfied the CSP prerequisites for the CAS MET…yet…they appear to be Mission Skill Proficient for CAS. • Example of a T&R that does not include CSP Maintain Table events in the MSP Maintain Table, which would ensure CSP to MSP relationship. • Affected T&R syllabi must consider this discrepancy when building combat crews.

  23. Have you achieved CSP prerequisites for your METs? • Notice that the AH-1W CAS MSP table does not include CSP 2000 Maintain prerequisites, while the CH-46E pilot syllabus does. • The example CH-46E “EXP” MET will always show proper status in M-SHARP for complete CSP/MSP achievement as defined in Chapter 1.

  24. Step 4 – Review Leadership Designations • Go to Reports>T&R Report>Designation Report • Filter to the first syllabus in your unit, select all personnel, and run the report for the last day of the reporting month. • Export the report to MS Excel and Save it as “HMLA-469 CBT LDR 31JAN12”, for example. • Filter out all Marines who are TAD to another unit, and all External Personnel as they do not contribute to your readiness. • TAD have an asterisk next to their names “*”. • External Personnel are highlighted at the bottom of your report in . • Note: Marines in are Category One Augments and DO COUNT toward your readiness. (make sure that your CO expects to take these Marines to war; review MCO 3125.1B if not sure of CAT I status) • Review your T&R Chapter 1, and delete all Designation Columns that do not apply to combat leadership, leaving a blank column after each. Yellow Blue

  25. Step 4 – Leadership Designations • T&R excerpt above shows Combat Leadership Readiness requirements. • Total up all combat leaders to ensure your objective data meets your expectations. • The fields indicate previously assigned designations from other units. • To modify a grayed out designation, go to Main>Assign Designations, and first “Delete” then Re-Designate the Marine so that he counts toward your unit’s readiness. GRAY Notice AHC, SL, & DL are each one lower than the SBTP Crew report! Must investigate.

  26. Step 4 – Leadership Designations Investigating why AHC, SL, & DL are each one lower than the SBTP Crew report! • Quick investigation shows that Capt Guardenier happens to have AHC, SL, DL, from another unit, all of which are related to the extra numbers on the SBTP Crew page. He may be a good place to dig deeper. • Further investigation of the Designation report details shows that Capt Guardenier has multiple Designations for more that one unit. • The Program manual dictates that “Designations” are unit specific. • HMLA-469 must delete the HMM-262 designation, so that only the 469 ones appear on the Designation report.

  27. Step 4 – Corrective Action HMLA-469 DESG Re-Assigned HMM-268 DESG Deleted • By deleting the HMM-262 “AHC” DESG, and re-assigning it under HMLA-469, Capt Guardenier’s data is now accurate. • Once the same procedure is done for the SL and DL, then the unit gains 3 more Combat Leadership Designations toward Current Readiness.

  28. Step 5 – Instructor Designations and T&R Qualifications • New T&R manuals include T&R Instructor Designations and Qualifications such as NSI and NSQ LLL, etc. as metrics for determining combat Crews. • Units must also asses these metrics during monthly SAS Assessment. Example of T&R Instructor Designations and Qualifications as part of “MET Capability” metrics.

  29. Step Five – Instructor Designations and T&R Qualifications • Use Standardized Report – “Qualifications and Designations” to create a customized grouping of Aircrew / QUALs / DESGs • Display shows all the “additional” metrics required to complete the SAS Assessment of ALL readiness metrics.

  30. Event Waivers Review • Program Manual: T&R Event Waivers • a. T&R Events may be waived for individuals undergoing the following training: • (1) Transition • (2) Series Conversion • (3) Refresher POI • (4) For commanding officers who desire to waive multiple events, the following guidance applies: • (a) Individuals should complete all R-coded events for the given syllabus. • (b) Individuals shall complete the culminating R-coded event for the given syllabus. • b. T&R Event waivers shall not be granted for: • Any Basic POI event…. • …(7) All events in a Qualification Syllabus…. • …b. The individual remains proficient throughout the respective event refly interval.

  31. Step 6 – Confirm Data Accuracy with Support Rep • Each unit will review their discreet M-SHARP CSP/MSP/ T&R Designation / Qualification Reports to determine which individual aircrew they expect “should be” CSP / MSP / Combat Leaders / Instructor Designated / Qualified <<then>> record any perceived discrepancies. • Steps 1 – 7 must be completed by the 5th working day after the end of the reporting month according to the SBTP order MCO 3125.1B. • Discrepancies: After the assessment of their T&R data is complete for all of the above metrics, the unit will record & identify to the M-SHARP Support Representative where perceived discrepancies exist using a simple M-SHARP export copies (MS Excel) with highlighted areas of concern as portrayed on the previous slides. • Once NO Discrepancies Exist: Send the M-SHARP Support Rep a final email indicating so and MS Excel Exports of your final SBTP Execution (Crew) report <<and>> Standardized Reports>Qualifications and Designations report.

  32. Step 6 – Confirm Data accuracy with Support Rep Reports>SBTP>SBTP Execution (Crew) Reports>Standardized Reports> QUALs & DESGs (for all syllabi) Send these 2 reports to the M-SHARP Support Rep, after all corrections have been made, to close out the SAS Assessment for the month.

  33. Step 7 – SAS is communicated to ATD/APP • By COB on the 5th day of the new month, the updated SAS level is communicated to ATD/APP by the Support Rep, and promulgated in an update to the ATD managed SAS Level report at http://msharpsupport.com/fly_usagestatus.asp. • Units that complete the SAS assessment successfully, and validate unit data accuracy, will be reported at SAS Level 1. • Units that have achieved baseline, but no command assessment is completed will be reported at SAS Level 2. • Units that have not met that standards of SAS Levels 1 or 2 will be reported at SAS Level 3.

  34. Summary • M-SHARP System Accuracy can be maintained by the monthly SAS Assessment Process. • Units can achieve confidence that their data is displayed as expected to HHQ, with no surprises. • The unit M-SHARP Implementation Officer is the key to achieving success. • Your M-SHARP Support Representative is standing by to assist you. http://msharpsupport.com/techsupport.asp

More Related