80 likes | 156 Views
Quality Center Update. Eileen Hall Ken Kasparian. Nodal Quality is of Increasing Concern. Areas of Concern Limited testing in lower environments Late detection of defects increasing defect resolution time Increased number of releases requires support for multiple versions of software (2+)
E N D
Quality Center Update Eileen Hall Ken Kasparian TPTF
Nodal Quality is of Increasing Concern • Areas of Concern • Limited testing in lower environments • Late detection of defects increasing defect resolution time • Increased number of releases requires support for multiple versions of software (2+) • Defects not uniformly prioritized from a program perspective • Currently do not have integrated test environment • Final builds of critical components have not been integrated • Mitigation Measures • Provide for adequate test cycles in revised schedule • Minimize number of releases/builds • Program level participation in defect prioritization • Accelerate build out of integrated test environment
Nodal FAT Active Defects by Severity by Project The number of Severity 1 and Severity 2 defects is increasing. • Problems areas include: • NMMS has 30 Severity 1 and Severity 2 defects • MMS has 14 Severity 2 defects • OS UI has 10 Severity 2 defects • EIP has 9 Severity 1 and Severity 2 defects Note – Includes New, Open, Reopen, Fixed and Test
Nodal Active Defects by Severity Trend • Severity 3 trend is remaining relatively constant (784 currently outstanding) • Severity 2 defects are increasing due to defect reclassification to reflect must-fix defects Sev 3 Sev 2 Sev 1
Average Days to Fix FAT Severity (1, 2, 3) Defect by Vendor Defect turnaround time is one key indicator of vendor performance.
Nodal % Reopened Defects by Vendor Key indicator of vendor performance (indicates what percentage of fixes delivered by a vendor failed retest). • ABB, AREVA, and Siemens are fixing their products with a low reopen rate, a good indication that these vendors are sufficiently testing their releases/defect bundles prior to delivery. • Increased focus on more robust dev/pre-FAT testing for vendors with high reopen rate.
Severity 1, 2, and 3 defects found in the Early Delivery Systems (EDS) Majority of EMS defects are detected in EDS.
Quality Strategy Moving Forward • Ensure adequate testing time in the appropriate environment. • Minimize number of releases/builds. • Prioritize defects according to program impact. • Complete integration test environment.