Скачать презентацию CANADIAN PATROL FRIGATE SOFTWARE MAINTENANCE TESTING BY LCDR Скачать презентацию CANADIAN PATROL FRIGATE SOFTWARE MAINTENANCE TESTING BY LCDR

d0137f9497801e60b3dc51ed493646f4.ppt

  • Количество слайдов: 22

CANADIAN PATROL FRIGATE SOFTWARE MAINTENANCE TESTING BY LCDR T. L. WILLIAMS CANADIAN PATROL FRIGATE SOFTWARE MAINTENANCE TESTING BY LCDR T. L. WILLIAMS

CPF SOFTWARE • • 1, 100, 000 SLOC 223 MODULES 10 YEAR DEVELOPMENT TESTED CPF SOFTWARE • • 1, 100, 000 SLOC 223 MODULES 10 YEAR DEVELOPMENT TESTED AS PART OF SIX YEAR AT SEA TRIALS PROGRAM • BUILD 36 FINAL CPF CONTRACT BUILD

CPF MAINTENANCE CONTRACT ISSUES • GOVERNMENT OWNED CONTRACTOR OPERATED (GOCO) • MOVE PGC TO CPF MAINTENANCE CONTRACT ISSUES • GOVERNMENT OWNED CONTRACTOR OPERATED (GOCO) • MOVE PGC TO HALIFAX • CM REMAINED IN MONTREAL • NAVY VERSION 1. 0 PROMISE • DND REORGANIZATION/STAFFING • TRANSITION OF CPF SOFTWARE TO IN-SERVICE AUTHORITY

TECHNICAL AUTHORITY NAVAL HSSF ORGANIZATION COMMUNITY SMa. RT SOFTWARE MANAGER ADMIN ASSISTANT COMMS QA TECHNICAL AUTHORITY NAVAL HSSF ORGANIZATION COMMUNITY SMa. RT SOFTWARE MANAGER ADMIN ASSISTANT COMMS QA CM SENSORS ASW PROGRAM GENERATION CENTER SUPPORT TEWA COMMAND SUPPORT TRACK MANAGEMENT

TESTING CPF MAINTENANCE CONTRACT STATED: “TESTING SHALL BE AT THE SAME LEVEL AS THE TESTING CPF MAINTENANCE CONTRACT STATED: “TESTING SHALL BE AT THE SAME LEVEL AS THE CPF PRIME CONTRACT”

NAVY VERSION 1. 0 PROBLEMS • REQUIREMENTS • WORK SPLIT BETWEEN SITES • POOR NAVY VERSION 1. 0 PROBLEMS • REQUIREMENTS • WORK SPLIT BETWEEN SITES • POOR PLANNING • FACILITY SCHEDULING • VERSION RELEASE DOCUMENT

NAVY VERSION 1. 0 PROBLEMS (CONT) • • • RELEASING AUTHORITY CONTRACTOR TESTING AT NAVY VERSION 1. 0 PROBLEMS (CONT) • • • RELEASING AUTHORITY CONTRACTOR TESTING AT SEA TESTING NUMEROUS DEFECTS STAFFING/EXPERIENCE LEVELS NO MEANINGFUL METRICS COLLECTED

SUCCESS OR FAILURE? • POLITICALLY FACILITY WAS JUDGED TO BE A SUCCESS • STANDING SUCCESS OR FAILURE? • POLITICALLY FACILITY WAS JUDGED TO BE A SUCCESS • STANDING UP THE FACILITY – SUCCESS • PRODUCING THE FIRST IN-SERVICE BUILD – FAILURE

CHANGES TO FACILITY • REQUIREMENTS GROUP STOOD-UP • CONTINUOUS IMPROVEMENT GROUP ESTABLISH • INDEPENDENT CHANGES TO FACILITY • REQUIREMENTS GROUP STOOD-UP • CONTINUOUS IMPROVEMENT GROUP ESTABLISH • INDEPENDENT TESTING GROUP ESTABLISHED • INCREASED STAFFING FOR SMa. RT

CHANGES TO FALICITY (CONTINUED) • MINI-SYSTEM INSTALLED • AUTOMATED CONFIGURATION MANAGEMENT • CLOSER TIES CHANGES TO FALICITY (CONTINUED) • MINI-SYSTEM INSTALLED • AUTOMATED CONFIGURATION MANAGEMENT • CLOSER TIES TO REQUIREMENTS GROUP DEVELOPED • TRANSITION OF SOFTWARE TO INSERVICE AUTHORITY • FACILITY REORGANIZED

NAVAL COMMUNITY ADMIN ASSISTANT SOFTWARE DEVELOPMENT MANAGER ASW/COMM/TM TECHNICAL AUTHORITY HSSF(H) REORGANIZATION CSST(H) SOFTWARE NAVAL COMMUNITY ADMIN ASSISTANT SOFTWARE DEVELOPMENT MANAGER ASW/COMM/TM TECHNICAL AUTHORITY HSSF(H) REORGANIZATION CSST(H) SOFTWARE MANAGER SPECIAL PROJECTS MANAGER SOFTWARE SYSTEM ENGINEER INTEGRATED SUPPORT MANAGER QUALITY ASSURANCE TEWA/SENSOR LINK SUPPORT COMMAND SUPPORT CONFIGURATION MANAGEMENT INFORMATION TECHNOLOGY TESTING

SOFTWARE SYSTEMS ENGINEER RESPONSIBILITIES • ASSESS IMPACT OF SOFTWARE AND SYSTEM CHANGES • COORDINATE SOFTWARE SYSTEMS ENGINEER RESPONSIBILITIES • ASSESS IMPACT OF SOFTWARE AND SYSTEM CHANGES • COORDINATE SYSTEM STUDIES AND INVESTIGATIONS • REVIEW TEST PLANS AND TEST PROCEDURES • OBSERVE ALL FORMAL TESTS

QUALITY ASSURANCE • QUALITY MANAGEMENT – DOCUMENT, V & V SOFTWARE PROCESS – INCREASE QUALITY ASSURANCE • QUALITY MANAGEMENT – DOCUMENT, V & V SOFTWARE PROCESS – INCREASE PROCESS CAPABILITY AND MATURITY – RAISE QUALITY AWARENESS AND PROVIDE TRAINING – CONTINUOUS IMPROVEMENT

QUALITY ASSURANCE (CONTINUED) • QUALITY CONTROL – VERIFY ALL DEFECTS AND ENHANCEMENTS ARE DOCUMENTED QUALITY ASSURANCE (CONTINUED) • QUALITY CONTROL – VERIFY ALL DEFECTS AND ENHANCEMENTS ARE DOCUMENTED AND TRACKED – WITNESS SPR CLOSURES, DELTA, AND SYSTEM TESTS – MONITOR SOFTWARE BUILDS AND DELIVERY PREPARATION

CONTINUOUS IMPROVEMENT HIGHLIGHTS • REQUIREMENTS REVIEW • PEER REVIEWS • TRAINING – 247 HOURS CONTINUOUS IMPROVEMENT HIGHLIGHTS • REQUIREMENTS REVIEW • PEER REVIEWS • TRAINING – 247 HOURS PROGRAMMERS – 173 HOURS TESTERS • NEW VERSION RELEASE PROCESS • INCREMENTAL BUILDS • NEW TESTING PROCESS

SOFTWARE TEST PROCESS Development Testing Program Debug SPR Closure Beta Site Testing Version Testing SOFTWARE TEST PROCESS Development Testing Program Debug SPR Closure Beta Site Testing Version Testing Operational Evaluation Survivability Test Beta Site Testing Delta Test Shipboard Alongside Testing System Test Shipboard At Sea Testing

BETA TESTING • OCCURS ON A CONTINUOUS BASIS • CFNOS AND CFNES INVOLVED • BETA TESTING • OCCURS ON A CONTINUOUS BASIS • CFNOS AND CFNES INVOLVED • DEFECTS ARE DOCUMENTED – ATTEMPT TO REPRODUCE ON PREVIOUS VERSION • FREE PLAY

VERSION TESTING • VERSION SURVIVABILITY TEST – COMPARES SYSTEM PERFORMANCE WITH PREVIOUS VERSION PERFORMANCE VERSION TESTING • VERSION SURVIVABILITY TEST – COMPARES SYSTEM PERFORMANCE WITH PREVIOUS VERSION PERFORMANCE – FULLY AUTOMATED – FOCUSES ON MISSILE THREAT PROFILES, TEWA PROCESSING – REPORT PRODUCED AND REVIEWED

DELTA TEST • INTEGRATION TESTING • WHITE BOX FOCUS • DEMONSTRATES ALL CHANGES FUNCTION DELTA TEST • INTEGRATION TESTING • WHITE BOX FOCUS • DEMONSTRATES ALL CHANGES FUNCTION CORRECTLY IN THE SAME BUILD • TEST REPORT PRODUCED/REVIEWED

SYSTEM TEST • NORMALLY STATIC • FOUR PHASES – EW/ASW – AWW/RADAR – FULL SYSTEM TEST • NORMALLY STATIC • FOUR PHASES – EW/ASW – AWW/RADAR – FULL LOAD TRACKING – OVERALL (8 HRS) (2 HRS) (6 HRS) • REPORT PRODUCED/REVIEWED

TESTING IMPROVEMENT S • TEST CELL ENHANCEMENT STUDY – FULLY DOCUMENT PROCESS • • TESTING IMPROVEMENT S • TEST CELL ENHANCEMENT STUDY – FULLY DOCUMENT PROCESS • • • DEVELOMENT AND USE OF METRICS FORMALIZATION OF PEER REVIEWS AUTOMATED TESTING DEFECT REPORTING DEFECT DATA COLLECTING TESTING/PROGRAMMING TOOLS

CONCLUSION • • • INITIAL TESTING POOR TRYING TO DO TOO MUCH AT ONCE CONCLUSION • • • INITIAL TESTING POOR TRYING TO DO TOO MUCH AT ONCE TESTING PROCESS NOW IN PLACE OBTAINING REPEATABLE RESULTS FINE TUNING PROCESS STAGE