Test and Development Efforts Affecting Systems Engineering Decisions

Test and Development Efforts Affecting Systems Engineering Decisions for the AN/AWS-2 Rapid Airborne Mine Clearance System Presented by Mr. Alan K. Jenkins to the 6 th Annual Systems Engineering Conference 20 -23 October 2003 Alan K. Jenkins (4. 11. 6. 2) Naval Air Warfare Center Aircraft Division Patuxent River, MD 20670 301 -342 -1334 30 August 2003

TOPICS • • Organic MCM Concept Schedule Challenge Approach Taken Connection between T&E and SE – C&TD – SD&D – P&D • Conclusion 30 August 2003 2

THE ORGANIC MCM CONCEPT (Not to Scale) MH-60 S ALMDS RAMICS RMS OASIS AN/AQS-20/X LMRS 30 August 2003 AMNS 3

RAMICS SYSTEM DESCRIPTION Neutralization Engage the target from A Safe Standoff Distance (SSO) Safe Standoff Shallow Target 30 August 2003 Assumed Target Position Center of Reacquisition Search Area Safe Standoff Deep Target 4

MAIN ISSUES FOR SE • Munition/Gun Size – Based on ORD predictions (ORD signed shortly before MS-B) • Aircraft Integration • Targeting System • Exit Criteria Unknown 30 August 2003 5

RAMICS Program History • Accelerated development program to seamlessly insert RAMICS capability into ongoing OAMCM initiative May 04 Jul 02 Milestone B Mar 01 Aug 03 Analysis of Alternatives 2000 2001 2002 2003 Mar 07 LRIP Delivery / IOC TECHEVAL 2004 2005 2006 2007 System Development & Demonstration Nov 03 ORD Approved Aug 02 SD&D Contract Awarded to Northrop Grumman 2008 2009 Production & Deployment Mar 06 DT-IIA Mar 02 OPEVAL Aug – Dec 05 Preliminary Design Review Concept & Technology Development 30 August 2003 Jul – Nov 06 Design Readiness Review Milestone C / LRIP Jan – Apr 05 Contractor Testing Feb 07 Full Rate Production Decision Review 6

APPROACH TAKEN • Parallel Efforts to Keep Risk Low and Minimize Development Schedule – Gov’t Develop Gun/Munition • Begin qualification efforts • Collect firing data in flight to support targeting system development and cut risk – Contractor Develop Targeting • To include integration of entire weapon system 30 August 2003 7

RAMICS INTEGRATED PRODUCT TEAM (IPT) PROGRAM MANAGER/DEPUTY PMS 210/PMS 210 B CAPT V. Jimenez/Mr. H. Scheetz Chief Engineer PMS 210 -1 K. Haas CAAS Vredenburg GSC ASN/PEO Advisory A/C Integration Agent HX-21 A. Jenkins ITT Chair/Flight Tests/DT/OT Weapon System Development NSWC, Crane B. Corwin Design Refinement/GFE APM Logistics PMS 210 -1 M. Dryslewski RAMICS APM PMS 210 -6 E. Bracero Technical Direction Agent NSWCCSS B. Burt Munitions Development NSWC, DD T. Harkins Munition Qualification/GFE PMA 299 D/PMS 210 -OPS S. Keith Principal for Safety NSWCCSS J. Morris WSESRB, LSRB, SSSTRP System Development and Demonstration NSWCCSS B. Burt Milestone C/Contract Engineering Oversight — Alliant Techsystems/Textron — ATR — ARINC — Sikorsky — ATC — Vredenburg — NAVAIR 30 August 2003 — Northrop Grumman 8

KEY C&TD PHASE ISSUES FOR TEST/SE • Ao. A Results – ATD Underway – ORD Input • Gun/Munition – Experiments • Targeting Performance Specification – Pointing Accuracy Needs/Wants • C&TD Exit Criteria Unknown 30 August 2003 9

SYSTEMS ENGINEERING FLOW Doc/Equip Program Initiation/Concept and Technology Demonstration ATD Munitions Experiments Ao. A Live Fire I ORD Ground Platform Tests Test SSO Acquisition Strategy Government – Gun & Munition System Development and Demonstration Dispersion Demo Key: Dev Phase CTD Exit Criteria Initial Flight (DT-IIA) Contractor – Targeting Development Integration CT/DT-IIB/C TECHEVAL SD&D Exit Criteria Live Fire T&E Production and Deployment OPEVAL Italics for tests not yet conducted 30 August 2003 P 3 I – Contractor Implementation FOT&E 10

ADVANCED TECHNOLOGY DEMONSTRATION AH-1 W Cobra Aircraft MMI Display RAMICS Munition Mk 6 Mine 30 August 2003 11

MUNITION TESTS • 20/25/30 mm used • Various nose diameters and shoulder heights/roll offs • With and without reactive payload • Successes with 25 mm and 30 mm • Munition size drives gun and visa versa • Trade study needed for determination of significant difference 30 August 2003 12

AOA SUMMARY 30 August 2003 13

GUN/MUNITION TRADE STUDY 25 mm vs. 30 mm • Constructed a Decision Analysis Worksheet described in the Defense Systems Management College (DSMC) System Engineering Management Guide, 1983, Chapter 8 - “Trade Studies. ” – Provides a disciplined, objective approach to decision making. – Applicable in situations where all candidates meet minimum performance requirements. – Allows performance parameters to be weighted, scored individually. 30 August 2003 14

TRADE STUDY RESULTS Parameter Weight Factor Effective (sink/deflagrate) Critical 25 mm G 1 R 2 30 mm NOTES: 125 mm can sink a mine at the threshold neutralization depth. If sinking is an acceptable neutralization method, then it minimally meets the performance requirement. 225 mm cannot deflagrate a mine at the threshold neutralization depth. If a mine must deflagrate in order to be considered neutralized, then the 25 mm does not meet the minimum performance requirement. LB Integratable Extremely Important G G Executable Considerabl y Important G G Operationally Available Considerabl y Important G G Safe Considerabl y Important G G Supportable Considerabl y Important G LB 25 mm Weight-Score = 152 30 mm Weight-Score = 168 Difference = 10. 3% LEGEND B LB G O R Exceeds the requirement Somewhat exceeds the requirement (objective) Meets the requirement (threshold) Almost meets the requirement Does not meet the requirement A difference in weight-scores of at least 10% indicates that there is a meaningful distinction between candidates, according to the DSMC SE Management Guide. 30 August 2003 15

CTD PHASE EXIT CRITERIA ASN RDA Acquisition Decision Memorandum 15 Mar 01 established the following C&TD Phase Exit Criteria : 1. Receive Safe Standoff certification from NAVAIR (Code 4. 1). 2. Determine projectile mine neutralization capability beyond 40 ft depth. 3. Develop a reduced-recoil gun/turret design that is acceptable for MH-60 S integration (based upon airframe fatigue and deformation, dynamic component wear, cost, crash load constraints and other issues as required) and document PMA 299/PMS 210 concurrence. Test and Evaluation Exit criteria completed by testing: • Safe standoff completed - Jul 02 • Projectile lethality completed - Oct 01 • Reduced recoil conducted - Apr 02 30 August 2003 16

Safe Standoff Tests • • Worst Case Threat Ensure Detonation Collect Shrapnel Data Use Safe Escape Modeling to determine distance for acceptable risk Distance impacts pointing resolution and accuracy! 30 August 2003 17

CRITERIA #1: SAFE STANDOFF • Completed - NAVAIR 4. 1 certification signed on 7 May 02 • Results : SSO Distances: Shallow mines 1500’ Deep mines 700’ 30 August 2003 18

NEUTRALIZATION CAPABILITY • • Conducted at West Freugh, Scotland Production Representative Munition Live and Inert MK 17 Sea Mines Simulated Mission Representative Sea Conditions • Live Fire Test and Evaluation Phase I Tests 30 August 2003 19

WEST FREUGH TESTS 30 August 2003 20

CRITERIA #2: MINE NEUTRALIZATION CAPABILITY BEYOND 40 FT DEPTH • • 30 August 2003 Completed - Documented in CSS ltr dated 12 Mar 2002 Results – 0 - 40 ft Deflagration – 40 - 150 ft Rapid sinking (less than 4 min. ) – 150 - 200 ft Slow sinking 21

REDUCED RECOIL DESIGN • Of the many issues for aircraft integration, at this point RAMICS development, recoil was biggest concern. • Vendor (Boeing/ATK) must demonstrate recoils consistently under 4000# using training/practice rounds. TP rounds have higher recoil than AP. Objective recoil load is 3000#. 30 August 2003 22

CRITERIA #3: REDUCED RECOIL GUN/TURRET DESIGN Completed – PMS-210/PMA-299 concurrence signed on 9 May 02 Results Achieved recoil reduction below 4000 lbs for armor piercing and Target Practice rounds 30 August 2003 23

C&TD SYNOPSIS • ATD program provided Ao. A and ORD inputs/program justification • Munitions experiments/tests fed trade study to determine if significant difference between 25 mm and 30 mm. Munition size drove gun decision. • SSO test results provided limits for targeting specification and exit criteria • Live Fire Phase I results provided exit criterion and verified analysis/reduced program risk. • SD&D Exit Criteria set at C&TD completion 30 August 2003 24

SD&D PHASE EXIT CRITERIA ASN RDA Acquisition Decision Memorandum 29 Jul 02 established the following SD&D Phase Exit Criteria : 1. 2. Meet ORD threshold for reacquisition and neutralization. 3. Complete a Production Readiness Review. 4. Demonstrate that the total program production goals can be achieved within cost projections of the APB. 5. 30 August 2003 Complete Developmental Testing and provide a summary of concurrent test results completed with Commander, Operational Test and Evaluation Force. Define and demonstrate all MH-60 S interfaces. 25

KEY SD&D TESTS • • Dispersion Demo Ground Platform DT-IIA, Initial Flight Tests DT-IIB/CT/DT-IIC, Contractor Tests and prep for TECHEVAL • TECHEVAL Tests in italics have yet to be performed. 30 August 2003 26

SYSTEMS ENGINEERING FLOW Doc/Equip Program Initiation/Concept and Technology Demonstration ATD Munitions Experiments Ao. A Live Fire I ORD Ground Platform Tests Test SSO Acquisition Strategy Government – Gun & Munition System Development and Demonstration Dispersion Demo Key: Dev Phase CTD Exit Criteria Initial Flight (DT-IIA) Contractor – Targeting Development Integration CT/DT-IIB/C TECHEVAL SD&D Exit Criteria Live Fire T&E Production and Deployment OPEVAL Italics for tests not yet conducted 30 August 2003 P 3 I – Contractor Implementation FOT&E 27

RAMICS SD&D DESIGN CONCEPT LH CSTRS (ALMDS COMMON) Sensor Pod Gun Camera, Boresight Laser Assy. Cradle Assembly Standard Mk 44 Gun Control Unit Gun Turret Assembly Gun Power Supply 30 August 2003 Turret Control Unit Ammunition Can 28

Dispersion Demonstration • Conducted by Raufoss (MK 258 manufacturer) at Snillfjord, Norway. MK 258 Mod 1 cartridges were used against a test plate. • Water depths up to 75 feet with in air travel of approximately 300 feet. Gun alignment was slightly modified between series of shots (7 in a series) to get grouping data. Single shots only. • Quick look results indicate dispersion very tight at depth. Final report in review at CSS. 30 August 2003 29

DISPERSION DEMONSTRATION Gun’s eye view of target plate. Two groupings shown. Each grouping fits within approximately 6” circle Target plate is 1 meter square 30 August 2003 30

GROUND PLATFORM TESTS • Conducted at Eglin AFB with DT-IIA Flight Configuration Hardware (gun and munition) • Collected data at various azimuth/depression angles • Data used to predict aircraft AND targeting pod effects of recoil 30 August 2003 31

GROUND PLATFORM TESTS Right – Front view of test setup Left – Side view of equipment tested. This is the DT-IIA equipment to be flown 30 August 2003 32

SYSTEMS ENGINEERING FLOW Doc/Equip Program Initiation/Concept and Technology Demonstration ATD Munitions Experiments Ao. A Live Fire I ORD Ground Platform Tests Test SSO Acquisition Strategy Government – Gun & Munition System Development and Demonstration Dispersion Demo Key: Dev Phase CTD Exit Criteria Initial Flight (DT-IIA) Contractor – Targeting Development Integration CT/DT-IIB/C TECHEVAL SD&D Exit Criteria Live Fire T&E Production and Deployment OPEVAL Italics for tests not yet conducted 30 August 2003 P 3 I – Contractor Implementation FOT&E 33

FUTURE TESTING • DT-IIA – In-flight data used for more accurate estimate of production configuration responses • CT/DT-IIB/DT-IIC – Tests at increasingly system maturity levels • TECHEVAL/LFT&E – Production Representative configurations, data for P 3 I efforts • OPEVAL/FOT&E – Final check, data used for P 3 I efforts 30 August 2003 34

DT-IIA Configuration RAMICS gun subsystem prototype installed on an MH-60 S helicopter. Note the final design has the gun installed on the starboard side of the aircraft. 30 August 2003 35

CONCLUSION • By introducing T&E at beginning of the Systems Engineering process, several real benefits were realized: – – – Kept/Keeps Risk Manageable Saved Time (e. g. , splitting responsibilities) Avoided Costs (e. g. , munition development) Early Documentation Keeps Team Focused on Finish Line • Key was complete buy-in and participation by engineering and test experts – borderless team. Especially challenging given wide geographic area and diverse community (Sea and Air sides) 30 August 2003 36

Questions? 30 August 2003 37