Evolution of Open System Architectures in support of

Evolution of Open System Architectures in support of T&E for Naval Combat Systems Ted Mulder, Senior Systems Engineer Robert Mueller, Senior Test Engineer NAVSEA, Port Hueneme, Surface Warfare Center Division Detachment San Diego NDIA System Engineering Conference, October 20 -23, 2003

Introduction • NAVSEA PHD DSD Mission – Combat System Integration Testing (CSIT) – Battle Group Interoperability Testing (BGIT) – CEC West Coast Land Based Test Site (LBTS) • Naval Combat Systems – Past & Present – Review legacy systems when proprietary and MIL-STD ruled the day – Present current systems such as the CVN-76 SSDS MK 2 • T&E Tools – Hardware-In-The-Loop (HWIL) Simulation/Stimulation Systems – Data Collection and Analysis – Future initiatives • Benefits of Open System Architectures (OSA) – T&E Benefits – Tradeoffs

Our Mission • Land-based reliability testing, integration, and certification of surface ship combat systems and computer networks both prior to initial operation and for in-service systems; • Design, development, and life cycle maintenance of standardized simulation systems; • Land-based facilities and services for the analysis of performance of in-service combat systems, subsystems, and equipment for afloat units; • Provide engineering and technical support for test and development of command control systems Performs CSIT & BGIT for non-Aegis Surface Combatants

CSIT/BGIT in the Fleet Response Plan (FRP) Emergency Surge Ready NAVSEA PHD DSD CSIT BGIT CV/CVN Maintenance Basic IDTC Intermediate IDTC Advanced IDTC/ Sustain Deploy • TSTA • FEP • C 2 X/FBP • JTFEX • Blue Water Cert 3 – 4 months Maximum 6 months Supporting Emergency Surge Is The Focus

CSIT Description Integration Phase Low level subsystem tests designed to allow for rapid program fault isolation and correction. Demonstration Phase Higher level of Combat System Testing that demonstrates that the integration of the Combat System performs IAW governing specification. Program change is not as fluid as in the previous phase. • Interface Validation • Functional Operability • Multi Platform Interoperability Test • Single / Multiple Warfare • Functional Stress • Performance Test • Stress and Endurance

Definition of an Open System “A system that implements sufficient open standards for interfaces, services, and supporting formats to enable properly engineered components to be utilized across a wide range of systems with minimal changes, to interoperate with other components on local and remote systems, and to interact with users in a style that facilitates portability. An open system is characterized by the following: • well defined, widely used, preferably non-proprietary interfaces/protocols; • use of standards which are developed/adopted by recognized standards bodies or the commercial market place; • definition of all aspects of system interfaces to facilitate new or additional systems capabilities for a wide range of applications; and • explicit provision for expansion or upgrading through the incorporation of additional or higher performance elements with minimal impact on the system. ” (OS-JTF 1998)

CV-63 (ACDS BK 0) Test Bed (1996) C 2 P Link-16 TAC-3 UYK-43 1553 B SGS AC UYK-20 LK-11 ASWM 4. 2 LK-4 A UYK-43 AC A RADAR VIDEO SIM Link-4 A ASWM 4. 3 B Link-11 48 C JMCIS AUTOID TAC-3 SUN MOD 370 (RVS/VSS) NSSMS SATSIM 49 NSSMS ACDS DDC SATSIM UYK-43 SPS-48 C UYK-44 NCV SATSIM DDC SATSIM UYK-20 UYK-44 CVNS UYK-44 A SEAT MK-157/3 TAS MK-23 B UYK-44 TAS SATSIM UYK-20 LLS TPX-42 (V)13 SDCE UYK-44 SLQ-32(V)4 LLS UYK-19 RBOC SIM CEESIM Combat System Simulation (CSS) Shipboard Simulation MIL-STD/Closed Analog NTDS Serial COTS/non-OSA UYK-43 NTDS Parallel Network OSA

CVN-76 (SSDS MK 2) Test Bed SPS-49 A SPQ-9 B DDS ATM SPQ-9 B LAU BH 1 (VME & SUN WKS) SPS-48(V)10 LAU IC 1 CEP WASP ASTABS TACTICAL USG 2 DOCTRINE (VME) (RADDS & SPQ-14) MIL-STD-751 B Radar Video SIM (2) SPS-73 ASDS NAV LAN SPS-67 (Telemechanics RVS) SPS-73 SPS-67 NAV LAN DDS CTA NTDS-E MK-2 TACTICAL Mod 1 DOCTRINE NTDS-A GCCS-M LAN (UYK 44 OSM) SLQ-32 A (V)4 R 17 (UYK-19) NAV LAN Digital Computer L-4 A J-Box L-11 STD Wind BFTT STOW DWMIS Wy BEWT GCCS-M (3. 1. 2. 1 p 1) Passive Link Tap RS-232 KCMX SPN-43 C IFF SIM (RVS) STD NAV & WIND NAV IOC NAVSSI (BLK 4) NAVSIM (Partial ICAN) GPS SIM Satellite RF IDS-010 WSN-7 / Jul 97 Rev B (OD 0 + OD 1) EMULATORS (2 Pentium PC) BAND 2/3 (MK-162) TPX-42(V)14 RAM BLK 1 CEESIM (Ver. 3. 1) (Ver 5. 1. 0. 0) Wha Eio, Zdo & Cqo (Ver 6. 8) SDC EMULATOR CDLMS SGS /AC CV-TSC 2 LIP, 4 TIP Cqo, Eio, Wy, Wha L 4 LLS USQ-118 L-16 RS-232 RNSSMS (VME) MLST-3 SSDS DDS BFTT STOW USIM BFTT STOW TSSS CEP BFTT CTA DIS Display LAN DIS 49 WSN-7 RLGN (CTC, POS, DEL) 48 OTH GOLD (RVS) IOC UPX-29 FC 4 IFF SIM COMMON SCENARIO CONTROL ENVIRONMENT (CSCE) Shipboard Integrated Sim MIL-STD/Closed Standalone Sim BFTT Ver. 3. 1 COTS/non-OSA Analog Network NTDS Digital OSA

Test Tools (Data Collection & Analysis) Logic Analyzer LAN Analyzer MILSTD 1397 Parallel Ethernet / FDDI MILSTD 1397 Low Level Serial MILSTD 1553 Serial C&C Sensor GEM {VME, UNIX, POSIX 1003. 1 b, NFS} Test Tool Network CSDR {Win. NT, NFS} DART {Linux, NFS} {IEEE 802. 3} The Tool {Linux, NFS}

Interface & Standards Evolution Combat Systems CV-63 UKY-44/43/20/19 SUN VME (IEEE 1014) TAC-3/4 PCI Q-70 UKY-19 PCM (IEEE 1386. 1) PC SCSI (ANSI) Ada 95 (ISO 8652) CMS-2 Y SUN OS HP-UX MIL-STD 1397 C++ (ISO 14882) Win. NT UNIX (POSIX 1, 2) Vx. Works (POSIX 1003. 1 b) CORBA (ISO 19500 -2) TCP (RFC 793, STD #7) UDP (RFC 768, STD #6) RS-232/422 (EIA/TIA) IP (RFC 791, STD #5) 43 RSS MIL-STD 1553 B Sim/Stim, T&E Tools CVN-76 Ethernet (IEEE 802. 3) FDDI (ANSI X 3 T 9. 5) MIL-STD 1553 B MIL-STD 1397 MIL-STD 751 B VME (IEEE 1014) UKY-44/43/20/19 PCI PC PCM HP-UX SCSI PC Win. NT SUN DEC DOS VAX DEC UML 43 RSS CMS-2 Y VAX C++ (ISO 14882) UNIX (POSIX 1, 2) Vx. Works (POSIX 1003. 1 b) DOS DIS (IEEE 1278) TCP (RFC 793, STD #7) MIL-STD 1553 B MIL-STD/Closed MIL-STD 1397 IP (RFC 791, STD #5) Ethernet (IEEE 802. 3) MIL-STD 1553 B MIL-STD 1397 RS-232 (EIA/TIA) COTS/non-OSA

LOW Market Acceptance WIDE Progression towards OSA Popular Proprietary Products ols o &E T T OPEN SYSTEMS s mb o aval C N em t Syst a Unique Designs, Optimized Performance PRIVATE Consensus Standards (No Products) Standards Base PUBLIC

Future Direction with OSA Middleware • • • Incorporate middleware in Sim/Stim and Test Tool environment Abstraction of interface and communication mechanisms from the hardware Leverage OODA paradigm (i. e. abstraction, reuse) Combat System TPX- 42 CEC ICAN SSDS SLQ-32 NAVSSI ACDS GCCS-M CV-TSC RNSSMS CDLMS SLQ-32 SATSIM CSCE RAM Emulators MLST 3 Middleware Sim/Stims CEP WASP Middleware T&E Networks Test Tools {CORBA, NDDS, Java RMI} Middleware DART The Tool CSDR GEM

Scalability Benefits New Requirements Solution (CPU or I/O max’ed out) (software, processing, additional I/O) (add equipment) UYK-43 Additional $750 K COTS OSA MIL-STD/Computers Current System VME Additional $15 K (VME chassis & SBC)

Interface Affordability MIL-STD Interfaces COTS OSA Interfaces Hub $5000 $200 NTDS VME card Ethernet PMC card $50

CSIT Benefits from using COTS OSA MIL-STD CSIT MIL-STD Interfaces Required each subcontractor to program and “re-invent” the required interface protocols, thus consuming test time to integrate and debug. Current CSIT with COTS OSA Reduction in MIL-STD interfaces allows more CSIT time for higher level functionality testing in the application layer.

OSA T&E Tradeoffs Pro Con • Leverage commercial technology • Reduce internal R&D costs • Reduced interface VV&A costs • Plug-In-Play Philosophy • Option of using multiple vendors • Industry upgrades & patches • Repair costs are less • Access to collective knowledge from public and industry sources • Accommodates rapid-prototyping • Allows user to focus on their domain knowledge and subject area • Controlled by industrial product cycle • Shorter life cycle • Reduce in-house R&D expertise • Reliant on vendors VV&A processes • Plug-In-Play is not what they say • Too many standards to maintain • Reliance on vendor schedule for upgrades and patches • Increased security risk – common knowledge of standards • Unable to negotiate repair costs

Summary • Evolutionary progression of Naval Combat Systems – Reduction of proprietary equipment and MIL-STDs – Increased usage of open systems and standards • Evolutionary progression of T&E Tools – HWIL Sim/Stim environments lockstep with the combat systems – Data Collection and Analysis will continue to utilize OSA – Incorporating OSA middleware products • OSA Benefits and Tradeoffs – Scalability and affordability – Increased reliability of interfaces allows CSIT test events to focus on the complexity of the application layer • Comments – “last nickels” – CSIT test approach will evolve to support tech refresh of OSAs – T&E support of future combat systems will require the use of OSAs – Adoption of OSAs will require more government participation in the standard working groups and conferences to ensure representation

“Jacta alea est” (the die is cast) COTS OSA is here to stay - there’s no turning back!

BACKUP SLIDES

CSIT & BGIT within the D-30 Process Design & Development DEP T&E and Certification D-18 Collaborative System Tests (CSTs) D-30 D-29 D-28 D-27 D-26 D-25 D-24 D-11 Platform CSIT/TSIT (Variable) D-22 D-19 D-18 D-4 BGSIT (Variable) D-10 Assess & Fix D-13 D-3 BF CCB Establish CCB Charter / Membership SPM / APM Define Initial Baseline Configuration Assess & Fix D-7 Shore BGIT (Variable) D-12 D-1 JIT Assess & Fix D-6 Assess & Fix D-9 D-7 D-6 D-5 D-4 D-3 D-2 D-1 D JIT FLTCINC Promulgate BF Composition Message BRB Promulgate Proposed Baseline Configuration D-2 CAPs&LIMs TCD COMPTUEX BGI CERT BRB Establish Deployment Baseline Configuration TYCOM Conduct Deployment Planning Review Conference BF CPG Quarterly BF Planning & Schedules Meetings SPM / APM / CSE Fighting Unit Final CSIT Readiness Review SEA 05 / SPAWAR 05 Battle Force Final BGIT Readiness Review SEA 05 Conduct Fighting Unit Fleet Delivery Readiness Review FLTCINC Conduct Battle Force BGSIT Readiness Review SPM / APM / CSE Conduct Fighting Unit ICRR BF CCB Promulgate Final Baseline Configuration SPM / APM Provide BF CCB With Post Availability Status Report SPM / APM / CSE Commence Shore-Site CSIT SEA 05 / SPAWAR 05 Commence Shore-Site BGIT SEA 05 / SPAWAR 05 Preliminary BFI Certification FLTCINC * CINCLANTFLT/CINCPACFLT Instruction 4720. 3 A of 27 April 00 Conduct Battle Force BGSIT