Скачать презентацию Conformance Testing of MOST based Applications Towards Effective Скачать презентацию Conformance Testing of MOST based Applications Towards Effective

026a5e1928f6015668163b3026b7c8b7.ppt

  • Количество слайдов: 16

Conformance Testing of MOST based Applications Towards Effective System Testing André Baresel, Michael Schmidt Conformance Testing of MOST based Applications Towards Effective System Testing André Baresel, Michael Schmidt - Daimler. Chrysler AG Contact: michael. a. [email protected] com

Overview on the Talk n Telematics Application: The System Architecture n Specifying Functional Behaviour Overview on the Talk n Telematics Application: The System Architecture n Specifying Functional Behaviour n Graphical Test Specification in Practice n Hardware in the Loop: Integration of Device Emulation n Using Graphical Logging: the importance of message tracing n Other Application Fields 2

Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application From Users Point Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application From Users Point of View n Audio (CD / Radio) n Telephone n Navigation n Video n Speech recognition n Short messaging (SMS) n User interface for body electronic 3

Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application Architecture of Telematics Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application Architecture of Telematics Application n Network of embedded devices n Bus system: MOST, CAN Most Bus n Applications implemented by many devices n Logical separation of behaviour into Function. Blocks 4

Application Spec Test Devel. Test Exec Logging Other Appl Specifying Functional Behaviour An Example Application Spec Test Devel. Test Exec Logging Other Appl Specifying Functional Behaviour An Example of one Telematics Application Show Tuning Info Audio Application Press Button, Devices interacting * Audio Gateway * Head Unit * Microphone * CD Changer Manage Audio Channels „Switch from Tape to CD“ Fade Volume n 15 messages in this use case n interactions with other events like mobile phone Start Playing CD Notify CD Position 5

Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & Execution Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & Execution n Specification-based tests 250+ complex MSCs n Each MSC describes a single scenario n Specific Test Data has to be selected n Parallelism described by textual documentation n Ideas for using State Charts textual 6

Application Spec Test Devel. Test Exec Logging Other Appl Graphical Test Specification In Practice Application Spec Test Devel. Test Exec Logging Other Appl Graphical Test Specification In Practice n Test Case Design on System Level n Components are Black Boxes n Data Encodings based on XML-Spec n Timing of Messages n Variation in Message Orderings Open Issue: “Different Ports for System Components” vs. “Modeling of parallel Components” 7

Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & Execution Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & Execution The Vision: Towards an Automated Test Environment MSC & State based Specifications Scripts Behavioral model Test execution Classification-Tree Method Systematic Definition of Test Data 8

Application Spec Test Devel. Test Exec Logging Other Appl Test System Hardware Environment n Application Spec Test Devel. Test Exec Logging Other Appl Test System Hardware Environment n SUT: Interplay of MOST devices n Test Hardware allows Stimulation n Capturing of communication between all devices 9

Application Spec Test Devel. Test Exec Logging Other Appl Test System MOST/CAN Message Encoder Application Spec Test Devel. Test Exec Logging Other Appl Test System MOST/CAN Message Encoder TTCN-3 Execution Environment Remote Test Runtime Interface MOST Interface virtual devices stimulate / simulate MOST Net. Services CAN Interface verify & simulate CAN Driver Optolyzer Interface verify MOST Optolyzer Control Or PCI Karte Optolyzer CAN Card Optolyzer Test Runtime Interface MOST/CAN Message Definition Hardware Interface to Access SUT TTCN Test Cases TTCN-3 Software Architecture 10

Application Spec Test Devel. Test Exec Logging Other Appl Hardware in the Loop Integration Application Spec Test Devel. Test Exec Logging Other Appl Hardware in the Loop Integration of Device Emulation n Test Scripts running with virtual & existing Devices n TRI Implementation detects whether or not a Device exists n Message Verification or Stimulation* is used MOST CAN Virtual Key voice Virtual CD Changer CAN bus 11

Application Spec Test Devel. Test Exec Logging Other Appl Using Graphical Logging The Importance Application Spec Test Devel. Test Exec Logging Other Appl Using Graphical Logging The Importance of Message Tracing Goal: Visualization of Message Passing for Analysis and Documentation n Telematics Testers work with Logs of different Sources, Filtering the important information is essential n Documentation and Error Reporting Solution: n Graphical Logger Prototype using Logger-Interface n Allows Navigation and Filtering 12

Application Spec Test Devel. Test Exec Logging Other Appl Conclusion n TTCN-3 has been Application Spec Test Devel. Test Exec Logging Other Appl Conclusion n TTCN-3 has been successfully used to test Telematic applications n First steps toward an efficient test development environment n The usage of GFN for specifying tests has been approved n The TRI allows us to create all scenarios of Hardware in a Loop (HIL) n It was easy to add new Hardware Interfaces n A prototype of a graphical logger has shown the advantages of the solution 13

Application Spec Test Devel. Test Exec Logging Other Appl Future Extensions… Using TTNC-3 to Application Spec Test Devel. Test Exec Logging Other Appl Future Extensions… Using TTNC-3 to Execute State Based Test Models n Wait for Events on Continue Signals n Describe Signal Generation Other Aspects n Integration with Test Management Tools n Roundtrip Testing: From Logging to Test Cases 14

Application Spec Test Devel. Test Exec Logging Other Application Fields for TTCN-3 In the Application Spec Test Devel. Test Exec Logging Other Application Fields for TTCN-3 In the Automotive Context Real Time Environments n motor controller (petrol & diesel engine) n electronic gear shifting, car body control (pneumatic shock absorption) n environmental electronics (e. g. window heating, air conditioning unit) Characterisation of Applications n many components interact n over different networks (most, can, bluetooth) n overlapping functionality n Real time constrains to be validated 15

Conformance Testing of MOST based Applications Towards Effective System Testing André Baresel, Michael Schmidt Conformance Testing of MOST based Applications Towards Effective System Testing André Baresel, Michael Schmidt - Daimler. Chrysler AG Contact: michael. a. [email protected] com 16