Conformance Testing of MOST based Applications Towards Effective System Testing

1. Conformance Testing of MOST based ApplicationsTowards Effective System Testing André Baresel, Michael Schmidt - DaimlerChrysler AG Contact: michael.a.schmidt@daimlerchrysler.com

2. Overview on the Talk • Telematics Application: The System Architecture • Specifying Functional Behaviour • Graphical Test Specification in Practice • Hardware in the Loop: Integration of Device Emulation • Using Graphical Logging: the importance of message tracing • Other Application Fields

3. Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application From Users Point of View • Audio (CD / Radio) • Telephone • Navigation • Video • Speech recognition • Short messaging (SMS) • User interface for body electronic

4. Application Spec Test Devel. Test Exec Logging Other Appl Telematics Application Architecture of Telematics Application • Network of embedded devices • Bus system: MOST, CAN Most Bus • Applications implemented by many devices • Logical separation of behaviour intoFunctionBlocks

5. Application Spec Test Devel. Test Exec Logging Other Appl Specifying Functional Behaviour An Example of one Telematics Application Show Tuning Info Press Button, Audio Application Devices interacting* Audio Gateway* Head Unit* Microphone* CD Changer „Switch from Tape to CD“ • 15 messages in this use case • interactions with other events like mobile phone Manage Audio Channels Fade Volume Start Playing CD Notify CD Position

6. Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & Execution • Specification-based tests250+ complex MSCs • Each MSC describes a single scenario • Specific Test Data has to be selected • Parallelism described by textual documentation • Ideas for using State Charts textual

7. Application Spec Test Devel. Test Exec Logging Other Appl Graphical Test SpecificationIn Practice • Test Case Design on System Level • Components are Black Boxes • Data Encodings based on XML-Spec • Timing of Messages • Variation in Message Orderings Open Issue:“Different Ports for System Components” vs. “Modeling of parallel Components”

8. Systematic Definition of Test Data Application Spec Test Devel. Test Exec Logging Other Appl Test Case Design & ExecutionThe Vision: Towards an Automated Test Environment MSC & State based Specifications Scripts Test execution Behavioral model Classification-Tree Method

9. Application Spec Test Devel. Test Exec Logging Other Appl Test System Hardware Environment • SUT: Interplay of MOST devices • Test Hardware allows Stimulation • Capturing of communication between all devices

10. TTCN Test Cases MOST/CAN Message Definition MOST/CAN Message Encoder TTCN-3 Execution Environment MOST Interface CAN Interface Optolyzer Interface virtual devices stimulate / simulate verify & simulate verify MOST NetServices MOST Optolyzer Control CAN Driver Or CAN Card PCI Karte Optolyzer Optolyzer Application Spec Test Devel. Test Exec Logging Other Appl Test SystemSoftware Architecture TTCN-3 Test Runtime Interface Remote Test Runtime Interface Hardware Interface to Access SUT

11. Virtual CD Changer voice Virtual Key CAN bus MOST CAN Application Spec Test Devel. Test Exec Logging Other Appl Hardware in the Loop Integration of Device Emulation • Test Scripts running with virtual & existing Devices • TRI Implementation detectswhether or not a Device exists • Message Verification or Stimulation* is used

12. Application Spec Test Devel. Test Exec Logging Other Appl Using Graphical Logging The Importance of Message Tracing Goal: Visualization of Message Passing for Analysis and Documentation • Telematics Testers work with Logs of different Sources, Filtering the important information is essential • Documentation andError Reporting Solution: • Graphical Logger Prototype using Logger-Interface • Allows Navigation andFiltering

13. Application Spec Test Devel. Test Exec Logging Other Appl Conclusion • TTCN-3 has been successfully used to test Telematic applications • First steps toward an efficient test development environment • The usage of GFN for specifying tests has been approved • The TRI allows us to create all scenarios of Hardware in a Loop (HIL) • It was easy to add new Hardware Interfaces • A prototype of a graphical logger has shown the advantages of the solution

14. Application Spec Test Devel. Test Exec Logging Other Appl Future Extensions… Using TTNC-3 to Execute State Based Test Models • Wait for Events on Continue Signals • Describe Signal Generation Other Aspects • Integration with Test Management Tools • Roundtrip Testing: From Logging to Test Cases

15. Application Spec Test Devel. Test Exec Logging Other Appl Other Application Fields for TTCN-3In the Automotive Context Real Time Environments • motor controller (petrol & diesel engine) • electronic gear shifting, car body control (pneumatic shock absorption) • environmental electronics (e.g. window heating, air conditioning unit) Characterisation of Applications • many components interact • over different networks (most, can, bluetooth) • overlapping functionality • Real time constrains to be validated

16. Conformance Testing of MOST based ApplicationsTowards Effective System Testing André Baresel, Michael Schmidt - DaimlerChrysler AG Contact: michael.a.schmidt@daimlerchrysler.com