Challenges in IMS Testing Theofanis VassiliouGioles The IMS
- Slides: 17
Challenges in IMS Testing Theofanis Vassiliou-Gioles
The IMS World IMS Network Client UNIMi, Mj, Mk, Mg, Mm, Mr, Mw Cx, SDP Dx Mn P-CSCF UDP IP IP © Cx UDP/TCP Mw IP S-CSCF L 1 (GSM, PSTN) I-CSCF IP L 2 L 2 L 1 Legacy Networks MGW (IMS) Po. C XML HTTP / SIP SCTP UDP/TCP SCTP NNI Applications Gg Mw Diameter SIP H. 248 Foreign Domains Applications AS HSS Cx L 2 L 1 ISC Enabling Services Presence Mg Mn/ Ms MGCF Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 2
The IMS World Is A fundamental service platform for all IP related multimedia services Offers Services specified by different organizations (e. g. OMA) Provides Service interworking between different services Based On IETF protocols like SIP, HTTP, XCAP, MEGACO © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 4
Requirements on Testing Flexible support of Protocols Plethora of RFCs Variations of protocols (specializations for 3 G) Text-based / XML based / bit oriented Services API level access Hardware Cooperative existence of different test hardware In-Time Test infrastructure must be available when needed © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 5
Available Test Specifications SIP Forum Test Framework (SFTF) Adopted IETFs SIP torture tests 67 test cases in 8 groups Last update 12/04 Implementation in Perl sipp [. sourceforge. net] Initial input from HP using Open. Call Primarily designed for traffic generation Uses XML for the definition of call flows © ETSI SIP Test Suite Defined by several Specialist Task Forces 610 mainly compliance test cases Current version covers RFC 3261 Basis for RAN#5 IMS test specification Maintained and extended Standardized test specification in TTCN-3 Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 6
What is TTCN-3? TTCN: Testing and Test Control Notation Language to write detailed test specifications (latest version) Standardized by ETSI (ES 201 873 series) and ITU-T (Z. 140 series). Domains Mobile communications (GSM, 3 G, TETRA, Smart. Card) and wireless LANs (Wi. MAX) Middleware platforms (CORBA, CCM, EJB, Web. Services) Internet protocols (IPv 6, SIGTRAN, SIP) Automotive (MOST, CAN, Flex. Ray) © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 7
TTCN-3 Textual Format ASN. 1 Types & Values IDL Types © Graphical Format Other Formats testcase my. Testcase () runs on MTCType system TSIType msc mi_synch 1_conc 1 { mydefault : = activate (Otherwise. Fail); setverdict(pass); : mtc ISAP 1 connect(PTC_ISAP 1: CP_ISAP 1, mtc: CP_ISAP 1) : map(PTC_ISAP 1: ISAP 1, system: TSI_ISAP 1); : PTC_ISAP 1. start(func_PTC_ISAP 1()); PTC_MSAP 2. start(func_PTC_MSAP 2()); Synchronization(); all component. done; log(”Correct Termination”); TTCN-3 Metamodel XML Types Other Types & Values n Tabular Format } Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de MSAP 2
Aspects of TTCN-3 Tooling Test Automation TTCN-3 tools © TTCN-3 based solutions TTCN-3 community Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 9
Aspects of TTCN-3 Tooling Test Automation © Editing Closed-Box Standard Bodies TTCN-3 Implementing tools TTCN-3 Test Device based Support solutions TTCN-3 Users community Executing Test Suite Frameworks Educational Institutions Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 10
TTCN-3 Development Tools – The Foundation Editing Textual Test Automation Graphical Tabular Standard Editing Closed-Box Bodies Implementing Compilers / Interpreters TTCN-3 Standardized Implementation / TCI) Test Device Interfaces (TRITTCN-3 Implementing Users based Multiple Platform Support tools community ( Java / C++) solutions Test Automation Editing Closed-Box Standard Bodies Implementing TTCN-3 Tools Test Device Support Users Executing Test Suite Frameworks Educational Institutions Executing Testuser Suite Educational Interactive: Graphical interfaces Executing Institutions Fully automated: Frameworks Command line user interfaces Distributed: Distributed execution environments © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 11
TTworkbench – An Impression of TTCN-3 Tooling Developerspective for modification Result analyzer Test execution Test campaign designer (test automation) Test parametrization © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de Test report Online logging, filter, reporting 12
TTCN-3 Solutions – The Nuts and Bolts Closed-Box Solutions Ready-to-Run Optimized application – Conformance test scenario Test Automation Editing Closed-Box Standard Bodies Implementing Test Device Support Users Executing Test Suite Frameworks Educational Institutions Test Device Support Test scripting language Multiple interface support – User defined test scenarios Test Suite Frameworks Ready-to-Run Modifiable and extensible – Combining compliance and development tests © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 13
TTCN-3 Community – Resources and Users Standard Bodies ETSI/3 GPP: SIP, IPv 6, M 3 UA Wi. MAX: Wi. MAX Certification – Produce TTCN-3 test suites Test Automation Editing Closed-Box Standard Bodies Implementing Test Device Support Users Executing Test Suite Frameworks Educational Institutions Universities, Research Institutes European / National Research Projects – Free academic licenses available Users Different domains: Telco, Automotive, Embedded Systems Education tracks available – TTCN-3 User Conference © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 14
Gains from Using TTCN-3 Users of TTCN-3 report that productivity system quality test reuse are doubled System. Under. Test coverage is substantially increased Since testers can concentrate on the test logic (i. e. what to test), while the test execution is fully automated (i. e. how to test technically) © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 15
Conclusions As IMS integrates various technologies closed-box test solutions might be inappropriate Test solutions must have a solid standing in SIP Dedicated open-source solution exists TTCN-3 based test solution can reuse and extend test solutions Flexible platform Future proof investment © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 16
Thank You ! Questions ? © Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 17
Selected Web Resources Testing Technologies – www. testingtech. de ETSI – www. etsi. org/ptcc SIP Forum – www. sipforum. com SIP@IETF – www. ietf. org/html. charters/sip-charter. html – www. softarmor. com/sipwg/ © SIP Foundry – www. sipfoundry. org/sftf/index. html SIPp – sipp. sourceforge. net SIPstone – www. sipstone. org TTCN-3 User Conf. – www. ttcn-3. org Mailing List – ttcn 3@list. etsi. org Testing Technologies 2006 / All Rights Reserved / Confidential Information / www. testingtech. de 18
Software testing domains
Decision table testing in software testing
Du path testing
Decision table based testing in software testing
Neighborhood integration testing
Decision table testing in software testing
Positive testing vs negative testing
Testing blindness in software testing
Rigorous testing in software testing
What is testing
Domain test means
Pengertian blackbox testing
Cs 3250
Component testing is a black box testing
Control structure testing in software engineering
Logic based testing in software testing
Behavior testing adalah
What is globalization testing
