Dependable Technologies Verification Validation De FINE Ana CAVALLI

Dependable Technologies Verification & Validation (De. FINE) Ana CAVALLI INT- Evry France De. FINE - PISA 2002 -

MOTIVATION • Why verification and validation are crucial dependable technologies ? • Dependability has as main objectives: availability, reliability, survivability, safety, security. . . – To achieve these objectives it is necessary to use methods for • System design • Verification • Validation (testing) De. FINE - PISA 2002 - 1

VERIFICATION & VALIDATION • What is verification? – Verification: To check that the system specification is correct and does not contain errors • What is validation? – Validation (testing): To check that the system implementation possesses the expected properties and does not contains errors (also to check interoperability with other implementations or other components) De. FINE - PISA 2002 - 2

VERIFICATION • • • Based on – formal specifications – static analysis techniques – model checking To verify – global properties – component properties To detect – design errors – deadlocks, livelocks De. FINE - PISA 2002 - 3

VALIDATION (testing) • • • Based on – formal specifications – active testing techniques (test generation, test selection, test execution) – passive (monitoring) testing techniques – definition of new architectures (for instance to test embedded systems) – fault models definition (to help define coverage and to detect errors) – coverage measures To perform – component testing – integration testing – interoperability testing – load testing – robustness testing To detect – functional errors – structural errors – transmission errors De. FINE - PISA 2002 - 4

HUMAN FACTOR IN SOFTWARE DESIGN • Combining both verification and validation techniques to be applied on system human interaction – to anticipate user behaviour (automation surprises, particularly in critical situations) – to specify stress environments – to produce scenarios that may identify potential automation surprises De. FINE - PISA 2002 - 5

GOALS • Adaptation of these techniques to dependable embedded systems. For instance, to be applied to: – fault tolerant architectures – cryptography, security protocols – real time constraints • Use of software tools – for the application to real systems – to assure scalability of methods • Integration in platforms to cover verification and validation (testing) of dependable systems De. FINE - PISA 2002 - 6

APPLICATION DOMAINS 1. Telecommunication systems 1. Cellular and wireless networks 2. Communication protocols 2. Ad-hoc services and networks 1. Rescue, emergency, military, . . . 3. Embedded systems 1. Transportation systems (air and ground) 2. Smart highways, automatic driving devices 3. Devices for helping handicapped persons De. FINE - PISA 2002 - 7

WORKING GROUPS • WG 1: Verification and validation methodologies for dependable embedded systems • WG 2: New validation architectures for dependable embedded systems • • • WG 3: Monitoring dependability measures WG 5: Formal aspects of user behaviour in safety critical environments. WG 6: Platforms for verification and validation of dependable industrial applications (cellular and wireless networks, ground air transportation). De. FINE - PISA 2002 - 8

CROSS ACTIONS · Roadmap for verification · · and validation of dependable embedded systems: A strategy for research and development Education and training: Creation of Pan-European masters as well as a common Doctoral program Elaborate best practices Participation in the definition of standards: ETSI, ISO, ITU-T, OMG, IETF, etc. Promotion of common activities with enterprises: IP projects, national projects De. FINE - PISA 2002 - 9

PARTNERS • Main partners: – GET-INT (Institut National des Télécom. ) - Ana Cavalli – University of Bordeaux I - CNRS-LABRI - Richard Castanet – University of Nijmegen - Jan Tretmans • Main associated non European partner – University of Québec at Montréal - Abdel Obaid De. FINE - PISA 2002 - 10

ASSOCIATED PARTNERS • Academic institutions: – – – – University of Evry - CNRS-LAMI. Pascale Legall Univ. J. Fourier, INPG Grenoble - CNRS-LSR/IMAG. Farid Ouabdesselam LAAS-ENSICA – Toulouse. Pierre de Saqui-Sannes ETSI - Anthony Wiles Brandenburg University of Technology, Cottbus. Hartmut König GMD FOKUS Fraunhofer Gesellschaft, Berlin. Ina Schieferdecker Humboldt University Berlin and Fraunhofer FIRST. Holger Schlingloff University of Goettingen - Dieter Hogrefe, University of Bremen. Jan Bredereke University of Stirling. Ken Turner CNR-IEI, Pisa. Antonia Bertolino, Universidad Carlos III, Madrid. Carlos Delgado Kloos Universidad Complutense de Madrid. Manuel Núñez – Tomsk University. Nina Yetvushenko De. FINE - PISA 2002 - 11

ASSOCIATED PARTNERS • Industrial partners: – – – – Siemens. Andreas Ulrich Airbus Deutschland, Hamburg. Hans-Joachim Tews Verified Systems International Gmb. H. Jan Peleska Testing Technologies IST Gmb. H. Theofanis Vassiliou-Gioles Praxis Critical Systems. Keith Harrison Ericsson Lab Italy-Rome. Emilia Peciola Teleca France. Edgardo Montes de Oca Ericsson Hungary Ltd. Conformance Lab. Sarolta Dibuz Fiat Research Center (CRF). Guido Scarafiotti Inquas Srl. Daniele Pes Telefonica I+D. Pedro Lizcano NOKIA. Colin Willcock POLKOMTEL. Joanna Lecornu Israel Aircraft Industries (IAI). Avner Engel De. FINE - PISA 2002 - 12