Model Interchange Working Group MIWG Interchange Testing Roadmap

Model Interchange Working Group (MIWG) Interchange Testing Roadmap Draft January 16, 2012 http: //www. omgwiki. org/model-interchange Sanford Friedenthal MIWG Chair safriedenthal@gmail. com

Roadmap Goals • Extend interchange testing to address – additional functionality of UML and Sys. ML – additional profiles (Soa. ML and UPDM) – additional versions (UML 2. 4. 1, Sys. ML 1. 3) – operational testing (e. g. , industrial strength) – other testing (e. g. , diagram interchange) • Conduct in most efficient and timely manner 01 -16 -2012 2

Approach • Define what test cases are needed • Define release schedule that sequences the test cases • Agree on updated testing process – Create diagram from reference diagram, generate xmi export, transform to canonical XMI, and validate against reference canonical XMI – Vendors should also import both the reference canonical XMI and the reference non-canonical XMI file and recreate diagram and validate against the reference diagram • Unresolved as to whether vendors should import, one, the other or both. Need vendor input. • Do vendors want to commit to canonical XMI as the standard interchange format? • 01 -16 -2012 Execute test cases based on participant level of commitment 3

MIWG Roadmap • • Initial Test Suite (Test Cases 1 -16) Soa. ML Test Cases Additional UML 2. 3 Test Cases Additional Sys. ML 1. 2 Test Cases UPDM Test Cases UML 2. 4. 1/ Sys. ML 1. 3 / XMI 2. 4. 1 Test Cases Industrial Strength Test Cases 01 -16 -2012 4

Initial Test Suite December, 2011 UML 2. 3/ Sys. ML 1. 2 / XMI 2. 1 Test Case 1 - Basic Class Modeling Test Case 2 - Advanced Class Modeling Test Case 3 - Profile Definition and Application Test Case 4 – Simple Activity (including f. UML execution) Test Case 5 – Activity (including f. UML execution) Test Case 6 – Composite Structure Test Case 7 – State Machines Test Case 8 – Use Cases Test Case 9 – Interactions Test Case 10 – Sys. ML Blocks Test Case 11 – Sys. ML Requirements Test Case 12 – Sys. ML + UML Intermediate activities Test Case 13 – Instances Test Case 14 – Sys. ML Parametrics Test Case 15 – Advanced Activities Test Case 16 – Sys. ML Allocations Approximately 60% of UML and Sys. ML Coverage 01 -16 -2012 5

UML/Sys. ML Not Tested by Initial Test Suite UML Classes Unused Accept. Call. Action. Execution. Specification Action. Input. Pin Add. Variable. Value. Action Any. Receive. Event Artifact Broadcast. Signal. Action Central. Buffer. Node Classifier. Template. Parameter Clear. Structural. Feature. Action Clear. Variable. Action Collaboration. Use Combined. Fragment Communication. Path Component. Realization Connectable. Element. Template. Parameter Consider. Ignore. Fragment Continuation Create. Link. Object. Action Data. Store. Node Deployment. Specification 01 -16 -2012 Device Duration. Constraint Duration. Interval Duration. Observation Element. Import Execution. Environment Expression Function. Behavior Gate General. Ordering Information. Item Interaction. Constraint Interaction. Operand Interaction. Use Interval. Constraint Literal. Null Manifestation Node Occurrence. Specification Opaque. Action Operation. Template. Parameter. Set Part. Decomposition Protocol. Conformance Qualifier. Value Read. Is. Classified. Object. Action Read. Link. Object. End. Qualifier. Action Read. Variable. Action Reclassify. Object. Action Redefinable. Template. Signature Reduce. Action Remove. Structural. Feature. Value. Action Remove. Variable. Value. Action Reply. Action Send. Object. Action Send. Signal. Action Sequence. Node Start. Classifier. Behavior. Action Start. Object. Behavior. Action State. Invariant String. Expression Substitution Template. Binding Template. Parameter. Substitution Template. Signature Time. Constraint Time. Event Time. Expression Time. Interval Time. Observation Unmarshall. Action Value. Pin Variable Sys. ML Stereotypes Unused Allocate. Activity. Partitio n Conform Connector. Property Control. Operator Copy Discrete Distributed. Property No. Buffer Optional Overwrite Participant. Property Probability Problem Rate Test. Case Viewpoint 6

Follow-on Test Cases Soa. ML UML 2. 3/ Soa. ML 1. 0 / XMI 2. 1 Test Case 17 – Service Contracts – Service. Contract, Message. Type, Participant, Services. Architecture, Consumer/Provider, Attachment? Test Case B – Service Interfaces – Service. Interface, Message. Type, Participant, Services. Architecture, Service/Request, Service. Channel, Attachment? Test Case C – Multi-Party Service Contracts – Service. Contract, Message. Type, Participant, Service. Architecture, Agent? Test Case D – Capabilities - Capability, Service. Interface, Participant, Expose, Service Test Case E – Milestones – Milestone Test Case F – Categorization – Catalog, Category, Free. Form. Descriptor, Free. Form. Value, Category. Value, Categorization 01 -16 -2012 7

Follow-on Test Cases UML Additional Functionality UML 2. 3 / XMI 2. 1 Test Case A – Component Diagram Test Case B – Timing Diagram Test Case C – Interaction Overview Diagram Test Case D – Collaboration (integrate with Soa. ML? ? ) Test Case E – Deployment Diagram Test Case F – Information Flow 01 -16 -2012 8

Follow-on Test Cases Sys. ML Additional Functionality UML 2. 3/ Sys. ML 1. 2 / XMI 2. 1 Test Case A – Sys. ML View/Viewpoint – view, viewpoint, conform Test Case B – Sys. ML Requirements – test case, copy, problem Test Case C – Sys. ML Properties – distributed property, value property Test Case D – Sys. ML Internal Block Diagram-advanced – connector property, participant property Test Case E – Sys. ML Advanced Activities – Rate, Optional, Overwrite, No. Buffer, Discrete, Allocate. Activity. Partition, Control. Operator 01 -16 -2012 9

Follow-on Test Cases UPDM UML 2. 3/ Sys. ML 2. 2 / UPDM 2. 1/ XMI 2. 1 Initial Conditions – Ensure Existing Test Cases 1 -16 with UPDM Profile Applied Test Case A – Additional Functionality Test Case B – Additional Functionality …. Test Case M – Additional Functionality Test Case N – SAR Model 01 -16 -2012 10

Follow-on Test Cases UML / Sys. ML Version Updates UML 2. 4. 1 / Sys. ML 1. 3 / XMI 2. 4. 1 Test Case 1 – Class Diagram (start early and validate Validator 2. 4. 1) Test Case 2 -16 – Update previous test cases 2 -16 and rerun Test Case N – Backward compatibility test cases? Test Case N+1 – UML Interactions Test Case N+2 – Sys. ML Ports and Flows 01 -16 -2012 11

Follow-on Test Cases Industrial Strength Test Case UML 2. 3 / Sys. ML 1. 2 / XMI 2. 4. 1 Test Case A – Roundtrip Test Case B – Delta XMI Test Case C – Size and performance Test Case D - Federated model with remote references 01 -16 -2012 12

Industrial Strength Use Case for Model Interchange 01 -16 -2012 S. Friedenthal 11/12/11 13

Other Interchange Testing • Diagram Interchange starting 2013 ? 01 -16 -2012 14

NIST Validator Roadmap • • UML 2. 2 UML 2. 3 UML 2. 4. 1 Sys. ML 1. 2 Sys. ML 1. 3 Soa. ML 1 UPDM 2. 0 01 -16 -2012 15

MIWG Testing Process

Canonical XMI - Process 01 -16 -2012 17