International Symposium 24 June 27 June 2013 Philadelphia

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA INCOSE IS 2013 Usability Group Session #1 June 25, 2013 MBSE Usability David Lempia MBSE Workshop

Introductions International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Name • Company • Experience with Modeling Systems MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Agenda International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • What is usability? • What exemplars did we capture? • What libraries would you like? • Literature review • Paper Outline for Library Guideline & Usability Challenges • Authors? ? ? MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

From INCOSE IW 2011 International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Top 4 Hi-value use cases: – Assemble components and associated behaviors from a library of primitives to meet the mission need – Conduct a Design Review using MBSD Environment – Make assertions on current design – Define system architecture and conduct architectural analysis MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

What is Usability? International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • A key part of human-machine interface • According to Usability. gov: measures the quality of a user's experience when interacting with a product or system whether a Web site, a software application, mobile technology, or any user-operated device … combination of factors, including: – Ease of Learning – Efficiency of Use – Memorability – Error Frequency / Severity – Satisfaction MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

What is Usability? (2) International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • According to SEI, a usable program: – Increases individual user effectiveness § Expedites routine performance – Accelerates error-free portion of routine – Reduces impact of routine errors § Improves non-routine performance – Supports problem-solving – Facilitates Learning § Reduces impact of errors caused by lack of knowledge – Prevents mistakes – Accommodates mistakes – Reduces impact of system errors – Increases user confidence and comfort Copyright © 2012 by Sanford Friedenthal, All Rights Reserved. MBSE Workshop

Quantifying Usability (Web) International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Some methods elicit typical user mental models: – Card sorting – what categories to users naturally group ideas into? – Contextual interviews – how do your users typically attempt to solve problems? – Focus groups – what is common about your users and what is divergent? – Personas – what do you think about when describing your users? MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Quantifying Usability (Web) International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Tests reveal challenges: – Have users attempt to utilize the functionality of the software – Track time to complete, mistakes, and subjective experience of the user MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Tool Language Key Heuristics (Nielsen + Shneiderman) International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Strive for consistency (a big one for the language!) • Reduce short-term memory load • Recognition rather than recall • Help users recognize, diagnose, and recover from errors • Keep system status visible • Enable frequent users to use shortcuts • Design dialogs to yield closure • Match between system and real world • Permit easy reversal of actions MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Paper 1 International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Abstract. This paper summarizes the conclusions of the MBSE Usability Group for 2012. Five perspectives are offered with each perspective grounded by an exemplar from the authors’ practice using Model Based Systems Engineering Environments. These exemplars range from very detailed step-by-step descriptions with identification of fine-grained usability issues to system of systems simulations developed by geographically dispersed operations in a global company. Discussion of each exemplar within the Usability Group led to significant lessons learned for the team. This paper summarized the chief lessons learned during this process. Today, the process continues. In the words of Ron Lyells, “Usability is an emergent quality. ” MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Paper 1 International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • David Lempia - Identified basic library use cases – 12 Usability Challenges § Ex: It is hard to find, identify, and understand the usage of library elements in a model. • • Bjorn Cole – Specialized Domains Judy Che - Architecture George Sawyer – Library Templates Craig Schimmel & Ron Lyells – Architecture MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Scope: You Will Find Yourself Designing An Agile Complex So. S International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Components: Simulation Sets, Simulation Tools Integrity Management Component mix: A/C FMS Environment ATC A/C Pwr A/C ECS) Sim Control COTS Tools Data Capture Measures Simulation Modelers Component inventory: Engineering Functions System assembly: Simulation Integrators Infrastructure evolution: Industry Assoc Active Infrastructure Passive SIM Scenario 1 SIM Scenario 2 SIM Scenario 3 Application Protocols Object Model Templates Rules Standards: DIS IEEE 1278. 1, HLA IEEE 1516. 1 roughly… ‘ 90 s Interface Specifications ‘ 2000 s SIM API MBSE ‘ 10 s Workshop

What Do Non-Executable Libraries Offer? International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • “Best in Class Algorithms” – What does this mean in Sys. ML? – Rather than high-performance algorithms, models that are well-formed to support high-performance algorithms as data objects – Aids to making descriptive models descriptive § For users - where are the semantic zoom points? – E. g. , in propulsion: tanks at thrusters at all levels, maybe valves not until one or two levels of depth § How should the model elements lead the user? – In viewing? – In updating? – In composing? Copyright © 2012 by Sanford Friedenthal, All Rights Reserved. MBSE Workshop

Example – Customizing Magic. Draw to express library in domain view International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Vehicle Model Architecture International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • High-level modular structure for dynamic vehicle modeling • Key vehicle subsystems are represented as distinct elements • Subsystem connections specified through well-defined interfaces • Signals distributed to subsystems via defined bus structure • Structure & interface are fixed, model content is not MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Use Case • Build domain models – Plant and Controls for each subsystem – Create re-usable libraries of component models with varying levels of fidelity • Integrate appropriate components to build up vehicle system model based on a vehicle model architecture – based on desired analysis • Use Variant Management to configure model selection and auto-wire models together Electrical Plnt Engine Ctrl Plnt Transmission Ctrl Plnt Ctrl Driveline Plnt Chassis Ctrl Plnt Ctrl Lo Lo Lo Med Med Med High High High MBSE Workshop 28 -Nov-20

Possible Starting Points for Creating a New or Adapted Sys. ML System Model International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Blank model – No support beyond the tool capabilities – Relies entirely on model expertise • Problem example models – Good for explaining model concepts – Often not the best choice for a large, complex model development • Generic system model template – Can provide a generalized model usable in many different domains – Can provide significant infrastructure • Domain-specific module template – Advantages of the generic template plus additional domain infrastructure MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Inclusion of “Pro-Forma” Examples for Correct Usage of Model Elements and Diagrams International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA MBSE Workshop

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Takeaways from IW 2013 MBSE Workshop

Recommendations: The User Experience International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Understand libraries as a crucial corporate asset. • Make exemplars of correct usage available in templates to streamline training and work (Put the best at people’s fingertips. ) – – – Best Practices / Process examples Example models Generic Domain-Specific Best of class algorithms • Design the user experience. – – – Understand your users. (Most users will not be modeling geeks!) Keep it simple Support flow Make it “write once” for the modeler Create an immersive environment for users As if it was a multi-player game (Because it is!) MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Recommendations: Power Tools International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • For trade studies: – Support Model Variants – Support Parameter Sets • Representational Power – Support Rich Objects – Support Architecture & Design Patterns • Create an end user programming environment – Enhance modeling efficiency by supporting macros. – Bring power to programs with abstract binding capabilities. – Allow objects to tailor themselves when placed. MBSE – Make it as easy to use as a spreadsheet Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Recommendations: Implement Service Oriented Architecture Vehicle Model Architecture at Ford Motor Company • REAL Runtime Architecture at Honeywell Similarities suggest using a SOA Architecture – Separate the interface code from model code § Different roles for engineers who model vs. integrate environment § Different locations in library for models vs. integration code – Develop Standard Interface Protocols • Support: – Collaboration – Plug & Play, Sharing, Re-use – Mashups Copyright © 2012 by Sanford Friedenthal, All Rights Reserved. MBSE Workshop

Recommendations: Supporting Collaboration International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Immersive Multi-Modeler Environment – Shared awareness – Supporting spiral of meaning § Dialog about applying modeling during projects § Dialog about library objects – New insights into library components – Emerging architectural & design patterns § Dialog happens inside the modeling environment MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA INCOSE IS 2013 Usability Group Session #2 June 26, 2013 MBSE Usability David Lempia MBSE Workshop

Introductions International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Name • Company • Experience with Modeling Systems MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Brainstorm International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Identify a set of desired re-usable library objects If you could start your systems model with any library building blocks, what would you want? – Write 3 -5 ideas down on a sheet of paper – In turn, share 1 new idea with the group or pass MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Session 2 International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Wednesday – Review Literature (Reusable Asset Specification) – Create Library Guide Paper Outline – Identify Interested Authors – Assign a section of the paper MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Papers International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Reusable Asset Specification, OMG Available Specification, Version 2. 2, Nov 2005 • Evolution and Composition of Reusable Assets in Product-Line Architectures: A Case Study, Jan Bosch • Metamodeling for Requirements Reuse, Oscar Lopez • Building Reusable Testing Assets for a Product Line, John D. Mc. Gregor • A Model for Effective Asset Re-use in Software Projects, Abhay Joshi MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

RAS International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

A model for effective Asset Re-use in Software Projects International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Paper Outline International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • 1. 0 Introduction • 2. 0 What is a system library? – 2. 1 Meta Data Needed to Support Libraries § Solution – Interface (Limit external relationships to these elements) – Variants (Items that can change during usage) » Include another library element » Change a path » Change a variable – Common (Items that can not change during usage) § Dependencies to other library elements MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Paper Outline International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA – 2. 2 Meta Data Needed to Support Libraries (Continued) § § Dependencies to other library elements Classification of library element Usage (How/Where can I use this library? ) Change History – 2. 3 Industry Needs (example desired libraries) MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Paper Outline International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • 3. 0 Best Practices for Creating, Sharing and Using Libraries – – – Have a Suggestive Interface Exploit Metaphors Make Dependencies Explicit Build in Variation Apply Configuration Control Provide Affordances • 4. 0 Usability Challenges • 5. 0 Conclusion MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Systems Libraries to Share International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • • Filters (lo-pass, hi-pass), Logic (and, or) Computer resources (Intel Core 2 with 2 GB RAM) Interface (ARINC 429, MS 1553) Drag & Drop Pre-configure Subsystems, Environments filtered and sorted by abstraction • Catalog / pre-configured objects that can be composed into missions or scenarios • Rapid way of sketching objects, then refining until predefined elements can be placed into the sketch; transition from sketch to model. MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Systems Libraries to Share International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • • • Basic hierarchy with structure and behaviors All functions associated with SE life cycle Creational patterns A palette of objects with Visio-like graphic icons A framework or template or wizard to guide the process • A library catalog – an index that is searchable and browsable • Architecture patterns and templates • Gang of 4 patterns MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Systems Libraries to Share International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Complete standard unit library • Constraint blocks for converting the same parameters to different forms • Variable abstraction level for components • Versions and variants; parametric models or built-in variability (CVL? ) • Multi-view point domains MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

Task - How might this work? International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA – Teams of 2 -3 – Pick an example from the list or select a new example – Try to capture all of the information for a reuse library element. What would it look like? What Sys. ML elements would you use? Draw pictures, create tables, document usage. § Example, Lo-Pass Filter Solution – Interface – Signal in, Signal out, Reset – Variant – Time Constant » Include another library element - None » Change a path - None » Change a variable – Time Constant – Common » Activity Diagram – Etc. Copyright © 2012 by Sanford Friedenthal, All Rights Reserved. MBSE Workshop

Task – Paper Outline International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA • Who is interested in working on the paper? – Are you interested in a specific section? MBSE Workshop Copyright © 2012 by Sanford Friedenthal, All Rights Reserved.

International Symposium 24 June – 27 June 2013 Philadelphia, PA, USA Thank You for your Help MBSE Workshop