Design your System with ObjectProcess Methodology OPM the

Design your System with Object-Process Methodology – OPM the New ISO 19450 Dov Dori Massachusetts Institute of Technology Technion, Israel Institute of Technology SRI International Princeton, NJ July 20, 2015 Dov Dori © 2015

How was this talk initiated? What will it be about? l Correspondence and Skype with Dr. Maneesh Singh of SRI after getting invitation here l I asked for an example to be used in the talk l I received a specification of OSRVT: Video Moving Target Indication Capability (coming up) l I will first present Object-Process Methodology – OPM, the New ISO 19450 l Then we will model the system using OPM and discuss potential benefits Dov Dori © 2015 2

OSRVT: Video Moving Target Indication Capability Presented to SRI International November 10, 2014, SRI International

One System Remote Video Terminal System MTI 2014, SRI International 4

Objective Video Moving Target Indication* (VMTI) capability for OSRVT using platform data stream (e. g. , MPEG 2 TS) *A computational process of locating a moving object (or several ones) in a video frame. No ID reported. Note: Introduction of such a capability will have little or no impact on other OSRVT operations. 2014, SRI International 5

OSRVT VMTI System HMI CSCI (Front End) VMTI CSCI 2014, SRI International (Back End) 6

VMTI Module Input Imagery O S R Metadata V Enable/ T Disable Synchronized C on t r o l l e r Input Imagery I m a g e MTI Params Screened Imagery Q u a l i t y S T A B Screened Imagery F 2 F Alignment O v e r l a y D e t e c t Screened Imagery Overlay Mask F 2 F Alignment VMTI Imagery M T I Screens input frames for image defects Options Aligns consecutive frames for stabilized stream Direct method Feature based 2014, SRI International Detects image overlays, generates mask (per frame) F 2 F Alignment (to) (from) Generates MTI params from metadata MTI ROI’s O S R V T Detects moving targets outside of overlay mask in screened, stabilized imagery 7

Moving Target Indication Detection Video frames (stabilized) with moving targets + Laplacian Pyramid Generation Change/ Foreground Detection Verification Blob Extraction Blob Filtering Moving Target Indication Core Overlay mask imagery + MTI parameters Generates multi -resolution features (Laplacian) Detects pixelbased spatiotemporal changes, relative to stabilized “background, ” due to “foreground” features from a particular pyramid level (as specified by MTI parameters) Extracts “blobs” or connected foreground “change” pixels 2014, SRI International Filters “blobs” fulfilling motion consistency (temporal) check Video frames (original) with moving target indications (VMTI imagery) 8

MTI Core Details Adaptive Background Modeling Video frames (stabilized) with moving targets Laplacian Pyramid Generation Fn RFn Compute spatiotemporal image gradients + Foreground/Background Segmentation Compute Normal Flow values Threshold Normal Flow values Foreground Detection (optional) NFn Temporal Filtering for Consistent Pixels Normal Flow Based Change Detection MFn Overlay mask imagery + MTI parameters Connected Component Labeling Extract pixel groups using labels BFn Compute Optical Flow Check Motion Significance FFn Optical Flow Based Blob Filtering Blob Extraction Visual Odometry (Camera R, T) From Optical Flow Reverse flow warp Insp Blobs, Check Temporal Consistency De-rotate Optical Flow Field Compute Epipole And Enforce Epipolar Constraint on Blob Pixels Parallax Detection (optional) Update Blobs After Removing Pixels Failing Epipolar Constraint PFn Video frames (original) with moving target indications (VMTI imagery) Fn: Histogram equalized frame w/ stab params BFn: Fn+ Blobs of change pixels RFn: Laplacian of Fn+ Stabilized ref frame FFn: Fn + consistent blobs + Optical Flow Field NFn: Fn+ Binarized Fn of change pixels PFn: Fn + consistent blobs (following Parallax Detection) MFn: Fn+ Binarized Fn of consistent change pixels 9 2014, SRI International

What is Conceptual Modeling? l A systematic, formalized process of describing, specifying, designing or explaining ideas, systems, products or processes through a model. l Applicable to both l l Science – Studying what is known and what is missing to satisfy human thirst for knowledge, and l Engineering – Designing systems to benefit humans, based on sound scientific principles Science can be thought of as reverse engineering of nature Dov Dori © 2015 11

Why Conceptual Modeling? q Convert tacit, fragmented knowledge into explicit, integrative knowledge. q Construct concise models – mental pictures of q q natural systems [science] and q artificial systems [engineering] q while integrating structure and behaviour q at all detail levels. Communicate the model to stakeholders q through formal, unambiguous, actionable descriptions. Dov Dori © 2015 12

A conceptual modeling language that is l simple yet expressive, and l intuitive yet

Universal Ontology: a set of concepts for describing a domain (industry, banking, military, botany, healthcare…) and systems within it. Universal Ontology: a domain-independent set of concepts for describing systems in the universe, both natural and man-made. Dov Dori © 2015 16

Fundamental question 1: What is needed to describe the universe? Answer: Describing the universe

Question 2: What can these things “do”? Answer: Things can exist or happen. 10/30/2020

Question 3: What are things that exist in the world? Answer: Objects exist. They

Question 4: What are things that happen in the world? Answer: Processes happen. They

Question 5: How do objects and processes relate? Answer: Processes happen to objects. While

OPM Things: Objects and Processes Object: A thing that exists or might exist physically or informatically. Process: A thing that transforms one or more objects. 2006 -7 Prof. Dov © Dori © 2015 Dov Dori 22

Physical vs. Informatical Things Dov Dori © 2015 23

OPM’s only two building blocks: 1. Stateful Object 2. Process All the other elements

processes transform objects. Transform? What does that mean? Transforming means l creating an object

Transforming an object by a process can be done in three ways (1) Process

(2) Process creates the object Consumption Creation 2006 -7 Prof. Dov © Dori ©

processes affect objects. Affecting? What does that mean? l. A process affects an object

The third and last kind of object transformation: (3) Process affects object by changing

The three transformation kinds Consumption: Creation: • OPM uses a single type of diagram – Object-Process Diagram (OPD) State Change: • Graphic edit operations are translated on the fly to natural language – Object-Process Language (OPL) • Catering to dual channel processing Dov Dori © 2015 30

The graphics-text equivalence OPM principle Any model fact expressed graphically in an OPD is also expressed textually in the corresponding OPL paragraph. Caters to the dual channel cognitive assumption (Mayer, 2010) 2006 -7 Prof. Dov © Dori © 2015 Dov Dori 31

What are the two major aspects of any system? l Structure – the static aspect: what the system is made of. l Time-independent l Behavior – the dynamic aspect: how the system changes over time. l Time-dependent 10/30/2020 Dov Dori © 2015 32

What third aspect is specific to man-made systems? Function – the utilitarian, subjective aspect: l Why is the system built? l For whom is the system built? l Who benefits from operating the system? l 10/30/2020 Dov Dori © 2015 33

The Object-Process Theorem Stateful objects, processes, and relations among them constitute a necessary and

Complexity Management with OPM l Systems are inherently complex. l To alleviate this complexity, in OPM, it is managed by detail decomposition through three refinement-abstraction: l In-zooming – Out-zooming l Unfolding – Folding l State expression – suppression. 2006 -7 Prof. Dov © Dori © 2015 Dov Dori 46

In-zooming – Out-zooming Example Process Performance Controlling - a metamodel from ISO 19450 • All the OPDs, at any detail level, are self-similar. • They contain only stateful objects, processes, and relations. 2006 -7 Prof. Dov © Dori © 2015 Dov Dori 47

Back to OSRVT – Moving Target Indicator: What is the Function of this system? • Describe in three words, the last being a verb ending with ing (gerund) • This will be our starting point of the OPM model 2006 -7 Prof. Dov © Dori © 2015 Dov Dori

The Function: Moving Target Indicating 2006 -7 Prof. Dov © Dori © 2015 Dov

Who is the Beneficiary? Who benefits from operating the system? 2006 -7 Prof. Dov

What attribute of War Fighter changes value by operating the system, such that benefit

What are the system’s input and output? 2006 -7 Prof. Dov © Dori ©

What is the name of the system we are developing? 2006 -7 Prof. Dov

The next detail level: Zooming into the Moving Target Indicating Function 2006 -7 Prof.

The Auto-Generated OPL Text: 2006 -7 Prof. Dov © Dori © 2015 Dov Dori

Summary: OPM Aspect Unification The three system aspects: l Function (why the system is built), l Structure (static aspect: what is the system made of), and l Behavior (dynamic aspect: how the system changes over time) l Are expressed bi-modally, in graphics and equivalent text l In a single model Dov Dori © 2015 58

Value Proposition to SRI International l Model requirements together with the customer l Use this model as a basis for concept generation and their evaluation and selection of best one l Achieve shared understanding and agreement of multidisciplinary engineering team l Communicate the solution model with the customer l Use the model across all the system lifecycle: detailed design, integration, testing, deployment, maintenance, retirement… Dov Dori © 2015 59

OPM Resources: • Book: Object-Process Methodology - A Holistic Systems Paradigm, Springer Verlag, Berlin, Heidelberg, New York, 2002. • Website: Enterprise Systems Modeling Laboratory contains • journal & conference papers, • free OPCAT software, • presentations, • projects, and more. Dov Dori © 2015 60

Join the growing OPM community Here! https: //www. jiscmail. ac. uk/cgi-bin/webadmin? SUBED 1=OPM&A=1 Questions and (hopefully) Answers Contact: Dov Dori – dori@mit. edu 2006 -7 Prof. Dov © Dori © 2015 Dov Dori

Essence and Affiliation l Essence pertains to the thing’s nature: l l denotes whether the thing is physical or informatical. Affiliation pertains to the thing’s scope: l denotes whether the thing is systemic, i. e. part of the system, or environmental, i. e. part of the system’s environment The Essence. Affiliation attribute value combinations Dov Dori © 2015 62

Cyber-Physical Systems: Characteristics l l l Software-controlled physical systems Include physical and cybernetic components An agent – a human decision-maker or an information & decision-making system – is the cybernetic component Hardware (motors, actuators, VLSI chips…) is the physical component Physical processes signal and induce cybernetic events Cybernetic processes signal and induce physical events Dov Dori © 2015 63

Essence is key to modeling Cyber-Physical systems l l l Physical objects in the model represent what is really “out there” – actual states and values of objects Informatical objects represent information about their corresponding physical objects Only informatical objects are available to a decision making agent (human or artificial) Dov Dori © 2015 64

Cyber-Physical Gap A cyber-physical gap exists when the state of the informatical object incorrectly

The cyber-physical gap – a critical factor in modern systems design • It must be accounted for when designing systems, notably safetycritical ones • OPM is most suitable for modeling cyber-physical gaps • This is due to its notion of essence – physical vs. informatical things 2006 -7 Prof. Dov © Dori © 2015 Dov Dori

Cyber-physical gap example: Three-Mile Island Accident First cyber-physical gap – Incorrect instrument reading: PORV is (stuck) open, but due to the false PORV closed indication, the Crew determines PORV is closed! A critical conflict between reality and its cybernetic mirroring! 2006 -7 Prof. Dov Dori Dov © Dori © 2015 Full presentation in http: //www. csdm 2014. csdm. fr/-Program-. html#13

Appendix: Sys. ML and OPM – a brief comparison Feature Sys. ML OPM Theoretical foundation UML; Object-Oriented paradigm Minimal universal ontology; Object-Process Theorem 1670 (700 + 270) 130 (100 + 30) OMG (2006) ISO (2014) 9 1 yes no yes Standard documentation number of pages Standardization body Number of diagram kinds Graphic modality Textual modality Physical-informatical distinction Systemicenvironmental distinction Dov Dori © 2015 68