Using Bayesian Belief Networks in Assessing Software Architectures

  • Slides: 16
Download presentation
Using Bayesian Belief Networks in Assessing Software Architectures Jilles van Gurp & Jan Bosch

Using Bayesian Belief Networks in Assessing Software Architectures Jilles van Gurp & Jan Bosch 18 November 1999 SAABNet

Contents • Qualitative Knowledge in SD • SAABNet • Validation results 18 November 1999

Contents • Qualitative Knowledge in SD • SAABNet • Validation results 18 November 1999 SAABNet

Software Development no quantitative information early in the design process requirements spec. design implementation

Software Development no quantitative information early in the design process requirements spec. design implementation test deployment 18 November 1999 SAABNet greater role of metrics in assessment

But • Defect fixing becomes more expensive later in the development process • So

But • Defect fixing becomes more expensive later in the development process • So there is a need to do assessments early on • There is not enough quantitative information available to use existing techniques 18 November 1999 SAABNet

Qualitative Knowledge • Examples – expert knowledge – general statistical knowledge – design/architecture patterns

Qualitative Knowledge • Examples – expert knowledge – general statistical knowledge – design/architecture patterns • Informal • Badly documented 18 November 1999 SAABNet

How to use Qualitative Knowledge • Assign expert designers to team • Do peer

How to use Qualitative Knowledge • Assign expert designers to team • Do peer reviews of requirement specs. and designs • Try to document the knowledge • Use AI 18 November 1999 SAABNet

Bayesian Belief Networks • Model probabilistic distributions using information about dependencies between the variables

Bayesian Belief Networks • Model probabilistic distributions using information about dependencies between the variables • Are an excellent way to model uncertain causal relations between variables • SAABNet (Software Architecture Assessment Belief Network) 18 November 1999 SAABNet

SAABNet

SAABNet

Three types of variables • Architecture Attributes – programming language, inheritance • Quality Criteria

Three types of variables • Architecture Attributes – programming language, inheritance • Quality Criteria – complexity, coupling • Quality Factors – maintenance, performance 18 November 1999 SAABNet More abstract

Usage • Insert what you know • Let the BBN calculate probabilities for what

Usage • Insert what you know • Let the BBN calculate probabilities for what you don’t know 18 November 1999 SAABNet

Usage (2) The screenshots were taken from a tool called Hugin professional which is

Usage (2) The screenshots were taken from a tool called Hugin professional which is a modeling tool used for creating and testing BBNs. See www. hugin. com. 18 November 1999 SAABNet

Validation • An embedded system – Evaluation of existing architecture – Impact of suggested

Validation • An embedded system – Evaluation of existing architecture – Impact of suggested changes in the architecture • Epoc 32 – Evaluation of Design – Impact of QRs on Architecture 18 November 1999 SAABNet

Our findings • We can explain SAABNets output (i. e. it doesn’t produce non

Our findings • We can explain SAABNets output (i. e. it doesn’t produce non sense) • Given the limited input, the output is remarkably realistic 18 November 1999 SAABNet

Future work • Extend SAABNet to include more variables • Build a more friendly

Future work • Extend SAABNet to include more variables • Build a more friendly GUI around SAABNet • Do an experiment to verify whether a SAABNet based tool can help designers 18 November 1999 SAABNet

Conclusions • BBNs provide a way to reason with qualitative knowledge in SD •

Conclusions • BBNs provide a way to reason with qualitative knowledge in SD • Our validation shows that even with a small amount of variables the output can be useful • More validation is needed. 18 November 1999 SAABNet

Contact information Jilles van Gurp Jan Bosch http: //www. ipd. hk-r. se/jvg http: //www.

Contact information Jilles van Gurp Jan Bosch http: //www. ipd. hk-r. se/jvg http: //www. ipd. hk-r. se/jbo [email protected] hk-r. se [email protected] hk-r. se Högskolan Karlskrona/Ronneby Department of Software Engineering & Computer Science 18 November 1999 SAABNet

Bayesian Statistics and Belief Networks Overview Book ChBayesian Statistics and Belief Networks Overview Book Ch
Lecture on Bayesian Belief Networks Basics Patrycja GradowskaLecture on Bayesian Belief Networks Basics Patrycja Gradowska
Bayesian Statistics and Belief Networks Overview Book ChBayesian Statistics and Belief Networks Overview Book Ch
Probabilistic Belief States and Bayesian Networks Where weProbabilistic Belief States and Bayesian Networks Where we
Belief Nets Notes 6 CDS 1 Bayesian NetworksBelief Nets Notes 6 CDS 1 Bayesian Networks
Lecture on Bayesian Belief Networks Basics Patrycja GradowskaLecture on Bayesian Belief Networks Basics Patrycja Gradowska
Bayesian Neural Networks Bayesian statistics An example ofBayesian Neural Networks Bayesian statistics An example of
BAYESIAN NETWORKS Bayesian Network Motivation We want aBAYESIAN NETWORKS Bayesian Network Motivation We want a
Bayesian Theory and Bayesian networks 1 Probability AllBayesian Theory and Bayesian networks 1 Probability All
Modeling regulatory networks in cells using Bayesian networksModeling regulatory networks in cells using Bayesian networks
Belief Value Attitude Belief Feeling that something isBelief Value Attitude Belief Feeling that something is
Kepercayaan belief Sikap dan Perilaku Konsumen Kepercayaan beliefKepercayaan belief Sikap dan Perilaku Konsumen Kepercayaan belief
Belief in Destiny To explore the belief inBelief in Destiny To explore the belief in
HEALTH BELIEF MODEL Teori Kepercayaan Kesehatan HEALTH BELIEFHEALTH BELIEF MODEL Teori Kepercayaan Kesehatan HEALTH BELIEF
Belief Systems GOD GOD I Belief systems aBelief Systems GOD GOD I Belief systems a
Belief Systems POLYTHEISTIC BELIEF IN OR WORSHIP OFBelief Systems POLYTHEISTIC BELIEF IN OR WORSHIP OF
HEALTH BELIEF MODEL Teori Kepercayaan Kesehatan HEALTH BELIEFHEALTH BELIEF MODEL Teori Kepercayaan Kesehatan HEALTH BELIEF
Belief in the Angels To explore Belief inBelief in the Angels To explore Belief in
Belief in the Prophets Faith belief and moralityBelief in the Prophets Faith belief and morality
Bayesian Inference Using JASP EricJan Wagenmakers Outline BayesianBayesian Inference Using JASP EricJan Wagenmakers Outline Bayesian
Software Architectures for Morphing in Polymorphous Computing ArchitecturesSoftware Architectures for Morphing in Polymorphous Computing Architectures
Reasons for prior belief in Bayesian epistemology ChristianReasons for prior belief in Bayesian epistemology Christian
Adaptation I Ideal observers Bayesian belief update andAdaptation I Ideal observers Bayesian belief update and
Bayesian Network and Computational Algorithm of Belief PropagationBayesian Network and Computational Algorithm of Belief Propagation
Bayesian Belief Network Tiwari Lucknow Compiled By RajBayesian Belief Network Tiwari Lucknow Compiled By Raj
Learning Bayesian Networks for Cellular Networks BMICS 576Learning Bayesian Networks for Cellular Networks BMICS 576
Seeded Bayesian Networks Constructing Genetic Networks From MicroarraySeeded Bayesian Networks Constructing Genetic Networks From Microarray
Being Bayesian About Network Structure A Bayesian ApproachBeing Bayesian About Network Structure A Bayesian Approach
Bayesian Interval Mapping 1 Bayesian strategy 3 17Bayesian Interval Mapping 1 Bayesian strategy 3 17