Module 9 Topics Binomial Distribution Poisson Distribution Exponential

Module 9 Topics • Binomial Distribution • Poisson Distribution • Exponential Distribution • Normal Distribution • Beta Distribution Modeling Uncertainty: THEORETICAL PROBABILITY MODELS 1

Introduction • Module 7: – basic probability – use in decision problems • Module 8: – subjective probability – modeling for decision analysis • Module 9: – theoretical distributions – application to decision analysis • Module 9 software tutorial 2

Theoretical Probability Models Learning Objectives • Refresh knowledge: – Binomial distribution – Poisson distribution – Exponential distribution – Normal distribution • Gain knowledge: – Beta distribution 3

Binomial Distribution (a discrete distribution) Model characteristics: • Dichotomous outcomes – Two possible outcomes – One outcome can occur • Constant probability of “success” • Independence 4

Binomial Distribution Mathematical model: • PB(R= r | n, p) = [n! / r! (n - r)!] pr(1 -p)n-r • B subscript = binomial probability • • R = binomial random variable r = number of successful outcomes n = number of events or trials p = probability of successful outcome • E (R) = m = np Var (R) = s 2 = np(1 - p) 5

Binomial Distribution Probability mass function notation: • f (x) = ( nx ) px qn-x • X = binomial random variable • x = number of successful outcomes • n = number of events or trials • p = probability of a successful outcome • q = 1 – p = probability of an unsuccessful outcome • E (X) = µ = np V (X) = σ2 = µq 6

Binomial Distribution Cumulative distribution function: • Probability of k or fewer “successful” outcomes k n • F (x ≤ k) = ∑ ( x ) px qn-x X=0 7

Binomial Distribution • Frequent application situations: – Quality control – Reliability – Survey sampling • Approximation by other models: – Poisson: p → 0 and n → ∞ – Normal: p ≤ 0. 5 and np > 5, OR p > 0. 5 and nq > 5 8

Binomial Distribution Example application: Items are manufactured in large lots, from each of which twenty units are selected at random. The lot is accepted if the sample contains three or fewer defectives. If the production process yields, on the average, ten percent defectives, what is the probability of lot acceptance? 9

Binomial Distribution Formulation: Determine the probability of three or fewer “successes” in 20 independent trials, each having 0. 1 probability of success. 3 20 F (x ≤ 3) = ∑ ( x ) (0. 1)x (0. 9)20 -x = 0. 867 X=0 10

Poisson Distribution (a discrete distribution) Model characteristics: • Time interval or spatial region • Probability of an event is small • Events are independent • Events take place at a constant rate 11

Poisson Distribution Mathematical model: • PP (X = k | m) = (e –m m k) / k ! • • • P subscript = Poisson probability X = Poisson random variable k = number of events that occur e = natural logs base, 2. 718… m = mean number of event occurrences • E (X) = µ = m Var (X) = σ2 = m 12

Poisson Distribution Probability mass function notation: • f (x) = (e – λ λ x ) / x ! • x = number of event occurrences • λ = mean number of event occurrences • e = natural logs base, 2. 718… • E (X) = µ = λ V (X) = σ2 = λ 13

Poisson Distribution Cumulative distribution function: • Probability of k or fewer occurrences within a temporal or spatial interval k • F (x ≤ k) = ∑ ( e – λ λ x ) / x ! X=0 14

Poisson Distribution • Frequent application situations: – Quality control – Reliability – Queuing – Physical properties • Approximation by another model: – Normal: λ > 5 15

Poisson Distribution Example application: The probability that a person will have a negative reaction to the injection of a certain serum is 0. 001. Determine the probability that two or more of 1, 000 people will have a negative reaction to the injection. 16

Poisson Distribution Formulation: Determine the probability that zero or one people will have a negative reaction when λ = np = 1, and take the complement. 1 1 – F (x ≤ 1) = 1 - ∑ e-11 x / x! = 0. 264 x= 0 17

Exponential Distribution (a continuous distribution) Model characteristics: • Time or distance between two outcome occurrences • Poisson model characteristics required • Uses Poisson mean ( m or λ ) 18

Exponential Distribution Mathematical model: • f E ( T = t | m ) = me-mt • • • E subscript = exponential probability T = exponential random variable t = interarrival period m = mean of Poisson distribution e = natural logs base, 2. 718. . • E (T) = μ = 1 / m Var (T) = σ2 = 1 / m 2 19

Exponential Distribution Probability density function notation: • f (x) = λ e -λx • x = length of interval between occurrences • λ = mean of Poisson distribution • e = natural logs base, 2. 718… • E (X) = μ = 1 / λ V (X) = σ2 = 1 / λ 2 20

Exponential Distribution Cumulative distribution function: • Probability that the interval between two occurrences is kof length k or less • F ( x ≤ k ) = ∫ 0 λ e – λ x d x = 1 – e – λ k 21

Exponential Distribution • Frequent application situations: – – Quality control Reliability Queuing Physical phenomena • Applicable when underlying process is Poisson 22

Exponential Distribution Example Application: The life of a certain brand of light bulb can be approximated by the exponential probability density function. If the mean life of the light bulb is 1, 000 hours, determine the probability that the bulb will last more than 1, 000 hours 23

Exponential Distribution Formulation: • Determine the probability that a light bulb will have a life of 1000 or fewer hours, when µ = 1000, and take the complement • µ = 1/λ = 1000 so λ = 1/1000 = 0. 001 • 1 – F(x ≤ 1000) = 1 - ∫ 0. 001 e- 0. 001 x dx 0 = 1 - {1 - e-0. 001(1000) } = 1 - {1 – e-1 } = 0. 368 1000 24

Normal (Gaussian) Distribution (a continuous distribution) Model characteristics: • “Bell–shaped” curve • Effective for measured phenomena • Effective for multiple sources of uncertainty • Two parameters, µ and σ 25

Normal Distribution Mathematical model: • fn ( y | µ, σ2 ) = (2πσ2)-1/2 exp [ -(y-µ)2 / 2σ2] • • • N subscript = normal probability y = value(s) of random variable Y π = 3. 14159… e = natural logs base 2. 718… µ = the distribution mean σ = the distribution standard deviation • E (Y) = µ Var (Y) = σ2 26

Normal Distribution Probability density function: • f (x) = (2πσ2)-1/2 exp [ -(x-µ)2 / 2σ2] - ∞<x<∞ ∞<µ<∞ σ>0 π, e are constants µ, σ are parameters • E (X) = µ Var (X) = σ2 27

Normal Distribution Cumulative distribution function: • Probability that a value of x or less will occur x • F (x) = (2πσ2)-1/2 ∫ exp [ -(v-µ)2 / 2σ2] dv -∞ • P (a < X ≤ b) = F (b) – Fb (a) = (2πσ2)-1/2∫a exp [ -(v-µ)2 / 2σ2] dv 28

Normal Distribution • Frequent application situations: – measured phenomena – measured results of multiple additive phenomena – approximation of other distributions – numerous inferential statistical methods 29

Normal Distribution Example application: The ages of employees at a company are normally distributed with a mean of 50 years and a standard deviation of 5 years. Determine the percentage of employees whose ages are likely to be between 50 and 52. 5 years. 30

Normal Distribution Formulation: • Determine the probability of age ≤ 50 years, and determine the probability of age ≤ 52. 5 years. Take the difference, and multiply the result by 100 to obtain the percentage. • Using the standard normal variate, Z = (x –μ) / σ, and cumulative distribution function probabilities from either tabled values or appropriate software, we obtain F(x ≤ 50) = F(Z ≤ 0) = 0. 5000 and F(x ≤ 52. 5) = F(Z ≤ 0. 5) = 0. 6915 • Then P(50 < x ≤ 52. 5) = 0. 6915 – 0. 5000 = 0. 1915 or 19. 15 % 31

Beta Distribution Model characteristics: • Variable bounded at both ends • Numerous distribution shapes • Events are independent • Models proportions 32

Beta Distribution Generalized beta probability density function: • f (x | λ 1, λ 2, ω1, ω2) = 1 Γ (λ 1+λ 2) _________ ω2 -ω1 Γ (λ 1) Γ (λ 2) ( ) ______ x – ω1 λ 1 -1 1 - _____ x – ω1 λ 2 -1 ω2 – ω1 where - ω1 ≤ x ≤ ω 2 - λ 1 , λ 2 , ≥ 0 - Γ(λ) = (λ – 1)! when λ Є I+, OR ∞ = ∫ xλ-1 e-x dx otherwise 0 33

Beta Distribution More frequently, set ω1 = 0 and ω2 =1 Γ (λ 1+ λ 2) • So f (x | λ 1, λ 2) = _____ xλ -1 (1 -x)λ -1 Γ (λ 1) Γ (λ 2) 1 2 Where 0 ≤ x ≤ 1 λ 1, λ 2 ≥ 0 Γ (λ) = (λ-1)! Where λ Є ∞ = ∫ 0 xλ-1 I+, OR e-x dx otherwise 34

Beta Distribution • When λ 1 and λ 2 are positive integers: • Probability density function (λ 1+ λ 2 – 1)! _______ f (x | λ 1, λ 2) = x λ -1 (1 – x)λ -1 1 2 (λ 1 – 1)! (λ 2 – 1)! where the random variable X = x and 0 ≤ x ≤ 1 35

Beta Distribution • Let n = λ 1 + λ 2 and r = λ 1 n-r-1 (n – 1)! • f β ( q | r, n ) = ________ q r-1 ( 1 – q ) • • • ( r – 1) ! ( n – r – 1) ! β subscript = beta probability Q = Beta random variable q = proportion value between 0 and 1 r = number of “successes” n = number of trials • E (Q) = µ = r / n Var (Q) = σ2 = r ( n – r) / [ n 2 ( n + 1) ] 36

Beta Distribution Cumulative distribution function: q _______ (n – 1)! • F (Q ≤ q | r, n) = ∫ υr-1 (1 – υ) dυ (r – 1)! (n – r – 1) 0 • Called Incomplete Beta Function – Equivalence to binomial cumulative distribution function • Values from tables or software 37

Beta Distribution • Frequent application situations: – – – Proportions or percentages Physical variables in restricted intervals Tolerances in quality control and reliability PERT networks (generalized form) Bayesian analysis (informative a priori) • Approximated by difference between two normal distributions when λ 1+ λ 2 ≥ ~ 30 38

Beta Distribution Example Application: • Suppose that the percentage of employees who submit medical benefits claims each year is a beta random variable. As the benefits coordinator for a small firm with 40 employees, you currently expect that about 30 percent will most likely submit claims this year. Determine the probability that more than 16 employees will submit claims. 39

Beta Distribution Formulation: • Determine the probability that 16 or fewer of 40 employees will submit claims, and take the complement. • μ = r/n = 0. 30 = r = (0. 30)(40) = 12 q = 16/40 = 0. 40 • From table values or software, Fβ (Q ≤ 0. 40 | 12, 40) = 0. 91 • Thus Pβ (Q > 0. 40) = 1 – 0. 91 = 0. 09 40

Summary • Theoretical distributions to model uncertainty • Five distributions: – – – Binomial Poisson Exponential Normal Beta • Each distribution: – – – Mathematical formulation Mean and variance Graphical representations Application situations Example problem 41