Statistics for Business and Economics 6 th Edition

Statistics for Business and Economics 6 th Edition Chapter 21 Statistical Decision Theory Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Chap 21 -1

Chapter Goals After completing this chapter, you should be able to: § Describe basic features of decision making § Construct a payoff table and an opportunity-loss table § Define and apply the expected monetary value criterion for decision making § Compute the value of sample information § Describe utility and attitudes toward risk Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 2

Steps in Decision Making § List Alternative Courses of Action § § List States of Nature § § Possible events or outcomes Determine ‘Payoffs’ § § Choices or actions Associate a Payoff with Each Event/Outcome combination Adopt Decision Criteria § Evaluate Criteria for Selecting the Best Course of Action Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 3

List Possible Actions or Events Two Methods of Listing Payoff Table Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Decision Tree 4

Payoff Table § Form of a payoff table § Mij is the payoff that corresponds to action ai and state of nature sj States of nature Actions s 1 s 2 . . . s. H a 1 a 2. . . a. K M 11 M 21. . . MK 1 M 12 M 22. . . MK 2 . . . M 1 H M 2 H. . . MKH Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 5

Payoff Table Example A payoff table shows actions (alternatives), states of nature, and payoffs Investment Choice (Action) Large factory Average factory Small factory Profit in $1, 000’s (States of nature) Strong Stable Weak Economy 200 90 40 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 50 120 30 -120 -30 20 6

Decision Tree Example Large factory Average factory Small factory Strong Economy 200 Stable Economy 50 Weak Economy -120 Strong Economy 90 Stable Economy 120 Weak Economy -30 Strong Economy 40 Stable Economy 30 Weak Economy 20 Payoffs Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 7

Decision Making Overview Decision Criteria No probabilities known Probabilities are known * Nonprobabilistic Decision Criteria: Decision rules that can be applied if the probabilities of uncertain events are not known § maximin criterion § minimax regret criterion Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 8

The Maximin Criterion § § § Consider K actions a 1, a 2, . . . , a. K and H possible states of nature s 1, s 2, . . . , s. H Let Mij denote the payoff corresponding to the ith action and jth state of nature For each action, find the smallest possible payoff and denote the minimum M 1* where More generally, the smallest possible payoff for action ai is given by Maximin criterion: select the action ai for which the corresponding Mi* is largest (that is, the action with the greatest minimum payoff) Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 9

Maximin Example The maximin criterion 1. For each option, find the minimum payoff Investment Choice (Alternatives) Large factory Average factory Small factory Profit in $1, 000’s (States of Nature) 1. Strong Economy Stable Economy Weak Economy Minimum Profit 200 90 40 50 120 30 -120 -30 20 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 10

Maximin Solution (continued) The maximin criterion 1. For each option, find the minimum payoff 2. Choose the option with the greatest minimum payoff Investment Choice (Alternatives) Large factory Average factory Small factory Profit in $1, 000’s (States of Nature) 1. Strong Economy Stable Economy Weak Economy Minimum Profit 200 90 40 50 120 30 -120 -30 20 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 2. Greatest minimum is to choose Small factory 11

Regret or Opportunity Loss § § § Suppose that a payoff table is arranged as a rectangular array, with rows corresponding to actions and columns to states of nature If each payoff in the table is subtracted from the largest payoff in its column. . . the resulting array is called a regret table, or opportunity loss table Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 12

Minimax Regret Criterion § § § Consider the regret table For each row (action), find the maximum regret Minimax regret criterion: Choose the action corresponding to the minimum of the maximum regrets (i. e. , the action that produces the smallest possible opportunity loss) Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 13

Opportunity Loss Example Opportunity loss (regret) is the difference between an actual payoff for a decision and the optimal payoff for that state of nature Investment Choice (Alternatives) Large factory Average factory Small factory Payoff Table Profit in $1, 000’s (States of Nature) Strong Economy Stable Economy Weak Economy 200 90 40 50 120 30 -120 -30 20 The choice “Average factory” has payoff 90 for “Strong Economy”. Given “Strong Economy”, the choice of “Large factory” would have given a payoff of 200, or 110 higher. Opportunity loss = 110 for this cell. Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 14

Opportunity Loss (continued) Investment Choice (Alternatives) Large factory Average factory Small factory Profit in $1, 000’s (States of Nature) Strong Economy Stable Economy Weak Economy 200 90 40 50 120 30 -120 -30 20 Opportunity Loss Table Investment Choice (Alternatives) Large factory Average factory Small factory Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Payoff Table Opportunity Loss in $1, 000’s (States of Nature) Strong Economy Stable Economy Weak Economy 0 110 160 70 0 90 140 50 0 15

Minimax Regret Example The minimax regret criterion: 1. For each alternative, find the maximum opportunity loss (or “regret”) Opportunity Loss Table Investment Choice (Alternatives) Large factory Average factory Small factory Opportunity Loss in $1, 000’s (States of Nature) Strong Economy Stable Economy Weak Economy 0 110 160 70 0 90 140 50 0 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 1. Maximum Op. Loss 140 110 16

Minimax Regret Example (continued) The minimax regret criterion: 1. For each alternative, find the maximum opportunity loss (or “regret”) 2. Choose the option with the smallest maximum loss Opportunity Loss Table Investment Choice (Alternatives) Large factory Average factory Small factory Opportunity Loss in $1, 000’s (States of Nature) Strong Economy Stable Economy Weak Economy 0 110 160 70 0 90 140 50 0 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 1. 2. Maximum Op. Loss Smallest maximum loss is to choose Average factory 140 110 160 17

Decision Making Overview Decision Criteria No probabilities known Probabilities are known * Probabilistic Decision Criteria: Consider the probabilities of uncertain events and select an alternative to maximize the expected payoff of minimize the expected loss § maximize expected monetary value Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 18

Payoff Table § Form of a payoff table with probabilities § Each state of nature sj has an associated probability Pi States of nature Actions s 1 (P 1) s 2 (P 2) . . . s. H (PH) a 1 a 2. . . a. K M 11 M 21. . . MK 1 M 12 M 22. . . MK 2 . . . M 1 H M 2 H. . . MKH Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 19

Expected Monetary Value (EMV) Criterion § Consider possible actions a 1, a 2, . . . , a. K and H states of nature Let Mij denote the payoff corresponding to the ith action and jth state and Pj the probability of occurrence of the jth state of nature with § The expected monetary value of action ai is § § The Expected Monetary Value Criterion: adopt the action with the largest expected monetary value Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 20

Expected Monetary Value Example § The expected monetary value is the weighted average payoff, given specified probabilities for each state of nature Profit in $1, 000’s (States of Nature) Investment Choice (Alternatives) Strong Economy (. 3) Stable Economy (. 5) Weak Economy (. 2) Large factory 200 50 -120 Average factory 90 120 -30 Small factory 40 30 20 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Suppose these probabilities have been assessed for these states of nature 21

Expected Monetary Value Solution (continued) Goal: Maximize expected monetary value Payoff Table: Profit in $1, 000’s (States of nature) Investment Choice (Action) Large factory Average factory Small factory Strong Economy (. 3) Stable Economy (. 5) Weak Economy (. 2) 200 90 40 50 120 30 -120 -30 20 Expected Values (EMV) 61 81 31 Maximize expected value by choosing Average factory Example: EMV (Average factory) = 90(. 3) + 120(. 5) + (-30)(. 2) = 81 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 22

Decision Tree Analysis § A Decision tree shows a decision problem, beginning with the initial decision and ending will all possible outcomes and payoffs Use a square to denote decision nodes Use a circle to denote uncertain events Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 23

Add Probabilities and Payoffs (continued) Large factory Strong Economy (. 3) 200 Stable Economy (. 5) 50 Weak Economy Average factory Small factory -120 Strong Economy (. 3) 90 Stable Economy (. 5) 120 Weak Economy Decision (. 2) -30 Strong Economy (. 3) 40 Stable Economy (. 5) 30 Weak Economy (. 2) 20 States of nature Probabilities Payoffs Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 24

Fold Back the Tree EMV=200(. 3)+50(. 5)+(-120)(. 2)=61 Large factory Strong Economy (. 3) 200 Stable Economy (. 5) 50 Weak Economy EMV=90(. 3)+120(. 5)+(-30)(. 2)=81 Average factory Small factory 90 Stable Economy (. 5) 120 (. 2) -30 Strong Economy (. 3) 40 Stable Economy (. 5) 30 Weak Economy Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. -120 Strong Economy (. 3) Weak Economy EMV=40(. 3)+30(. 5)+20(. 2)=31 (. 2) 20 25

Make the Decision EV=61 Large factory Strong Economy (. 3) 200 Stable Economy (. 5) 50 Weak Economy EV=81 Average factory Strong Economy (. 3) Stable Economy (. 5) Weak Economy EV=31 Small factory (. 2) -120 90 120 40 Stable Economy (. 5) 30 (. 2) Maximum EMV=81 -30 Strong Economy (. 3) Weak Economy Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. (. 2) 20 26

Bayes’ Theorem § § Let s 1, s 2, . . . , s. H be H mutually exclusive and collectively exhaustive events, corresponding to the H states of nature of a decision problem Let A be some other event. Denote the conditional probability that si will occur, given that A occurs, by P(si|A) , and the probability of A , given si , by P(A|si) Bayes’ Theorem states that the conditional probability of si, given A, can be expressed as In the terminology of this section, P(si) is the prior probability of si and is modified to the posterior probability, P(si|A), given the sample information that event A has occurred Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 27

Expected Value of Perfect Information, EVPI Perfect information corresponds to knowledge of which state of nature will arise § To determine the expected value of perfect information: § § § Determine which action will be chosen if only the prior probabilities P(s 1), P(s 2), . . . , P(s. H) are used For each possible state of nature, si, find the difference, Wi, between the payoff for the best choice of action, if it were known that state would arise, and the payoff for the action chosen if only prior probabilities are used This is the value of perfect information, when it is known that si will occur Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 28

Expected Value of Perfect Information, EVPI (continued) The expected value of perfect information (EVPI) is § § Another way to view the expected value of perfect information Expected Value of Perfect Information EVPI = Expected monetary value under certainty – expected monetary value of the best alternative Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 29

Expected Value Under Certainty § Expected value under certainty = expected value of the best decision, given perfect information Profit in $1, 000’s (Events) Investment Choice (Action) Strong Economy (. 3) Stable Economy (. 5) Weak Economy (. 2) 200 90 40 50 120 30 -120 -30 20 Value of best decision 200 for each event: 120 20 Large factory Average factory Small factory Example: Best decision given “Strong Economy” is “Large factory” Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 30

Expected Value Under Certainty (continued) Profit in $1, 000’s (Events) Investment Choice (Action) § Now weight these outcomes with their probabilities to find the expected value: Large factory Average factory Small factory Strong Economy (. 3) Stable Economy (. 5) Weak Economy (. 2) 200 90 40 50 120 30 -120 -30 20 200 120 20 200(. 3)+120(. 5)+20(. 2) = 124 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Expected value under certainty 31

Expected Value of Perfect Information (EVPI) EVPI = Expected profit under certainty – Expected monetary value of the best decision Recall: Expected profit under certainty = 124 EMV is maximized by choosing “Average factory”, where EMV = 81 so: EVPI = 124 – 81 = 43 (EVPI is the maximum you would be willing to spend to obtain perfect information) Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 32

Bayes’ Theorem Example Consider the choice of Stock A vs. Stock B Percent Return (Events) Stock Choice (Action) Strong Economy (. 7) Weak Economy (. 3) Stock A 30 -10 18. 0 Stock B 14 8 12. 2 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. Expected Return: Stock A has a higher EMV 33

Bayes’ Theorem Example (continued) Prior Probability § Permits revising old probabilities based on new information New Information Revised Probability Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 34

Bayes’ Theorem Example (continued) Additional Information: Economic forecast is strong economy § When the economy was strong, the forecaster was correct 90% of the time. § When the economy was weak, the forecaster was correct 70% of the time. F 1 = strong forecast F 2 = weak forecast E 1 = strong economy = 0. 70 Prior probabilities from stock choice example E 2 = weak economy = 0. 30 P(F 1 | E 1) = 0. 90 P(F 1 | E 2) = 0. 30 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 35

Bayes’ Theorem Example (continued) § Revised Probabilities (Bayes’ Theorem) Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 36

EMV with Revised Probabilities Pi Event Stock A xij. Pi Stock B xij. Pi . 875 strong 30 26. 25 14 12. 25 . 125 weak -10 -1. 25 8 1. 00 Σ = 25. 0 Revised probabilities Σ = 11. 25 EMV Stock B = 11. 25 EMV Stock A = 25. 0 Maximum EMV Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 37

Expected Value of Sample Information, EVSI Suppose there are K possible actions and H states of nature, s 1, s 2, . . . , s. H The decision-maker may obtain sample information. Let there be M possible sample results, A 1, A 2, . . . , A M The expected value of sample information is obtained as follows: § § § Determine which action will be chosen if only the prior probabilities were used Determine the probabilities of obtaining each sample result: Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 38

Expected Value of Sample Information, EVSI (continued) § § For each possible sample result, Ai, find the difference, Vi, between the expected monetary value for the optimal action and that for the action chosen if only the prior probabilities are used. This is the value of the sample information, given that Ai was observed Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 39

Utility § Utility is the pleasure or satisfaction obtained from an action § § The utility of an outcome may not be the same for each individual Utility units are arbitrary Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 40

Utility (continued) § § Example: each incremental $1 of profit does not have the same value to every individual: A risk averse person, once reaching a goal, assigns less utility to each incremental $1 A risk seeker assigns more utility to each incremental $1 A risk neutral person assigns the same utility to each extra $1 Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 41

Utility Three Types of Utility Curves $ Risk Aversion $ Risk Seeker Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. $ Risk-Neutral 42

Maximizing Expected Utility § Making decisions in terms of utility, not $ § § § Translate $ outcomes into utility outcomes Calculate expected utilities for each action Choose the action to maximize expected utility Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 43

The Expected Utility Criterion § § Consider K possible actions, a 1, a 2, . . . , a. K and H states of nature. Let Uij denote the utility corresponding to the ith action and jth state and Pj the probability of occurrence of the jth state of nature Then the expected utility, EU(ai), of the action ai is The expected utility criterion: choose the action to maximize expected utility § If the decision-maker is indifferent to risk, the expected utility criterion and expected monetary value criterion are equivalent Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 44

Chapter Summary § § § Described the payoff table and decision trees Defined opportunity loss (regret) Provided criteria for decision making § § § If no probabilities are known: maximin, minimax regret When probabilities are known: expected monetary value Introduced expected profit under certainty and the value of perfect information Discussed decision making with sample information and Bayes’ theorem Addressed the concept of utility Statistics for Business and Economics, 6 e © 2007 Pearson Education, Inc. 45