New Evidence on Energy Education Effectiveness Jackie Berger

New Evidence on Energy Education Effectiveness Jackie Berger 2008 ACI Home Performance Conference April 8, 2008

Presentation Outline • • • Description of Program and Evaluation Study Motivation Study Results Conclusion Future research 3

PECO LIURP – Program and Evaluation 4

Program Description • PECO LIURP – Low Income Usage Reduction Program • Run by utilities in PA • PUC requires annual evaluation • Education and energy efficiency measures • Baseload and heating jobs 5

2005 LIURP Impacts # 4, 551 197 1, 164 Pre-Use Post-Use Savings % Savings Electric Baseload (k. Wh) 11, 188 10, 073 1, 115 Electric Heat (k. Wh) 21, 956 20, 326 1, 629 Gas Heat (ccf) 1, 206 1, 039 168 10. 00% 7. 40% 13. 90% 6

CFL Impacts $/Unit Savings Cost/ $/Unit Measure Saved Over (k. Wh) Home Saved Lifetime $68 $0. 07 $0. 02 953 5 (± 173) $274 $0. 29 $0. 07 7

Study Methodology 8

Survey Research Methodology • Stratification for sample selection – Job type • Electric baseload – only CFLs • Gas heating – only CFLs on electric side – Electric supplemental heat • Used at the time of service delivery • Not used at the time of service delivery 9

Survey Research Methodology • Stratification for sample selection – Energy Savings • Removed top and bottom 5% in each of 4 groups • Divided each group into top, middle, and bottom savers 10

Survey Research Methodology Customer Type Electric Supplemental Heat Yes Electric Baseload No Yes Gas Heat No TOTAL SAMPLE Electric Savings Top Third Middle Third Bottom Third Number Selected 65 65 65 61 62 61 65 65 65 769 11

Survey Research Methodology Customer Type Electric Supplemental Heat Yes Electric Baseload No Yes Gas Heat No TOTAL SAMPLE Electric Savings Top Third Middle Third Bottom Third Completes 18 22 18 20 18 15 18 23 20 20 24 18 234 28% 34% 28% 31% 28% 23% 30% 37% 33% 31% 37% 28% 30% 12

Savings by Job Type and Household Characteristics 13

Electric Savings by Job Type and HH Characteristics All Customers Mean Electric Obs. Savings (k. Wh) 233 854 Baseload 111 1, 131 38% 24% 10% 18% Gas Heat 122 602 24% 26% 11% 13% 26% Elec Supp. Heat No Elec Supp. Heat 118 1, 078 38% 23% 11% 8% 20% 115 624 23% 28% 10% 16% 24% Electric Savings Group (k. Wh Change) Large Medium Low Small <=- 1, 500 -500 -1, 500 31% 25% 10% 12% 22% -250 -500 -250 - +250 Increase >250 14

Electric Savings by Job Type and HH Characteristics Electric Savings Group (k. Wh Change) Mean Electric Savings (k. Wh) Large Medium <=- 1, 500 -500 -1, 500 58 1, 275 40% 26% 12% 5% 17% no 53 974 36% 23% 8% 15% 19% Gas Heat yes 60 888 37% 20% 10% 23% Gas Heat no 62 326 11% 32% 11% 16% 29% Elec Supp. Heat Obs. Baseload yes Baseload/ Gas Heat Low Small -250 -500 -250 - +250 Increase >250 15

Electric Savings by Job Type and HH Characteristics Obs. Electric Savings Group (k. Wh Change) Mean Electric Savings (k. Wh) Large Medium <=- 1, 500 -500 -1, 500 Low Small -250 -500 -250 - +250 Increase >250 Air Conditioning Central 76 955 37% 24% 11% 7% 22% Window/Wall 140 765 26% 25% 11% 14% 24% None 17 1132 35% 6% 12% 16

Electric Savings by Job Type and HH Characteristics Baseload/ AC Type Gas Heat Mean Electric Obs. Savings (k. Wh) Electric Savings Group (k. Wh Change) Large Medium <=- 1, 500 -500 -1, 500 Low Small -250 -500 -250 - +250 Increase >250 Baseload Central 41 1177 46% 20% 10% 5% 20% Baseload Window/ Wall 61 1071 33% 25% 11% 13% 18% Baseload None 9 1325 33% 44% 0% 11% Gas Heat Central 35 695 26% 29% 11% 9% 26% Gas Heat Window/ Wall 79 529 22% 25% 10% 15% 28% Gas Heat None 8 916 38% 25% 13% 13% 17

Savings by Reports on Education Provided and Actions Taken 18

Electric Savings by Energy Education Reported 233 Mean Electric Savings (k. Wh) 854 Obs. All Customers Review bills? yes no 142 91 872 826 Recommend actions to save energy? yes no 206 27 825 1074 Estimate $ savings from each action recommended? yes no 142 91 901 780 Estimate total $ savings from all actions? yes no 110 123 837 869 19

Electric Savings by Number of Letters Read How many of the LIURP monthly energy saving letters have you read? All Most Some One/None Don’t Remember Letters Obs. Mean Electric Savings (k. Wh) 64 35 44 17 73 1038 900 627 552 877 20

Electric Savings By Reported Actions What energy-saving actions have you been able to take since the provider came to your home? Obs. Mean Electric Savings (k. Wh) 7 8 4 69 15 29 17 15 15 37 4 13 2253 1395 1250 1148 1021 777 518 369 365 203 13 (Action mentioned with greatest expected savings) Avoid space heaters Disconnect unused refrigerators/freezers Reduce use of electric dryer Use CFLs Accept LIURP services Turn off unused lighting Turn off unused television/computer Other/don’t know Alter thermostat settings Weatherization measures New appliances None 21

Electric Savings by Reduced Appliance Use Reduced use of _____ as a result of participating in the program? All Customers 233 Mean Electric Savings (k. Wh) 854 Electric space heater** yes no 105 128 1150 611 Air conditioner yes no 136 97 947 723 Electric dryer yes no 71 162 995 792 Dishwasher yes no 64 169 641 935 Obs. 22

Electric Savings by Reduced Appliance Use Reduced use of _____ as a result of participating in the program? All Customers 233 Mean Electric Savings (k. Wh) 854 Obs. Dehumidifier yes no 18 215 1058 837 Number of lights left on all night* yes no 43 190 1174 781 Lights yes no 161 72 879 797 23

Electric Savings by Number of Hours CFLs Used Average number of hours CFLs are used 1 -2 3 -4 5 -6 7 -24 Don’t Know Obs. 29 54 58 32 60 Mean Electric Savings (k. Wh) 649 819 705 1012 1044 24

Savings by Program Ratings and Reported Savings 25

Electric Savings by Most Important Program Benefit What do you feel is the most important benefit of the program? Lower Energy Bills Energy Education Safer/More Comfortable Home Specific Services Lower Energy Use New Appliances Compliant Don’t Know Obs. 72 69 17 23 24 6 3 19 Mean Electric Savings (k. Wh) 1015 796 769 671 523 433 1318 1227 26

Electric Savings by Energy Education Rating How helpful was LIURP in teaching about energy use and ways to save energy? Very Helpful Somewhat Helpful Of Little Help Don’t Know Obs. Mean Electric Savings (k. Wh) 135 69 23 6 925 645 1055 881 27

Electric Savings by Report of Energy Savings Has your household reduced its overall energy usage as a result of the program? Yes No/Don’t Know Is your PECO bill higher, lower, or unchanged since receipt of energy services? Lower Unchanged Higher Don’t Know Obs. Mean Electric Savings (k. Wh) 189 44 897 667 Obs. Mean Electric Savings (k. Wh) 138 56 29 10 920 706 660 1337 28

Electric Savings by Program Satisfaction All Baseload Gas Heat Energy Education Obs. Mean Electric Savings (k. Wh) Obs. Mean Electric Obs. Savings (k. Wh) Very Satisfied 140 885 69 1335 71 448 Somewhat Sat. 79 696 39 683 40 708 Dissatisfied 10 1439 2 2417 8 1195 Don’t Know 4 1414 1 1923 3 1245 Very Satisfied 141 742 71 1153 70 325 Somewhat Sat. 78 1021 37 1103 41 947 Dissatisfied 9 1044 1 273 8 1140 Don’t Know 5 1054 2 1270 3 910 LIURP 29

Multivariate Analysis 30

Multivariate Analysis Variable Baseload Job Electric Space Heat Provider Reviewed Bills Provider Recommended Actions to Save Energy Provider Estimated Savings from Each Action Provider Estimated Savings from Actions Overall Respondent Read All Letters Respondent Read Most Letters Reduced Electric Space Heater Use Reduced AC Use Reduced Electric Dryer Use Reduced Number of Lights Left on All Night Reduced Use of Dehumidifier Uses CFLs 7 or More Hours Per Day on Average LIURP Very Helpful Teach How Reduce Use Reduced Use as a Result of LIURP Very Satisfied with Energy Education Reports -524* -424* -121 -390 204 -176 -142 -123 Behavior Changes -508* Education Satisfaction -493* -451* -502* -92 -98 -265 -212 -155 -75 -82 -64 All Factors -542* -169 -455 202 -228 -88 53 -472* -139 -89 -361 -144 -146 -73 -80 -20 31

Summary and Conclusion 32

Summary • Expected relationships found – Energy education provided – Attention to follow-up materials – Behavior changes – Hours of CFL usage – Energy education ratings – Usage and bill savings 33

Conclusion • New evidence for – Impact of energy education on energy usage – Accuracy of customer reports • Energy education quality • Changes in energy use behavior • Need larger sample size!! 34

Contact Jackie Berger Director of Program Evaluation APPRISE 32 Nassau Street, Suite 200 Princeton, NJ 08542 609 -252 -8009 Jackie-berger@appriseinc. org 35