NJNG SAVEGREEN Evaluation Findings January 28 2016 Presentation

  • Slides: 84
Download presentation
NJNG SAVEGREEN Evaluation Findings January 28, 2016

NJNG SAVEGREEN Evaluation Findings January 28, 2016

Presentation Overview SAVEGREEN Program Overview SAVEGREEN Evaluation Overview Background Research Participant Feedback Contractor Feedback

Presentation Overview SAVEGREEN Program Overview SAVEGREEN Evaluation Overview Background Research Participant Feedback Contractor Feedback Energy Impacts Non-Energy Benefits Key Findings and Recommendations 2

SAVEGREEN PROGRAM OVERVIEW 3

SAVEGREEN PROGRAM OVERVIEW 3

SAVEGREEN Programs Goals Increase energy efficiency opportunities for customers Promote and enhance the use

SAVEGREEN Programs Goals Increase energy efficiency opportunities for customers Promote and enhance the use of the NJCEP offerings Raise awareness of the whole house approach to energy efficiency Increase customer awareness of energy efficient appliances and weatherization measures Increase NJ employment in energy efficiency and conservation 4

SAVEGREEN Programs Residential Enhanced Rebate Residential Non-HPw. ES On-Bill Repayment • High-efficiency gas furnace

SAVEGREEN Programs Residential Enhanced Rebate Residential Non-HPw. ES On-Bill Repayment • High-efficiency gas furnace or boiler • SAVEGREEN rebate in addition to NJCEP rebate • Participation in free NJNG audit is required • High-efficiency gas furnace or boiler and gas water heater • SAVEGREEN On-Bill Financing in addition to NJCEP rebate • Participation in free NJNG audit is required Residential HPw. ES On. Bill Financing and Rebate • NJCEP HPw. ES participation • On-Bill Financing and Incentive provided by NJNG Commercial and Industrial Direct Install • NJCEP Direct Install participation • On-Bill Financing in addition to NJCEP 70% rebate OPower Pilot • Mailings that compare usage to similar neighbors • Provide recommendations for usage reduction 5

SAVEGREEN Programs 2013 Programs Furnace/Boiler Enhanced Rebate NJ Clean Energy Program SAVEGREEN Project Jan-June

SAVEGREEN Programs 2013 Programs Furnace/Boiler Enhanced Rebate NJ Clean Energy Program SAVEGREEN Project Jan-June $400 $300 Jan-June July-Dec $900 $500 NJNG Audit Required Up to $6, 500 OBRP 0% interest over 5 years NJNG Audit Required Furnace Boiler Furnace and Water Heater $6500 OBRP HPw. ES $900 Tier Savings Rebate II 10%-19. 99% $2, 000 20%-24. 99% $4, 000 >25% $5, 000 III C&I Direct Install July-Dec $250 $300 70% of retrofit costs up to $125, 000 Up to $10, 000 OBRP 0% interest over 10 years SAVEGREEN pays NJCEP rebate when OBRP is used Up to $53, 571 OBRP 0% interest over 2 years 6

SAVEGREEN EVALUATION OVERVIEW 7

SAVEGREEN EVALUATION OVERVIEW 7

Core Evaluation Questions Are programs contributing to incremental energy efficiency activity in NJNG territory?

Core Evaluation Questions Are programs contributing to incremental energy efficiency activity in NJNG territory? • Customer Interviews • Contractor Interviews • Program Data Analysis Are customers influenced to make whole-house improvements? • Customer Interviews • Contractor Interviews • Program Data Analysis Do programs provide value to participating and non-participating NJNG customers? • Usage Impact Analysis • Non-Energy Benefits Analysis Is program effectively managed? • SAVEGREEN Document Review and Outreach Review • NJNG Interviews • NJCEP and DOE Interviews • Customer Interviews • Contractor Interviews 8

Evaluation Overview Background Research Program Data Analysis Participant Interviews Contractor Interviews Electric Data Collection

Evaluation Overview Background Research Program Data Analysis Participant Interviews Contractor Interviews Electric Data Collection Billing Data Analysis Non. Energy Benefits 9

BACKGROUND RESEARCH 10

BACKGROUND RESEARCH 10

SAVEGREEN Programs Participation SAVEGREEN Participation Year Residential OBRP Rebates C&I 2009 2010 2011 2012

SAVEGREEN Programs Participation SAVEGREEN Participation Year Residential OBRP Rebates C&I 2009 2010 2011 2012 2013 2014 512 4, 881 7, 371 6, 973 6, 701 4, 218 0 0 28 246 0 0 271 721 1, 720 1, 721 Direct Install 0 0 0 16 2009 -2014 30, 656 274 4, 433 16 $6500 HPw. ES 11

SAVEGREEN Programs Energy. Savvy Impact Staff Management Contractor Information Reporting Program Management Files in

SAVEGREEN Programs Energy. Savvy Impact Staff Management Contractor Information Reporting Program Management Files in progress Review job status Weekly pipeline jobs report OBRP denied Staff work load Fewer calls to NJNG CSG can see customer progress Conversion jobs 12

SAVEGREEN Programs Energy. Savvy Impact Customer Service Customer Participation NJNG Audit Data NJNG Audit

SAVEGREEN Programs Energy. Savvy Impact Customer Service Customer Participation NJNG Audit Data NJNG Audit Reports Information in system for staff review Online audit shorter and easier NJNG auditor data updated in Energy. Savvy NJNG auditors in the field can generate reports Customers can check status Follow-up email blasts Solved problem of multiple data entry. Provide immediate feedback to customers 13

SAVEGREEN Programs Contractor Outreach Email blasts Counter days at supply houses Informational meetings Free

SAVEGREEN Programs Contractor Outreach Email blasts Counter days at supply houses Informational meetings Free technical training sessions Increased rebate contractors to 2, 100 14

SAVEGREEN Programs Customer Outreach Website banner advertisements Targeting mailings to online audit participants Marketing

SAVEGREEN Programs Customer Outreach Website banner advertisements Targeting mailings to online audit participants Marketing to customers who sent inquiries Links to municipal websites Presentations and workshops Partnerships with the C&I Direct Install contractors 15

SAVEGREEN Programs Challenges Annual Approval (Now bi-annual) Changes in NJCEP Requirements Planning NJNG marketing

SAVEGREEN Programs Challenges Annual Approval (Now bi-annual) Changes in NJCEP Requirements Planning NJNG marketing activities Frequent refinements Retaining SAVEGREEN staff NJNG outreach, literature, website changes required Data Sharing Restrictions Contractor Education Conversion from $6500 OBRP to HPw. ES NJCEP to utilities Impact of equipment changes on installation procedures Need more than 6 months Outreach and marketing Orphaned water heaters Increase to 18 months Contractor job completion in approval window Contractor marketing 16

SAVEGREEN Programs Accomplishments Outreach • Promoted awareness of SAVEGREEN • In >30, 000 customers’

SAVEGREEN Programs Accomplishments Outreach • Promoted awareness of SAVEGREEN • In >30, 000 customers’ homes • Educated customers about energy efficiency Health and Safety • Promoted the need for the combination rebate • Reduced orphaned hot water heater issues OBRP Offering Customer Service Marketplace Connections • Increased affordability • Fewer than 10 defaults • Focus on providing excellent customer service • Discussions with customers about usage • All SAVEGREEN staff members interact with customers and contractors • NJNG receives feedback to make improvements 17

SAVEGREEN Programs Accomplishments NJNG Leadership Commitment Contractor Training Efficiency DOE Home Energy Score Participation

SAVEGREEN Programs Accomplishments NJNG Leadership Commitment Contractor Training Efficiency DOE Home Energy Score Participation • Management assistance with the program • Launched commercial OBRP in 3 months due to company support • Trained hundreds of contractors • SAVEGREEN information and technical skills • Only 29 staff members • Served over 30, 000 customers • Helped shape DOE Home Energy Score Program • Scored 54% of homes scored across the country • NJNG has 15 -17% of residential customers in state • Served 30% of NJCEP participants (as high as 50% at times) 18

PARTICIPANT FEEDBACK 19

PARTICIPANT FEEDBACK 19

Participant Feedback Methodology Program Participation Dates Included in Study Excluded Cases Sample Stratification Rebate

Participant Feedback Methodology Program Participation Dates Included in Study Excluded Cases Sample Stratification Rebate 6/1/14 – 12/31/14 Fuel Switch Signed contractor release; Home Energy Score presented HPw. ES 6/1/14 – 12/31/14 Project Cost Missing NJCEP Tier II or Tier III OBRP HVAC / Water Heating 6/1/14 – 12/31/14 Fuel Switch None C&I Direct Install 1/1/2014 – 12/31/2014 None 20

Participant Feedback Sample Participant Interview Sample Residential Programs Sample Frame Selected Sample Call Attempts

Participant Feedback Sample Participant Interview Sample Residential Programs Sample Frame Selected Sample Call Attempts Targeted Completes Completed Interviews C&I $6500 Direct Rebate HPw. ES OBRP Install 1, 513 50 1 -7 20 20 807 50 1 -4 20 20 179 15 1 -2 5 5 13 13 5 5 21

Participant Feedback Information Goals Participation Impact of SAVEGREEN Customer Impact Communication Satisfaction Information Source

Participant Feedback Information Goals Participation Impact of SAVEGREEN Customer Impact Communication Satisfaction Information Source On energy efficiency implementation Energy Bills SAVEGREEN Web-Based Tool SAVEGREEN Motivation for participation On whole-house approach Home Comfort NJNG Representatives Contractors Other factors impacting measure selection Additional Planned Measures Recommendations Free ridership and spillover 22

Participant Feedback Information Source How did you first hear about the NJNG SAVEGREEN Project

Participant Feedback Information Source How did you first hear about the NJNG SAVEGREEN Project and its on-bill repayment program for your project? SAVEGREEN Information Source Contractor NJNG Website Friend / Family Neighbor Newspaper Advertisement Total* Rebate 13 3 1 0 1 20 $6500 HPw. ES All OBRP Programs 1 9 23 2 0 5 0 3 4 0 4 4 1 1 3 5 20 45 *Others mentioned by 1 -2 customers NJNG Mailing NJNG Rep in Neighborhood Home Depot Salesperson NJNG Rep Research 23

Participant Feedback Main Participation Reason What was the main reason that you decided to

Participant Feedback Main Participation Reason What was the main reason that you decided to participate in the program? Participation Reason HPw. ES OBRP Save Money/Energy 8 SAVEGREEN Financing 7 Equipment Needed Replacement 7 Switch to Natural Gas 2 Improve Home Equipment 2 *Others mentioned by 1 customer each Rebate Environmental Benefits Contractor Solicitation Home Comfort 24

Participant Feedback Application Process How easy or difficult was the SAVEGREEN On Bill Repayment

Participant Feedback Application Process How easy or difficult was the SAVEGREEN On Bill Repayment application process? SAVEGREEN Application Process Rebate $6500 OBRP HPw. ES OBRP Very Easy 14 5 17 Somewhat Easy 1 0 3 Contractor Applied 5 0 0 Total 20 5 20 All 36 4 5 45 Were you satisfied with the length of time to receive your SAVEGREEN rebate? How satisfied were you with the program process overall? Satisfaction Very Satisfied Somewhat Dissatisfied Total Application Process Time to Receive Rebate $6500 OBRP HPw. ES OBRP All 17 2 1 20 17 3 0 20 5 0 0 5 20 0 0 20 42 3 0 45 25

Participant Feedback Impact on Home What changes have you noticed in your home after

Participant Feedback Impact on Home What changes have you noticed in your home after the installation? Changes in Home is Warmer Lower Gas/Electric Bills More Even Heating AC Works Better System is Quieter Home is Less Humid Rebate $6500 OBRP HPw. ES OBRP All 9 1 1 11 8 1 1 10 4 4 4 2 0 0 1 0 5 3 2 1 9 7 7 3 *Others mentioned by 1 -2 customers each Better Air Quality Does Not Heat Up as Fast Heat Does Not Need to Be as High Home is Pipes Do Less Not Freeze Dry Hot Less Water is Dust Hotter 26

Participant Feedback SAVEGREEN Impact Have you noticed any changes in the comfort of your

Participant Feedback SAVEGREEN Impact Have you noticed any changes in the comfort of your home? In your NJNG bills? In your natural gas usage? Noticed Changes Energy Bills Home Comfort Rebate Yes No Don’t Know Total NJNG Usage $6500 HPw. ES All $6500 HPw. ES All Rebate OBRP 3 OBRP 3 15 4 3 1 18 2 36 7 12 2 0 0 17 2 29 4 7 3 0 0 9 10 16 13 1 1 0 2 6 5 1 12 10 5 1 16 20 5 20 45 27

Participant Feedback Impact on Home Rebate • “My furnace now has settings that speed

Participant Feedback Impact on Home Rebate • “My furnace now has settings that speed up or slow down the air, which is better than when it was just always blasting before. ” • “My home is much drier, I no longer rely on the dehumidifier to improve the air quality. ” • “My wife has not had a single asthma attack in the last five months and that’s what’s really important to me. ” • “My bills are considerably lower. ” HPw. ES OBRP • “The new heating equipment is very quiet. The new furnace is a lot cleaner – we used to have a lot of soot when we heated with fuel oil. The home is also less drafty and now my pipes don’t freeze. ” • “I received a ‘scorecard’ on energy use from NJNG and I had moved from one of the largest energy users to one of the least. My home is now more comfortable but that the heating system is now not as effective in some rooms – some rooms are now colder in the 28 winter. ”

Participant Feedback SAVEGREEN Importance How important was the SAVEGREEN rebate in your decision to

Participant Feedback SAVEGREEN Importance How important was the SAVEGREEN rebate in your decision to purchase the high efficiency furnace/boiler? Do you feel that the rebate amount is sufficient? Rebate Importance Very Somewhat Not At All Total Rebate 7 6 7 20 $6500 HPw. ES All OBRP 4 1 0 5 18 2 0 20 29 9 7 45 SAVEGREEN Rebate Amount Adequate Low Don’t Know Total 17 2 1 20 29

Participant Feedback Barriers Were there any barriers to moving forward with the high efficiency

Participant Feedback Barriers Were there any barriers to moving forward with the high efficiency equipment? Were there any barriers to participating in the NJNG SAVEGREEN program? Any Barriers To Completing Upgrades Rebate SAVEGREEN Participation $6500 HPw. ES All 3 Rebate OBRP $6500 HPw. ES All 3 OBRP Yes 3 2 2 7 3 0 1 4 No Tota l 17 3 18 38 17 5 19 41 20 5 20 45 30

Participant Feedback Barriers Rebates • “The high efficiency equipment needed to be exhausted differently.

Participant Feedback Barriers Rebates • “The high efficiency equipment needed to be exhausted differently. ” • “It took a long time to get the money. We are still waiting for a third check to come and it’s been a year since we replaced the furnace. ” • “The contractor couldn’t supply the information we needed to complete the application and I needed to contact the manufacturer directly. ” $6500 OBRP • “Because I converted to natural gas from oil and my home was 30 years old, it didn’t have the proper vents and piping needed for this type of equipment. ” • “The one barrier in installing the equipment was that we needed to get two permits to change the equipment, one from our township and one from the senior community that we live in. ” 31

Participant Feedback Participant Satisfaction How satisfied or dissatisfied were you with the audit? …with

Participant Feedback Participant Satisfaction How satisfied or dissatisfied were you with the audit? …with the installation contractor? …with the installation? Audit Satisfaction Installation Contractor $6500 HPw. ES Rebate All OBRP Very Satisfied 15 5 16 36 16 4 18 38 Somewhat Satisfied 2 0 3 5 3 0 2 5 Somewhat Dissatisfied 1 0 0 1 1 1 0 2 Very Dissatisfied 1 0 0 0 0 DK/Refused 1 0 1 2 0 0 Total 20 5 20 45 New Equipment/Installation Very Satisfied Somewhat Dissatisfied Very Dissatisfied Total Rebate 25 0 0 0 25 $6500 OBRP 5 0 0 0 5 HPw. ES OBRP 19 1 0 0 20 All Programs 44 1 0 0 45 32

Participant Feedback Participant Satisfaction Overall, how satisfied were you with the NJNG SAVEGREEN Program?

Participant Feedback Participant Satisfaction Overall, how satisfied were you with the NJNG SAVEGREEN Program? Overall SAVEGREEN Rebate Satisfaction $6500 OBRP HPw. ES All OBRP Programs Very Satisfied 18 5 19 42 Somewhat Satisfied 2 0 1 3 Somewhat Dissatisfied 0 0 Very Dissatisfied 0 0 Total 20 5 20 45 33

Participant Feedback Recommendations What, if anything, do you think NJNG could do to improve

Participant Feedback Recommendations What, if anything, do you think NJNG could do to improve the program? Recommendations Rebate More Program Advertising Increase Rebate More Thorough Audit More Accessible Program Information Increase On Bill Repayment Flexibility No Suggestions 3 3 1 1 0 9 $6500 OBRP 2 0 0 2 HPw. ES OBRP 5 0 1 1 2 10 All 10 3 2 21 *Others mentioned by 1 customer each Shorter Wait for Rebate Improve Contractor Reliability Advertising Through Mail Improve Auditor Communication More Information on Choosing Measures Provide Accurate 34

Residential Feedback Key Findings & Recommendations Information Source • Continue focusing on the contractors

Residential Feedback Key Findings & Recommendations Information Source • Continue focusing on the contractors while maintaining other outreach methods Participation Reason • Include the benefits of saving money or energy and the benefits of SAVEGREEN financing options in the residential program marketing materials SAVEGREEN Website • The website is an important source of information and NJNG should continue to update it as needed Measure Installation Decisions • Contractors should be trained to clearly educate participants on their options for installation and how those decisions will or will not affect HPw. ES OBRP program benefits 35

Residential Feedback Key Findings & Recommendations Changes to Homes • Many respondents noticed changes

Residential Feedback Key Findings & Recommendations Changes to Homes • Many respondents noticed changes in the comfort of their homes and to their bills, so these benefits should be included in marketing materials Home Energy Score • Most participants did not recall receiving this report, but those who did recall it considered the report important SAVEGREEN Importance • The On Bill Repayment was extremely important to the HPw. ES OBRP participants and should be continued to encourage the adoption of whole house improvements Participant Satisfaction • The high levels of satisfaction show that the program is working well and there is little room for improvement 36

C&I Participant Feedback Key Findings & Recommendations SAVEGREEN Importance Measures Information Source • 2

C&I Participant Feedback Key Findings & Recommendations SAVEGREEN Importance Measures Information Source • 2 of 5 noted that they were approached by the contractor • NJNG should work with the C&I Direct Install contractors to provide additional outreach about the program • 3 felt that their new heating units provided a more balanced, reliable temperature • 1 said the new heating unit was quieter. • 3 reported decreased energy bills • The benefits of reduced bills and improved comfort should be included in the program marketing materials • 4 of the 5 had not been planning on making energy efficiency improvements • 4 stated that they would not have moved forward, without the OBRP • All 5 felt that the OBRP was very important in their decision to pursue the energy efficiency upgrades • All 5 felt that the NJ Clean Energy rebates were very important in their decision • The program appears to have a large impact on the uptake of energy efficiency and should be continued in its form if budget is available. 37

CONTRACTOR FEEDBACK 38

CONTRACTOR FEEDBACK 38

Contractor Feedback Methodology 10 Contractors Interviewed Rebate HPw. ES Rebate Only (2) HPw. ES

Contractor Feedback Methodology 10 Contractors Interviewed Rebate HPw. ES Rebate Only (2) HPw. ES Only (1) Rebate and $6500 OBRP (2) HPw. ES and $6500 (1) C&I Direct Install (2) Seal-up (2) 39

Contractor Feedback Information Goals SAVEGREEN Information High Efficiency Equipment • Participants’ SAVEGREEN information source

Contractor Feedback Information Goals SAVEGREEN Information High Efficiency Equipment • Participants’ SAVEGREEN information source • Information that contractor provided to customers about SAVEGREEN • Availability and performance of qualifying equipment • Customers’ decision factors for highefficiency equipment Program Impact • Energy efficiency implementation • Whole-house approach • Other factors impacting measure selection • Free ridership Assessment • Barriers to participation • Satisfaction and recommendations 40

Contractor Feedback Customer Awareness Contractor Information Source NJNG letter/email NJNG contractor meeting CSG NJCEP

Contractor Feedback Customer Awareness Contractor Information Source NJNG letter/email NJNG contractor meeting CSG NJCEP Customer Information Source Contractors NJNG marketing Contractor SAVEGREEN Advertising Newspaper Website Mailing Home Show Street Fair NJNG SAVEGREEN Marketing was Effective Gas bill insert Online Mailing NJNG auditor 41

Contractor Feedback C&I Participation Why do you think there has not been greater participation

Contractor Feedback C&I Participation Why do you think there has not been greater participation in the SAVEGREEN Direct Install program? • Lack of awareness • Difficult to understand offering 42

Contractor Feedback Barriers to Participation 4 of 8 Residential Contractors Noted 1 or More

Contractor Feedback Barriers to Participation 4 of 8 Residential Contractors Noted 1 or More Barriers • • • OBRP credit requirement (3 contractors) Customers unwilling to replace hot water heater Equipment efficiency requirements Attic clutter Scheduling difficulty 1 of 2 C&I Contractors Noted Barrier • OBRP credit requirements 43

Contractor Feedback Barriers to Installations Venting requirements (2) Cost of highefficiency equipment Expense of

Contractor Feedback Barriers to Installations Venting requirements (2) Cost of highefficiency equipment Expense of duct improvements Loan denials Township permitting requirements (2) 44

Contractor Feedback Participation in Trainings requested Trainings are useful to contractors • Improved understanding

Contractor Feedback Participation in Trainings requested Trainings are useful to contractors • Improved understanding of SAVEGREEN • Technical information • Improve work efficiency 4 of 8 noted that current trainings are what are needed • Selling the highefficiency option • Manual J (provide more often) • Explaining the rebate • Understanding the programs 45

Contractor Feedback Other Influential Factors Health and safety issues Saving energy Financing options Reducing

Contractor Feedback Other Influential Factors Health and safety issues Saving energy Financing options Reducing bills Comfort issues Return on investment What other factors in addition to the program incentives influenced customers’ decision to purchase high efficiency equipment or to move forward with the home performance project? Old equipment 46

Contractor Feedback Encourage Whole House Yes, program influences whole house upgrades What more can

Contractor Feedback Encourage Whole House Yes, program influences whole house upgrades What more can the program do? 3 of 4 rebate contractors Both HPw. ES contractors Both seal-up contractors More marketing (3 contractors) Higher rebates for furnace/boiler Increased financing options Free audits Increase emphasis on audit importance Better communication about contractor release 47

Contractor Feedback Satisfaction Contractor Satisfaction SAVEGREEN Process SAVEGREEN Overall Very Satisfied 4 9 Satisfied

Contractor Feedback Satisfaction Contractor Satisfaction SAVEGREEN Process SAVEGREEN Overall Very Satisfied 4 9 Satisfied 2 0 Somewhat Satisfied 0 1 Somewhat Dissatisfied 0 0 Very Dissatisfied 0 0 TOTAL 6 10 48

Contractor Feedback Key Findings & Recommendations Marketing • Continue contractor emails and training sessions

Contractor Feedback Key Findings & Recommendations Marketing • Continue contractor emails and training sessions • Continue customer-targeted print and web-based advertisements Participation • No significant barriers that SAVEGREEN can or should address • Discuss potential for additional coordination with refrigeration contractors with C&I contractors and NJCEP managers who have direct control over the program Contractor Communication • Continue to provide trainings as they increase SAVEGREEN awareness and provide important information • Continue to update and maintain the SAVEGREEN Website and Portal • Send emails to alert contractors when program updates are posted • Continue to use email as primary source of contractor communication SAVEGREEN Impact • SAVEGREEN has large impact on energy efficiency • Continue program if funding is available Contractor Satisfaction • Provide payments directly to contractors (change has been made) 49

ENERGY IMPACTS 50

ENERGY IMPACTS 50

Energy Impacts Methodology • Treatment group – 2013 participants • Participant comparison group –

Energy Impacts Methodology • Treatment group – 2013 participants • Participant comparison group – 2014 participants • Matched comparison group – Matched nonparticipants 51

Energy Impacts Data Attrition Rebate HPw. ES # % Original population 6, 240 --

Energy Impacts Data Attrition Rebate HPw. ES # % Original population 6, 240 -- 1, 720 -- Eligible population 5, 982 100% 1, 648 100% Received usage data 5, 973 >99% 1, 648 100% Enough usage data 4, 369 73% 1, 264 77% No baseload/heating usage outliers 3, 168 53% 1, 156 70% Full Analysis Group 3, 168 53% 1, 156 70% Reliable PRISM Results 2, 697 45% 1, 068 65% 52

Rebate Impact Natural Gas Savings Treatment Therms Matched Comparison Savings # Therms Net Savings

Rebate Impact Natural Gas Savings Treatment Therms Matched Comparison Savings # Therms Net Savings # Pre Post Therms % -143** -13. 8% 72** 7. 0% 3, 168 1, 028 1, 099 -71** -6. 9% 3, 168 1, 036 1, 178 Degree Day 3, 168 1, 102 1, 026 75** 6. 8% 3, 168 1, 098 >-1 >-0. 1% 76** 6. 9% PRISM 1, 110 1, 008 101** 9. 1% 2, 697 1, 103 1, 089 14** 1. 3% 88** 7. 9% Raw 2, 697 53

Rebate Impact Gas Savings by Capacity 120 100 Net Savings (Therms) 100 80 70

Rebate Impact Gas Savings by Capacity 120 100 Net Savings (Therms) 100 80 70 61 60 40 20 0 ≤ 70 71 -100 Capacity (Tons) >100 54

Rebate Impact Gas Savings by Efficiency Furnaces 90 72 59 50 40 30 20

Rebate Impact Gas Savings by Efficiency Furnaces 90 72 59 50 40 30 20 92 90 88 86 84 80 78 0 76 94%-95% Efficiency >95% 83 82 10 ≤ 93% 94 94 Net Savings (Therms) 60 96 81 80 70 Boilers ≤ 93% 94%-95% Efficiency 55

Rebate Impact Gas Savings by Pre-Usage 120 105 Net Savings (Therms) 100 79 80

Rebate Impact Gas Savings by Pre-Usage 120 105 Net Savings (Therms) 100 79 80 60 40 37 20 0 ≤ 800 801 -1, 200 Pre-Treatment Usage (Therms) >1, 200 56

HPw. ES Impact Natural Gas Savings Treatment Therms Matched Comparison Savings Therms # Net

HPw. ES Impact Natural Gas Savings Treatment Therms Matched Comparison Savings Therms # Net Savings # Pre Post Therms % Raw 1, 156 1, 023 899 125* 12. 2% 1, 156 1, 027 1, 144 -117** -11. 4% 242** 23. 6% Degree Day 1, 156 1, 048 849 199** 19. 0% 1, 156 1, 050 1, 072 -22** -2. 1% 221** 21. 1% PRISM 1, 068 1, 039 814 225** 21. 6% 1, 068 1, 037 1, 048 -11** -1. 0% 235** 22. 6% **Denotes significance at the 99 percent level. 57

HPw. ES Impacts Savings by OBRP & Rebate $ 300 251 Net Savings (Therms)

HPw. ES Impacts Savings by OBRP & Rebate $ 300 251 Net Savings (Therms) 250 200 221 184 150 100 50 0 ≤ $10, 000 $10, 001 -$14, 000 > $14, 000 OBRP & Rebate Amount 58

HPw. ES Impacts Gas Savings by Pre-Usage 350 329 Net Savings (Therms) 300 250

HPw. ES Impacts Gas Savings by Pre-Usage 350 329 Net Savings (Therms) 300 250 208 200 150 120 100 50 0 ≤ 800 801 -1, 200 >1, 200 Pre-Treatment Usage (Therms) 59

Electric Impacts Methodology Participant Selection • • • Enough gas usage data for gas

Electric Impacts Methodology Participant Selection • • • Enough gas usage data for gas usage impact analysis Top and bottom 2% gas savings removed Participants with >1 rate code removed (greater likelihood of fuel switch) Incomplete address information removed (mailed authorization request) Random sample of 500 enhanced rebate and 500 HPw. ES selected Authorization and Data • 1, 000 selected participants were mailed an authorization form request • JCP&L provided usage data • 83 Rebate and 119 HPw. ES participants had sufficient electric data 60

Electric Impacts Findings Insignificant and/or inconsistent results • Small sample size • Little change

Electric Impacts Findings Insignificant and/or inconsistent results • Small sample size • Little change in usage • High variability in savings Enhanced rebate findings • Not statistically significant • Differed between estimation methodologies HPw. ES findings • Inconsistent across various approaches 61

NON-ENERGY BENEFITS 62

NON-ENERGY BENEFITS 62

Non-Energy Benefits Environmental Benefits Economic Benefits Health & Safety Benefits 63

Non-Energy Benefits Environmental Benefits Economic Benefits Health & Safety Benefits 63

Environmental Benefits Methodology Energy Savings Reduction in Natural Gas Usage Avoided Emissions Tons of

Environmental Benefits Methodology Energy Savings Reduction in Natural Gas Usage Avoided Emissions Tons of CO 2, SO 2, Nox, PM 2. 5, and VOC Value Avoided Emissions $ value using APEEP Model 64

Environmental Benefits Avoided Emissions 2013 Participants Natural Gas Savings Per Participant (Therms) Total Natural

Environmental Benefits Avoided Emissions 2013 Participants Natural Gas Savings Per Participant (Therms) Total Natural Gas Savings (MMBtu) CO 2 -eq 2 SO 23 NOx 3 PM 2. 53 VOC 3 Rebate 6, 700 76 506, 631 50, 663 HPw. ES OBRP 1, 720 221 380, 316 38, 032 Natural Gas Emission Rate Marginal Value of Avoided Emissions (Tons CO 2 -eq/1, 000 MMBtu) (2015 dollars /Ton) 1 62 $41. 4 0. 000293 $111, 573 0. 046 $23, 023 0. 000927 $468, 563 0. 00268 $44, 180 65

Environmental Benefits Value of Avoided Emissions Rebate HPw. ES OBRP Marginal Total Avoided Value

Environmental Benefits Value of Avoided Emissions Rebate HPw. ES OBRP Marginal Total Avoided Value of Emissions Avoided Savings (tons) Emissions ($ per ton) $41. 4 $129, 945 2, 356 $41. 4 $97, 547 $227, 492 CO 2 -eq 3, 139 SO 2 0. 015 $111, 573 $1, 654 0. 011 $111, 573 $1, 242 NOx 2. 32 $23, 023 $53, 485 1. 74 $23, 023 $40, 150 $93, 634 PM 2. 5 0. 047 $468, 563 $22, 002 0. 035 $468, 563 $16, 516 $38, 518 VOC 0. 136 $44, 180 $6, 005 0. 102 $44, 180 Total $213, 091 $4, 508 $2, 896 $10, 513 $159, 963 $373, 054 Monetary values are in 2015 dollars Avoided emissions for CO 2 -eq are in metric tons. Avoided emissions for all other air pollutants are in short tons 66

Environmental Benefits Value of Avoided Emissions Time Period 2014 Lifetime Rebate HPw. ES OBRP

Environmental Benefits Value of Avoided Emissions Time Period 2014 Lifetime Rebate HPw. ES OBRP Total Benefit $213, 091 $159, 963 $373, 054 $1, 909, 622 $2, 543, 862 $4, 453, 491 Monetary values in 2015 dollars. Lifetime benefits measured over 15 -year measure life. Avoided emissions for CO 2 -eq are in metric tons. Avoided emissions for all other air pollutants are in short tons 67

Economic Benefits Theory SAVEGREEN spending replaces retail spending • Charge on energy bill would

Economic Benefits Theory SAVEGREEN spending replaces retail spending • Charge on energy bill would have been spent on retail goods Retail spending replaces natural gas spending • Energy savings from program spent on retail goods Increase in economic activity because replacement spending has • Higher labor intensity • Greater percentage spent in NJ 68

Economic Benefits Methodology • Regional Input-Output Modeling System (RIMS) • Produced by Bureau of

Economic Benefits Methodology • Regional Input-Output Modeling System (RIMS) • Produced by Bureau of Economic Analysis (BEA) Output Change = Expenditures * (Output Multiplier with Program – Output Multiplier Without Program) Employment Change = (1/$1, 000) * Expenditures * (Employment Multiplier with Program – Employment Multiplier Without Program) 69

Economic Benefits Sources of Economic Impact NJNG Administrative Spending NJNG and NJCEP Incentives Customer

Economic Benefits Sources of Economic Impact NJNG Administrative Spending NJNG and NJCEP Incentives Customer Net Costs Customer Total Savings Estimates based on 2013 expenditures and participants’ savings. 70

Economic Benefits Output Multipliers Source of Economic Impact NJNG Admin Spending Labor: Admin, Prog

Economic Benefits Output Multipliers Source of Economic Impact NJNG Admin Spending Labor: Admin, Prog Dev. General: Sales, Marketing Labor: Rebates, Inspect, QC NJNG & NJCEP Incentives NJNG HPw. ES Incentives NJNG Enhanced Rebates NJCEP Rebates Customer Net Costs HPw. ES Net Costs Rebate Net Costs Customer Total Savings Natural Gas Savings Output Multiplier With Program Sector Multiplier Office admin Business supply Prof, scientific, tech Services to buildings/dwellings Retail trade 1. 9212 1. 7661 1. 9241 1. 7845 1. 7112 Output Multiplier Without Program Sector Multiplier Retail trade Natural gas 1. 7112 1. 2638 Output Multiplier Increase 0. 2100 0. 0549 0. 2129 0. 0733 0. 4474 71

Economic Benefits Output Impact Source of Economic Impact Base Amount NJNG Admin Spending Labor:

Economic Benefits Output Impact Source of Economic Impact Base Amount NJNG Admin Spending Labor: Admin, Prog Dev. General: Sales, Marketing Labor: Rebates, Inspect, QC NJNG & NJCEP Incentives NJNG HPw. ES Incentives NJNG Enhanced Rebates NJCEP Rebates Customer Net Costs HPw. ES Net Costs Rebate Net Costs Customer Total Savings Natural Gas Savings Total Economic Impact $251, 346 $1, 941, 029 $1, 224, 056 $23, 694, 720 $4, 804, 500 $2, 178, 460 $1, 568, 640 $35, 030, 970 $10, 086, 713 Output Multiplier Without Change Program 1. 9212 1. 7112 0. 2100 1. 7661 1. 7112 0. 0549 1. 9241 1. 7112 0. 2129 1. 7845 1. 7112 0. 0733 1. 7112 1. 2638 0. 4474 Economic Impact ($) $52, 783 $106, 562 $260, 602 $1, 736, 823 $352, 170 $159, 681 $114, 981 $2, 567, 770 $4, 512, 795 $9, 864, 167 72

Economic Benefits Output and Employment Type of Impact Output ($) Employment (job-years) Impact $9,

Economic Benefits Output and Employment Type of Impact Output ($) Employment (job-years) Impact $9, 864, 167 495 73

Health & Safety Benefits Methodology Energy. Savvy Data Available for 2014 participants Issues identified

Health & Safety Benefits Methodology Energy. Savvy Data Available for 2014 participants Issues identified during NJNG Audits for Enhanced Rebates and $6500 OBRP Percent who address issues is not known 74

Health & Safety Issues Identified Improper Dryer Venting Improper Bath Venting Did Not Pass

Health & Safety Issues Identified Improper Dryer Venting Improper Bath Venting Did Not Pass Oven Inspection Moisture Issues Gas Piping Leaks Did Not Pass Depressurization Worst Case Test Did Not Pass Water Heater Draft (Worst Case) Gas Piping Leaks at Dryer Did Not Pass Water Heater Draft (Natural) Asbestos Issues CO ≥ 100 ppm by Water Heater Structure Issues CO ≥ 100 ppm in CAZ Homes With Issue Rebate $6, 500 OBRP # % 894 23% 61 25% 724 19% 62 25% 189 5% 6 2% 132 3% 10 4% 90 2% 4 2% 76 2% --52 1% --28 1% 0 0% 15 <1% --15 <1% 0 0% 8 <1% --7 <1% 0 0% --75

Health & Safety Benefits Participants with Any Issue Customer Has Any Issue Rebate $6,

Health & Safety Benefits Participants with Any Issue Customer Has Any Issue Rebate $6, 500 OBRP # % Yes 1, 616 42% 99 40% No 1, 969 51% 147 60% 283 7% 0 0% 3, 868 100% 246 100% No Health & Safety Data Total 76

KEY FINDINGS & RECOMMENDATIONS 77

KEY FINDINGS & RECOMMENDATIONS 77

Overview of Findings Program Accomplishments • • Customer Participation Contractor Recruitment Contractor Training Importance

Overview of Findings Program Accomplishments • • Customer Participation Contractor Recruitment Contractor Training Importance of Program to Efficiency Work High Customer and Contractor Satisfaction Large Gas Usage Impacts Non-Energy Benefits Achieved 78

Program Design and Administration BPU Communication Energy Savvy Capabilities Discuss large impact of Application

Program Design and Administration BPU Communication Energy Savvy Capabilities Discuss large impact of Application Additional Reports • Short-term approval • Frequent program changes • OBRP approval rate • Health and safety issues identified during audits Additional Data Fields • HPw. ES H&S Issues • H&S Issues resolved • HPw. ES measures installed Consider customer release for JCP&L data for future evaluation Most said application was easy – no other refinements needed NJNG Audit Customers unlikely to undertake additional measures Auditors should provide information about expected impacts of additional measures 79

Marketing and Outreach Marketing Method Marketing Content • Contractor was most common source of

Marketing and Outreach Marketing Method Marketing Content • Contractor was most common source of information • Several other sources • Continue contractor emails and training sessions • Continue customertargeted print and web-based advertising • Include benefits in program marketing materials • Reduced bills • Financing options • Improved comfort Participation • No significant barriers • Work more closely with the C&I Direct Install contractors to provide additional outreach SAVEGREEN Website • Important source of customer information • Continue to update as needed 80

Contractors Communication • Continue to maintain and update SAVEGREEN website and portal • Send

Contractors Communication • Continue to maintain and update SAVEGREEN website and portal • Send email alerts to contractors when program updates are posted • Use email as primary source of contractor communication Contractor Training • Continue to provide • Increases SAVEGREEN awareness • Provides important technical information Measure Installation Decisions • Train contractors to educate customers on installation options and impact on HPw. ES OBRP benefits • Discuss potential for additional coordination with refrigeration contractors with C&I contractors C&I Assessments • Contractors appear to do good job with assessment and customer communication 81

SAVEGREEN Impact Home Impact • Participants noted changes in home comfort and bills Home

SAVEGREEN Impact Home Impact • Participants noted changes in home comfort and bills Home Energy Score • Most did not recall but those who did said it was important Impact on Upgrades • Most participants said SAVEGREEN was very or somewhat important • Contractors said SAVEGREEN significantly impacted energy efficiency awareness • Program should be continued in current form if budget is available 82

SAVEGREEN Satisfaction Participants Contractors • High levels of satisfaction • Recommended increased marketing •

SAVEGREEN Satisfaction Participants Contractors • High levels of satisfaction • Recommended increased marketing • High levels of satisfaction • Recommend director contractor payment 83

Contact Jackie Berger, Ph. D. President and Co-Founder APPRISE 32 Nassau Street, Suite 200

Contact Jackie Berger, Ph. D. President and Co-Founder APPRISE 32 Nassau Street, Suite 200 Princeton, NJ 08542 609 -252 -8009 www. appriseinc. org 84