U.S. Department of Energy Energy Efficiency & Renewable Energy U.S. Department of Energy Energy Efficiency & Renewable Energy

Quick Links Results

Author: U.S. Department of Energy
Publication Date: 2015

Volume 1 of the Better Buildings Neighborhood Program Evaluation Report provides findings from a comprehensive impact, process, and market effects evaluation of the program period, spanning from September 2010 through August 2013.

Author: U.S. Department of Energy
Publication Date: 2015

Volume 2 of the Better Buildings Neighborhood Program Evaluation Report comprises a measurement and verification process, as well as billing regression analysis on projects with sufficient utility bill data, to determine gross verified savings.

Author: U.S. Department of Energy
Publication Date: 2015

Volume 3 of the Better Buildings Neighborhood Program Evaluation Report statistically identifies factors associated with successful residential energy upgrade programs using a survey sampling, cluster analysis, and multivariate regression approach.

Author: U.S. Department of Energy
Publication Date: 2015

Volume 4 of the Better Buildings Neighborhood Program Evaluation Report assesses the degree to which the Better Buildings Neighborhood Program met its process goals and objectives to identify the most effective program design and implementation approaches.

Author: U.S. Department of Energy
Publication Date: 2015

Volume 5 of the Better Buildings Neighborhood Program Evaluation Report provides findings from a comprehensive impact, process, and market effects evaluation of the program period, spanning from September 2010 through August 2013.

Author: U.S. Department of Energy
Publication Date: 2015

Volume 6 of the Better Buildings Neighborhood Program Evaluation Report provides findings from a comprehensive impact, process, and market effects evaluation of the program period, spanning from September 2010 through August 2013. This volume includes case studies that describe successful strategies that programs used during the evaluation period.

Author: Southeast Energy Efficiency Alliance
Publication Date: 2013

This report presents the phase 1 process evaluation conducted of the 13 programs in the Southeast Consortium Better Buildings Neighborhood Program (BBNP).

Author: Southeast Energy Efficiency Alliance
Publication Date: 2013

This report presents the phase 2 process evaluation conducted of the 13 programs in the Southeast Consortium Better Buildings Neighborhood Program (BBNP).

Briefing on the Better Buildings Neighborhood Program Evaluation
Author: U.S. Department of Energy
Publication Date: 2015
Presentation, Media

This presentation describes the Better Buildings Neighborhood Program evaluation findings, including goal and objective attainment, energy and CO2e impacts, program implementation lessons learned, market effects findings, and recommendations.

Author: California Public Utilities Commission
Publication Date: 2012

This report focuses on four utilities in California. The research for this report included reviewing program documents and tracking databases, conducting two rounds of interviews with four investor owned utility program managers, interviewing California Public Utility Commission staff members and an intervener, surveying 76 on-bill financing program participants and 29 vendors who helped deliver the program, interviewing 12 account executives, and conducting six focus groups across California with 46 energy audit participants who had not participated in on-bill financing.

Monitor the effectiveness of contractor and workforce development efforts, motivate improvement, address low performers, and adapt on a regular basis.

Communicate program results to contractor partners and workforce development stakeholders.

Determine processes for collecting and sharing data about key contractor metrics and workforce development activities.

Develop contractor engagement, quality assurance, and workforce development plans that include strategies, workflow, timelines, and staff and partner roles and responsibilities.

Develop workforce and contractor engagement procedures, forms, and materials

Author: U.S. Department of Energy
Publication Date: 2006

This guide details and explains the five types of general program evaluations and provides guidance on selecting the type of evaluation suited to the program to be evaluated, given the type of information required and budget limitations. It is intended for use by managers of both deployment and R&D programs within the U.S. Department of Energy's Office of Energy Efficiency and Renewable Energy (EERE), although most of the examples of evaluations pertain to deployment programs.

Author: Dimitrios Laloudakis, Energize Phoenix
Publication Date: 2011

This presentation outlines the techniques for collecting and evaluating energy efficiency program evaluation data, including data related to marketing efforts.

Energy Efficiency and Conservation Loan Program Webinar Series: #4 Residential Energy Efficiency Deep Dive, Part Two
Author: U.S. Department of Agriculture; U.S. Department of Energy
Publication Date: 2014
Presentation, Media, Transcript

This webinar is the fourth (in a series of six) hosted by USDA Rural Utility Service (RUS) and focusing on the Energy Efficiency and Conservation Loan Program (EECLP). The second in a two-part series, this webinar shares best practices from the more than 40 competitively selected state and local governments who participated in the U.S. Department of Energy’s Better Buildings Neighborhood Program. This webinar focuses on data collection and continuous improvement, partnering with financial institutions, community-based outreach, and quality assurance of contractor work. It also features a case study from Jackson Electric Member Corporation about their audit tools, rebates and loans, tracking and reporting, and marketing and advertising strategies.

Communicate pertinent results of evaluations to program staff, partners, and stakeholders.

Manage third-party impact and process evaluation activities by coordinating with evaluators, transferring data, and overseeing evaluation deliverables. 

Identify the right questions to ask, appropriate metrics to collect, and the processes needed to initiate third-party impact and process evaluations.

Identify and implement systems and tools that will support data collection and data quality necessary for effective evaluation.

Develop evidence-based insights into your program’s performance through third-party process and impact evaluations. Learn how to develop effective data collection strategies and timely evaluations to identify important program achievements as well as opportunities for making program improvements.

Evaluation of Residential Behavior-Based Programs
Author: Bill Saxonis, New York Department of Public Service; Annika Todd, Lawrence Berkeley National Lab; C. Anna Spurlock, Lawrence Berkeley National Lab
Publication Date: 2016
Presentation, Media

Residential behavior-based (BB) programs use strategies grounded in the behavioral and social sciences to influence household energy use. These programs have unique evaluation challenges and usually require different evaluation methods than those currently employed for most other types of efficiency programs. This webcast provides an introduction to documenting the energy savings associated with BB programs and examples of how different jurisdictions are addressing BB program evaluation.

Financial Program Management for Continuous Improvement
Author: U.S. Department of Energy
Publication Date: 2011
Media
(67 MB)
, Transcript

This webcast discussed financial program management.

Focus on the continuous improvement of your financing activities by tracking and evaluating data, responding to feedback, and modifying strategies when needed.

Launch your financing activities in coordination with other program components.

Establish an evaluation plan that will allow you to determine how your financing activities are impacting the market.

Develop a plan to implement your financing activities, with defined roles for financial institution partners, contractors, customers, and your program.

Determine if enhancements to existing financing products or the development of new products are necessary to allow you to achieve your goals and objectives.

Ensure that your program’s customers will have access to affordable financing, so they can pay for the services you offer.

Author: U.S. Department of Energy
Publication Date: 2016

This summary from a Better Buildings Residential Network peer exchange call focused on approaches organizations can use to improve the efficiency and effectiveness of home upgrade programs, including strategies to streamline data entry and make continuous process improvements.

Author: Electric Power Research Institute
Publication Date: 2008

Energy efficiency program evaluation is increasingly important as utilities implement programs to meet regulatory requirements, such as energy efficiency portfolio standards. While utilities need internal staff to oversee evaluation activities, most evaluations are actually conducted by outside consultants. Thus, utility staff require a sufficient understanding of the evaluation process to plan program evaluation activities as well as to manage internal stakeholders and evaluation contractors. This guide is intended to help prepare utility staff to accomplish these tasks.

Author: U.S. Department of Energy
Publication Date: 2016

This case study of Arizona Public Service (APS) and Arizona’s HPwES Sponsor, FSL Home Energy Solutions (FSL), focuses on their continuous improvements designed to elevate customer and contractor experience while boosting program cost-effectiveness.

Author: Energy Trust Oregon (Prepared by Johnson Consulting Group)
Publication Date: 2012

This report presents key findings and recommendations from the process evaluation of Clean Energy Works Oregon's (now Enhabit's) energy efficiency financing program. Table 1 provides a good list of key process evaluation research questions which may help others scope comprehensive process evaluations.

Author: Consortium for Energy Efficiency
Publication Date: 2015

The Consortium for Energy Efficiency has collected information from its membership for each of the past four years on the behavior-based programs currently underway and how these programs are being evaluated. This presentation describes the annual data collection effort and highlight the key findings of this research to date. Results discussed will consider the social science knowledge most commonly incorporated into the programs captured, as well as methods used for program evaluation and overarching lessons learned from the program administrator community.

Author: U.S. Department of Energy
Publication Date: 2014

This summary from a Better Buildings Residential Network peer exchange call focused on choosing and developing program evaluation.

Develop processes, strategies, and procedures to continuously improve your organization’s operations and position in the market.

Publicize benefits and lessons learned resulting from your organization’s success in the market.

Monitor the effectiveness of marketing and outreach strategies and adapt as needed.

Develop a plan and metrics to evaluate the effectiveness of your marketing and outreach strategies. 

Develop a marketing and outreach plan that details your strategies and tactics, workflows and timelines, staff roles and responsibilities, and budget.

Author: Wisconsin Energy Conservation Corporation
Publication Date: 2011

Example Me2 and Green Madison process evaluation plan to conduct an in-depth investigation and assessment of the major program areas.

Author: Wisconsin Energy Conservation Corporation
Publication Date: 2011

Example Me2 and Green Madison process evaluation plan to conduct an in-depth investigation and assessment of the major program areas.

Author: National Association of State Energy Officials
Publication Date: 2014

The Multi-State Residential Retrofit Project is a residential energy-efficiency pilot program, funded by a competitive U.S. State Energy Program (SEP) award through the U.S. Department of Energy. The Multi-State Project operates in four states: Alabama, Massachusetts, Virginia, and Washington. During the course of this three-year process evaluation, Cadmus worked closely with NASEO and the four states to collect information about the programs from many perspectives, including: State Energy Office staff, program implementers, homeowners, auditors/contractors, real estate professionals, appraisers, lenders, and utility staff. This report discusses: the project’s context; its goals; the evaluation approach and methods; cross-cutting evaluation results; and results specific to each of the four states.

Author: U.S. Department of Energy
Publication Date: 2016

The research described in this report holds great potential to significantly improve the process for including energy efficiency in developing and implementing federally funded multifamily rehabilitation projects through the USDA, the U.S. Housing and Urban Development (HUD) Low Income Housing Tax Credit, and other programs.

Author: Dale Hoffmeyer, U.S. Department of Energy; Gavin Hastings, Tierra Resource Consultants; Julie Caracino, NYSERDA; Cynthia Adam, Pearl National Certification; Greg Thomas, Performance Systems Development
Publication Date: 2015

Home Performance (HP) XML is transforming the way home energy upgrade programs collect and transfer information from one software system to another, leading to improved contractor satisfaction, lower administrative costs, and technological advancements in the home performance industry. This presentation provides an overview of HPXML and its benefits, and discuss how the data standard is facilitating technological and process improvements among home energy upgrade programs and software developers in the United States.

Author: The Cadmus Group, Inc.
Publication Date: 2012

Pacific Power contracted with The Cadmus Group, Inc., to conduct impact and process evaluations of its Washington low-income weatherization program for the program period extending from March 2009 through February 2011. The impact evaluation assessed energy savings and cost-effectiveness associated with the program, and in doing so quantified select non-energy benefits. The process evaluation assessed program delivery and efficacy, potential bottlenecks, opportunities for improvements, and participants’ experiences and satisfaction with the program.

Author: iSpring
Publication Date: 2014

The purpose of this report, prepared by sustainability consulting firm iSpring, is to provide the results of the EnergyWorks program to the contractors and auditors who participated, along with information on lessons learned over the course of the program that might prove helpful in their future work.

Author: Research Into Action, Inc.
Publication Date: 2010

This report describes the process evaluation of a pilot project in Portland Oregon that informed the refinement and expansion of the program statewide into Clean Energy Works Oregon (now Enhabit).

Author: U.S. Department of Energy
Publication Date: 2012

This peer exchange call summary focused on effective program evaluation and incorporating changes into programs based off evaluation insight.

Improve your program’s efficiency and effectiveness through regular information collection, assessment, decision-making, adaptation, and communication.

Develop a strategy for communicating program impacts and benefits to key audiences to create and sustain support and engagement.

Ensure a positive customer experience with your program from launch through implementation over time.

Establish metrics and measurement strategies for understanding whether you are effectively achieving your program goals and meeting your customers’ needs, while identifying areas that can be improved.

Develop a detailed plan for launching and operating your program that integrates all program components into a process that is customer-friendly and efficient for contractors and other partners.

Develop the necessary materials, tools, and staff capacity to effectively deliver and manage your program.

Design a residential energy efficiency program that integrates marketing and outreach, contractor coordination, incentives, financing, and program evaluation to provide customers with the products and services they want through a customer-centric process.

Author: U.S. Department of Energy
Publication Date: 2011

This document provides a menu of initial questions for a program administrator or implementer to build on and use in developing a real-time evaluation survey to collect qualitative data from contractors.

Author: U.S. Department of Energy
Publication Date: 2011

This document provides a menu of initial questions for a program administrator or implementer to build on and use in developing a real-time evaluation survey to collect qualitative data from program participants.

Author: Chris Lohmann, U.S. Department of Energy
Publication Date: 2011

Presentation providing an overview of financing programs, a strategy for continuous improvement, tools for program management, a risk management strategy, and common risks associated with financing programs.

To monitor progress toward program goals, successful residential energy efficiency programs have used a combination of project tracking systems, customer surveys, information from call centers, and feedback from contractors and other partners. By measuring performance at key points in the upgrade process, program administrators have been able to identify succuessful strategies, detect problems, and better understand which processes are working and which are not, allowing them to make...

Financial incentives—from rebates to lower interest rates—can help residential energy efficiency programs attract customers’ attention. Deadlines can create a sense of urgency and motivate homeowners to action on home energy upgrades. Many programs successfully established time limits on financial incentives and saw participation dramatically increase. ...

Author: Torsten Glidden, Build It Green
Publication Date: 2016

This presentation discusses how Energy Upgrade California streamlined its program through improvements in its HPXML and IT software.

Author: Michigan Saves
Publication Date: 2009

Sample RFP from Michigan Saves for a third-party to conduct an evaluability assessment and process evaluation for the program during the first phase of implementation.

Author: State and Local Energy Efficiency Action Network
Publication Date: 2011

This report presents the results of a scoping study to assess the need for national databases that can support best practices in energy efficiency program evaluation, measurement, and verification (EM&V).

Author: Washington State University Energy Program
Publication Date: 2012

This mid-program evaluation includes extensive analysis of program sectors, including results of surveys of participants, and summarizes lessons learned to date.

Author: Washington State University Energy Program
Publication Date: 2012

This mid-program evaluation includes extensive analysis of program sectors, including results of surveys of participants, and summarizes lessons learned to date.

Author: Washington State University Energy Program
Publication Date: 2012

This mid-program evaluation includes extensive analysis of program sectors, including results of surveys of participants, and summarizes lessons learned to date.

Author: U.S. Energy Information Administration
Publication Date: 2013

For this inventory, EIA reviewed and catalogued 329 data sources containing state energy efficiency program evaluation results into an inventory. The focus of this inventory is to support the National Energy Modeling System (NEMS) and to research cost information in state-mandated energy efficiency program evaluations.

Author: Betsy Kleinfelder, The Sustainability Institute
Publication Date: 2012

As part of its "intentional learning" process, Charleston WISE collects information from homeowners that helps the program systematically test assumptions and implement continuous improvement.