Maintaining Program Integrity The Role of Product

Maintaining Program Integrity

The Role of Product Testing • Goal: Protect the integrity of the label – Require the submission of appropriate test data on a product specific basis • Enhancing ESTAR Test Methods by referencing industry test procedures, developing test facility manuals, and requiring third-party documentation, where necessary – Implementing Testing Initiative to identify potential compliance problems • Set in motion a review process to ensure manufacturers take corrective measures

Referencing Industry Test Procedures • Dehumidifiers: Test Criteria: Tests shall be conducted in accordance with Clauses 4, 5, and 7 of ANSI/AHAM Standard DH-1, except that a watt-hour meter shall be used to measure dehumidifier energy consumption during the capacity rating test. The watt-hour meter shall be accurate within 0. 5 percent of the indicated value and have a scale with graduations of 1 watt-hour or less. Energy Factor is to be calculated according to Section 4. 2 of CAN/CSA-C 749 -94.

Quality Assurance: Improved Test Methods • EX: ESTAR Ceiling Fan Test Facility Guidance Manual – Provides procedures and specifications for building and setting up an air delivery room, specifies equipment, test method reporting procedures – Requires laboratories to calibrate to ensure consistent, repeatable results • All laboratories are required to calibrate, using the same reference fan, once a year and produce results within +/-3% of each other.

Quality Assurance: Improved Test Methods (cont. ) • EX: ESTAR Monitor Test Method Committee – More than 30 industry representatives collaborating with EPA on the draft monitor test method – References published specifications from VESA and IEC • supplement guidelines where necessary with methods developed in cooperation with industry – Process will ensure On Mode testing consistency among manufacturers

Compliance Testing Initiative • • Selecting products with greatest market share Using existing ESTAR testing guidelines Independent testing lab Stakeholder communication protocol with defined steps for non-compliance • Test results and recommendations – July/August -- Televisions – Nov. -- DVDs – Dec. /Jan. -- Monitors • Future efforts under consideration: on-site test method evaluations potential

TV Results Manufacturer Model Number Standby Mode Power (Watts) Energy Star Limit in Standby Mode (Watts) Unit #1 Unit #2 Pass/Fail Unit #3 1 A 3. 0 0. 7 0. 8 Pass 1 B 3. 0 0. 7 Pass 1 C 3. 0 0. 6 Pass 1 D 3. 0 0. 4 0. 5 0. 4 Pass 1 E 3. 0 1. 2 0. 9 Pass 2 A 3. 0 2. 8 2. 7 Pass 2 B 3. 0 1. 1 1. 0 1. 2 Pass 2 C 3. 0 2. 9 3. 0 Pass 2 D 3. 0 0. 7 0. 9 Pass 2 E 3. 0 0. 8 0. 6 0. 7 Pass 2 F 3. 0 0. 7 0. 5 Pass 2 G 3. 0 0. 5 0. 4 Pass 2 H 3. 0 0. 4 1. 9 Pass 3 A 3. 0 1. 6 2. 5 1. 6 Pass 3 B 3. 0 1. 8 2. 0 1. 8 Pass

DVD Results Manufacturer Model Number DVD Product Type 1 A DVD 2 A 3 3 Audio/DVD Partner Status Standby Mode Power (Watts) Pass/Fail Unit #1 Unit #2 Unit #3 No 0. 0 N/A (Pass) DVD No 1. 3 1. 2 N/A (Pass) A DVD Yes 2. 0 1. 9 1. 7 Pass B DVD Yes 2. 4 Pass 1. 4 1. 5 Pass 3 C DVD Yes (model labeled, but not qualified) 3 D DVD/VCR Yes 3. 2 3. 5 3. 1 Pass 4 A DVD No 2. 9 1. 8 N/A (Pass) 5 A DVD/VCR Yes (model isn’t labeled or qualified) 11. 6 7. 4 N/A (Fail) 6 A DVD Yes 1. 7 2. 0 Pass 7 A DVD Yes 0. 3 0. 4 0. 3 Pass 7 B DVD Yes 0. 4 0. 6 0. 4 Pass 7 C DVD Yes 0. 5 0. 8 0. 3 Pass 7 D DVD Yes 0. 6 0. 4 Pass 7 E DVD Yes 0. 3 Pass 8 A DVD Yes (model labeled, but not qualified) 0. 9 Pass

Lighting: Fixtures and Bulbs • Routine/ongoing testing initiative – PEARL -- creation and funding of certified lab to test product quality and performance – Two rounds of testing to date – Products failing are removed from ENERGY STAR

Retail Partner Store Level Assessment Background and Summary Rounds 1 & 2

Retail Store Level Assessment • Designed to evaluate the consumer shopping experience with ENERGY STAR in retail channel – Programmatic changes to increase product purchases • Three part assessment: – Salesperson knowledge and extent ENERGY STAR messaging is used in sales process – Visibility/presence of ENERGY STAR in store displays by department – Availability/visibility of ENERGY STAR qualified and labeled products in stores

Basic Approach • Approx. 7 qualified product categories for each trial (e. g. , DVDs, TVs); some variability • Approx. 5 national retailers including Best Buy, Home Depot, Lowe’s, Sears, Wal*Mart • Approx. 7 cities across the country from MA to CA

Cities/Products Fall & Summer • • Atlanta, GA • TVs (fall 01) Baltimore, MD • DVDs (summer 02) Boston, MA Dallas, TX Milwaukee, WI Portland, OR San Diego, CA

Evaluation Process • Sales Staff Evaluation – “Shoppers” Evaluate • 3 top considerations identified during sale • Mention of ENERGY STAR and understanding of program goals, elements, or features during the sales process – Combine to one score and scale to “ 100” – To reach “ 100” • Present ENERGY STAR, energy efficiency, and environment as top considerations • Demonstrate thorough knowledge of ENERGY STAR program during the sale

Evaluation Process • Display Check – Display material (POS/POP) present beyond labeled products – Who generates/applies and relative size • Product Shelf Inventory – Measure proportion ENERGY STAR-qualified products on shelves – Check visibility/presence of ENERGY STAR label on products and packaging

Summary Findings – 2 rounds • Salesperson knowledge – Scores by product 25 -50 – Highest = CFLs, appliances – Lowest = electronics • Store display visibility – Little difference in presence of ENERGY STAR focused materials in the two rounds – High opportunity in lighting and CE departments to coordinate materials with ENERGY STAR product promotions

Summary Findings – 2 rounds • Product inventory – Shelf area devoted to qualified products consistent with market penetration data – Ideal = see increase, over time, in inventory of ENERGY STAR qualified products • Product labeling – 26% of qualified DVD models not labeled at all; 26% models “mixed” – Small number of products “mis-labeled”

Our Action Steps • Retail partner “strategies” – Best Buy, Costco, Nationwide, Radio. Shack, Sears, Wal*Mart • Training/Product stocking • Promotion “matchmaking” – Contact with retailers/vendors • Website re-engineering – Shopping tool more robust – Qualified Product lists more accurate, easier to use

Our Action Steps • Future RSL plans – 2 rounds/year – Some variation in products/retailers – Local appliance/electronics dealers included on a limited basis • Questions

Logo Monitoring • Newspaper/magazine clips – monthly • Websites – quarterly • Follow up – calls – letters – referral to DOJ

Discussion and Feedback • Are there additional measures we should consider taking to protect the integrity of the ENERGY STAR label?