Benchmarking Presentations

Benchmarking for Large C&I
Facility Energy Use

What Is Benchmarking and What Is It Good For?
Gwen Farnsworth
E SOURCE Research Manager
September 27, 2005

18th Annual E SOURCE Forum
2005 Platts, a Division of The McGraw-Hill Companies
Can You Tell Me?

Questions we hear from energy managers and
key account managers:
How much energy does an office building use?
Am I using too much energy?
How can I compare energy use across my
facilities?
What is my cost per HDD?
Is my facility using less energy since we put in
that new HVAC system?
9/27/05
Confidential: Not for distribution outside subscribing organization
Workshop Objectives
Main points of this workshop
Benchmarking is harder than most assume
Some data is available (how to find it and
how to use it)
The good and bad news about external
benchmarking tools
Reality check on internal benchmarking
(energy accounting) tools
How to help your customers
9/27/05
Presentation Outline
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
9/27/05
What Is Benchmarking and

What Is It Good For?
You cant manage what

you dont measure.
9/27/05

What Is It Good For? (cont.)
Benchmarking
Is a process of comparing the energy usage
(and/or costs) of one facility against other
similar facilities
May involve comparing against facilities
owned or operated by the same company
(internal benchmarking) or against an industry
standard (external benchmarking)
9/27/05

Why benchmark?
Get perspective on how facilities are performing

Motivate action (energy-awareness programs)
Screen buildings for audits, tune-ups, and retrofits
Communicate good results (public PR and
internal reporting)
Develop performance targets
Forecast and budget
Assess impact of energy conservation measures
9/27/05

Why dont more energy managers benchmark?
Dont know where to find external benchmark data

Dont know how to use external benchmark data
Dont have time to track internal data
Dont know what metrics to track
Dont have the proper tools (energy accounting software)
Dont know how to use energy accounting software
(or its just not user-friendly)
Hoping to get energy accounting software to do things
it wasnt designed to do
8
9/27/05

Benchmarking task or goal
Energy
accounting
Statistical
analysis
Target audits and planned retrofits
Create energy awareness campaigns
Compare against external data
Develop performance targets
Monitor performance
Communicate good results
Assess impact of energy conservation measures
Forecast and budget
Source: Platts
9
9/27/05

If the only tool you have is a

hammer, it is tempting to treat
everything as if it were a nail.
Abraham Maslow,
The Psychology of Science
10
9/27/05
11
9/27/05
Can You Tell Me?

facilities?
12
9/27/05
External Benchmarking Data: Commercial

Some commercial data sources
U.S. DOE EIA CBECS (Commercial Building
Energy Consumption Survey)
NRCAN OEE CIBEUS (Commercial and
Institutional Buildings Energy Use Survey)
Californias CEC CEUS (Commercial
End-Use Survey)
13
9/27/05
External Benchmarking Data: CBECS

Commercial Building
Energy Consumption Survey
Survey conducted every 4 years
1999 data released 20012002
2003 preliminary Building Characteristics
data released mid-2005
Expect 2003 energy Consumption and
Expenditures data early 2006
14
9/27/05
External Benchmarking Data: CBECS (cont.)

What data is collected?
5,430 buildings (1999)

1,000 square feet or greater
Structurally enclosed buildings
At least 50% of floor space for a primary
commercial or institutional use
How is the data collected?

Computer assisted telephone interview
Mail survey of energy providers (if needed)
15
9/27/05

Best available national data
Results extrapolated to national level
Useful for
Building characteristics
Energy intensity estimates
Estimated end-use breakdowns (preliminary)
16
9/27/05

Formats in which to access CBECS data
Special topics reports, 1999 Building Activities
Detailed tables
Public use micro-data files
www.eia.doe.gov/emeu/cbecs/contents.html
17
9/27/05
External Benchmarking Data: CBECS,

Building Activities Reports
18
9/27/05

Detailed Tables
19
9/27/05

Public Use Micro-Data Files
20
9/27/05
10

Public Use Micro-Data Files (cont.)
21
9/27/05

22
9/27/05
11

23
9/27/05

End-Use Consumption Estimates
24
9/27/05
12

Special topics reports, 1999 Building Activities
and End-Use Estimates tables
Quick online answers
Just a small portion of the available data
Detailed tables
More detailed data
Requires more time and familiarity
Public use micro-data files

Unlimited flexibility for manipulating the data
Requires in-depth study of background materials
25
9/27/05
External Benchmarking Data:

CIBEUS, Canada
First Canadian commercial and institutional
building survey: 2000 data (published 2002)
Future building surveys will be smaller
26
9/27/05
13

CIBEUS, Canada (cont.)
What data is collected?
4,101 responses
Buildings of at least 1,000 square feet
At least 50% of space for a single commercial
or institutional activity
Areas with population of 175,000 or more
(50,000-plus in Atlantic provinces)
How is that data collected?

In-person interviews
Some data collected from energy supplier
27
9/27/05

Useful for
Building characteristics
Energy intensity data
Not to be confused with NRCANs

Comprehensive Energy Use Database (CEUD)
28
9/27/05
14

Formats in which to access CIBEUS data
Detailed tables
PDF or Excel
www.oee.nrcan.gc.ca/corporate/statistics/neud/dpa/
data_e/cibeus_description.cfm?attr=0
29
9/27/05

30
9/27/05
15
External Benchmarking Data: CEUS

(California Energy Commission)
California Energy Commission sponsored
the surveys
Data were collected in utility service territories
PG&E 1996
SCE 1992, 1995 (electric only)
No public access to full data set (except

via CalArch)
Next round of data should be more accessible
31
9/27/05
32
9/27/05
16
External Benchmarking Tools:

Commercial
Some available tools
Energy Stars Portfolio Manager (EPA)
LBNLs Arch and CalArch
Kilojolts EnerCop
33
9/27/05

Energy Star
What the user does
Enter 12 months of billed energy data
Enter building characteristics data
What the software does

Compares entered data to CBECS (and
additional external data for some sectors)
Normalizes for various factors that affect usage
(e.g., occupancy, computers, swimming pool)
Complex algorithms for weather normalization
using 30-year norms
34
9/27/05
17

Energy Star (cont.)
What the user gets
Energy Star score (1 to 100, 75 = the building
ranks among the 25% most-efficient buildings)
Site and source annual energy intensity
CO2 emissions estimate
35
9/27/05

Energy Star (cont.)
Source: Energy Star, www.energystar.gov
36
9/27/05
18

Energy Star (cont.)
Source: Energy Star
37
9/27/05

Energy Star (cont.)
Source: Energy Star

38
9/27/05
19

Energy Star (cont.)
Its not perfect
Some sectors currently not represented
(restaurants, retail)
Must assess one building at a time; cant get
the big picture for a single sector
Results dont provide context
Score is based on source (primary) energy;
can be confusing for user
39
9/27/05
Can You Tell Me?

facilities?
40
9/27/05
20
External Benchmarking Tools: Arch

What the user does
Enters building descriptive data (size, ZIP code,
type of building)
Enters total annual energy use
What the software does

Queries CBECS database for energy usage
data of similar buildings (grouped by type, size,
and location)
41
9/27/05
External Benchmarking Tools: Arch (cont.)

What the user gets
A histogram report showing distribution of similar
buildings and usage from CBECS
Graph identifies where the users building would
appear in the distribution
Summary of information the user entered,
calculation of Btu/ft2/yr, number of similar
buildings from CBECS
42
9/27/05
21
Source: LBNL, http://poet.lbl.gov/arch
43
9/27/05
Source: LBNL
44
9/27/05
22

Its not perfect
Results may be based on few buildings
Results show actual survey data, not
extrapolated to the broader population
(i.e., no regional weighting)
Current version (released 2001) uses 1995
CBECS data
45
9/27/05

CalArch
Very similar to Arch
Similar interface, data entry and output
Data is California-specific (CEUS)
And its also not perfect

Some CEUS data is electric only
View actual survey data, not representative of
broader population (unweighted)
46
9/27/05
23

CalArch (cont.)
Source: LBNL, http://poet.lbl.gov/cal-arch/benchmark.html
47
9/27/05

CalArch (cont.)
Source: LBNL
48
9/27/05
24

CalArch (cont.)
Source: LBNL
49
9/27/05

Kilojolts EnerCop
Kilojolts Consulting Group
(Lexington, Massachusetts)
EnerCop software, commercially released in
August 2005
Includes sector-specific energy intensity
benchmarks from CBECS data
Developing a Kilojolts benchmark with
additional industry data
50
9/27/05
25
External Benchmarking Tools: EnerCop

(cont.)
Source: Kilojolts, www.kilojolts.com
51
9/27/05
External Benchmarking Tools: EnerCop

(cont.)
Source: Kilojolts
52
9/27/05
26
53
9/27/05
For More Information

Gwen Farnsworth
Tel 720-548-5428
E-mail gwen_farnsworth@platts.com
54
9/27/05
27
Benchmarking for
Large C&I Facility Energy Use
External Benchmarking Data and Tools:
Industrial
Neil Kolwey
September 27, 2005
Industrial Benchmarking Challenges

Most of energy use is for processes
(average of 80% for process use,
20% for HVAC and lighting)
Process use is industry-specific
Within specific industry sectors, many different
product mixes and different processes
Within same company, different products
and processes
9/27/05
Measurement of Energy Performance

Tracking energy use for facility or operation
Breakdown of energy use within facility
Identify largest energy uses
Understand weather-related component
Possible tracking at process level
Comparing energy use for facility (benchmarking)

Other facilities within same company
Other facilities within industry sector
9/27/05
External Data and Tools

Manufacturing Energy Consumption
(MECs) data
Energy-use breakdown for specific sectors
Annual Survey of Manufacturing

(ASM) data
Total energy costs and total value of shipments
Energy Star Plant Energy Performance Indicators

(EPI) data
Benchmarking tool available for a few sectors
9/27/05
What Are the Largest Uses

of Energy at My Facility?
Facility energy analysis/audit
Temporary submeters
Analysis of equipment rating, capacity factor,
hours of operation
Use MECs dataprovides typical energy use

patterns for your industry subsector
9/27/05
MECs Data Strengths and Weaknesses

Strengths
Provides breakdown of total energy use (for the
sector as a whole), by process and facility uses,
and for electricity versus specific fuels
Weaknesses
MECs provides no measure of total energy
use per unit of output
1998 data is most recent
Data quality problems, gaps
Data for specific sectors is limited
9/27/05
MECs Data: Energy Use for Rubber

and Plastic Products (NAIC 326)
Electricity use
(59% of total
energy)
Lighting
8%
Other
7%
HVAC
9%
Process
cooling
8%
Machine
drive
52%
Process
heating
16%
9/27/05
MECs Data: Energy Use for Rubber

and Plastic Products (NAIC 326)
Fuel use
(41% of total
energy)
Other
12%
HVAC
15%
Boiler fuel
50%
Process
heating
23%
Source: EIA, from http://www.eia.doe.gov/emeu/mecs/contents.html
8
9/27/05
MECs Data for One Sector:

Paper Products
9/27/05
External Benchmarking Data: ASM

Strengths
ASM provides annual energy costs (fuels and electricity),
other operating costs, and total value of shipments for
specific industrial sectors
2003 data is most recent
Weaknesses
Energy use for a specific facility depends on specific
processes, products made, and on outdoor temperature
(to a smaller extent)
ASM offers no way to adjust for these variables in order to
produce meaningful comparisons to the sectorwide average
10
9/27/05
ASM Data: What Is It Good For?

Electricity
costs
(million $)
Total energy
costsfuels
and electricity
(million $)
Total value
of shipments
(million $)
Polystyrene foam
products (32614)
114
200
6,647
Glass container mfg.

(NAICS 327213)
185
511
4,361
Cement mfg. (NAICS

32731)
589
1,158
7,550
Ferrous metal foundries

(NAICS 33151)
543
845
14, 653
Industrial sector
Source: Platts; data from ASM
11
9/27/05
ASM Data: Table 4
12
9/27/05
ASM Data: Table 2
13
9/27/05
ASM Data: Sources

Where does it come from?
U.S. Census data gathered every four years
From approximately 55,000 manufacturing
facilities
Where to find it:

http://www.census.gov/mcd/asmhome.html
14
9/27/05
External Benchmarking Data: Energy Star

Plant Energy Performance Indicators (EPIs)
Strengths
Useful tool for comparing energy performance
with other facilities in the same sector
Energy data is adjusted for product mix,
production rate, outdoor temperature, and
other variables, making it more meaningful
Weaknesses
Only available for a few sectors
Somewhat complicated to use
15
9/27/05
Sectors with Upcoming Energy Star EPIs
Breweries
Motor vehicle mfg.
Cement mfg.
Petroleum refining
Corn refining
Pharmaceutical mfg.
See http://www.energystar.gov/index.cfm?c=in_focus.bus_industries_focus
16
9/27/05
Data for Energy Star EPIs

Source
ASM and additional data from U.S. Census
Bureau
Data from companies participating in focus groups
How to use
Facilities enter data on annual energy use, total
production, product mix, and other metrics
Output is percentile ranking of facility compared
with other companies in sector (75th percentile
or above is considered efficient)
17
9/27/05
Internal Benchmarking
Comparing energy use per unit output for
similar facilities within the same company
Works if company has several facilities making
the same product (beer, cement)
Consider energy accounting tools
More-sophisticated analysis is possible on
site-specific basis
Some tools work well with submetering and
interval data
18
9/27/05
Internal Benchmarking Example: Unilever

2001 energy
budget
(million $)
1Q01 energy
costs
2Q01 energy
costs
3Q01 energy
costs
4Q01 energy
costs
YTD energy
costs
(million $)
Baltimore
1.37
0.38
0.39
0.35
0.25
1.37
Cartersville
0.62
0.18
0.15
0.19
0.14
0.66
Edgewater
0.38
0.05
0.09
0.07
0.09
0.30
Chicago
2.58
0.78
0.59
0.76
0.66
2.79
Total
4.94
1.39
1.22
1.37
1.14
5.11
Facility
Green : Under budget or 2000 consumption

Yellow: Exceeds budget or 2000 consumption
by <20%
Red : Exceeds budget or 2000 consumption
by >20%
19
9/27/05
Industrial Summary
Industrial facilities are hard to compare
External benchmarking data is limited
Basic internal benchmarking can be useful
Dont forget analysis and tracking of energy use
at the facility level
20
9/27/05
10

Neil Kolwey
Research Manager
Tel 720-548-5741
E-mail neil_kolwey@platts.com
21
9/27/05
11
Benchmarking for
Large C&I Facility Energy Use
Commercial & Industrial Benchmarking
Tools and Tips
Gwen Farnsworth
September 27, 2005
Internal Benchmarking (Energy Accounting)
Tools
2
9/27/05
Can You Tell Me?

facilities?
9/27/05
Internal Benchmarking Tools

E SOURCE researchers reviewed several energy
accounting software systems
Itron EEM
Cadence Enterprise
Avista Advantage Facility IQ and BI Tool
EnVinta Enterprize.EM
SMR Utility Manager
Metrix (Abraxas)
Kilojolts EnerCop
4
9/27/05
Internal Benchmarking Tools:

Energy Star
Some EASs now offer Energy Star benchmarking
Cadence Enterprise
Save More Resources
Avista Advantage
Ei3 Energy Watch
Servidyne EnergyCheck
9/27/05

Energy Star (cont.)
Source: Cadence Network, www.cadencenetwork.com
9/27/05

Energy Star (cont.)
Source: Cadence Network
9/27/05

Energy Star (cont.)

8
9/27/05

Ranking
Ranking is a basic way to compare usage
across sites. Some options are to rank by:
Index or simple normalization function (such as
usage/output, usage/ft2 , usage/HDD)
Total annual usage, or daily usage or costs
Budget variance
Percentage improved over baseline
9/27/05

Ranking (cont.)
Source: Itron, www.itron.com
10
9/27/05

Ranking (cont.)
Source: EnVinta, www.enterprizeem.com
11
9/27/05

Ranking (cont.)
Source: Avista Advantage, www.avistaadvantage.com
12
9/27/05

Ranking (cont.)
13
9/27/05

Ranking (cont.)
Source: Kilojolts
14
9/27/05

Ranking (cont.)
Source: Kilojolts
15
9/27/05

Weather Normalization (cont.)

16
9/27/05

Weather Normalization
Weather normalization options are limited with
commercial software
Focus on cost-avoidance (M&V, performance
versus baseline)
Normalize for weather by individual site, not
across sites
Require experienced users to control regression
options
17
9/27/05

Cost Avoidance
Source: SMR, www.savemoreresources.com

18
9/27/05

Cost Avoidance (cont.)
Source: SMR
19
9/27/05

Source: Abraxas Consulting (Metrix)
20
9/27/05
10


21
9/27/05

Selecting Software
Each tool and vendor offers unique features
Big Bundle: Bill pay, error resolution, refunds,
procurement
Energy Star
Cost-avoidance analysis
Weather data (temp, HDD/CDD, 30-year norm)
Budgeting, scenario forecasting, variance analysis
Meter data analysis
ASP versus intranet versus desktop versions
22
9/27/05
11

Selecting Software (cont.)
Key usability features
Report set-up, modification options, and interface
Grouping
Filtering
Calculations (normalization indexes)
Graphic options
Navigation interface
Online help, report explanations, and instructions
23
9/27/05

Why Usability Features Are Important
24
9/27/05
12

Report Options

25
9/27/05

Report Options (cont.)
Source: Itron
26
9/27/05
13

Source: EnVinta
27
9/27/05

Source: SMR
28
9/27/05
14

Grouping Function
29
9/27/05

Grouping Function (cont.)
Source: EnVinta
30
9/27/05
15

Grouping Function (cont.)
Source: SMR
31
9/27/05

Filtering Function
Source: SMR
32
9/27/05
16

Filtering Function (cont.)
Source: Kilojolts
33
9/27/05

Filtering Functions (cont.)
Source: Avista Advantage
34
9/27/05
17

Graphic Options
Source: SMR
35
9/27/05

Graphic Options (cont.)
Source: SMR
36
9/27/05
18

Source: SMR
37
9/27/05

Source: EnVinta
38
9/27/05
19

39
9/27/05

Online Help

40
9/27/05
20

Interface
Source: Avista Advantage

41
9/27/05

Keeping Data Clean
Source: EnVinta
42
9/27/05
21

Keeping Data Clean (cont.)
Source: Itron
43
9/27/05

Keeping Data Clean (cont.)
Source: SMR
44
9/27/05
22
45
9/27/05
How to Benchmark
1. Gather the data for each site
Total usage and demand
Expenditures
Normalization factors (square footage,
occupancy, revenue, production)
2. Check the data

Anomaly, missing data or variance reports
Review graphs of site-level monthly trends
46
9/27/05
23
How to Benchmark (cont.)

3. Clean the data
Verify and correct suspicious data
Estimate usage if missing
Exclude suspicious, incorrect, or incomplete
records from analysis
4. Convert to comparable values

Daily or annual usage
Indexes
47
9/27/05

5. Compare usage and expenditures
Totals (daily, monthly, quarterly, annual)
Index values (per ft2, per HDD or CDD,
per activity variable)
Average, range, distribution
Difference from average
Difference from previous period
Difference from budget
Difference from target
Rankings and multiple index ranking
48
9/27/05
24

5. Compare usage and expenditures (cont.)
Apply normalization factors to external benchmark
usage data (if available)
Adjust square footage for varying space types for
internal benchmarking
49
9/27/05

6. Interpret results
Top and bottom performers
Prioritize highest users and highest spenders
7. Take action
50
9/27/05
Desktop audits
Walk-through and full-building audits
Commissioning
Retrofit and operational plans
Recognize and reward good performers
25

Avoid the easy mistakes
Record usage for when energy was used, not
necessarily when the bill was paid
If comparing monthly data, make sure its
normalized to calendar month
CDD, HDD, and production monthly totals
should correspond to meter-read dates
Compare full-cycle data (annual average)
51
9/27/05

Use graphics
Line graphs to check monthly trends
Bar charts to compare current versus previous
period, budget, or target
Scatterplot to understand relationships between
usage and drivers (e.g., weather, production)
Histogram to see range and distribution of
performance across sites
52
9/27/05
26

Weekly
Energy metric
Compare daily energy use to
benchmarks
Monthly
Quarterly Annually
Verify utility bills
Compare monthly energy use to

historical trends
Summarize monthly results and

report to facility managers
Compare usage to historical trends
Compare usage to industry

benchmarks
Re-assess historical trends and

baseline
a
Source: Platts; adapted from LBNL- 54862
53
9/27/05
What You Can Do

Provide customer usage data in electronic
format
Calculate benchmark data from your
customer data
Provide national benchmark data
Encourage and help customers to use
Energy Star
54
9/27/05
27

Gwen Farnsworth
Tel 720-548-5728
E-mail gwen_farnsworth@platts.com
Neil Kolwey
Tel 720-548-5741
E-mail neil_kolwey@platts.com
55
9/27/05
28

Benchmarking Presentations

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Benchmarking Presentations

Uploaded by

Copyright:

Available Formats

Benchmarking for Large C&I

Facility Energy Use

September 27, 2005

Can You Tell Me?

Confidential: Not for distribution outside subscribing organization

Confidential: Not for distribution outside subscribing organization

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

You cant manage what

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

Get perspective on how facilities are performing

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

Dont know where to find external benchmark data

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

Target audits and planned retrofits

Create energy awareness campaigns

Compare against external data

Develop performance targets

Communicate good results

Assess impact of energy conservation measures

Forecast and budget

Confidential: Not for distribution outside subscribing organization

What Is Benchmarking and

If the only tool you have is a

Confidential: Not for distribution outside subscribing organization

Confidential: Not for distribution outside subscribing organization

Can You Tell Me?

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: Commercial

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS (cont.)

5,430 buildings (1999)

How is the data collected?

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS (cont.)

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS (cont.)

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS,

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data: CBECS (cont.)

Public use micro-data files

Confidential: Not for distribution outside subscribing organization

External Benchmarking Data:

Confidential: Not for distribution outside subscribing organization