Best Practices for Data Centers Lessons Learned from

Best Practices for Data Centers: Lessons Learned from Benchmarking 22 Data Centers Steve Greenberg, Dale Sartor, Bill Tschudi, and Evan Mills, Lawrence Berkeley National Laboratory Peter Rumsey, Rumsey Engineers Bruce Myatt, EYP Mission Critical Facilities August 17, 2006 ACEEE Summer Study

The Data Center Challenge Data Centers 15 -40 x the energy intensity of typical office buildings n A single rack of servers can be 20 k. W n – $17 k per year (at $. 10) per rack – Hundreds of racks per center n Where are the opportunities? – 22 data centers benchmarked

IT equipment load density LBNL supercomputer center

Using benchmark results to find best practices We wondered what metrics were indicators of better performance. The ratio of IT equipment power to the total is an indicator of relative overall efficiency. Examination of individual systems and components in the centers that performed well helped to identify best practices.

Percentage of power to IT equipment We observed a wide variation in relative performance

HVAC system effectiveness We observed a wide variation in HVAC performance

Optimize Air Management Enforce hot aisle/cold aisle arrangement n Eliminate bypasses and short circuits n Reduce air flow restrictions n Proper floor tile arrangement n Proper locations of air handlers n

Typical hot aisle-cold aisle arrangement

Right-Size the Design Data Center HVAC often under-loaded n Ultimate load uncertain n Design for efficient part-load operation n – modularity – variable-speed fans, pumps, compressors Upsize fixed elements (pipes, ducts) n Upsize cooling towers n

Optimize the Central Plant Have one (vs. distributed cooling) n Medium temperature chilled water n Aggressive temperature resets n Primary-only CHW with variable flow n Thermal storage n Monitor plant efficiency n

Design for Efficient Central Air Handling Fewer, larger fans and motors n VAV easier n Central controls eliminate fighting n Outside-air economizers easier n

Use Free Cooling n Outside-Air Economizers – Can be very effective (24/7 load) – Controversial re: contamination – Must consider humidity n Water-side Economizers – No contamination question – Best in series with chiller

Improve Humidity Control n Eliminate inadvertent dehumidification – – – n n Computer load is sensible only Medium-temperature chilled water Humidity control at make-up air handler only Use ASHRAE allowable RH and temperature Eliminate equipment fighting – Coordinated controls on distributed AHUs

Specify Efficient Information Technology Power Supplies and Uninterruptible Power Supplies Power supplies in IT equipment generate much of the heat. Highly efficient supplies can reduce IT equipment load by 15% or more. UPS efficiency also varies a lot. (Do they need the same environment as the IT equipment or can their conditions be relaxed? )

Consider On-Site Generation n Can use waste heat for cooling – sorption cycles – typically required for cost effectiveness Swaps role with utility for back-up n Air-quality issues n Sell-back options n – complex controls required

Use Liquid Cooling of Racks and Computers n n Water is 3500 x more effective than air on a volume basis Cooling distribution is more energy efficient Water-cooled racks available now; liquidcooled computers are coming Heat rejection at a higher temperature – Chiller plant more efficient – Water-side economizer more effective

Improve Design, Operations, and Maintenance Processes n n n Get IT and Facilities people to work together Use life-cycle cost analysis Document design intent Introduce energy optimization early Benchmark existing facilities Re-commission as a regular part of maintenance

Summary n n n n n Air management Right-sizing Central plant optimization Efficient air handling Free cooling Humidity control UPSs and power supplies On-site generation Liquid cooling Design and M&O processes

Conclusion Energy benchmarking can be effective in helping to identify better performing designs and strategies. As new strategies are implemented (e. g. liquid cooling), energy benchmarking will enable comparison of performance.

Thank you! Questions? ? For more info: http: //hightech. lbl. gov/datacenters