Professional Documents
Culture Documents
Article Heat Transfer Engineering 2013 PDF
Article Heat Transfer Engineering 2013 PDF
Article Heat Transfer Engineering 2013 PDF
net/publication/258788064
CITATIONS READS
29 360
4 authors, including:
All content following this page was uploaded by Nicolas Lamaison on 11 January 2016.
To cite this article: Jackson B. Marcinichen , Jonathan A. Olivier , Nicolas Lamaison & John R. Thome (2013) Advances in
Electronics Cooling, Heat Transfer Engineering, 34:5-6, 434-446, DOI: 10.1080/01457632.2012.721316
Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained
in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the
Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and
should be independently verified with primary sources of information. Taylor and Francis shall not be liable for
any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of
the Content.
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://
www.tandfonline.com/page/terms-and-conditions
Heat Transfer Engineering, 34(5–6):434–446, 2013
Copyright
C Taylor and Francis Group, LLC
ISSN: 0145-7632 print / 1521-0537 online
DOI: 10.1080/01457632.2012.721316
This article highlights the advantages of on-chip microchannel cooling technology, based on first- and second-law analysis
and experimental tests on two types of cooling cycles, the first driven by an oil-free liquid pump and the second by an oil-free
vapor compressor. The analysis showed that the drivers of the fluid were the main culprits for major losses. It was further
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013
found that when energy recovery is of importance, making use of a vapor compression cycle increases the quality of the
recovered energy, hence increasing its value. This was demonstrated by analyzing the synergy that can exist between the
waste heat of a data center and heat reuse by a coal-fired power plant. It was found that power-plant efficiencies can be
increased by up to 6.5% by making use of a vapor compression cycle, which results not only in significant monetary savings,
but also in the reduced overall carbon footprints of both the data center and the power plant.
Figure 1 Data-center size and information technology (IT) power requirements. (Color figure available online.)
currently being used in the recent Aquasar computer [7–9], is much more effective in removing heat, with heat removal val-
which is an IBM blade center converted to use of a water-cooled ues using refrigerants over 300 W/cm2 being achieved [11]. It
cycle with water cooling elements designed by the LTCM lab has also been shown that heat fluxes of 180 W/cm2 can be re-
attached directly to the back side of the central processing unit moved with a refrigerant saturation temperature as high as 60◦ C
(CPU) dies. However, water has some notable disadvantages, (for facilitating waste heat recovery), while maintaining the chip
such as requiring a high pumping power, its high freezing point, temperature below 85◦ C [12]. These results were obtained on
microbe formation, corrosive properties of ultra-clean water, the evaporators depicted in Figure 2.
its electrical conductivity, and erosive properties at high fluid Another advantage of making use of on-chip cooling for the
velocities [10]. cooling of data center servers is that the waste heat can easily
Two-phase microchannel flow takes advantage of the latent be reused elsewhere. This is because the heat removal process is
heat of the fluid (an environmentally friendly refrigerant), which local to the server, thus minimizing any loss to the environment.
Consider a data center with 100,000 servers, each having a
heat generation rate of 300 W per server. This translates to 30
MW of heat that needs to be dissipated, which can potentially
be recovered. For servers running 24 h/day at a typical usage
level of 20% for 365 days/year, this translates to a total of 52.6
million kWh of energy consumption per year and heat to be
dissipated, which, at an average cost of 0.10 $/kWh, represents
a total annual value of $5.3 million.
The aim of this article is to provide an overview of microevap-
oration technology highlighting some thermohydraulic funda-
mentals of the flow in the microchannels and the application of
such technology to the cooling of data centers, which promises
to have a huge impact in minimization of energy consumption
and CO2 footprint. The potential for waste heat recovery due to
the enormous quantity of energy involved in such an application
will also be shown. Simulations and experimental results will be
provided to illustrate the benefits of applying such technology
Figure 2 Examples of typical microchannel coolers in copper and silicon. in data centers and reuse of wasted heat by a small electrical
(Color figure available online.) power plant.
MULTI-MICROCHANNEL ELEMENTS
General Fundamentals
Microevaporators
able online.)
to characterize flow (with or without flashing) through micro-
orifices as small as 15–25 μm, transient aspects of the two-phase
flow bubble coalescence process [18], time-strip analysis of motor valves are used to control the flow rate through each ME
high-speed videos to discern information on the dryout process according to the flow requirements of each.
and wave formation [19], flow pattern transition theory [14], The vapor compression (VC) cycle (Figure 6) consists of a
two-phase hot-spot cooling [17], critical heat flux [20], and so variable speed vapor compressor together with a condenser, liq-
on. All these aspects are focused solely on the microevaporator. uid accumulator, internal heat exchanger, low-pressure receiver,
To see the actual effect on the cooling performance of a data electronic expansion valve, and stepper motor valves prior to
center, such on-chip microevaporators are analyzed in this study each chip. After the variable-speed compressor (VSC) the flow
as part of a complete two-phase cooling cycle to determine their passes through three heat exchangers: the condenser, an inter-
actual energetic characteristics. nal heat exchanger (iHEx) and the low-pressure receiver (LPR).
A supplementary detailed discussion, including thermal de- This guarantees subcooling and superheating at the inlet of the
sign methods, on two-phase flow and heat transfer in microscale MEs and the VSC, respectively. The last two heat exchangers
channels can be found in the free web-book Wolverine Engineer- also increase the performance of the cooling system [22, 23].
ing Databook III of Thome [21]. Expansion is ensured by an electric expansion valve (EEV) prior
to the fluid flowing through the SMV/ME/MPAE .
The Mollier diagrams for the two cooling cycles with re-
TWO-PHASE MICROEVAPORATOR COOLING CYCLE: spect to HFC134a are given in Figures 7 and 8. To represent
COMPUTATIONAL AND EXPERIMENTAL
EVALUATIONS
circuit boards, known as server blades. Each blade is a server in its own right,
often dedicated to a single application. The blades are literally servers on a card, Figure 6 Schematic of the vapor compression cooling cycle. (Color figure
containing processors, memory, integrated network controllers, etc. available online.)
60°C (16.82bar)
Pump Using an in-house simulation code written specifically for
0.5bar
16.5 4 3
this purpose, the cooling cycles were designed and evaluated
1 58.73°C under steady-state conditions. A small blade center with 32
(16.32bar)
microprocessors and their associated auxiliary electronics were
16.0 considered, giving a total heat load of 3700 W. The simulations
Subcooler Condenser
considered:
15.5
100 150 200 250 300 • 60◦ C microevaporator inlet temperature (liquid saturated).
h, kJ/kg • 95◦ C condensing temperature (vapor compression cycle) and
Figure 7 HFC134a P-h diagram showing the thermodynamic conditions for
an increase of 2◦ C in the microevaporator’s water temperature
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013
specific points of the LP cycle. (Color figure available online.) (liquid pumping cycle).
• 30% outlet vapor quality for the MEs (to avoid dryout under
critical heat flux conditions).
the thermodynamic conditions for illustration purposes, a 0.5- • HFC134a, HFO1234ze, and liquid water as the working fluids
bar pressure drop in the microevaporator was considered for to evaluate.
both the LP and VC cycles, with the LP cycle having a sat-
uration temperature of 60◦ C and the condensing and evapo- The idea was to compare the cycles with respect to their energy
rating temperatures for the VC cycle being 90◦ C and 60◦ C, consumption, size of condensers, and temperature of the sec-
respectively. ondary fluid (potential use for a secondary application making
The goal of these cycles is to control the chip temperature to use of the waste heat), assuming a pressure drop of 1.5 bars in
a preestablished level by controlling the inlet conditions of the the entire cooling cycle. A design constraint was also imposed
microevaporator (pressure, subcooling and mass flow rate). It on the condenser (tube-in-tube type), with the pressure drops in
is imperative to keep the microevaporators outlet vapor quality the working and secondary fluids being limited to 0.05 and 1
below that of the critical vapor quality, which is associated with bar, respectively.
the critical heat flux (CHF). Due to this limitation, additional The simulations were also based on the following assump-
latent heat is available for further evaporation, which can be tions:
used by other low heat flux generating components in the server
• Steady-state flow and heat transfer.
blade (cooled by the MPAE ) not susceptible to CHF. Another
• The flow is adiabatic throughout all piping.
parameter that must be controlled is the condensing pressure
• Isentropic pumping and compression.
(condensing temperature). The aim, during the winter, is to re-
• Isenthalpic expansion (adiabatic).
• Uniform heat load on the microprocessors (no hot spots).
HFC134a
40 • Uniform flow distribution in the manifold leading to the MEs
LPR iHEx
5 4 3 2
and within the MEs themselves.
90°C (32.4bar) • One-dimensional heat transfer in the ME, more detail of which
can be found in reference [25].
0.2 0.4 0.6 0.8
Table 1 shows a summary of the results obtained.
P, bar
0.44°C (subcooling) LPR Even though the simulations considered isentropic pump-
ing and compression (ideal cases), huge differences in power
60°C (16.8bar) 7V consumption can be seen. If energy recovery is not taken into
6
1
7
iHEx Table 1 Simulation results
ME MPAE
LP cycle VC cycle
LP cooling cycle
uniform heat fluxes were considered. HFC134a was tested as
0.50 the working fluid and an oil free minicompressor and a gear
pump as drivers.
0.45 The full details of the system, its layout, uncertainties and
its controllability can be found in reference [24]. The main
0.40 focus here is to show an energetic and exergetic comparison
between both cooling cycles under steady state condition. Such
0.35
a comparison mainly evaluates the difference between the power
0.4 0.5 0.6 0.7 0.8 0.9 1
consumption of the drivers and the available energy and exergy
Driver overall efficiency, [-]
in the condenser. The experimental condition selected for the
Figure 9 Exergetic efficiency versus driver overall efficiency. (Color figure comparison was that the input powers on pseudo chips 1 and 2
available online.) were 90 W (41.7 W/cm2) and 75 W (34.7 W/cm2), respectively,
typical of an existing IBM blade server. For the VC cycle, a post
consideration, the LP cycle is the best option. Higher pumping heater (125 W) was considered, which simulated the heat load of
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013
power (about five times) is also observed when water instead auxiliary electronics of servers (memories, DC/DC converters,
of HFC134a or HFO1234ze is used as the working fluid. Heat etc.).
exchanger volume, which dominates the overall size of the sys-
tem, is also lower for the refrigerants. This implies a lower
initial investment cost for the two-phase system as well as a Energy Analysis
more compact system. When energy recovery is of concern, the
higher exergy obtained by making use of the VC cycle would be Table 2 shows the results for the driver’s power consumption
of particular interest, as the higher temperatures obtained would and overall efficiency, the latter calculated as the ratio between
be more attractive to the end user making use of the waste heat. the isentropic pumping or compression and the electrical input
To better understand the exergetic point of view of the poten- power. It also shows the two systems’ input and output energies
tial energy recovery, a simplified exergy analysis was developed associated with components and piping and the thermodynamic
for both cycles considering HFC134a as the working fluid. The conditions in the condenser for the main and secondary working
aim was to evaluate the effect the driver’s overall efficiency has fluids.
on the exergetic efficiency of the cycles. Exergetic efficiency The results show that the driver input power for the VC sys-
was defined as the ratio between recovered (in the condenser) tem is about six times higher than for the LP system. It is worth
and supplied (in the driver and blades) exergies. Figure 9 shows observing that the driver has a low overall efficiency (defined
the results, where it can be seen that the exergetic efficiency by the ratio between the isentropic pumping/compression power
increases when the overall driver efficiency increases. The VC and driver input power), which for the pump is mainly a result
cooling cycle starts to become the best exergetic option after a of its inverter’s high energy consumption (about 10 W when the
driver overall efficiency of about 67% is reached.
Table 2 Results of the energy analysis for the LP and VC cycles
pump is not working) and also leakage and slip of HFC134a in Table 3 Exergetic analysis of the VC and LP cooling systems
the gears. The last two aspects are due to the low viscosity of
LP cycle VC cycle
the working fluid (123.61 μPa for HFC134a against 466.40 μPa
for water at 60◦ C), which is at the lower limit for the specified Exergy supplied, W 40.1 146.7
pump (hence a pump specifically designed for the liquid refrig- Exergy destroyed, W 35.2 136
Pump or compressor 17.4 74.4
erant would be advisable). This also justifies why the difference Condenser 3.5 21.4
in driver input power was higher for computational than for ME1 3.4 3.6
experimental evaluations, where the former did not consider the ME2 0.9 0.8
actual driver inefficiencies. Regarding the oil-free minicompres- Post heater — 9
sor, despite its high overall efficiency in its actual refrigerator iHEx — 1.3
LPR — 0.9
applications, it is unusually low here since it is operating at SMV 0.27 3.3
temperature considerably above its intended design conditions Piping 9.7 21.3
[26, 27]. Exergy recovered, W 4.9 10.7
It can also be seen that 50.6% and 62.5% of the VC and LP Exergetic efficiency 12.3 7.3
systems’ energy, respectively, is associated with heat losses. It Pump or compressor 0.03 27.2
Condenser 58.4 33.6
shows that improvements can be made to improve the overall ME1 72.6 70.7
performance of the system, mainly associated with the reduction
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013
this type of utility [29]. For these simulations, a “perfect match” was considered, that
The case study is performed with a data center that uses the is, for fixed condensing and evaporating temperatures (Tcond
on-chip cooling concept proposed and tested earlier to cool the and Tevap ), fixing the value of the number of blades in the data
server blades. The heat removed is then redistributed to a power center to match the size of the power plant (output of electricity
plant to increase its efficiency. The power utility considered here generation, Welec ) and vice versa. Additional information can
is a typical thermal regenerative Rankine cycle consisting of a be found in reference [33].
boiler, a high- and low-pressure turbine, a condenser, a low- For the power plant, the average working pressures were
pressure and high-pressure feedwater pump, and a feedwater taken from the literature [34] as follows: (i) the boiler operates
heater. The feedwater heater receives heat from steam tapped at a pressure of 16.55 MPa, with superheated vapor entering the
after the high-pressure turbine. The optimal pressure for tap- turbines at 800 K and (ii) the condensing pressure is set at 10
ping the steam will be calculated to obtain maximum thermal kPa, with subcooled liquid leaving the low pressure pump at a
efficiency in each simulation. The data center waste heat will temperature of 46◦ C (T6). Any heat added through the main heat
be injected into the Rankine cycle after the condenser and prior exchanger will then result in an increase of temperature from
to the feedwater heater through an additional heat exchanger T6 to T7 (Figure 11). The evaporating temperature (microevap-
(MHE). The two cycles (LP cycle and VC cycle) and the power orator and heat spreader-HS on the blades) will vary between
plant are illustrated schematically in Figure 11. 25◦ C and 60◦ C and the condensing temperature (in the MHE)
The analyses were based on the following idealized assump- between 47◦ C and 90◦ C.
tions:
Figure 13 Influence of evaporating temperature (VC cycle: condensing tem- Figure 15 Influence of evaporating temperature on power plant efficiency
perature = 90◦ C). (Color figure available online.) (Tcond = 90◦ C). (Color figure available online.)
For the calculation of the carbon footprint, only the con- analysis with a lower evaporating temperature in the VC cycle
tribution of the electricity used is considered. Further, of the shows higher potential savings in CO2 (Figure 17). This results
greenhouse gases, only CO2 will be considered as it contributes in 380 tons of CO2 savings (PP and DC) per megawatt of elec-
more than 75% of all the greenhouse gases and is responsible tricity production when using the LP cycle versus 1980 tons of
for most to the greenhouse effect. CO2 per MW for the VC cycle.
Figures 16 and 17 show the total savings of CO2 (for the
power plant and data center) per megawatt of electricity pro- Monetary Savings
duction. Again, the evaporating and condensing temperature
effects were evaluated. The CO2 savings were calculated for the Figures 18 and 19 give the combined annual monetary sav-
data center relative to air cooling technology and for the power ings for the data center/power plant as a function of the condens-
plant in terms of mass of CO2 consumed per kilowatt-hour pro- ing and evaporating temperatures, respectively. The monetary
duced. The specific consumption of the power plant without savings of the data center was calculated with relation to tra-
considering data center energy recovery is 0.85 kg CO2 /kWh, ditional air cooling technology, which includes the savings in
which was determined considering the power plant efficiency energy costs by implementing a liquid pumping or vapor com-
(45.5%), the energy density (6.67 kWh/kg [36]), and mass of pression cycle and the savings in carbon tax (this was assumed
CO2 per kg of coal (2.6 kg/kg [36–38]). to be $30/ton CO2 [39]). For the power plant the specific price to
It can be observed that increasing the condensing tempera- produce 1 kWh of electricity was used, which considers the fuel
ture significantly increases the total amount of CO2 saved (see saved and the savings made in carbon tax. A value of $90/ton of
Figure 16). However, the potential savings in CO2 are always coal was used for fuel costs (average price from October 2008
smaller with the LP cycle than with the VC cycle. A similar to October 2010 [40]). The value obtained for a power plant
Figure 16 Influence of condensing temperature on carbon footprint (Tevap = Figure 18 Influence of condensing temperature on monetary savings (Tevap =
60◦ C). (Color figure available online.) 60◦ C). (Color figure available online.)
VSC variable-speed compressor a Multi-Microchannel Heat Sink with Hotspot Heaters for
Ẇ cv energy transfer rate by work, W Energy-Efficient Microelectronic CPU Cooling Applica-
Welec output of electricity generation, W tions, IEEE Transactions on Components, Packaging and
xo MEs’ outlet vapor quality, — Manufacturing Technology, vol. 1, no. 6, pp. 873–883,
2011.
Greek Symbols
[13] Revellin, R., Dupont, V., Ursenbacher, T., Thome, J. R.,
η efficiency and Zun, I., Characterization of Two-Phase Flows in Mi-
crochannels: Optical Measurement Technique and Flow
Subscripts
Parameter Results for R-134a in a 0.5 mm Channel, Inter-
AE auxiliary electronics national Journal of Multiphase Flow, vol. 32, pp. 755–774,
comp vapor compressor 2006.
pump liquid pump [14] Ong, C. L. and Thome, J. R., Macro-to-Microchannel
cond condensing Transition in Two-Phase Flow: Part 1—Two-Phase Flow
evap evaporating Patterns and Film Thickness Measurements, Experimental
Thermal and Fluid Science, vol. 35, pp. 37–47, 2011.
[15] Costa-Patry, E., Olivier, J. A., and Thome, J. R., Hot-
REFERENCES Spot Effects on Two-Phase Flow of R245fa in 85μm-
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013
[25] Olivier, J. A., Marcinichen, J. B., Bruch, A., and Thome, [40] globalCOAL, Coal, Australian Thermal Coal Daily
J. R., Green Cooling of High Performance Micro Proces- Price, 2011. http://www.indexmundi.com/commodities/
sors: Parametric Study between Flow Boiling and Water ?commodity=coal-australian&months=60
Cooling, International Journal of Thermal Sciences and
Engineering Application, vol. 3, pp. 041003.1–041003.12, Jackson B. Marcinichen is a research post doc at the
2011. Laboratory of Heat and Mass Transfer at the EPFL
(Lausanne-Switzerland) and has more than 15 years
[26] Hermes, C. J. L., Melo, C., Knabben, F. T., and Gonçalves,
experience in heating, ventilation, air conditioning,
J. M., Prediction of the Energy Consumption of House- and refrigeration (HVAC&R) systems. He received
hold Refrigerators and Freezers via Steady-State Simula- his B.E. in mechanical engineering from the Federal
tion, International Journal of Applied Energy, vol. 86, pp. University of Santa Catarina, Brazil in 1996, and his
1311–1319, 2009. Ph.D. in mechanical engineering from the same uni-
[27] Gonçalves, J. M., Melo, C., Hermes, C. J. L., and Bar- versity in 2006. He has authored more than 20 tech-
nical papers in journals, conferences, book chapters,
bosa, J. R., Experimental Mapping of the Thermodynamic and U.S. patents. He has designed and evaluated several experimental facilities
Losses in Vapor Compression Refrigeration Systems, Jour- characterizing the thermo- and hydrodynamic of cooling systems (calorimeters,
nal of the Brazilian Society of Mechanical Sciences and a wind tunnel, hybrid systems, etc.). Currently he is engaged in the development
Engineering, vol. 33, no. 2, pp. 159–165, 2011. of a new novel hybrid cooling system to cool high-performance microprocessors
using on-chip cooling.
[28] Moran, M. J., Howard, I., and Shapiro, N., eds. Fundamen-
Downloaded by [EPFL Bibliothèque] at 05:04 23 August 2013