Cold Air Containment Green Networking Workshop at SIGCOMM 2011 - - PowerPoint PPT Presentation

▶
cold air containment
SMART_READER_LITE
LIVE PREVIEW

Cold Air Containment Green Networking Workshop at SIGCOMM 2011 - - PowerPoint PPT Presentation

Dec 21, 2023 333 likes •707 views

Cold Air Containment Green Networking Workshop at SIGCOMM 2011 Friday, August 19th, 2011 Mikko Pervil and Jussi Kangasharju www.helsinki.fi/yliopisto Reseach goals 1) Reduce cooling requirements (this talk) 1) A/C performance 2) Chilling

slide-1
SLIDE 1

www.helsinki.fi/yliopisto

Cold Air Containment

Green Networking Workshop at SIGCOMM 2011 Friday, August 19th, 2011 Mikko Pervilä and Jussi Kangasharju

slide-2
SLIDE 2

Mikko Pervilä & Jussi Kangasharju 2 18.8.2011 www.helsinki.fi/yliopisto

Reseach goals

1) Reduce cooling requirements (this talk)

1) A/C performance 2) Chilling plant performance

2) Produce cooling for free (GreenNet 2010) 3) Harvest exhaust heat (future work)

...With minimal rebuilding = cheaply

slide-3
SLIDE 3

Mikko Pervilä & Jussi Kangasharju 3 18.8.2011 www.helsinki.fi/yliopisto

source: Urs Hoelzle, European DC Summit 2011 * source: GeSI/The Climate Group: SMART 2020 ** source: NRDC

72%

slide-4
SLIDE 4

Mikko Pervilä & Jussi Kangasharju 4 18.8.2011 www.helsinki.fi/yliopisto

source: Joe Kava, European DC Summit 2011

Materials: Steel and plastics

slide-5
SLIDE 5

Mikko Pervilä & Jussi Kangasharju 5 18.8.2011 www.helsinki.fi/yliopisto

Cold Air Containment

  • VanGilder's patent filed in 2005:
  • Cold Aisle Isolation
  • HP's white paper:
  • Hilss and Iyer, Improved data center efficiency —

incorporating air stream containment, 2009 (URL)

  • Emulation-based, details omitted
  • 14% to 41% “efficiency improvements”
slide-6
SLIDE 6

Mikko Pervilä & Jussi Kangasharju 6 18.8.2011 www.helsinki.fi/yliopisto

Mixed air flows

Rack Rack CRAC

Side view

Raised floor

slide-7
SLIDE 7

Mikko Pervilä & Jussi Kangasharju 7 18.8.2011 www.helsinki.fi/yliopisto

Separate air flows

Side view

Rack Rack CRAC

Plastic wrap

slide-8
SLIDE 8

Mikko Pervilä & Jussi Kangasharju 8 18.8.2011 www.helsinki.fi/yliopisto

Case: CERN

  • “Flagship” installation
  • Video from visitor area of CERN's DC
  • http://www.youtube.com/watch?v=x5rmtSpuSGA
slide-9
SLIDE 9

Mikko Pervilä & Jussi Kangasharju 9 18.8.2011 www.helsinki.fi/yliopisto

Just buy it?

  • Too much rebuilding
  • New racks, reinstall everything
slide-10
SLIDE 10

Mikko Pervilä & Jussi Kangasharju 10 18.8.2011 www.helsinki.fi/yliopisto

Just build a CFD?

  • Computational Fluid Dynamics model
  • Complex = expensive
  • Google's modelling several (4+) iterations
  • Cost: 5-10 k$
slide-11
SLIDE 11

Mikko Pervilä & Jussi Kangasharju 11 18.8.2011 www.helsinki.fi/yliopisto

Real implementation

  • Our costs 120.65 € in total:
  • Plastic covers 29.50 €
  • PVC tubes 37.14 €
  • Duct tape 54.01 €
  • Built in 3 hrs by

three persons

  • Some corners

were cut

slide-12
SLIDE 12

Mikko Pervilä & Jussi Kangasharju 12 18.8.2011 www.helsinki.fi/yliopisto

Before changes

Typical DC evolution → Inefficient placement?

slide-13
SLIDE 13

Mikko Pervilä & Jussi Kangasharju 13 18.8.2011 www.helsinki.fi/yliopisto

Computer Room A/C (CRAC)

Engineering solution: add more power

slide-14
SLIDE 14

Mikko Pervilä & Jussi Kangasharju 14 18.8.2011 www.helsinki.fi/yliopisto

Chilling plant

And more chilling plants.

slide-15
SLIDE 15

Mikko Pervilä & Jussi Kangasharju 15 18.8.2011 www.helsinki.fi/yliopisto

Two chilling plants

Shared chilling plant Dedicated chilling plant

slide-16
SLIDE 16

Mikko Pervilä & Jussi Kangasharju 16 18.8.2011 www.helsinki.fi/yliopisto

Data Center BK117

Ukko CRAC CRAC CRAC CRAC CRAC storage HIIT CS Dept.

slide-17
SLIDE 17

Mikko Pervilä & Jussi Kangasharju 17 18.8.2011 www.helsinki.fi/yliopisto

Power draws

  • 75 kW max power draw of Ukko cluster
  • 55 kW cooling equipment installed in 2010
  • 6,9 kW of Computer Room A/C (CRAC) units
  • 44,7 kW chilling plant
  • 3,8 kW rooftop radiator
  • IT + CRAC load
  • 85 kW typical
  • 115 kW sustained peaks
slide-18
SLIDE 18

Mikko Pervilä & Jussi Kangasharju 18 18.8.2011 www.helsinki.fi/yliopisto

Week before 26.3.2011

Ukko cluster Total Storage, HIIT, CRAC, UPS CS Dept. 1 hour

slide-19
SLIDE 19

Mikko Pervilä & Jussi Kangasharju 19 18.8.2011 www.helsinki.fi/yliopisto

Rising ambient temperature

Inlet temperatures from one host Absolute values suspect, relative change correct

slide-20
SLIDE 20

Mikko Pervilä & Jussi Kangasharju 20 18.8.2011 www.helsinki.fi/yliopisto

Finished installation

ﾧ after_CAC_installation.mp4

http://www.youtube.com/watch?v=jZIuJIVYsDs

slide-21
SLIDE 21

Mikko Pervilä & Jussi Kangasharju 21 18.8.2011 www.helsinki.fi/yliopisto

Effects on Ukko

  • Two 16 h periods before and after
  • Before: 7 hrs normal, 9 hrs peak load
  • After: 9 hrs peak, 7 hrs normal load
slide-22
SLIDE 22

Mikko Pervilä & Jussi Kangasharju 22 18.8.2011 www.helsinki.fi/yliopisto

Less cooling needed

  • Same time periods as before
  • Two CRAC:s kept on same set point
  • Two CRAC:s adjusted up by 7 C
  • One CRAC shut off completely!
slide-23
SLIDE 23

Mikko Pervilä & Jussi Kangasharju 23 18.8.2011 www.helsinki.fi/yliopisto

But power...

2 kW drop

Real savings at the chilling plant(s)?

Ukko cluster Total

Storage, HIIT, CRAC, UPS

CS Dept.

slide-24
SLIDE 24

Mikko Pervilä & Jussi Kangasharju 24 18.8.2011 www.helsinki.fi/yliopisto

Cooling fluid measurements

Set point unchanged Set point raised by 7 °C Cooling fluid measured here. Valves (W, S)

slide-25
SLIDE 25

Mikko Pervilä & Jussi Kangasharju 25 18.8.2011 www.helsinki.fi/yliopisto

Before change, valve W

Periodic drops

  • f temperature
slide-26
SLIDE 26

Mikko Pervilä & Jussi Kangasharju 26 18.8.2011 www.helsinki.fi/yliopisto

After change, valve W

Almost stable temperature

slide-27
SLIDE 27

Mikko Pervilä & Jussi Kangasharju 27 18.8.2011 www.helsinki.fi/yliopisto

Before change, valve S

slide-28
SLIDE 28

Mikko Pervilä & Jussi Kangasharju 28 18.8.2011 www.helsinki.fi/yliopisto

After change, valve S

slide-29
SLIDE 29

Mikko Pervilä & Jussi Kangasharju 29 18.8.2011 www.helsinki.fi/yliopisto

Pressure differences

  • Inefficient placement

strikes back

  • Less aisles is better
  • sock_video.mp4
  • YouTube link
slide-30
SLIDE 30

Mikko Pervilä & Jussi Kangasharju 30 18.8.2011 www.helsinki.fi/yliopisto

“Finalized” version

  • Switch to hard plastic sheets (video)
  • http://www.youtube.com/watch?v=8-uybY91f4o
  • Extra cost: ~260 €
slide-31
SLIDE 31

Mikko Pervilä & Jussi Kangasharju 31 18.8.2011 www.helsinki.fi/yliopisto

Reseach goals

1) Reduce cooling requirements (this talk) 2) Produce cooling for free (GreenNet 2010) 3) Harvest exhaust heat (?)

...With minimal rebuilding = cheaply

slide-32
SLIDE 32

Mikko Pervilä & Jussi Kangasharju 32 18.8.2011 www.helsinki.fi/yliopisto

Last year at GreenNet

slide-33
SLIDE 33

Mikko Pervilä & Jussi Kangasharju 33 18.8.2011 www.helsinki.fi/yliopisto

Helsinki Chamber (HC)

  • rack servers
  • much more heat
  • improved air flow
  • more reflective

+ CAC prototype!

slide-34
SLIDE 34

Mikko Pervilä & Jussi Kangasharju 34 18.8.2011 www.helsinki.fi/yliopisto

…And then we built that

slide-35
SLIDE 35

Mikko Pervilä & Jussi Kangasharju 35 18.8.2011 www.helsinki.fi/yliopisto

Summary

  • Cold Air Containment optimizes cooling
  • Can now install 20% more load
  • A/C can take it
  • Chilling plants can take it(?)
  • Tent and HC demonstrate free cooling
  • Next project: Harvesting exhaust heat
slide-36
SLIDE 36

Mikko Pervilä & Jussi Kangasharju 36 18.8.2011 www.helsinki.fi/yliopisto

Questions?

Pictures by

  • Janne Ahvo
  • Tuomas

Puikkonen

  • Sebastian

Siikavirta

Thanks!

Clear plastics are safe!