Beyond Power Capping Coping with the Complexity of the German - PowerPoint PPT Presentation

Beyond Power Capping Coping with the Complexity of the German Electricity Market Dagstuhl Seminar “Dark Silicon: From Embedded to HPC Systems” Axel Auweter Leibniz Supercomputing Centre of the Bavarian Academy of Sciences and Humanities

SuperMUC • Phase 1 (2012) • 9216 nodes (Sandy Bridge) • 3.2 PFlops peak • Phase 2 (2015) • 3072 nodes (Haswell) • 3.2 PFlops peak • Approx 5MW Power

16 15,37 15,02 14,33 14,04 13,25 12 12,07 Electricity Cost ( € Cent / kWh) 11,53 11,41 11,4 9,73 9,34 8,92 8,86 8 7,98 6,86 6,47 6,05 4 0 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 Average electricity costs for German industrial customers consuming up to 20.000 MWh / year. Source: BDEW Strompreisanalyse 2014

16 15,37 15,02 14,33 14,04 13,25 12 12,07 Electricity Cost ( € Cent / kWh) 11,53 11,41 11,4 9,73 9,34 8,92 8,86 8 7,98 Production & 6,86 Transmission Costs 6,47 6,05 4 0 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 Average electricity costs for German industrial customers consuming up to 20.000 MWh / year. Source: BDEW Strompreisanalyse 2014

Power to the Customer Government Production Transmission Provider Consumption

Production vs. Demand • Power needs to be produced at the time when it is consumed • 50 Hz utility frequency serves as controlled variable • Varying response speeds depending on type of power plant min power: 50-60% min power: 40-50% min power: 40-50% max. change rate: ~4% / min max. change rate: ~3% / min max. change rate: ~10% / min

Electricity Transmission • 4 separate High Voltage Networks (380kV) • Providers ensure frequency stability through: • Collecting next-day plans from producers/ consumers (15 minute intervals) • Balancing between deviations from the next-day plans • Cross-zone balancing coordinated by Amprion Image Source: wikipedia

Electricity Transmission • Many Medium Voltage (10-30kV) networks across Germany • Operators load-balance internally and with the 4 High Voltage Networks • 3-fold action plan when deviations cannot be load-balanced across the networks: Primary Control Power (seconds) • Secondary Control Power (5 minutes) • Minute Reserve (15 minutes) •

Market for Electrical Energy • Based on 15-minute intervals Nevertheless: customers always deal with one company as • Over-the-Counter (OTC) the “provider” of their Market electrical energy! • Open Market Providers typically offer pricing schemes that enable customers to • Spot / Future / Option Market procure their power on these open markets… • EEX (Leipzig) / EPEX (Paris) • Indices (Phelix)

Cost Breakdown 0.60 1.60 0.05 0.05 4.00 0.01 0.11 ✓ Production (EEX) ! Electricity Tax Co-Generation Levy Renewables Energy Levy §19 StromNEV Levy O ff shore Levy Interruptible Loads Levy Concession Levy Network Service Fee Network Usage Fee 2.05 6.24 0.06 Electricity Costs in ct/kWh. Assuming an average annual consumption of 2.3 MW, year 2014.

Electricity Tax - “Stromsteuer” • Introduced 1999 • Taxes every use of electrical energy (2.05 ct/kWh) • Official reasoning: “Increase energy prices to encourage investments in energy efficiency.” • Use of the tax money: support statutory pension insurance • Exemptions: Electricity when consumed from a distinct grid solely powered by renewables • Producing companies can offset fees for the statutory pension insurance • Electrolytic applications - production of glass, brick, cement - metallurgy - … • … •

Renewables & Co-Generation Levy EEG-Umlage, KWK-Umlage • Introduced 2000 (Renewables), 2002 (Co-Generation) • Power from wind, solar and co-generation sources is preferred into the grid • Owners of power plants receive a fixed, subsidized amount per kWh to encourage investments in wind, solar, and co-generation plants • Costs for this subsidy are paid by the consumers Co-Gen Levy (Up to 100.000 kWh/y) Renewables Levy Co-Gen Levy (From 100.000 kWh/y) Co-Gen Levy (From 100.000 kWh/y - exempt industries) 0.4 7 6 0.3 5 ct / kWh ct / kWh 4 0.2 3 2 0.1 1 0 0 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Cost Breakdown 0.60 1.60 0.05 0.05 4.00 0.01 0.11 ✓ Production (EEX) ! ✓ Electricity Tax ✓ Co-Generation Levy ✓ Renewables Energy Levy ✓ §19 StromNEV Levy O ff shore Levy Interruptible Loads Levy Concession Levy Network Service Fee Network Usage Fee 2.05 6.24 0.06 Electricity Costs in ct/kWh. Assuming an average annual consumption of 2.3 MW, year 2014.

O ff shore Levy - “O ff shore-Umlage” Image Source: energy transition.de

O ff shore Levy - “O ff shore-Umlage” Government Transmission Network Operator Wind Power Company “Okay, we’ll set up an insurance for network operators to cover loss of profits in case of delayed “Laying the cable to connect offshore wind power deployments.” the offshore plants is high risk: What if the wind parks are delayed?” “We are not going to invest if the timely connection to the grid is not ensured!”

Cost Breakdown 0.60 1.60 0.05 0.05 4.00 0.01 0.11 ✓ Production (EEX) ! ✓ Electricity Tax ✓ Co-Generation Levy ✓ Renewables Energy Levy ✓ §19 StromNEV Levy ✓ O ff shore Levy Interruptible Loads Levy Concession Levy Network Service Fee Network Usage Fee 2.05 6.24 0.06 Electricity Costs in ct/kWh. Assuming an average annual consumption of 2.3 MW, year 2014.

Interruptible Loads Levy • Consumers > 50MW may arrange for interrupting their load upon demand of the network operator • In return, these consumers get paid a base + working fee! For HPC Centers: Some recent start-up companies try to combine • High write-down costs multiple smaller consumers of hardware! to overcome the 50MW • Killing jobs = extra initial hurdle! energy for restart! • Suspend/Resume e.g. www.enernoc.com anyone?

Cost Breakdown 0.60 1.60 0.05 0.05 4.00 0.01 0.11 ✓ Production (EEX) ! ✓ Electricity Tax ✓ Co-Generation Levy ✓ Renewables Energy Levy ✓ §19 StromNEV Levy ✓ O ff shore Levy ✓ Interruptible Loads Levy ! ✓ Concession Levy Network Service Fee Network Usage Fee 2.05 6.24 0.06 Electricity Costs in ct/kWh. Assuming an average annual consumption of 2.3 MW, year 2014.

Network Fees - “Netzentgelte” • The actual revenue of your grid provider! • Based on: Connection point (lower voltage - higher cost) • Max. 15-min average power consumption in the year • Annual utilization time • Actual consumption • • Service Fee / Usage Fee

Network Fees - “Netzentgelte” Network Fees Utilisation Time < 2500 h / y Utilisation Fee: ct / kWh Service Fee: € / (kW * y) Point of Service 2.62 8.96 Medium Voltage Switching Station • The actual revenue of your grid provider! 3.88 10.13 Medium Voltage 4.06 Example HPC Center 10.31 Low Voltage Switching Station 4.15 • Based on: 10.82 Average Power Consumption: 2.3MW Low Voltage Annual Energy Consumption: 201.48 GWh Connection point (lower voltage - higher cost) • HPL Power Consumption: 3.5MW Utilisation Time > 2500 h / y Max. 15-min average power consumption in the year • Annual utilisation time: 201.48 GWh Utilisation Fee: ct / kWh Service Fee: € / (kW * y) Point of Service 3.5 MW Annual utilization time • 0.24 68.29 Medium Voltage = 5757 h Switching Station Actual consumption • 0.60 92.04 Medium Voltage 0.56 97.82 Low Voltage Switching Station 1.38 80.02 Low Voltage 322,140 € 120,888 € • Service Fee / Usage Fee (Service Fee) (Usage Fee)

Cost Breakdown 0.60 1.60 0.05 0.05 4.00 0.01 0.11 ✓ Production (EEX) ! ✓ Electricity Tax ✓ Co-Generation Levy ✓ Renewables Energy Levy ✓ §19 StromNEV Levy + 19% VAT ✓ O ff shore Levy ✓ Interruptible Loads Levy ! ✓ Concession Levy ✓ Network Service Fee ! ✓ Network Usage Fee 2.05 6.24 0.06 Electricity Costs in ct/kWh. Assuming an average annual consumption of 2.3 MW, year 2014.

Recommendations • Continue your energy savings efforts! • Try to buy your electricity on the market! • Keep an eye at the market for interruptible load schemes! • Work towards a flat load profile / avoid peaks! • Move your data center to a different country?!? :-) • Consider talking to politicians…