Energy'Introspector:'Standard'Physical'Library' - PowerPoint PPT Presentation

Energy'Introspector:'Standard'Physical'Library' Interface'for'Full;System'Microarchitecture'and' Mul>;Physics'Simula>ons' ! William!Song † ,!Saibal!Mukhopadhyay † ,!Arun!Rodrigues ‡ ,!! and!Sudhakar!Yalamanchili † ! † Georgia!Ins?tute!of!Technology,!Atlanta,!GA! ‡ Sandia!Na?onal!Laboratories,!Albuquerque,!NM! SPONSORS! SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Major'Challenges' ! A!modeling!methodology!and!infrastructure!for! full$system* applica/on*+*microarchitecture*+*mul/$physics*simula/ons* ! Interac?ons!between!applica?ons!and!physical!phenomena! ! Interac?ve!dynamics!between!mul?ple,!dis?nct!physical!phenomena,! e.g.,!temperature!and!reliability! ! Interface*design !between!system/microarchitecture!models!and! physical!models! Back!Side!Air!Cooling! ! Standard*library !and! API*interface ! ! Ease!of!ReMuse! Cu!heat!spreader! Tier!4! Tier!3! Tier!2! Tier!1! BT!substrate! PCB! 2 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

State'of'the'Prac>ce' Current!prac?ces!(e.g.,!traceMdriven!simula?ons)!are!insufficient!at! 1. scale!to!address!research!problems!at!the!intersec?on!of! applica?ons,!microarchitecture,!power,!thermal,!and!reliability,!etc.! !→! We*need*holis/c*modeling*environment.* Applica>ons' ! Architecture' Physics' A!single!model!does!not!provide!all!necessary!details!and!modeling! 2. capabili?es!for!different!research!problems.! !→! We*need*a*framework*that*is*open*to*the*composi/on*of*** *************new*or*updated*physical*models !(universal) .* * → *The*physical*models*and*simulators*should*not*have* * *******cross$dependency*in*implementa/ons* (standard!interface) .* 3 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Problem'Descrip>on' In!this!talk,!we!address!two!major!problems:! Implemen>ng'integrated'power;thermal;reliability'simula>ons' 1. ! Why!do!we!need! microarchitecture,*mul/$physics*co$simula/on ! environment!( vs*conven/onal*trace$driven*simula/ons )?! Functional Emulation Benchmarks (Frontend) Microarchitecture Management Algorithms Instruction Stream Simulations Performance* Clock Frequency Microarchitecture Microarchitecture Counters* Controller Configuration Timing Simulation Power Modeling Failure Rate Access Counter Statistics Cumulative Power*Traces* Voltage Microarchitecture Power Modeling and Physical Thermal Modeling Leakage Dynamic + ! Configuration Energy Energy Thermal*Traces* Reliability Modeling Leakage Feedback Floor-plan Power Wear Modeling Package Floor-plan Configuration and Temperature Thermal Modeling Instantaneous* Floorplanning Failure*Rates* Multi-Physics Interactions Trace&driven+simula0ons+++++++vs+++++++Full&system+integrated+simula0ons+ + Which+simula0on+model+should+we+use?+ 4 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Problem'Descrip>on'(cont.)' Incorpora>ng'Various'Implementa>ons'of'Modeling'Tools'via' 2. Standard+Libraries+ ! A!single!model!doesn’t!provide!all!necessary!details!or!modeling! capabili?es!for!different!research!problems.! ! Open'to'Integra>on :!Can!we! standardize*the*interface*and* integra/on !of!models?! ! !so]ware!engineering!problem! McPAT, DSENT, etc. HotSpot, 3D-ICE, etc. BTI, TDDB, etc. Noise, Delay, etc. Thermal Reliability Other Power Library Library Library Libraries Standard'Mul>;Physics'Library'Interface' Microarchitecture'Simula>on'Framework' 5 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

General'Prac>ces:'Trace;Driven'Simula>ons' • Trace$driven*simula/on !is!the!most!commonly! used!approach!to!analyze!physical!impacts!of! Microarchitecture microarchitectural!opera?ons.! Simulations Performance Counters • Each!step!is!an!independent!simula?on.! Power Modeling • This!approach!does!not!capture! feedback* Power Traces interac/ons !between!the!models! Thermal Modeling (e.g.,!temperature!–!leakage!power!feedback).! Thermal Traces • This!simula?on!approach!can!only!be!used!to! Wear Modeling model! monotonous*processor*execu/ons !! Instantaneous Failure Rates (i.e.,!steadyMstate!analysis).! • Ref:*A.*Coskun,*T.*Rosing,*K.*Mihic,*G.*Micheli,*and*Y.*Leblebici,*“Analysis*and*Op/miza/on*of*MPSoC* Reliability,”*JOLPE,*Jan.*2006.** 6 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Full;System'Microarchitecture'&'Mul>;Physics'' Co;Simula>ons' ! We!propose!an!integrated!microarchitecture!and!mul?Mphysics! simula?on!model:! Functional Emulation Benchmarks (Frontend) Management Algorithms Instruction Stream Clock Frequency Microarchitecture Microarchitecture Controller Configuration Timing Simulation Failure Rate Access Counter Statistics Cumulative Voltage Microarchitecture Power Modeling and Physical Leakage Dynamic + ! Configuration Energy Energy Reliability Modeling Leakage Feedback Floor-plan Power Package Floor-plan Configuration and Temperature Thermal Modeling Floorplanning Multi-Physics Interactions 7 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Library'Integra>on'and'Mul>;Physics'Interac>ons' ! By!standardizing!individual!tools!into!a!set!of!libraries,! linking* library*models*becomes*a*problem*of*describing*physical* interac/ons ,!instead!of!the!so]ware!integra?on!of!tools.! Functional Emulation Benchmarks (Frontend) Management Algorithms Instruction Stream Clock Frequency Microarchitecture Microarchitecture Power Models Controller Configuration Timing Simulation (Power Library) Cacti/McPAT, Failure Rate Access Counter Statistics Cumulative Orion/DSENT, etc. Voltage Microarchitecture Power Modeling and Physical Leakage Dynamic + ! Configuration Energy Energy Reliability Modeling Leakage Feedback Floor-plan Power Package Floor-plan Configuration and Temperature Thermal Modeling Floorplanning Wear Models Multi-Physics Interactions (Reliability Library) Thermal Models NBTI, TDDB, HCI, (Thermal Library) Electromigration, etc. 3D-ICE, HotSpot, Microfluidics, etc. 8 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

SoPware'Engineering'Problems' ! With!mul?ple!models!integrated!into!the!same!framework,!there! are!several!engineering!problems!to!be!resolved:! Unified'Processor'Configura>on :! 1. ! There!has!to!be!a!way!to! associate*different*physical*models* with*different*processor*components ,!e.g.,!SRAM!vs.!logic!vs.! interconnect,!thermal!vs.!reliability,!etc. * ! Different*physical*phenomena*are*characterized*at*different* levels*of*processor*abstrac/on ,!i.e.,!package,!floorMplan,! architectural!unit,!etc.! Data'Synchroniza>on'and'Manipula>on :! 2. ! Physical!interac?ons/data!across!different!models!must!be! synchronized. ! • Ref:*W.*Song,*S.*Mukhopadhyay,*and*S.*Yalamanchili,*“Energy*Introspector:*A*Parallel,*Composable* Framework*for*Integrated*Power$Reliability$Thermal*Modeling*for*Mul/core*Architectures,”*ISPASS* (Short*Paper),*Mar.*2014.* 9 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY

Associa>ng'Physical'Models'and'Processor'Components'' Packaging) ! A! pseudo*component !is!a! physically* Model Library Pseudo Component = Thermal Library (Package) defined*unit !where!a!model!can! es?mate!physical!phenomena,!! Model Library Pseudo Component Pseudo Component = NULL (Cores: Intermediate) (Uncore: Floor-plan) e.g.!L2!cache!power.! Floor7planning) Model Library = Reliability Library … Pseudo Component Pseudo Component Pseudo Component ! A!processor!is!configured!by! (Floor-plan: Core0) (Floor-plan: Core1) (Floor-plan: CoreN) Pseudo Component (Source: L2$) Data)Reference)) composing! pseudo*component* Model Library = Model Library = Model Library = (Physical)Interac/on)) Reliability Library Reliability Library Reliability Library Model Library hierarchy .! = Energy Library … Pseudo Component Pseudo Component Pseudo Component (Source: Inst$) (Source: Registers) (Source: ALUs) ! Libraries*are*a]ached*to*pseudo* Model Library Model Library Model Library = Energy Library = Energy Library = Energy Library components !and!simulate!different! Architecture)Decomposi/on) Register ALU physical!phenomena!at!different! Files FPU levels! Instruction Instruction Instruction Fetch ST Cache Buffer Decoder Window LD Branch Data L1 Data Instruction Prediction TLB Cache TLB On-Chip L2 Data Cache Network 10 SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING | GEORGIA INSTITUTE OF TECHNOLOGY