Sefos A self-aware factored operating system A Traditional OS App 1 - PowerPoint PPT Presentation

Sefos A self-aware factored operating system

A Traditional OS App 1 App 2 App 3 System call Operating System Memory File Device Scheduler Manager System Drivers App 2 Cache Cache App 1 I/O Disk App 3 Devices Core Core DRAM 2

Sefos: A Self-Aware OS Heartbeat/ Performance App 1 App 2 App 3 measurements heartbeat, System call algorithm goals sefos: A Self-Aware Observe Analysis & Optimization Operating Engine System Memory File Device Scheduler Control system Manager System Drivers Learner Decide Act voltage, freq, speed cache size, activity, power miss precision associativity power, temp rate App 2 Cache Cache App 1 I/O Cache Cache Disk App 3 PEP Core PEP Core Devices Core Core DRAM 3

Sefos is Factored File system fleet !,-%# .%*&# Core !"# #!"# !"# #!"# !"# $%%&# '%(# )*+%# User I/O App !"# #!"# !"# #!"# ! $"#%&'()*+,#-.()#/+*0-'+/#1+232#.&4+#/+*0-'+5#6&3+#/+*0-'+#!"5#78+#/+*0-'+#9":# ! ;&'<#/+*0-'+#-/#%=*(<+*#%&'()*+,#-.()#&# !""#$ )%#,-/(*->=(+,#/+*0+*/## ! ;&'<#/+*0+*#-/#>)=.,#()#&#')*+# ! ?668-'&@).#')*+/#4+//&3+#&#6&*@'=8&*#/+*0+*#')*+#()#=@8-A+#/+*0-'+# ! "+*0+*#')*+/#')88&>)*&(+B')44=.-'&(+#()#-468+4+.(#.++,+,#$"#/+*0-'+ # 4

Sefos is Self-Aware ! Sefos Analysis and Analysis & Optimization Engine Optimization Engine Observe ! A closed feedback loop of Vital Signs ODA (e.g. heartbeats) ! Each component provides a new OS service: Actuators Decision Engine Decide Act ! The observer provides vital • Applications (e.g. algorithms) signs services • OS sub-systems (e.g. • performance models growing fleets) ! The decision engine provides • control system • Hardware components (e.g. performance models and AI • learner frequency scaling) learning engine ! The actuators modifies system status ! Each component is either implemented as a fos fleet or integrated into another Analysis & S/W components. Optimization Engine 5

Sefos: Building self-awareness into fos Vital Signs Fleet Analysis & Optimization Engine ! Observes the status of software Observe and hardware components. Vital Signs ! Provides a distributed, global (e.g. heartbeats) knowledge-base of the system ! Implemented as a fleet, storing Actuators Decision Engine the information in a distributed data object key-value store ! ! Collects measurements from: 1) Applications e.g. Apps heartbeats, Application-specific measurements (fps in a video encoder or flops in a scientific app) 2) OS subsystems e.g. Utilization ratio of the file system fleet 3) Hardware components e.g. temperature, core frequency, power, cache miss rate 6

Sefos: Building self-awareness into fos Decision Engine Analysis & Optimization Engine ! A new OS service Vital Signs ! Implemented through a fleet of servers for scalability Decide Decision Engine Actuators ! Process input from the vital (e.g. performance signs service models, control system, AI learner) ! Provides two approaches to runtime decision making: " Machine learning " Classical control theory 7

Sefos: Building self-awareness into fos Actuators Analysis & Optimization Engine ! Actions allowing the system to Vital Signs adapt at runtime ! Three sets of actions, based on Actuators their impact: Decision Engine Act • Applications • Application actions • OS sub-systems • Hardware components (e.g. Allocating or de-allocating cores to • frequency scaling) an application Switching between algorithms • Migrating processes for better data • locality and cache usage • OS services actions Growing and shrinking fleets • Migrating servers • • Hardware actions Frequency scaling to save power • " Implemented as extension to fos fleets, OS tools for hardware actions or application-specific actions 8

Observe-Decide-Act Loop in Sefos Heartbeats Algorithm App O Choice O O OS D A D D D Runtime A Compiler Arch – net Arch – mem O Computation Arch – proc Migration A Logic & Heartbeats frequency circuits scaling Dynamic Device voltage A scaling 9 9