Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Design for Low-Power IoT Systems: Coarse-Grained Reconfigurable Acceleration Units
FRANCESCA PALUMBO
UNIVERSITÀ DEGLI STUDI DI SASSARI
Coarse-Grained Reconfigurable Acceleration Units FRANCESCA PALUMBO - - PowerPoint PPT Presentation
Design for Low-Power IoT Systems: Coarse-Grained Reconfigurable Acceleration Units FRANCESCA PALUMBO UNIVERSIT DEGLI STUDI DI SASSARI Design for Low-Power Internet-of-Things (IoT) Systems ISCAS 2018 Overview Motivations - What we need
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
FRANCESCA PALUMBO
UNIVERSITÀ DEGLI STUDI DI SASSARI
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
2
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
3
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
4
> 7 billion 20 MWh/year 1,800 kg oil
http://www.gartner.com/newsroom/id/3598917
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
4
> 7 billion 20 MWh/year 1,800 kg oil
Designed by Freepik
> 1 billion smartphones
http://www.gartner.com/newsroom/id/3598917
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
4
> 7 billion 20 MWh/year 1,800 kg oil
Designed by Freepik
> 1 billion smartphones 8.4 billion connected things in 2017 (+31% wrt 2016) 20.4 billion by 2020
http://www.gartner.com/newsroom/id/3598917
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Connectivity and real-time situation awareness are nowadays common in different scenarios.
5
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SMART HEALTH: distributed healthcare assistance to improve quality of life and active and healthy ageing, functionalities can be changed according to the daily tasks.
Connectivity and real-time situation awareness are nowadays common in different scenarios.
5
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SMART-SOCIETY: increased building efficiency and comfort, i.e. lightning/air quality management can be adjusted to the room status. SMART HEALTH: distributed healthcare assistance to improve quality of life and active and healthy ageing, functionalities can be changed according to the daily tasks.
Connectivity and real-time situation awareness are nowadays common in different scenarios.
5
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SMART-TRANSPORTATION: autonomous electric vehicle, improved driver assistance and care. Path towards destinations may vary, even diverging from the optimal
SMART-SOCIETY: increased building efficiency and comfort, i.e. lightning/air quality management can be adjusted to the room status. SMART HEALTH: distributed healthcare assistance to improve quality of life and active and healthy ageing, functionalities can be changed according to the daily tasks.
Connectivity and real-time situation awareness are nowadays common in different scenarios.
5
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Modern digital devices (real-time and ad-hoc) are pervasive (98% of computers are embedded) and interconnected.
6
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Modern digital devices (real-time and ad-hoc) are pervasive (98% of computers are embedded) and interconnected. They may also present sensing and actuating capabilities, leading to the concept of CPS.
6
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Modern digital devices (real-time and ad-hoc) are pervasive (98% of computers are embedded) and interconnected. They may also present sensing and actuating capabilities, leading to the concept of CPS.
Safety Security Certif. Distrib. HMI Seamless MPSoC Energy Automotive x x x x x x x Aerospace x x x x x x x Healthcare x x x x x x x x Consumer x x x
6
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Reconfiguration may allow to optimally implement complex/demanding systems, managing numerous/conflicting requirements and a variety of functionalities. Modern digital devices (real-time and ad-hoc) are pervasive (98% of computers are embedded) and interconnected. They may also present sensing and actuating capabilities, leading to the concept of CPS.
Safety Security Certif. Distrib. HMI Seamless MPSoC Energy Automotive x x x x x x x Aerospace x x x x x x x Healthcare x x x x x x x x Consumer x x x
6
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
7
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ENVIRONMENTAL AWARENESS: Influence of the environment on the system, i.e. daylight vs. nocturnal, radiation level changes, etc. Sensors are needed to interact with the environment and capture conditions variations.
7
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ENVIRONMENTAL AWARENESS: Influence of the environment on the system, i.e. daylight vs. nocturnal, radiation level changes, etc. Sensors are needed to interact with the environment and capture conditions variations. USER-COMMANDED: System-User interaction, i.e. user preferences, etc. Proper human-machine interfaces are needed to enable interaction and capture commands.
7
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ENVIRONMENTAL AWARENESS: Influence of the environment on the system, i.e. daylight vs. nocturnal, radiation level changes, etc. Sensors are needed to interact with the environment and capture conditions variations. USER-COMMANDED: System-User interaction, i.e. user preferences, etc. Proper human-machine interfaces are needed to enable interaction and capture commands. SELF-AWARENESS: The internal status of the system varies while operating and may lead to reconfiguration needs, i.e. chip temperature variation, low battery. Status monitors are needed to capture the status of the system.
7
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
8
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
FUNCTIONALITY-ORIENTED: To adapt functionality because the CPS mission changes, or the data being processed changes and adaptation is required. It may be parametric (a constant changes) or fully functional (algorithm changes).
A B C
8
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
FUNCTIONALITY-ORIENTED: To adapt functionality because the CPS mission changes, or the data being processed changes and adaptation is required. It may be parametric (a constant changes) or fully functional (algorithm changes). NON-FUNCTIONAL REQUIREMENTS-ORIENTED: Functionality is fixed, but system requires adaptation to accommodate to changing requirements, i.e. execution time or energy consumption.
A B C
8
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
FUNCTIONALITY-ORIENTED: To adapt functionality because the CPS mission changes, or the data being processed changes and adaptation is required. It may be parametric (a constant changes) or fully functional (algorithm changes). NON-FUNCTIONAL REQUIREMENTS-ORIENTED: Functionality is fixed, but system requires adaptation to accommodate to changing requirements, i.e. execution time or energy consumption. REPAIR-ORIENTED: For safety and reliability purposes, adaptation may be used in case of faults. Adaptation may add self-healing or self-repair features. e.g.: HW task migration for permanent faults, or scrubbing (continuous fault verification) and repair.
A B C
8
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
9
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Flexibility Efficiency
10
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
DSP GPU CPU GP
Flexibility Efficiency
10
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ASIC DSP GPU CPU GP
Flexibility Efficiency
10
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ASIC DSP GPU CPU GP
Flexibility Efficiency
CG RECONF FG
Reconfigurable computing provides a trade-off between execution efficiency typical of ASICs and flexibility mainly exhibited by GP devices.
10
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
ASIC DSP GPU CPU GP
Flexibility Efficiency
CG RECONF FG
Fine-Grained (FG) Coarse-Grained (CG) bit-level word-level flexibility ☺ speed ☺ memory
Reconfigurable computing provides a trade-off between execution efficiency typical of ASICs and flexibility mainly exhibited by GP devices.
10
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
VRC → Virtual Reconfigurable Circuits
DPR → Dynamic and Partial Reconfiguration
11
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
C
COMPUTING PARADIGM:
exchange through dedicated channels PECULIARITIES:
EXTERNAL INTERFACE:
A B D
actions state
13
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
C
COMPUTING PARADIGM:
exchange through dedicated channels PECULIARITIES:
EXTERNAL INTERFACE:
A B D
actions state
13
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
coarse grained substrate
1:1
http://sites.unica.it/rpct/
14
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
coarse grained substrate
1:1
http://sites.unica.it/rpct/
14
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
coarse grained substrate
1:1
coarse grained reconfigurable substrate
SB
SB
2:1
http://sites.unica.it/rpct/
14
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
coarse grained substrate
1:1
coarse grained reconfigurable substrate
SB
SB
2:1
http://sites.unica.it/rpct/
14
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Multi-Dataflow Composer (MDC) tool: Dataflow 2 HW tool
15
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Multi-Dataflow Composer (MDC) tool: Dataflow 2 HW tool
HDL Coarse-Grain (CG) reconfigurable substrate
HETEROGENOUS FUNCTIONAL UNITS
15
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Multi-Dataflow Composer (MDC) tool: Dataflow 2 HW tool
HDL Coarse-Grain (CG) reconfigurable substrate
configuration logic
HETEROGENOUS FUNCTIONAL UNITS IRREGULAR INTERCONNECT
15
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Multi-Dataflow Composer (MDC) tool: Dataflow 2 HW tool
HDL Coarse-Grain (CG) reconfigurable substrate
configuration logic
HETEROGENOUS FUNCTIONAL UNITS IRREGULAR INTERCONNECT
15
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Functional Oriented Non-Functional Oriented
A B C
16
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Functional Oriented
A B C in1
B E in2
A SW C in1 Execution Profile
B E SW in2
Non-Functional Oriented
A B C
16
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
A B C in
A D B in B E C
A SW C in Execution Profile
B B SW E D SW
Functional Oriented
A B C in1
B E in2
A SW C in1 Execution Profile
B E SW in2
Non-Functional Oriented
A B C
16
Troughput vs Energy
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Execution Profile A SW A SW A in SW
A A A in
A A in
A in
A B C in
A D B in B E C
A SW C in Execution Profile
B B SW E D SW
Functional Oriented
A B C in1
B E in2
A SW C in1 Execution Profile
B E SW in2
Non-Functional Oriented
A B C
16
Troughput vs Energy QoS Vs. Energy
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
17
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
Power consumption = Dynamic power + Static power
Dynamic: activity dependent
switching, there is a period of time when both the PMOS and the NMOS transistors are on (I·V·f)
(determined by the formula C·V2·f). Static: not activity dependent, but due to leakage currents.
90 nm Inflection Point
18
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
capacitance by custom design.
parallelism, mapping.
Dynamic
Clock gating Variable frequency Voltage islands Variable power supply Multi power supply DVFS
Static
Multi-threshold dev. Power gating Back (substrate) bias Multi-oxide devices SOI CMOS
INTRINSICALLY SYSTEM LEVEL MANAGEABLE AT SYSTEM LEVEL
19
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
20
Reduce frequency whenever you can. Stop the clock when the component is not active.
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
20
Reduce frequency whenever you can. Stop the clock when the component is not active.
Fine-Grained
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
20
Reduce frequency whenever you can. Stop the clock when the component is not active.
Fine-Grained Coarse-Grained
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
20
Reduce frequency whenever you can. Stop the clock when the component is not active.
Fine-Grained Coarse-Grained
50% less dynamic power
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
21
Reduce the voltage level of a power island whenever you can. Switch it off when it is not active.
Static Voltage Scaling (SVS )
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
21
Reduce the voltage level of a power island whenever you can. Switch it off when it is not active.
OFF
OFF
Static Voltage Scaling (SVS ) SVS with Power Shut Off (PSO)
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
21
Reduce the voltage level of a power island whenever you can. Switch it off when it is not active.
OFF
OFF
OFF OFF OFF OFF OFF
Static Voltage Scaling (SVS ) SVS with Power Shut Off (PSO) SVS with PSO and Power Modes
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
21
Reduce the voltage level of a power island whenever you can. Switch it off when it is not active.
OFF
OFF
OFF OFF OFF OFF OFF
Static Voltage Scaling (SVS ) SVS with Power Shut Off (PSO) SVS with PSO and Power Modes
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
22
Switch off the clock, applicable to both ASIC and FPGA.
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
22
Switch off the clock, applicable to both ASIC and FPGA.
Switch off the power supply, ASIC only (partially FPGA).
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
22
Switch off the clock, applicable to both ASIC and FPGA.
Switch off the power supply, ASIC only (partially FPGA).
POWER- DOWN BLOCK
Vdd Power Switch-Off Cell
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
22
Switch off the clock, applicable to both ASIC and FPGA.
Switch off the power supply, ASIC only (partially FPGA).
gated regions to normally-on cells.
POWER- DOWN BLOCK
P_UP
ALWAYS-ON BLOCK
Isolation Cell
POWER- DOWN BLOCK
Vdd Power Switch-Off Cell
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
22
Switch off the clock, applicable to both ASIC and FPGA.
Switch off the power supply, ASIC only (partially FPGA).
gated regions to normally-on cells.
MAIN REGISTER SHADOW REGISTER
SAVE RESTORE Retention Register
POWER- DOWN BLOCK
P_UP
ALWAYS-ON BLOCK
Isolation Cell
POWER- DOWN BLOCK
Vdd Power Switch-Off Cell
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
23
Switch off the clock, applicable to both ASIC and FPGA.
Switch off the power supply, ASIC only (partially FPGA).
gated regions to normally-on cells.
Vary mode changing Vdd, ASIC only.
POWER DOMAIN 1 0.8 V POWER DOMAIN 2 1.2 V
Level Shifters
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
depth of the filter can vary.
(LR), one always on and one switchable
24
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
depth of the filter can vary.
(LR), one always on and one switchable
insertion of
power switch cells;
handle the control signals [1*shut-o + 1*isol. + 2*reten.]
24
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
25
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
25
SB0
SB1 SB2
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
25
Common element
SB0
SB1 SB2
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SB0
SB1 SB2
26
Common element
α execution: E and F, being not involved, are wasting power!
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SB0
SB1 SB2
27
Common element
β execution: B C and D, being not involved, are wasting power!
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SB0
SB1 SB2
28
Common element
γ execution: B C and D, being not involved, are wasting power!
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
E D A D F C D A B
α β γ
29
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
SB
E A C B
SB SB
F D E D A D F C D A B
α β γ MDC front-end
29
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
C F D A B E
SB
E A C B
SB SB
F D E D A D F C D A B
α β γ MDC front-end
29
LRs Identification
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
C F D A B E LR 1 2 3 4 5 actors A B,C D E F α 1 1 1 β 1 1 1 γ 1 1
SB
E A C B
SB SB
F D E D A D F C D A B
α β γ MDC front-end
29
LRs Identification
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
low power (clock gated) CGR substrate
en generator
clk
configurator
en1 en2 en3 en4 en5 LR
actors
α β γ 1 A 1 1 2 B,C 1 3 D 1 1 1 4 E 1 5 F 1 1
MDC back-end
30
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
31
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
32
x0 x4 x2 x6 x1 x5 x3 x7 y0 y1 y2 y3 y4 y5 y6 y7
radix-2 butterfly stage 1 stage 2 stage 3
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
33
b_00 b_10 b_20 b_30 b_10 b_11 b_21 b_31 b_02 b_12 b_22 b_32
12 butterflies
b_00 b_10 b_20 b_30
4 butterflies
b_00
1 butterfly
b_00 b_10
2 butterflies
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
b_00 b_10 b_20 b_30 b_10 b_11 b_21 b_31 b_02 b_12 b_22 b_32 SWITCHABLE AREA
34
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
b_00 b_10 b_20 b_30 b_10 b_11 b_21 b_31 b_02 b_12 b_22 b_32 SWITCHABLE AREA
34
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
FFT: power vs throughput Dynamic trade-off management On ASIC MDC offers automatic implementation of power-gated and clock-gated designs FFT: Area
35
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
36
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
37
UNIVERSITY OF SASSARI UNIVERSITY OF CAGLIARI
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
37
UNIVERSITY OF SASSARI UNIVERSITY OF CAGLIARI
Design for Low-Power Internet-of-Things (IoT) Systems – ISCAS 2018
38
Coordinator: Michal Masin (IBM), michaelm@il.ibm.com Scientific Coordinator: Francesca Palumbo (UniSS), fpalumbo@uniss.it Innovation Manager: Katiuscia Zedda (Abinsula), katiuscia.zedda@abinsula.com Dissemination-Communication Manager: Francesco Regazzoni (USI), francesco.regazzoni@usi.ch www.cerbero-h2020.eu info@cerbero-h2020.eu @CERBERO_h2020
EU Commission for funding the CERBERO (Cross-layer modEl-based fRamework for multi-
part of the H2020 Programme under grant agreement No 732105.