Page 1
IEEE 802.1 Time-Sensitive Networking (TSN)
János Farkas, Norman Finn, Patricia Thaler Ericsson Huawei Broadcom
IETF 99 – Tutorial July 16, 2017
IEEE 802.1 Time-Sensitive Networking (TSN) Jnos Farkas, Norman - - PowerPoint PPT Presentation
IEEE 802.1 Time-Sensitive Networking (TSN) Jnos Farkas, Norman Finn, Patricia Thaler Ericsson Huawei Broadcom IETF 99 Tutorial July 16, 2017 Page 1 Before We Start This presentation should be considered as the
Page 1
IEEE 802.1 Time-Sensitive Networking (TSN)
János Farkas, Norman Finn, Patricia Thaler Ericsson Huawei Broadcom
IETF 99 – Tutorial July 16, 2017
Page 2 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Before We Start
This presentation should be considered as the personal view of the presenters not as a formal position, explanation, or interpretation
Page 3 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Outline
Page 4 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
INTRODUCTION
Page 5 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Potential Markets (not comprehensive)
Industrial Automation
5G
High Traffic Mix, Deterministic, Low Latency, Secure, Reliable, High Throughput
Page 6 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
(aka IEEE 802 or LMSC)
– Develop LAN and MAN standards – Mainly for link and physical layers
– 802 LAN/MAN architecture – Internetworking among 802 LANs, MANs, and other wide area networks – 802 Security – 802 overall network management, and protocol layers above the MAC & LLC layers.
IEEE 802 and 802.1
OSI Reference Model
Application Presentation Session Transport Network Data Link Physical Medium
IEEE 802
IEEE 802.1
Page 7 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
From AVB to TSN
– Started in 2005 – Address professional audio, video market – Consumer electronics – Automotive infotainment – Avnu Alliance: associated group for compliance and marketing
– AVB features become interesting for other use cases, e.g.
– AVB was not an appropriate name to cover all use cases – AVB TG was renamed to TSN TG in 2012 – Interworking TG and TSN TG were merged in 2015
Page 8 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Time-Sensitive Networking
TSN Components
Latency Bounded low latency:
Credit Based Shaper Frame Preemption Scheduled Traffic Cyclic Queueing & Forwarding Asynchronous Traffic Shaping
Reliability Ultra reliability:
Frame Replication & Elimination Path Control Per-Stream Filtering & Policing Time sync reliability
Synchronization Time sync:
Timing and Synchronization
Guaranteed data transport with bounded low latency, low delay variation, and extremely low loss Zero congestion loss Resource Mgmt Dedicated resources & API
Stream Reservation Protocol TSN configuration YANG Link-local Reservation Protocol
Page 9 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Bounded Latency
require a guaranteed not-to-exceed end-to-end latency for critical data
are irrelevant
– Throw away late packets; grossly overprovision the network; intensive engineering and testing. – Provide zero congestion loss
Page 10 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
0 Loss = Bounded Latency
– Constant input rate – Finite buffer capacity – 0 packets lost
Page 11 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
How to Get 0 Congestion Loss
– Packets/interval in == packets/interval out
– Packetized data is not a constant-rate bit stream – Different flows’ optimal transmit times can conflict
Page 12 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Gaps and Bursts
resources before the critical flow starts
strictly limit inter-flow interference and provide predictable gap/burst behavior
variations (e.g., forwarding delay)
Page 13 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Traditional Service
Loss probability Buffers allocated End-to-end latency Latency variation Probability Probability
Application’s requirement High Priority Average
(or grossly overprovisioning)
Page 14 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
TSN Service
Loss probability Buffers allocated End-to-end latency Latency variation Probability Probability
High Priority Average TSN Average Application’s requirement
Page 15 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Bottom Line: Why TSN?
– Network engineering – Bandwidth, over-provisioning – Testing
– Way easier to engineer – Works even in hard-to-test corner cases – Way cheaper
Page 16 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
RELIABILITY
Page 17 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Frame Replication and Elimination
(802.1CB)
– NO failure detection / switchover
then combine and delete extras
N1 N2 14 15 16 14 15 16 disjoint paths
frame flow
Replication Elimination
Page 18 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Illustration of QoS & Reliability Functions
Transmission Selection
Per-Stream Filtering and Policing Queuing
frame reception Frame transmission
Per Stream
Per-Stream Shaping Packet Replication / Elimination
Per Class
can be viewed as a hierarchical approach
Page 19 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Policing
using the Drop Eligible bit of VLAN tags
being discarded than “green” frames
determined that a frame can be delivered to some port. Frames that are dropped by the forwarding mechanism are not policed.
(see also RFC 2963)
Page 20 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Per-Stream Filtering and Policing
malfunctioning, malicious attacks, etc. (802.1Qci)
– Filters, Counters
– Open or Closed – can be time-scheduled
– Bandwidth Profile of MEF 10.3 – Red/Yellow/Green Marking Stream Filter Stream Gate Queueing Meter
incoming frame
Page 21 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
DETERMINISTIC LATENCY
Page 22 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Priority and Weighted Queuing
– Standard management hooks for weighted priority queues without over-specifying the details
Priority selection 1 2 3 4 5 6 7 Priority selection 1 2 3 4 5 6 7 Weighted
Highest priority: 7
Page 23 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Credit Based Shaper
(CBS - 802.1Qat)
– Shaped queues have higher priority than unshaped queues – Shaping still guarantees bandwidth to the highest unshaped priority (7)
but with really useful mathematical properties
– Only parameter = bandwidth – The impact on other queues of any number of adjacent shapers is the same as the impact of one shaper with the same total bandwidth.
Priority selection 1 4 5 6 7 2 3 Weighted
Highest priority for shaped queues
Page 24 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Credit Based Shaper – Example
Page 25 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Scheduled Traffic
Constant Bit Rate (CBR) streams, which are periodic with known timing
bridge queues (802.1Qbv)
time-schedule
Priority selection 1 4 5 6 7 2 3
T T T T T T T T
Weighted
Page 26 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Cyclic Queuing and Forwarding
alternate using time-gated control
compared to the cycle time, double buffers are sufficient:
Priority selection 1 6 7 2 3 4 5
T T T T T T T T
Alternately open green and purple Shapers ensure fair access for 0, 1, 6, 7 traffic
Frames being received Output in progress For next cycle Dead-time pad
Page 27 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Asynchronous Traffic Shaping
– All flows from one input port to same output port share the same queue – One shaper state machine per flow, and the right shaper applied to the packet upfront of the queue
Link
BE
High Low High Low select select
Page 28 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Frame Preemption
preemptable frames (802.3br and 802.1Qbu)
– It is link local per hop, i.e., it is not IP fragmentation
rocks:
rocks:
1 2 2 2
… …
1 2
…
3 3
…
Page 29 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Without Hold and Release
but not in all cases.
pMAC tx eMAC tx MAC Merge tx
IPG > Min mPacket left
Page 30 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
With Hold and Release
start of a scheduled rock
pMAC tx eMAC tx MAC Merge tx
Part 1 IPG Hold Part 2 Release Express traffic window Guard band
Page 31 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Preemption with Scheduling
Transmission Selection Transmission Selection MAC Control eMAC MAC Merge Sublayer PHY (unaware of preemption) MAC Control pMAC
Express Preemptable
802.3br Interspersing Express Traffic (IET)
802.1Qbv – Scheduled Traffic802.1Qbu Frame Preemption
Whole packets cross the MAC service interface. Fragments exist only below the MAC
Page 32 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
mPacket Format
Preamble SFD MAC DA FCS Ethertype Data MAC SA MAC Frame Express Non-fragmented Preemptable frame MCRC is the CRC of a non-final fragment. Value is the same as the FCS of the frame bytes transmitted XOR FFFF0000 MCRC indicates that the frame has been preempted 7 1 6 6 2 4 Last Fragment Preamble SMD-Cx FCS Data 6 1 4 Frag Count 1 First Fragment Preamble SMD-Sx MCRC Data 7 1 4 MAC DA Ethertype MAC SA 6 6 2
Legend: Start mPacket delimiter (SMD) SMD-E Express mPacket SMD-Sx: Start Fragment SMD-Cx: Continuation FragmentPreamble SMD-E MAC DA Ethertype Data MAC SA 7 1 6 6 2 FCS 7 1 6 6 2 Preamble SMD-Sx MAC DA Ethertype Data MAC SA FCS Intermediate Fragment Preamble SMD-Cx Data 6 1 4 Frag Count 1 MCRC Fragmented Preemptable frame Payload of each fragment (DATA plus CRC) ≥ min packet size
Page 33 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
DEDICATED RESOURCES
Page 34 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
TSN Configuration
– Fully Distributed Model – Fully Centralized Model – Centralized Network / Distributed User Model
Page 35 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Reservation Protocol
– Advertises streams – Registers the path of streams – Calculates the worst-case latency – Establishes an AVB domain – Reserves the bandwidth for streams
– Replicate a registration including changes – Optimized for databases on the order of 1 Mbyte – Not tied to bridges
Page 36 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
NO TIME TO TALK ABOUT
Page 37 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Timing & Synchronization
(P802.1AS-Rev)
– Redundant paths – Redundant GMs
long chains, rings
convergence time
Page 38 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Security
– Defines encapsulation of Extensible Authentication Protocol (EAP) over IEEE 802 – Widely deployed on both wired and Wi-Fi networks
– MACsec secures a link not a conversation – MACsec counters 802.1X man-in-the-middle attacks
– Supports trail of trust from manufacturer to user – Defines how a Secure Device Identifier may be cryptographically bound to a device to support device identity authentication
Page 39 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
SUMMARY
Page 40 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
TSN Summary
TSN
Latency Bounded low latency:
Credit Based Shaper Frame Preemption Scheduled Traffic Cyclic Queueing & Forwarding Asynchronous Traffic Shaping
Reliability Ultra reliability:
Frame Replication & Elimination Path Control Per-Stream Filtering & Policing Time sync reliability
Synchronization Time sync:
Timing and Synchronization
Guaranteed data transport with bounded low latency, low delay variation, and extremely low loss Zero congestion loss Resource Mgmt Dedicated resources & API
Stream Reservation Protocol TSN configuration YANG Link-local Reservation Protocol
Page 41 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Related Work: DetNet
provides Layer 3 aspects in support of applications requiring deterministic networking
define a common architecture
– characterization of flows – data plane, including encapsulation – required forwarding behaviors
Page 42
Survey: https://www.surveymonkey.com/r/99ieee
Page 43 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Page 44 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
FURTHER READING
Page 45 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Further Reading
http://www.ieee802.org/1/files/public/docs2017/tsn-farkas-intro-0517-v01.pdf
http://www.ieee802.org/802_tutorials/2017-07/tutorial-Automotive-Ethernet-0717-v02.pdf
http://standards.ieee.org/downloads/TSN_for_Automotive_Networks.pdf
http://standards.ieee.org/downloads/TSN_for_Industrial_Networks.pdf
https://drive.google.com/file/d/0B6Xurc4m_PVsZ1lzWWoxS0pTNVE/view?usp=sharing
Bridging” http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6595589
Time-Sensitive Networking http://www.ieee802.org/802_tutorials/2015-03/8023-IET-TF-1501-Winkel-Tutorial-
20150115_r06.pptx
Page 46 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Further Reading
GCM-AES-256 Cipher Suite
Extended Packet Numbering
Access Control
Security Key Agreement Protocol (MKA) Extensions
Page 47 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
BACKUP
Page 48 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
IEEE 802 is here: a standards committee formed by the Computer Society aka NesCom aka RevCom
IEEE Standards Organization
Page 49 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
– generally the top of the link layer
TAG = Technical Advisory Group
All Those Dots …..
Page 50 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
IEEE 802.1 Working Group
and other wide area networks, 802 Security, 802 overall network management, and protocol layers above the MAC & LLC layers.
– Chair: Patricia Thaler
– Chair: John Messenger
– Chair: Maximilian Riegel
– Chair: Michael Seaman
– Chair: János Farkas
Page 51 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
IEEE 802.1 Standards
independent standards
e.g., 802.1Qbv or 802.1AEcg
standard, e.g., 802.1Qav is now part of 802.1Q-2014
integrated into a single document
– Clauses 6 through 9 give a general overview of the 802.1Q bridge architecture – To get oriented on an additional area, it’s best to read the Clause titled the “Principles of <area>” – Once oriented, references in the subclause of Clause 5 Conformance for the relevant device can be helpful
Page 52 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Basic Principles
– This is a major Layer 2 value, not a defect!
– Destination MAC – VLAN ID (VID)
– Frame is forwarded to every port (except for reception port) within the frame's VLAN if it is not known where to send it – Filter (unnecessary) ports if it is known where to send the frame (e.g. frame is only forwarded towards the destination)
decision based on
– Priority – Drop Eligibility – Time
Page 53 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Protocol (gPTP)
– A Layer 2 profile of the IEEE 1588 Precision Time Protocol (PTP)
Sensitive Streams (FQTSS):
– Specifies Credit-Based Shaper (CBS)
– Registration and reservation of time-sensitive streams
– Provides an overall AVB architecture and AVB profiles
AVB Standards
Page 54 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
& Performance Improvements and TSN configuration
TSN Standards and Projects
related related
Page 55 IEEE 802.1 Time-Sensitive Networking (TSN) IETF 99 – Tutorial
Forwarding Process in 802.1Q