SLIDE 1
10 Thousand Channels to 10 Million Viewers: 10 Thousand Channels to - - PowerPoint PPT Presentation
10 Thousand Channels to 10 Million Viewers: 10 Thousand Channels to - - PowerPoint PPT Presentation
10 Thousand Channels to 10 Million Viewers: 10 Thousand Channels to 10 Million Viewers: Scaling Video Delivery over IP Scaling Video Delivery over IP Neill A. Kipp Neill A. Kipp Distinguished Engineer Distinguished Engineer One Frame of
SLIDE 2
SLIDE 3
Y Cb Cr Y Cb Cr
SLIDE 4
MPEG-2 Video Transport MPEG-2 Video Transport
PAT PMT 1 481 482 PID packetized elementary stream PES PES 188 byte packets program map table program allocation table audio 491 35 signals
SLIDE 5
Linear Transcoder single profile H.262 multiple profile H.264
Transcode to MPEG-4 Transcode to MPEG-4
1920 × 1080 1280 × 720 320 × 180 768 x 432 512 × 288 multicast
SLIDE 6
Package into DASH with Pillar LP Package into DASH with Pillar LP
7 x 188 byte packets per UDP Encoder Boundary Point (EBP) RAM disk DASH MPD TS
time shift buffer
13,445 Pillars running on 1443 hosts
SLIDE 7
XFINITY TV App for Comcast customers
SLIDE 8
Voice Remote Voice Remote
SLIDE 9
Distributed HTTP Access Distributed HTTP Access
Content Router
…
geographically distributed edge cache clusters manifest hostname and path hostname to resolve numeric address
- f router
manifest path 302 redirect to selected server in closest, least-loaded cluster health reports
DNS HTTP
cache miss to mid tier
SLIDE 10
Super8 JITP Super8 JITP
cache miss to origin mid tier cache 40 Super8 instances for national linear
IPVS
SLIDE 11
Player Plays the Frame Player Plays the Frame
SLIDE 12
Ad Signal Ad Signal
35
https://www.youtube.com/watch?v=3LHk2dou6jE
SLIDE 13
Blackout Blackout
https://www.youtube.com/watch?v=wiq3f02u3Y4
SLIDE 14
ENDEC Ingest
DASH Origin Super8
National EAS WS EAS Aggregator
poll OASIS CAP XML
Emergency Alert! Emergency Alert!
http://wallpapersinhq.pw/images/big/untitled_wallpaper-11614.jpg
SLIDE 15
Press Record Press Record
SLIDE 16
Pillar Linear Packager Super8 JITP Manifest Agent Segment Recorder Recorder Manager Active Vault MPD A8 TS
Rio 1.0 Cloud Recording Architecture
N8 C3 Stream Queues A8 Scheduler Updater N8 Stream Agent Metadata Storage ZK S3 S3 + fanout SQL S3 JQ Reconstitution Agent Reconstituted Vault DASH Origin Archive Agent Archived Vault
SLIDE 17
Master
schedule monitor rebalance launch Kubernetes nodes
Kubernetes master
etcd configure IP traffic
Kubernetes master
Virtualization, Orchestration, One-click Deploy Virtualization, Orchestration, One-click Deploy
SLIDE 18
Big Data Big Data
VIPER Player Platform Storm Hunk HTTP Collector Hadoop playback metrics history path
real-time analytics
2 years 3.5 PB MemSQL Headwaters Kafka Comcast API + metadata 1 min heartbeat
SLIDE 19
At Scale At Scale
550 edge nodes 138 TB ram disk 6 PB spinning 72 mid-tier nodes 36 TB ram disk 20 PB spinning 6.3 Tbps capacity 15 billion transactions, 5 PB per day 10 million viewers 13,445 linear channels 13,445 Pillars – 1443 VMs – 40 data centers 426 Super8 instances 40 data centers x1000 x100
SLIDE 20
On Demand Live On Demand Transcoder Network Attached Storage Super8™ Just-in-time Packager IP Content Delivery Network Player Platform Multicast Controller Home Gateway Emergency Alert System Analytics Ingest Linear Transcoder Alternate Content Router Event Scheduler Placement Opportunity Information System Real Time Reporting Pillar LP Linear Packager C2Factory VOD Indexer Analytics Storage DASH VOD Origin Rio Cloud Recording System Cloud Recordings
Player Platform Big Data
Advertising Decision System Manifest Manipulator
Content Origination
Blackout Manager
Service Delivery Engineering/ Infrastructure Alternate Content Release Management
SLIDE 21