SLIDE 1
Building an Open-Source based audio streaming platform
Maxime Bugeia
2 February 2020
2
Building an Open-Source based audio streaming platform Maxime - - PowerPoint PPT Presentation
Building an Open-Source based audio streaming platform Maxime - - PowerPoint PPT Presentation
Building an Open-Source based audio streaming platform Maxime Bugeia 2 February 2020 We stream audio! 2 French public broadcasting service 6 national channels 47 local channels 23 music webradios 2 Million listeners per day 200k
SLIDE 2
SLIDE 3
3
French public broadcasting service
6 national channels 47 local channels 23 music webradios 2 Million listeners per day 200k simultaneous listeners
SLIDE 4
4
Before
Black Box 3rd party Icecast
SLIDE 5
5
After
Icecast HLS Our own cloud and
- pen source based
infrastructure
SLIDE 6
6
Audio streaming
ICECAST
Streaming server Master/Relay Architecture Single bitrate No cache
HLS
Segmented audio/video files Sliding Playlist (m3u8) Adaptive bitrate Better mobile experience Cacheable content
Just “static” files Long persistent TCP connections
SLIDE 7
Getting audio to the cloud
7
Audio to listeners
SLIDE 8
Getting audio to the cloud
8
Audio to listeners
Producing stream formats Icecast HLS
SLIDE 9
Getting audio to the cloud Deliver content to listeners
9
Audio to listeners
Producing stream formats
CDN
Icecast HLS
SLIDE 10
Getting audio to the cloud Deliver content to listeners
10
Audio to listeners
Producing stream formats
CDN
Operate the platform Icecast HLS
SLIDE 11
11
Getting audio to the cloud!
SLIDE 12
LOCAL CHANNELS WEBRADIOS NATIONAL CHANNELS WAN
12 MULTICAST
Transport: multicast problem
DIRECT CONNECT
SLIDE 13
LOCAL CHANNELS WEBRADIOS NATIONAL CHANNELS WAN
13 MULTICAST
Transport: multicast problem
?
DIRECT CONNECT
SLIDE 14
LOCAL CHANNELS WEBRADIOS NATIONAL CHANNELS WAN
14 MULTICAST
Transport: multicast problem
?
No multicast in AWS!
DIRECT CONNECT
SLIDE 15
15
Transport: SRT to the rescue
SLIDE 16
LOCAL CHANNELS WEBRADIOS NATIONAL CHANNELS WAN
16 MULTICAST
Transport: to the cloud!
DIRECT CONNECT
SLIDE 17
17
SRT CALLER 1 SRT CALLER 2 SRT LISTENER 1 SRT LISTENER 2
m a i n backup m a i n backup
5 inputs per channel
Transport: resiliency
b a c k u p s a t b a c k u p s a t
SLIDE 18
18
Audio to cloud
DIRECT CONNECT SAT BACKUP
SLIDE 19
19
Producing stream formats!
SLIDE 20
20
Liquidsoap
Open Source Audio & Video Streaming Language Collaboration with Radio France
One program to rule them all
Receive Transcode Control
SRT listener Output AAC Output MP3 Produce HLS Produce Icecast Switch between sources Fallback logic Expose metrics
SLIDE 21
21
Producing the streams
DIRECT CONNECT SAT BACKUP
Icecast
Transcoder Liquidsoap
HLS
SLIDE 22
22
Liquidsoap Icecast Master Nginx Icecast stream HLS stream Icecast stream
Transcoder Architecture
HLS files
SLIDE 23
Radio as Code
23
Define inputs
SLIDE 24
Radio as Code
24
Live: what we want to play
SLIDE 25
Radio as Code
25
Fallback logic
SLIDE 26
Radio as Code
26
Fallback logic
Never fail!
SLIDE 27
27
Output HLS
Radio as Code
Source that never fails
SLIDE 28
28
Output HLS
Radio as Code
SLIDE 29
29
Output HLS
Radio as Code
SLIDE 30
30
Output Icecast
Radio as Code
Source that never fails
SLIDE 31
31
Liquidsoap Icecast Master HLS files live.m3u8 live_hifi.m3u8 segment1.ts segmentxxx.ts
Transcoders Architecture
HLS stream Nginx Icecast stream Icecast stream
SLIDE 32
32
Scaling to 200k listeners!
SLIDE 33
33
https://icecast.radiofrance.fr/fip-hifi.aac
Icecast Master
HTTP :80 HTTPS :443
Scale: Icecast
Transcoder 1 Transcoder 2 Icecast Relay 1 Icecast Relay 2 Icecast Relay X
AWS NLB
Icecast Relay
SLIDE 34
34
https://icecast.radiofrance.fr/fip-hifi.aac
Icecast Master
HTTP :80 HTTPS :443
Scale: Icecast
Transcoder 1 Transcoder 2 Icecast Relay 1 Icecast Relay 2 Icecast Relay X
AWS NLB
Icecast Relay
No cache No autoscaling Icecast Relay automatic fallback
SLIDE 35
35
HLS base stream
Scale: HLS
CDN
Cache layer
Transcoder 1 Transcoder 2 Varnish 1 Varnish 2 Varnish X
AWS NLB https://stream.radiofrance.fr/fip/fip.m3u8 https://stream.radiofrance.fr/fip/fip_hifi.m3u8 fip_aac_hifi_2_301960_1579533023.ts Segments Playlists
SLIDE 36
36
HLS base stream
Scale: HLS
CDN
Cache layer
Transcoder 1 Transcoder 2 Varnish 1 Varnish 2 Varnish X
AWS NLB https://stream.radiofrance.fr/fip/fip.m3u8 https://stream.radiofrance.fr/fip/fip_hifi.m3u8 fip_aac_hifi_2_301960_1579533023.ts Segments Playlists
Autoscaling at cache layer CDN level fallback possible
SLIDE 37
37
HLS base stream
Scale: HLS
CDN
Cache layer
Transcoder 1 Transcoder 2 Varnish 1 Varnish 2 Varnish X
AWS NLB https://stream.radiofrance.fr/fip/fip.m3u8 https://stream.radiofrance.fr/fip/fip_hifi.m3u8 fip_aac_hifi_2_301960_1579533023.ts Segments Playlists
Just like web!
SLIDE 38
38
Operate
SLIDE 39
39
Liquidsoap Icecast Master Nginx Icecast stream HLS stream Icecast stream
Transcoder Architecture
HLS files
SLIDE 40
40
Liquidsoap Icecast Master Nginx Liquidsoap xxxx Icecast stream HLS stream Icecast stream
Transcoder Architecture
One Liquidsoap per channel
HLS files Liquidsoap xxxx Liquidsoap xxxx Liquidsoap xxxx Liquidsoap xxxx Liquidsoap xxxx
SLIDE 41
Automate
41
Declarative everything Generating:
- SRT callers
- Liquidsoap scripts
- Icecast master & relay conf
SLIDE 42
42
Monitor
Visualize Collect Export metrics
Node Exporter Liquidsoap Icecast exporter
SLIDE 43
43
Monitor
SLIDE 44
44
HLS access logs HTTP POST Json Custom logs Ingester HLS Icecast
Monitor: real time listeners
Icecast prometheus Exporter
SLIDE 45
45
Monitor
SLIDE 46
46
Learn more
https://github.com/mbugeia/srt2hls Receive SRT stream Produce HLS Prometheus Metrics HTTP API Command and fallback logic https://github.com/Haivision/srt https://www.liquidsoap.info/
SLIDE 47
47
Special thanks to the Liquidsoap team! https://www.liquidsoap.info/
Learn more
SLIDE 48
For internal use only / prepared with love
Questions?
SLIDE 49
For internal use only / prepared with love
SLIDE 50
50
HLS / DASH Compatibility
SLIDE 51
51
mp3 / aac Compatibility
SLIDE 52
52
- gg / flac Compatibility
SLIDE 53
53
N L B Transcoders Segments HLS HTTP POST Segment Forwarder Storekeeper PGM PostgreSQL Bus RabbitMQ Cluster Kubernetes Segment .ts Playlists .m3u8 Player