Improving Video Streaming and File Compression Efficiency without - - PowerPoint PPT Presentation

Improving Video Streaming and File Compression Efficiency without Affecting Quality

By Yves Faroudja

1990 2000 2010 2020 2030 TIME

BITRATE/ % of Internet

1/25% 2/50% 4/75% 8/90%

Demand Exceeds Supply = Opportunity

DEMAND COMPRESSION EFFICIENCY

• Demand for video bandwidth is

doubling every 3 years

• However, network compression

schemes efficiency doubles every 10 years

MPEG 2 H264 HEVC

Realized Technology Goal

• Preserve image quality at a bitrate reduction potential of 35%

to 50% with existing compression systems via the use of novel pre- and post- processing.

• Solution is video compression/codec agnostic.

System Overview

Transmission

• r

Storage

Main Channel

Conventional Compression Conventional Decompression

Support Channel(s)

Post- Processor VIDEO INPUT OUTPUT(1)

FULL RESOLUTION

OUTPUT(0)

LOWER RESOLUTION

Pre- Processor

MPEG TS

OUTPUT(n)

Additional lower RESOLUTIONS

Application Details: Pre-Processor

Main Channel

VIN H & V LPFs

Conventional Compression mux

Decimator Delay Match

Decompression

Expand

Support Layer Compression Motion Data

Send

Reduced Bitrate

Pre-Processor

Application Details: Post-Processor

High Quality Low Resolution Output To Display or Distribution

Support Layer Expander

Conventional Decompression

Decompression Non-linear Bandwidth Expansion

Storage

Full Resolution Output

Post-Processor

Receive Main 1/n Pixels demux

+

System Overview

Transmission

• r

Storage

Main Channel

Conventional Compression Conventional De- Compression

Support Channel(s)

Post- Processor VIDEO INPUT Pre- Processor

MPEG TS

Transmission

• r

Storage

Main Channel

Conventional Compression Conventional De- Compression

MPEG TS 4K 1080p 720p DVD VCD

OUTPUT(1)

FULL RESOLUTION

OUTPUT(n)

Additional Lower RESOLUTIONS

OUTPUT(0)

LOWER RESOLUTION

Application Example: 1080p Satellite Back-end Transmission

Reduced Bitrate Main Channel

INPUT 1080p Pre- Processor Satellite Uplink Facility

Conventional Compression Small Support Channel

Conventional Decompression

Satellite Downlink Facility

High Quality Reduced Output Stream(480p/540p/720p) Transmission of reduced bitrate stream allows for more streams per transponder mux Second stream at no additional bandwidth cost reduces system complexity

1080P Reduced Bitrate Output Post- Processor

demux

Application Example: 1080p Server Storage

Reduced Bitrate Main Channel

INPUT 1080p Pre- Processor Satellite Uplink Facility

Conventional Compression Small Support Channel

Conventional Decompression

Satellite Downlink Facility

High Quality Reduced Output Stream(480p/540p/720p) Storage of reduced bitrate streams increases available space 35% -50% mux Second stream at no additional bandwidth cost reduces system complexity

1080P Reduced Bitrate Output to CDN Post- Processor

demux

Application Example: 4K UHD Transmission on 1080P Network

Main Channel Reduced Bitrate 1080p

INPUT 4K Pre- Processor Distribution

Conventional Compression Small Support Channel

Conventional Decompression

CDN

Very High Quality Reduced Output Stream(1080p/720p) Deliver the UHD experience now mux Second stream at no additional bandwidth cost reduces system complexity

4K UHD Reduced Bitrate Output Post- Processor

demux

Application Example: 1080P HD Telepresence

Reduced Bitrate Main Channel

INPUT 1080P Pre- Processor

Conventional Compression Small Support Channel

Conventional Decompression

High Quality Reduced Output Stream(480p/540p/720p) Transmission of reduced bitrate streams ensures consistent quality even on crowded networks mux

Post- Processor

demux

1080p Output

A pre- and post- processor system is located at each site

Practical Implementation

Computer Simulation

• Validate and Measure the algorithms and approach
• - Matlab
• - C Model
• - Executable (Linux)
• Process real clips to gauge objective correctness (PSNR, SSIM, etc).
• Process real clips to gauge perceptual quality (i.e.. “Beauty”)
• Automate
• Iterate

Real Time GPU Implementation

• HPC-CUDA/OpenCL
• - Well suited to speedily process parallel compute and serial

compute elements = Real time

• - Well suited for rapid prototyping and implementation = Quick changes
• - Well suited for server head end = No specialized HW required

Mobile Post-Processing Implementation

• Tradeoff of power, processing & speed.
• - Should not consume more power than traditional decompression,

render, and display

• - Validate that decompression, render and display are processing

capable at the client

• - Validate that decompression, render and display can keep up with

real time and low latency playback

Original 4 Mbps/1080p Original 2 Mbps/1080p

Original 4 Mbps/1080p Original 2 Mbps/1080p Processed 2 Mbps/1080p

Original 4 Mbps/1080p Original 2 Mbps/1080p Original 4 Mbps/1080p

Original 4 Mbps/1080p Original 2 Mbps/1080p Original 4 Mbps/1080p Processed 4 Mbps/1080p

In Conclusion

• Codec technology cannot keep up with the voracious demand

for video bandwidth

• The coming clogging of the internet pipes seems inevitable
• We are proposing an out-of-the compression ‘box’ solution to

improve the situation

Thank you!

FIN