HD Video over IP HD Video over IP Seungju Lee, Jaeyoun Kim, JongWon - - PowerPoint PPT Presentation

NETWORKed MEDIA LAB.

• 1 -
• DEPT. OF INFO. & COMM., GIST

HD Video over IP HD Video over IP

Seungju Lee, Jaeyoun Kim, JongWon Kim

2006 21st APAN Meeting @ Tokyo, Japan

• Jan. 24th, 2006

Networked Media Laboratory

• Dept. of Information & Communications

Gwangju Institute of Science & Technology (GIST) jykim@nm.gist.ac.kr

http://hdtv.nm.gist.ac.kr

NETWORKed MEDIA LAB.

• 2 -
• DEPT. OF INFO. & COMM., GIST

Contents Contents

Uncompressed HD Video over IP

• Introduction
• Challenges and Proposed System
• Experiment

Visualization for HD Video over Collaborative Environments

• Introduction
• Challenges and Proposed System
• Experiment

Conclusion

NETWORKed MEDIA LAB.

• 3 -
• DEPT. OF INFO. & COMM., GIST

Uncompressed HD Video over IP Uncompressed HD Video over IP

NETWORKed MEDIA LAB.

• 4 -
• DEPT. OF INFO. & COMM., GIST

Goals and Challenges Goals and Challenges

Research Target

• Cost-effective system integration
• Dual-stream transport technique by using two 1GE-NIC

Have to consider

• Hardware Compatibility

Motherboard RAID card Motherboard HD-SDI Interface card

• Performance

Internal bottleneck

• Device Driver Support

NETWORKed MEDIA LAB.

• 5 -
• DEPT. OF INFO. & COMM., GIST

Uncompressed HDTV Streaming

System Overview

• Software-based and Hardware-based display

NETWORKed MEDIA LAB.

• 6 -
• DEPT. OF INFO. & COMM., GIST

Cost Cost-

• effective System Integration

effective System Integration

Total Costs (roughly, $ 30,000 ~ $ 40,000)

• 1 Sony HVR-Z1N camera and auxiliaries, $ 6,000
• 2 SuperMicro server systems, $ 10,000
• 2 Chelsio 10GE NICs, $ 5,400
• 2 AJA HD-SDI interface cards, $ 4,400
• 1 AJA Analog component to digital HD-SDI converter, $ 2,300
• 1 AJA HD-SDI to DVI-D converter, $ 1,200
• 2 24-bit audio A/D converters, $ 1,600
• 1 Mic., with echo cancellation, $ 800
• 1 Plasma 52’ HDTV, $ 10,000
• 1 LCD monitor supporting 1920x1080 resolution, $ 3,000
• 1 Avid Flying Cow A/D audio converter $ 400

Software : UltraGrid (USC/ISI) modification

NETWORKed MEDIA LAB.

• 7 -
• DEPT. OF INFO. & COMM., GIST

Hardware Spec. Hardware Spec.

Device Specification Mainboard SuperMicro X6DHE-XG2 DS & G (7520chipset) CPU Intel Dual-Xeon 3.0C FSB 800Mhz Memory PC3200 DDRII/400Mhz REG/ECC 2GB RAID 3 ware 9500s-8 SATA RAID controller HDD WD Raptor 74GBx8 SATA 10000 RPM WD740GD for server Seagate 120GB SATA 7200 RPM for client Graphics NVIDIA Geforce 6600GT 128 MB PCI-Express x16

Hardware spec. is important to prevent internal bottleneck We recommend followed system spec.

NETWORKed MEDIA LAB.

• 8 -
• DEPT. OF INFO. & COMM., GIST

Hardware Features

• HD-SDI card

AJA XENA HS capture card www.aja.com

• Support active samples ONLY (1920x1080 for 30 Hz/1.001)
• Maximum data rate : 1.244 Gbps
• Digital AV I/O
• Linux and Windows

BlackMagic DeckLink HD-Plus www.blackmagic-design.com

• Support total samples (2200x1125 for 30 Hz/1.001) along

with active samples

• Windows only

Centaurus card + audio www.dvs.de

• Support both total and active resolution
• Linux and Windows
• Expensive (over $ 10,000)
• Graphic card: support of xVideo (Software Display)

NVIDIA GeForce 6600GT 128 MB PCI-Express x16

Hardware Spec. (Cont.) Hardware Spec. (Cont.)

NETWORKed MEDIA LAB.

• 9 -
• DEPT. OF INFO. & COMM., GIST

System Integration: OS Kernel Selection System Integration: OS Kernel Selection

Linux OS Kernel (RedHat 9) dependency of integrated system hardware

Kernel Chelsio T210 Chelsio N201 XENA-HS RAID 2.4.18 X X O

• 2.4.21

X O

• O

2.4.25 O O O

• 2.4.28

X O O O 2.6.5 X O X O 2.6.6 O O

• 2.6.9

X O X

• 2.6.10

X O X O 2.6.11 X O

• O

2.6.12 X X

NETWORKed MEDIA LAB.

• 10 -
• DEPT. OF INFO. & COMM., GIST

Dual Dual-

• Stream Transport: Basic Problem

Stream Transport: Basic Problem

Dual-Stream Transport based on RTP/RTCP Frame splitting / assembly with synchronization

Splitter Network induces Delay, Jitter and out-of-order packets Packets created regularly at frequency f Transmitter Ref Clock Jitter makes packet arrive irregularly Assembler Smoothes out jitter effect brings them inorder Receiver Ref Clock

• Real-time Transport Protocol (RTP) & RTP Control protocol (RTCP)
• Payload format SMPTE-292M (draft-ieft-avt-smpte292-video-01.txt)

Specifies the widely used interconnect for HDTV equipment over IP

• `RTP Profile for TCP Friendly Rate Control’: interactions of TFRC with

RTP (draft-ietf-avt-tfrc-profile-03.txt)

NETWORKed MEDIA LAB.

• 11 -
• DEPT. OF INFO. & COMM., GIST

Dual Dual-

• Stream Transport: Proposed

Stream Transport: Proposed Architecture Architecture

Even / Odd frames are sent independently in a synchronized manner (thread based realization) Dual-Stream RTP transport covers transport for each flow Receiver places frames into separate playout buffers Display unit gets those frames and render them to the display (considering playout time) Detect packets dropped or reordered by network

NETWORKed MEDIA LAB.

• 12 -
• DEPT. OF INFO. & COMM., GIST

GwangJu GwangJu (GIST) (GIST) Daejeon Daejeon (KISTI) (KISTI)

Experiments Experiments

1G 1G SuperSiren SuperSiren-

• KREONET

KREONET Dedicated Link Dedicated Link

Experiments

• Domestic (Daejeon-GwangJu, 19 Aug., 2005)

NETWORKed MEDIA LAB.

• 13 -
• DEPT. OF INFO. & COMM., GIST

Domestic Tests

• Jumbo frames (9K MTU)
• Dedicated 1G link from KISTI to GIST
• Out-band audio (RAT or Skype)
• Software (xVideo) display on Plasma TV (1280x768 Res.)
• One-way live streaming
• 8-bit 4:2:2 active sampled video (down sized to roughly 910 Mbps)

Domestic Experiment Domestic Experiment

NETWORKed MEDIA LAB.

• 14 -
• DEPT. OF INFO. & COMM., GIST

Visualization for HD Video over Visualization for HD Video over Collaborative Environments Collaborative Environments

NETWORKed MEDIA LAB.

• 15 -
• DEPT. OF INFO. & COMM., GIST

High High-

• quality Visualization

quality Visualization

Display large size image for various research areas

• satellite imagery (365Kx365K pixels maps) for geoscientists
• brain imagery (4Kx4K pixels sensor) for neurobiologists
• Medical still image or animation

Enlarge display resolution

• Display device has the limit of resolution
• i.e., 20” LCD monitor at 1600x1200

Tiled Display

• Clustered display devices provide a

virtual large-resolution display

• To overcome the limit of resolution in

display device

NETWORKed MEDIA LAB.

• 16 -
• DEPT. OF INFO. & COMM., GIST

Goals and Challenges Goals and Challenges

Target Area in Collaborative Environment

• AG SVC consists of multiple machines

Target area

How to visualize multiple video streams over tiled display? System Performance Network Bandwidth Scalability/Flexibility Synchronization

NETWORKed MEDIA LAB.

• 17 -
• DEPT. OF INFO. & COMM., GIST

System Design System Design

Decoupled Decoding and Display Structure

NETWORKed MEDIA LAB.

• 18 -
• DEPT. OF INFO. & COMM., GIST

Data Distribution Strategy Data Distribution Strategy

Fractional Pixel Streaming

• To reduce the bandwidth to multiple SVC Displayers

Considering the display area of each SVC Displayer over tiled display

< Design of SVC >

NETWORKed MEDIA LAB.

• 19 -
• DEPT. OF INFO. & COMM., GIST

Experiments Experiments

• 1 0 x5 Monitors
• Resolution : 1 6 0 0 0 x 6 0 0 0
• 2 5 Display m achines
• 2 m onitors per m achine
• Decoding MPEG-2 TS

W ith 1 4 4 0 x 1 0 8 0 resolution captured from SONY HVR-Z1 U HDV cam coder

• Dual AMD 6 4 bit 2 .4 Ghz processors
• NVI DI A Quadro FX3 0 0 0 graphics card
• 1 Giga Ethernet netw ork interface
• 4 GB m ain m em ory

SVC Displayer-25 Sync Master SVC Displayer-1 SVC Decoder SVC Controller

1 Gbps network

SVC Provider

100 Mbps network

HD Camcoder

DVI output SVC control interface IEEE 1394

Sync channel

SVC control interface

. . . .

NETWORKed MEDIA LAB.

• 20 -
• DEPT. OF INFO. & COMM., GIST

Conclusion Conclusion

Versatile media tool for various media format for heterogeneous collaborative environments

• Decode/Transform as unified format in Local area network
• Integration of transport part

NETWORKed MEDIA LAB.

• 21 -
• DEPT. OF INFO. & COMM., GIST

Thank you! Thank you!

Send Inquiry to jykim@nm.gist.ac.kr http://netmedia.gist.ac.kr Gwangju Institute of Science & Technology