HD Video over IP HD Video over IP Seungju Lee, Jaeyoun Kim, JongWon Kim 2006 21 st APAN Meeting @ Tokyo, Japan Jan. 24 th , 2006 Networked Media Laboratory Dept. of Information & Communications Gwangju Institute of Science & Technology (GIST) jykim@nm.gist.ac.kr http://hdtv.nm.gist.ac.kr N ETWORKed M EDIA L AB. - 1 - D EPT. OF I NFO. & C OMM., GIST
Contents Contents � Uncompressed HD Video over IP o Introduction o Challenges and Proposed System o Experiment � Visualization for HD Video over Collaborative Environments o Introduction o Challenges and Proposed System o Experiment � Conclusion N ETWORKed M EDIA L AB. - 2 - D EPT. OF I NFO. & C OMM., GIST
Uncompressed HD Video over IP Uncompressed HD Video over IP N ETWORKed M EDIA L AB. - 3 - D EPT. OF I NFO. & C OMM., GIST
Goals and Challenges Goals and Challenges � Research Target o Cost-effective system integration o Dual-stream transport technique by using two 1GE-NIC � Have to consider o Hardware Compatibility � Motherboard � RAID card � Motherboard � HD-SDI Interface card o Performance � Internal bottleneck o Device Driver Support N ETWORKed M EDIA L AB. - 4 - D EPT. OF I NFO. & C OMM., GIST
Uncompressed HDTV Streaming � System Overview o Software-based and Hardware-based display N ETWORKed M EDIA L AB. - 5 - D EPT. OF I NFO. & C OMM., GIST
Cost- -effective System Integration effective System Integration Cost � Total Costs (roughly, $ 30,000 ~ $ 40,000) o 1 Sony HVR-Z1N camera and auxiliaries, $ 6,000 o 2 SuperMicro server systems, $ 10,000 o 2 Chelsio 10GE NICs, $ 5,400 o 2 AJA HD-SDI interface cards, $ 4,400 o 1 AJA Analog component to digital HD-SDI converter, $ 2,300 o 1 AJA HD-SDI to DVI-D converter, $ 1,200 o 2 24-bit audio A/D converters, $ 1,600 o 1 Mic., with echo cancellation, $ 800 o 1 Plasma 52’ HDTV, $ 10,000 o 1 LCD monitor supporting 1920x1080 resolution, $ 3,000 o 1 Avid Flying Cow A/D audio converter $ 400 � Software : UltraGrid (USC/ISI) modification N ETWORKed M EDIA L AB. - 6 - D EPT. OF I NFO. & C OMM., GIST
Hardware Spec. Hardware Spec. � Hardware spec. is important to prevent internal bottleneck � We recommend followed system spec. Device Specification Mainboard SuperMicro X6DHE-XG2 DS & G (7520chipset) CPU Intel Dual-Xeon 3.0C FSB 800Mhz Memory PC3200 DDRII/400Mhz REG/ECC 2GB RAID 3 ware 9500s-8 SATA RAID controller WD Raptor 74GBx8 SATA 10000 RPM WD740GD for HDD server Seagate 120GB SATA 7200 RPM for client Graphics NVIDIA Geforce 6600GT 128 MB PCI-Express x16 N ETWORKed M EDIA L AB. - 7 - D EPT. OF I NFO. & C OMM., GIST
Hardware Spec. (Cont.) Hardware Spec. (Cont.) � Hardware Features o HD-SDI card � AJA XENA HS capture card www.aja.com - Support active samples ONLY (1920x1080 for 30 Hz/1.001) - Maximum data rate : 1.244 Gbps - Digital AV I/O - Linux and Windows � BlackMagic DeckLink HD-Plus www.blackmagic-design.com - Support total samples (2200x1125 for 30 Hz/1.001) along with active samples - Windows only � Centaurus card + audio www.dvs.de - Support both total and active resolution - Linux and Windows - Expensive (over $ 10,000) o Graphic card: support of xVideo (Software Display) � NVIDIA GeForce 6600GT 128 MB PCI-Express x16 N ETWORKed M EDIA L AB. - 8 - D EPT. OF I NFO. & C OMM., GIST
System Integration: OS Kernel Selection System Integration: OS Kernel Selection � Linux OS Kernel (RedHat 9) dependency of integrated system hardware Kernel Chelsio T210 Chelsio N201 XENA-HS RAID 2.4.18 X X O - 2.4.21 X O - O 2.4.25 O O O - 2.4.28 X O O O 2.6.5 X O X O 2.6.6 O O - - 2.6.9 X O X - 2.6.10 X O X O 2.6.11 X O - O 2.6.12 X X - - N ETWORKed M EDIA L AB. - 9 - D EPT. OF I NFO. & C OMM., GIST
Dual- -Stream Transport: Basic Problem Stream Transport: Basic Problem Dual Transmitter Ref Clock Receiver Ref Clock Jitter makes packet arrive irregularly Network induces Delay, Jitter and out-of-order packets Splitter Assembler Smoothes out jitter effect brings them inorder Packets created regularly at frequency f � Dual-Stream Transport based on RTP/RTCP � Frame splitting / assembly with synchronization o Real-time Transport Protocol (RTP) & RTP Control protocol (RTCP) o Payload format SMPTE-292M (draft-ieft-avt-smpte292-video-01.txt) � Specifies the widely used interconnect for HDTV equipment over IP o `RTP Profile for TCP Friendly Rate Control’: interactions of TFRC with RTP (draft-ietf-avt-tfrc-profile-03.txt) N ETWORKed M EDIA L AB. - 10 - D EPT. OF I NFO. & C OMM., GIST
Dual- -Stream Transport: Proposed Stream Transport: Proposed Dual Architecture Architecture � Even / Odd frames are sent independently in a synchronized manner (thread based realization) � Dual-Stream RTP transport covers transport for each flow � Receiver places frames into separate playout buffers � Display unit gets those frames and render them to the display (considering playout time) � Detect packets dropped or reordered by network N ETWORKed M EDIA L AB. - 11 - D EPT. OF I NFO. & C OMM., GIST
Experiments Experiments � Experiments o Domestic (Daejeon-GwangJu, 19 Aug., 2005) Daejeon Daejeon (KISTI) (KISTI) 1G SuperSiren SuperSiren- -KREONET KREONET 1G Dedicated Link Dedicated Link GwangJu GwangJu (GIST) (GIST) N ETWORKed M EDIA L AB. - 12 - D EPT. OF I NFO. & C OMM., GIST
Domestic Experiment Domestic Experiment � Domestic Tests o Jumbo frames (9K MTU) o Dedicated 1G link from KISTI to GIST o Out-band audio (RAT or Skype) o Software (xVideo) display on Plasma TV (1280x768 Res.) o One-way live streaming o 8-bit 4:2:2 active sampled video (down sized to roughly 910 Mbps) N ETWORKed M EDIA L AB. - 13 - D EPT. OF I NFO. & C OMM., GIST
Visualization for HD Video over Visualization for HD Video over Collaborative Environments Collaborative Environments N ETWORKed M EDIA L AB. - 14 - D EPT. OF I NFO. & C OMM., GIST
High- -quality Visualization quality Visualization High � Display large size image for various research areas o satellite imagery (365Kx365K pixels maps) for geoscientists o brain imagery (4Kx4K pixels sensor) for neurobiologists o Medical still image or animation � Enlarge display resolution o Display device has the limit of resolution o i.e., 20” LCD monitor at 1600x1200 � Tiled Display o Clustered display devices provide a virtual large-resolution display o To overcome the limit of resolution in display device N ETWORKed M EDIA L AB. - 15 - D EPT. OF I NFO. & C OMM., GIST
Goals and Challenges Goals and Challenges � Target Area in Collaborative Environment o AG SVC consists of multiple machines How to visualize multiple video streams over tiled display? System Performance Network Bandwidth Target area Scalability/Flexibility Synchronization N ETWORKed M EDIA L AB. - 16 - D EPT. OF I NFO. & C OMM., GIST
System Design System Design � Decoupled Decoding and Display Structure N ETWORKed M EDIA L AB. - 17 - D EPT. OF I NFO. & C OMM., GIST
Data Distribution Strategy Data Distribution Strategy � Fractional Pixel Streaming o To reduce the bandwidth to multiple SVC Displayers � Considering the display area of each SVC Displayer over tiled display < Design of SVC > N ETWORKed M EDIA L AB. - 18 - D EPT. OF I NFO. & C OMM., GIST
Experiments Experiments . . DVI output SVC control SVC control interface interface 1 Gbps network 100 Mbps network SVC Displayer-25 IEEE 1394 Sync Master . Sync channel . HD Camcoder SVC Decoder SVC Provider SVC Controller � 1 0 x5 Monitors SVC Displayer-1 � Resolution : 1 6 0 0 0 x 6 0 0 0 � 2 5 Display m achines � 2 m onitors per m achine • Decoding MPEG-2 TS W ith 1 4 4 0 x 1 0 8 0 resolution captured from SONY HVR-Z1 U HDV cam coder • Dual AMD 6 4 bit 2 .4 Ghz processors • NVI DI A Quadro FX3 0 0 0 graphics card • 1 Giga Ethernet netw ork interface • 4 GB m ain m em ory N ETWORKed M EDIA L AB. - 19 - D EPT. OF I NFO. & C OMM., GIST
Conclusion Conclusion � Versatile media tool for various media format for heterogeneous collaborative environments o Decode/Transform as unified format in Local area network o Integration of transport part N ETWORKed M EDIA L AB. - 20 - D EPT. OF I NFO. & C OMM., GIST
Gwangju Institute of Science & Technology Thank you! Thank you! Send Inquiry to jykim@nm.gist.ac.kr http://netmedia.gist.ac.kr N ETWORKed M EDIA L AB. - 21 - D EPT. OF I NFO. & C OMM., GIST
Recommend
More recommend
