Multi-channel streaming for medical and multimedia industry applications and multimedia industry applications Ji ř í Halák 1 , Michal Krsek 1 , Pavel Pe č iva 2 , Sven Ubik 1 , Petr Žejdl 1 1 CESNET 2 MNUL 1 CESNET, 2 MNUL 3rd E2E Workshop on Applications and Services Prague, 30 November 2010
Motivation Why we decided to develop technology for low-latency parallel video streaming? • high-definition video transfers are one of the expected driver application areas in high-speed networking • advanced application areas require multiple low-latency video advanced application areas require multiple low latency video streams, for example, such remote collaboration in multimedia industry or interactive training in medicine • it was an opportunity to leverage our experience in hardware- accelerated high-speed network monitoring using FPGAs l t d hi h d t k it i i FPGA (Field Programmable Gate Arrays)
Requirements • transmission of multiple streams with post-HD resolution • operating over Internet infrastructure (routers, switches) ti I t t i f t t ( t it h ) • low latency (for interactive work) • lightweight, easy to deploy • extendable by customer firmware upgrades y pg
Picture resolution HD (1920 x 1080) ( ) 2K (2048 x 1080) UHDTV1 (3840 x 2160) 4K (4096 x 2160) UHDTV2 (7680 x 4320) 8K (8192 x 4320) Other parameters: frame rate (24, 25, 30, ...), color depth (8, 10, 12 bits), subsampling (4:4:4, 4:2:2, ...).
Interfaces video & audio interface video & audio interface network interface network interface Transmission device
Video interface Serial Digital Interface – most often used in professional video equipment q p Bit-rate Standard SDI SDI 143 270 Mb/s 143-270 Mb/s SMPTE 252 SMPTE 252 HD-SDI 1.485 Gb/s SMPTE 292 3G-SDI 2.97 Gb/s SMPTE 424 Maping picture formats: HD → HD-SDI SMPTE 274 HD, 2K → dual-link HD-SDI HD, 2K dual link HD SDI SMPTE 372 SMPTE 372 HD, 2K → 3G SDI SMPTE 424
Network interface • dedicated fibre or wavelength - electro-optical convertor / extender electro optical convertor / extender • synchronous network (SONET/SDH) synchronous network (SONET/SDH) - picture data are also synchronous, they can be easily mapped to payload, receiver can derive its clock from the network • asynchronous network (Ethernet) - no direct clock connection between sender and receiver, t nnable recei er clock tunnable receiver clock with controller required to prevent ith controller req ired to pre ent buffer overflow / underflow
MVTP-4K Modular Video Transfer Platform 11.4’ (330 mm) 17’ (433 mm) 3.3’ (84 mm) Input: 8x HD-SDI Output: 8x HD-SDI Network: 10 Gigabit (4x dual HD-SDI) (4x dual HD-SDI) Ethernet
Hardware structure Xilinx Virtex 5 FPGA Xenpak 10GBASE-LR transceiver
Network transmission 1 stream 4K RGB (4096x2160 or 3840x2160) 1 stream 3D 4K 4:2:2 2 streams 4K 4:2:2 2 streams 4K 4:2:2 4 streams 2K/HD RGB (2048x1080/1980x1080) 8 streams 2K/HD 4:2:2 (2048x2160/1920x1080) • uncompressed transfer • simultaneous bidirectional transfer simultaneous bidirectional transfer • can transfer embedded audio in selected HD-SDI channel • adds less than 1 ms delay to networking delay
Other modes Video processor - HD-SDI inputs - HD-SDI outputs - HD-SDI outputs Network processor - 10GE input 10GE i t - 10GE output
Prague-Chicago-Prague loop • 4K 4:2:2 signal 4K 4:2:2 signal • 9072 miles / 14602 km) • CzechLight NetherLight StartLight network with one • CzechLight, NetherLight, StartLight network with one router and several switches
Prague-Chicago-Prague loop
Cinegrid 2009 demo - Remote real time uncompressed 4K color management p g - 4K content and Colorist in Prague (Barrandov studios) - 4K projector and DoP in San Diego
CineGrid 2009 demo
3D HD transfers of robotic surgeries • daVinci Surgical System in Masaryk Hospital in Ústí nad Labem • urological operation lead by MUDr Jan • urological operation lead by MUDr. Jan Šraml, head of department • audience at 5th International congress of g mini-invasive and robotic surgery, Brno, Czech Republic, October 2010
Real-time 3D HD - CZ to Japan • Robotic surgery in Masaryk hospital in Ústí nad Labem, Czech republic • 150 ms network delay + 1 ms sender & receiver delay (negligible) • Parallel full HD videoconference for commentary and questions • Approx. 11000 miles / 17600 km
Receiving 3D streaming in KEK, Tsukuba, Japan
Networking Attempt 1 – GLIF (most of the way) p ( y) • SINET3 (Japan NREN) is connected to MAN LAN (New York) ( p ) ( ) • CESNET does not have direct link to US, but we have link to NetherLight to NetherLight N N • NetherLight kindly offered to use their link to MAN LAN • In MAN LAN we needed to connect SONET with Ethernet In MAN LAN, we needed to connect SONET with Ethernet, no free port on router to do this was available • NetherLight offered to use another link to StarLight but there NetherLight offered to use another link to StarLight, but there was no free port for SONET / Ethernet conversion in StarLight either
Networking (cont.) Attempt 2 – shared Internet • videoconference with Dante about setting up Premium IP • videoconference with Dante about setting up Premium IP, normally up to 10% of link capacity (1 Gb/s), we needed 2.6 Gb/s for uncompressed 3D HD, agreed on 2 Gb/s • set up of 2 synchronized scaling boxes to change 1080i/59.97 to 720p/25 => 1.95 Gb/s N N • experience: premium IP improved the picture a lot (approx. 1 small glitch / 10 sec.), but only within Geant • we were at the mercy of Geant-US link load, bad one day before, fortunately acceptable during the real demo – almost glitch free • after demo, we tried 3D full HD (2.6 Gb/s) at best effort, picture improved (!) due to scaling elimination
Future steps - Cinegrid 2010 demo – real-time 3D 2K remote post processing - APAN 2011 demo – real-time 3D HD robotic surgery + real-time cave-to-cave l ti t - Technical improvements (compression transcoding etc ) - Technical improvements (compression, transcoding, etc.) - 8K uncompressed transfer over 2x 10 GE p - Applications (film post-production, scientific visualisations, cave-to-cave 3D transmissions, art performances)
Acknowledgements • Supported by the research plan Optical National Research Network and its New Applications (MSM6383917201, 2004-2010) by the Czech Ministry of Education, Youth and Sports • Special thanks to the team in the Masaryk hospital in Ústí nad Labem in Ústí nad Labem
Recommend
More recommend
