SLIDE 1 Multi-channel streaming for medical and multimedia industry applications
Jiří Halák1, Michal Krsek1, Pavel Pečiva2,
and multimedia industry applications
Sven Ubik1, Petr Žejdl1
1 CESNET 2 MNUL 1 CESNET, 2 MNUL
3rd E2E Workshop on Applications and Services Prague, 30 November 2010
SLIDE 2 Motivation
Why we decided to develop technology for low-latency parallel video streaming?
- high-definition video transfers are one of the expected driver
application areas in high-speed networking
- advanced application areas require multiple low-latency video
advanced application areas require multiple low latency video streams, for example, such remote collaboration in multimedia industry or interactive training in medicine
- it was an opportunity to leverage our experience in hardware-
l t d hi h d t k it i i FPGA accelerated high-speed network monitoring using FPGAs (Field Programmable Gate Arrays)
SLIDE 3 Requirements
- transmission of multiple streams with post-HD resolution
ti I t t i f t t ( t it h )
- operating over Internet infrastructure (routers, switches)
- low latency (for interactive work)
- lightweight, easy to deploy
- extendable by customer firmware upgrades
y pg
SLIDE 4
Picture resolution
HD (1920 x 1080) ( ) 2K (2048 x 1080) UHDTV1 (3840 x 2160) 4K (4096 x 2160) UHDTV2 (7680 x 4320) 8K (8192 x 4320) Other parameters: frame rate (24, 25, 30, ...), color depth (8, 10, 12 bits), subsampling (4:4:4, 4:2:2, ...).
SLIDE 5
Interfaces
video & audio interface network interface video & audio interface Transmission device network interface
SLIDE 6
Video interface
Serial Digital Interface – most often used in professional video equipment q p
Bit-rate Standard SDI 143 270 Mb/s SMPTE 252 SDI 143-270 Mb/s SMPTE 252 HD-SDI 1.485 Gb/s SMPTE 292 3G-SDI 2.97 Gb/s SMPTE 424
Maping picture formats: HD → HD-SDI SMPTE 274 HD, 2K → dual-link HD-SDI SMPTE 372 HD, 2K dual link HD SDI SMPTE 372 HD, 2K → 3G SDI SMPTE 424
SLIDE 7 Network interface
- dedicated fibre or wavelength
electro optical convertor / extender
- electro-optical convertor / extender
- synchronous network (SONET/SDH)
synchronous network (SONET/SDH)
- picture data are also synchronous, they can be easily
mapped to payload, receiver can derive its clock from the network
- asynchronous network (Ethernet)
- no direct clock connection between sender and receiver,
t nnable recei er clock ith controller req ired to pre ent tunnable receiver clock with controller required to prevent buffer overflow / underflow
SLIDE 8
MVTP-4K
Modular Video Transfer Platform 11.4’ (330 mm) 17’ (433 mm) 3.3’ (84 mm) Input: 8x HD-SDI (4x dual HD-SDI) Output: 8x HD-SDI (4x dual HD-SDI) Network: 10 Gigabit Ethernet
SLIDE 9
Hardware structure
Xilinx Virtex 5 FPGA Xenpak 10GBASE-LR transceiver
SLIDE 10 Network transmission
1 stream 4K RGB (4096x2160 or 3840x2160) 1 stream 3D 4K 4:2:2 2 streams 4K 4:2:2 2 streams 4K 4:2:2 4 streams 2K/HD RGB (2048x1080/1980x1080) 8 streams 2K/HD 4:2:2 (2048x2160/1920x1080)
- uncompressed transfer
- simultaneous bidirectional transfer
simultaneous bidirectional transfer
- can transfer embedded audio in selected HD-SDI channel
- adds less than 1 ms delay to networking delay
SLIDE 11 Other modes
Video processor
- HD-SDI inputs
- HD-SDI outputs
- HD-SDI outputs
Network processor 10GE i t
SLIDE 12 Prague-Chicago-Prague loop
4K 4:2:2 signal
- 4K 4:2:2 signal
- 9072 miles / 14602 km)
- CzechLight NetherLight StartLight network with one
- CzechLight, NetherLight, StartLight network with one
router and several switches
SLIDE 13
Prague-Chicago-Prague loop
SLIDE 14 Cinegrid 2009 demo
- Remote real time uncompressed 4K color management
p g
- 4K content and Colorist in Prague (Barrandov studios)
- 4K projector and DoP in San Diego
SLIDE 15
CineGrid 2009 demo
SLIDE 16 3D HD transfers of robotic surgeries
- daVinci Surgical System in Masaryk
Hospital in Ústí nad Labem
- urological operation lead by MUDr Jan
- urological operation lead by MUDr. Jan
Šraml, head of department
- audience at 5th International congress of
g mini-invasive and robotic surgery, Brno, Czech Republic, October 2010
SLIDE 17 Real-time 3D HD - CZ to Japan
- Robotic surgery in Masaryk hospital in Ústí nad Labem, Czech republic
- 150 ms network delay + 1 ms sender & receiver delay (negligible)
- Parallel full HD videoconference for commentary and questions
- Approx. 11000 miles / 17600 km
SLIDE 18
Receiving 3D streaming in KEK, Tsukuba, Japan
SLIDE 19 Networking
Attempt 1 – GLIF (most of the way) p ( y)
- SINET3 (Japan NREN) is connected to MAN LAN (New York)
N
( p ) ( )
- CESNET does not have direct link to US, but we have link
to NetherLight
N
to NetherLight
- NetherLight kindly offered to use their link to MAN LAN
- In MAN LAN we needed to connect SONET with Ethernet
In MAN LAN, we needed to connect SONET with Ethernet, no free port on router to do this was available
- NetherLight offered to use another link to StarLight but there
NetherLight offered to use another link to StarLight, but there was no free port for SONET / Ethernet conversion in StarLight either
SLIDE 20 Networking (cont.)
Attempt 2 – shared Internet
- videoconference with Dante about setting up Premium IP
- videoconference with Dante about setting up Premium IP,
normally up to 10% of link capacity (1 Gb/s), we needed 2.6 Gb/s for uncompressed 3D HD, agreed on 2 Gb/s
N
- set up of 2 synchronized scaling boxes to change 1080i/59.97
to 720p/25 => 1.95 Gb/s
N
- experience: premium IP improved the picture a lot (approx.
1 small glitch / 10 sec.), but only within Geant
- we were at the mercy of Geant-US link load, bad one day before,
fortunately acceptable during the real demo – almost glitch free
- after demo, we tried 3D full HD (2.6 Gb/s) at best effort, picture
improved (!) due to scaling elimination
SLIDE 21 Future steps
- Cinegrid 2010 demo – real-time 3D 2K remote post processing
- APAN 2011 demo – real-time 3D HD robotic surgery +
l ti t real-time cave-to-cave
- Technical improvements (compression transcoding etc )
- Technical improvements (compression, transcoding, etc.)
- 8K uncompressed transfer over 2x 10 GE
p
- Applications (film post-production, scientific visualisations,
cave-to-cave 3D transmissions, art performances)
SLIDE 22 Acknowledgements
- Supported by the research plan Optical National Research
Network and its New Applications (MSM6383917201, 2004-2010) by the Czech Ministry of Education, Youth and Sports
- Special thanks to the team in the Masaryk hospital
in Ústí nad Labem in Ústí nad Labem
