Echo cancellation for interactive HD streaming Feb. 23, 2011 Hong - PowerPoint PPT Presentation

ASIA-PACIFIC ADVANCED NETWORK 31 ST MEETING ASIA-PACIFIC ADVANCED NETWORK 31 MEETING HDTV Working Group Echo cancellation for interactive HD streaming Feb. 23, 2011 Hong Kong Convention and Exhibition Centre (HKCEC) Hong Kong Convention and Exhibition Centre (HKCEC) Boncheol Goo KAIST Graduate School of Culture Technology

HDTV WG Contents 1. Overview of communication over networks a. Networked communication configuration b. Platform for education and culture contents c. About the CTNet group 2. Issues of echo cancellation 2 I f h ll i a. Obstacles to communication over networks b. Echo cancellation b. Echo cancellation c. Echo canceller d. The problems of echo cancellation test e. Self-test for echo cancelling f. Basic microphone and speaker placement 2 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG a. Networked communication configuration VW B Business i AR / MR Business University Performing Arts Multi Home Institute Mobile Terminal Domestic Video Digital Heritage Network Tx/Rx Network Audio LIVE LIVE Archive System Archive System HW / SW HW / SW Access Foreign Network • High-speed Network • Research Group • Contents Global Partners 3 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG b. Platform for education and culture contents B Business i University Multi Home Future Network Platform 3 Institute  Future Convergent Network Mobile Terminal Domestic  Future Intelligent Network Network Platform 2  Future Open Network  Future Ultra-Broadband Network NOC Future Internet Future Internet  Clean-Slate Design Core Platform Global Scalability/Ubiquity Mass Storage Security/Robustness Network Center Mobility y Heterogeneity QoS/Quality of Experience Re-configurability/Self-Organization Context-awareness Manageability Manageability Archive System A hi S t Vi Visualization System li ti S t S Service System i S t Data/Information/Knowledge-centric Economics Contents 3D(Stereo) Education DRM Dome Theater Performing Arts Digital Cinema Cultural Exchange 4 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About the CTNet • The CTNet at the GSCT of KAIST in Korea is a research group focusing on interactive performance over high-speed networks . performance over high speed networks • Ranging from unidirectional transmission of performing arts to the joint performance in multiple locations, the group's mission is to develop performance technologies and rehearse networked performances on both technical and artistic scales rehearse networked performances on both technical and artistic scales. • This group envisages a new future of networked performances that will change the way performance is planed, produced, published, experienced and appreciated, and we are active participants in every facet of this exciting future are active participants in every facet of this exciting future. • KISTI (KREONET 1Gbps) Partners • NIA (KOREN 1Gbps) ( p ) • Keio/DMC, KMD • University of Florida • NYU • i2cat (Barcelona) ( ) • CineGrid (San Diego) • GIST(KR) • Chungnam University(KR) 5 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / The Queen’s Dance Live webcast, KAIST - LiveVibe TV at Florida, Nov. 18, 2010 6 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / The Queen’s Dance Video Codec IOCOM G id IOCOM Grid multi-point collaboration platform 7 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / The Queen’s Dance 8 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / I-M-Age Networked performance, KAIST – Emily Carr University at Vancouver, Nov. 5, 2010 9 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / I-M-Age 10 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / I-M-Age 11 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Pansori - Flamenco Networked performance, KAIST – i2cat at Barcelona, Oct. 20, 2010 12 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Pansori - Flamenco Barcelona KAIST Tx Tx Rx Reflector Sync Rx Rx Tx Rx Composition Rx Tx 13 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Pansori - Flamenco 14 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Memory Collaborative Connections in Time & Space Mar 14th, 7:30pm at NYU, 5:30pm at CU in Boulder, 15th, 8:30am at KAIST, 2010 Three-Point Distributed Live Performance 15 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Memory 16 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / Memory 17 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / NetBand Interactive performance, KAIST – Keio University at Tokyo, Nov. 2, 2009 18 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / NetBand 19 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / NetBand 20 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

1. Overview of communication over networks HDTV WG c. About CTNet group / NetBand 21 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG a. Obstacles to communication over networks Network Latency Encoder Decoder Outgoing Delay A/D Encoding Latency g y D/A Decoding Latency g y Echo Decoder Encoder Incoming Delay 22 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG b. Echo cancellation Receive Path Adaptive Echo Filter Filter Send Path S d P th Speech N i Noise ∑ NLP Reduction Noise Noise Echo Canceller 23 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG c. Echo canceller / Hardware XAP 800 is a highly advanced twelve-by-twelve digital matrix mixer with XAP 800 i hi hl d d t l b t l di it l t i i ith echo cancellation, noise cancellation, and audio processing. G-Wire 24 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG c. Echo canceller / Software The EchoDamp software application developed by USC(University of Southern California) is a multi channel audio mixer and echo controller designed primarily California) is a multi-channel audio mixer and echo controller designed primarily for the High-Bandwidth Musical Videoteleconference environment. - Performs multi-channel audio mixing - Creates separate mixes for performers, control C t t i f f t l room, and audience members - Controls both incoming and outgoing echo - Maintains full audio frequency spectrum - Calibrates audio levels between sites - Calculates round-trip latency between sites - Reduces rumble and low-frequency noise - Runs on Macintosh and Windows computers - Works with numerous hardware audio interfaces Echo Damp 25 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG d. The problems of echo cancellation test • It is needed always to have a test partner. y p • It is needed more time to prepare the echo cancellation test. • On the effect of removing echo sound, I have to depend on partner’s judgment. A B B Echo Canceller Echo Canceller 26 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG e. Self-test for echo cancelling XAP 800 Sound Comparison Sound play delay A Audio Interface EchoDamp Sound play Sound Reference delay Echo Cancel B Audio Interface Audio Interface Comparison 27 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

2. Issues of echo cancellation HDTV WG f. Basic microphone and speaker placement 28 / 29 Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011