Echo cancellation for interactive HD streaming Feb. 23, 2011 Hong - - PowerPoint PPT Presentation

echo cancellation for interactive hd streaming
SMART_READER_LITE
LIVE PREVIEW

Echo cancellation for interactive HD streaming Feb. 23, 2011 Hong - - PowerPoint PPT Presentation

ASIA-PACIFIC ADVANCED NETWORK 31 ST MEETING ASIA-PACIFIC ADVANCED NETWORK 31 MEETING HDTV Working Group Echo cancellation for interactive HD streaming Feb. 23, 2011 Hong Kong Convention and Exhibition Centre (HKCEC) Hong Kong Convention and


slide-1
SLIDE 1

ASIA-PACIFIC ADVANCED NETWORK 31ST MEETING ASIA-PACIFIC ADVANCED NETWORK 31 MEETING

HDTV Working Group

Echo cancellation for interactive HD streaming

  • Feb. 23, 2011

Hong Kong Convention and Exhibition Centre (HKCEC) Hong Kong Convention and Exhibition Centre (HKCEC)

Boncheol Goo

KAIST Graduate School of Culture Technology

slide-2
SLIDE 2

HDTV WG

Contents

  • 1. Overview of communication over networks
  • a. Networked communication configuration
  • b. Platform for education and culture contents

c. About the CTNet group

2 I f h ll i

  • 2. Issues of echo cancellation
  • a. Obstacles to communication over networks
  • b. Echo cancellation
  • b. Echo cancellation

c. Echo canceller

  • d. The problems of echo cancellation test

e. Self-test for echo cancelling f. Basic microphone and speaker placement 2 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-3
SLIDE 3

HDTV WG

  • 1. Overview of communication over networks

VW

B i

  • a. Networked communication configuration

AR / MR Performing Arts Multi Home University Institute Business Business

Video

Digital Heritage

Tx/Rx

Domestic Network Mobile Terminal

Audio

HW / SW

LIVE

Network Archive System

HW / SW

LIVE Access

Archive System

Foreign Network

Global Partners

  • High-speed Network
  • Research Group
  • Contents

3 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-4
SLIDE 4

HDTV WG

  • 1. Overview of communication over networks

B i

  • b. Platform for education and culture contents

Domestic Mobile Terminal Multi Home Business University Institute  Future Convergent Network

Future Network Platform 3

Network NOC

Platform 2

 Future Intelligent Network  Future Open Network  Future Ultra-Broadband Network

Future Internet

 Clean-Slate Design Scalability/Ubiquity Security/Robustness Mobility

Core Platform

Mass Storage

Global Network

Center Future Internet

y Heterogeneity QoS/Quality of Experience Re-configurability/Self-Organization Context-awareness Manageability

Vi li ti S t A hi S t S i S t

Manageability Data/Information/Knowledge-centric Economics

Visualization System Archive System Service System

Contents DRM 3D(Stereo) Dome Theater Digital Cinema Education Performing Arts Cultural Exchange

4 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-5
SLIDE 5

HDTV WG

  • 1. Overview of communication over networks
  • c. About the CTNet
  • The CTNet at the GSCT of KAIST in Korea is a research group focusing on interactive

performance over high speed networks performance over high-speed networks.

  • Ranging from unidirectional transmission of performing arts to the joint performance in

multiple locations, the group's mission is to develop performance technologies and rehearse networked performances on both technical and artistic scales rehearse networked performances on both technical and artistic scales.

  • This group envisages a new future of networked performances that will change the

way performance is planed, produced, published, experienced and appreciated, and we are active participants in every facet of this exciting future are active participants in every facet of this exciting future.

Partners

  • KISTI (KREONET 1Gbps)
  • NIA (KOREN 1Gbps)

( p )

  • Keio/DMC, KMD
  • University of Florida
  • NYU
  • i2cat (Barcelona)

( )

  • CineGrid (San Diego)
  • GIST(KR)
  • Chungnam University(KR)

5 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-6
SLIDE 6

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / The Queen’s Dance

Live webcast, KAIST - LiveVibe TV at Florida, Nov. 18, 2010

6 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-7
SLIDE 7

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / The Queen’s Dance

Video Codec

IOCOM G id IOCOM Grid

multi-point collaboration platform

7 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-8
SLIDE 8

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / The Queen’s Dance

8 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-9
SLIDE 9

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / I-M-Age

Networked performance, KAIST – Emily Carr University at Vancouver, Nov. 5, 2010

9 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-10
SLIDE 10

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / I-M-Age

10 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-11
SLIDE 11

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / I-M-Age

11 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-12
SLIDE 12

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Pansori - Flamenco

Networked performance, KAIST – i2cat at Barcelona, Oct. 20, 2010

12 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-13
SLIDE 13

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Pansori - Flamenco

Tx Barcelona KAIST Tx Rx Rx

Sync

Reflector

Tx Rx Rx

Composition

Tx Rx 13 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-14
SLIDE 14

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Pansori - Flamenco

14 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-15
SLIDE 15

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Memory

Collaborative Connections in Time & Space

Mar 14th, 7:30pm at NYU, 5:30pm at CU in Boulder, 15th, 8:30am at KAIST, 2010

Three-Point Distributed Live Performance

15 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-16
SLIDE 16

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Memory

16 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-17
SLIDE 17

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / Memory

17 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-18
SLIDE 18

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / NetBand

Interactive performance, KAIST – Keio University at Tokyo, Nov. 2, 2009

18 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-19
SLIDE 19

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / NetBand

19 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-20
SLIDE 20

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / NetBand

20 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-21
SLIDE 21

HDTV WG

  • 1. Overview of communication over networks
  • c. About CTNet group / NetBand

21 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-22
SLIDE 22

HDTV WG

  • 2. Issues of echo cancellation
  • a. Obstacles to communication over networks

Encoder Decoder Network Latency A/D Encoding Latency D/A Decoding Latency

Outgoing Delay

g y g y

Echo

Encoder Decoder

Incoming Delay

22 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-23
SLIDE 23

HDTV WG

  • 2. Issues of echo cancellation
  • b. Echo cancellation

Receive Path

Adaptive Filter

S d P th Echo

N i Filter

Send Path Speech NLP

Noise Reduction

Noise Noise Echo Canceller 23 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-24
SLIDE 24

HDTV WG

  • 2. Issues of echo cancellation
  • c. Echo canceller / Hardware

XAP 800 i hi hl d d t l b t l di it l t i i ith XAP 800 is a highly advanced twelve-by-twelve digital matrix mixer with echo cancellation, noise cancellation, and audio processing. G-Wire 24 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-25
SLIDE 25

HDTV WG

  • 2. Issues of echo cancellation
  • c. Echo canceller / Software

The EchoDamp software application developed by USC(University of Southern California) is a multi-channel audio mixer and echo controller designed primarily

  • Performs multi-channel audio mixing

C t t i f f t l

California) is a multi channel audio mixer and echo controller designed primarily for the High-Bandwidth Musical Videoteleconference environment.

  • Creates separate mixes for performers, control

room, and audience members

  • Controls both incoming and outgoing echo
  • Maintains full audio frequency spectrum
  • Calibrates audio levels between sites
  • Calculates round-trip latency between sites
  • Reduces rumble and low-frequency noise
  • Runs on Macintosh and Windows computers
  • Works with numerous hardware audio interfaces

Echo Damp 25 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-26
SLIDE 26

HDTV WG

  • 2. Issues of echo cancellation
  • d. The problems of echo cancellation test
  • It is needed always to have a test partner.

y p

  • It is needed more time to prepare the echo cancellation test.
  • On the effect of removing echo sound,

I have to depend on partner’s judgment.

A B

Echo Canceller Echo Canceller

B

26 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-27
SLIDE 27

HDTV WG

  • 2. Issues of echo cancellation
  • e. Self-test for echo cancelling

XAP 800

Sound play Sound delay

Comparison

Audio Interface

EchoDamp

A

Sound play Sound delay

Reference Echo Cancel

Audio Interface

Comparison

B

Audio Interface

27 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-28
SLIDE 28

HDTV WG

  • 2. Issues of echo cancellation
  • f. Basic microphone and speaker placement

28 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011

slide-29
SLIDE 29

HDTV WG

Thank you for your attention

Global Lambda Integrated Facility http://www.glif.is/publications/maps/ GLIF Map 29 / 29

Echo cancellation for interactive HD streaming @ HKCEC, Feb. 23, 2011