Context-Aware Converged Communications B.H. Juang Motorola - - PowerPoint PPT Presentation

Context-Aware Converged Communications

B.H. Juang

Motorola Foundation Chair Professor & Georgia Research Alliance Eminent Scholar

School of Electrical & Computer Engineering Georgia Institute of Technology

Access Transport SN/IP VMS Internet

App Server Web Server ISP

IP / Data Network SS7 Network

SCE SMS Mngmt Billing

ISUP INAP INAP SIP Freephone * Prepaid / Card Call Center * LNP, LTF/LIDB Call Screening * Messaging * VPN Call Routing * Web based Provisioning *...

Circuit Switch

Communication Services Today – IN IN Perspective

SCP HLR

After Kozik

Access Transport SN/IP VMS Internet

App Server Web Server ISP

IP / Data Network SS7 Network

SCE SMS Mngmt Billing

ISUP INAP INAP SIP

Circuit Switch

SCP HLR Application Server

SIP, LDAP, XML, IN, SCTP/TALI, Corba, Jain, Parlay

Packet Call Center * Online Comm. Center * Virtual Kiosk * Mediation Voice Portals * Message Gateway * Voice / Data VPN * . . .

VoiceXML, WML, HTML, SIP, ...

After Kozik

Towards Converged Voice/Internet Services

Only an intermediate solution!!

Example – Multiparty Communication Services

Call Cont. Server ISP site Media Bridge Controller Media Bridge MPC Applet Suite

Whiteboard, Text, Audio (EC/Codec), Video, Signaling/directory

MPC Applet Suite MPC Applet Suite

Chat Room Call Session

MPC Applet Suite client server

RTP RTP RTP RTP Peer-to-peer (side-bar) audio whisper, copy files Stream file, share files

Interest group

Control Media data

Business model: Service provider = IP server + feature server

MGCP MEGACO

NTT’s Resonant Communication Networks

mostly

IN

Context-Aware Communications

Context Sensing Context Inference Context Representation and Translation Media Communication Chain

Network Architecture

Information Management User/Application Context Determination Content Processing Communication & Networking

Intelligent Peripheral

SM

Service Adjunct Operations Systems

• SCP

CCS (SS7) Network

STP SSP: Service switching point Service management systems

AIN CCN (Context-sensitive Converged Networks)

CSC CSC (Context & Service Control) Network CSSP: Converged Service switching point Context-Sensitive Information Management Systems Digital Terminal

Multimedia Service Complex To other CSCs

Digital Terminal Wired or wireless Service Management Systems

Architectural Evolution

Network Architecture for CCN

IP Transport Layer Application Layer Network Control Layer

Registration Address Authentication Authentication for Other Party Authentication Status Check Connection Negotiation Connection Processing Session Control Flow

Modified from Tachimoto & Morita of NTT Access Control Encryp- tion Control Quality Control

End-to-end Session Control

session

Context Service Control Layer

Context Control

CSC

Dimensions of Context

CONTEXT user environment applications

Personal Attributes Local Resources Service Agreements Preferences Physical Information Network Computing Display

Spatial Temporal/history Activity-Related Physiological

Expectations & Goals

Audio Video Wireless Sensors in the Labs at Gatech

Devices for Aging in Place

EKG from Control EKG from GTWM

Multi-channel Hi-Fi Telecommunication

Traditional telephony

switch switch

• trunk

New multi-channel network for information sharing

Multi- channel Aggregate Processor Multi- channel Aggregate Processor

Packet Network MIMO MIMO

• r

for intelligent assistance

Mic’s Cameras Spkr’s Projectors

Spatialization & The Perceptual Dimension

Spatial separation plays a role. Compare mono with stereo

Binaural Hearing & Cocktail Party Effect

Stream segregation also plays a role. Compare one talker (m1+m2) with two (m1+f2) (m1 m2 f2 )

Stereophonic Conferencing Demonstration Sound spatialization makes talker-tracking easier in multi-party conferencing environments, resulting in improved effectiveness in communication

Multi-channel Communications

Human communication is a spatial-temporal event. It is important to track the source objects.

Stereophonic Acoustic Echo Cancellation

ROOM 1 ROOM 2 h1 h1 ~

talker

+

• g1

h2 h2 g2 ~ NL NL

Multi-channel Source Separation

s’2 s’1 x2 x1 H12 H21 H11 H22 s1 s2

mixing

W12 W21 W11 W22

un-mixing One possible approach (Ikram of Gatech and Morgan of Bell Labs): x = H s R’ = <x xH> s’ = Wx Find un-mixing filter matrix W such that Λs’ = W R’ WH is diagonalized by minimizing the squared Frobenius norm of the off-diagonal matrix of Λs’

21 2 11 1

h s h s ∗ + ∗

22 2 12 1

h s h s ∗ + ∗

(room impulse responses)

Sound Source Localization

talker

• 1. Time Delay Estimation
• 2. Source Location Estimation

Various methods:

• triangulation - solve a set of hyperbolic

equations

• spherical intersection - solve a set of

linearized spherical equations

• spherical interpolation - similar to SI,

but with reduced constraint

• one-step-least-squares – transforms the

problem into an estimation/minimization problem; works the best Applications:

• Conferencing with participant tracking
• Improved sound and sight pickup

Developed at Bell Labs & Georgia Tech

Further challenge

The Content Processing Chain

CONTENT ACQUISITION & RETRIEVAL CONTENT DISTRIBUTION CONTENT DECODING CONTENT ENCODING CONTENT PRESENTATTION USER INTERFACE

Context Determination

CONTENT

Where is the content? Whose is it?

Produce Aggregate

What is this content about?

Catalog/ Index

What

• ther

content is it related to?

Integrate Syndicate

What is the right content for this user?

Personalize

What is the best way to utilize and interact with this content?

Interactive Marketing

Broadcast, Wireline, Wireless, Interactive TV

Applications Back End

Managing Content for CAC – Semantic Metadata

Semantic Metadata

Communication with Region-of-Interest

ROI Algorithms for: Lossless Coding Progressive Transmission Electronic Zooming

Integration with VoIP, VUI, TIVO and Array Processing Technologies

UDP + FEC+ error concealment UDP+ MMTP + selective retransmission

Over-provisioning / Packet Loss Rate for Perfect Q: 7 for UDP 2 for MMTP [Theoretical Limit is 1]

Context-Aware Content Distribution

Multimedia Transport Protocol - MMTP

Embedded and Layered Coding

Switch 1 Switch 2 Switch 3 Switch 4 Cell site Voice packet 3 2 1 2 3 1 2 3 telephone cell-phone

NETWORK

Channel coding Layered bitstream

Information Management & Support Layers

Context Management Adaptive and Customized Information Services MetaServices

Context-Aware Convergent Communications

Research Vision

Imbue Converging Digital Services with the attributes and

perception of personalization, flexibility, richness and privacy;

Incorporate Context, broadly defined, into the deep fabric of

wired and wireless networks for information, transactions and entertainment;

Harness the capabilities of multimedia processing, embedded

computing and pervasive broadband for Context-Aware Telecommunications;

Spawn a new generation of applications of interest to the end

user, the communications industry and society, using the exemplary test domains of tele-health, distributed education and entertainment.

Summary Convergent & Converged Communication Networks need research advances in:

• Infrastructure for User-Centric Converged

Services

• Context-Aware Media Processing
• Context-Aware Information Management
• The Science and Engineering of Context