Multipoint Video Communication System with 3D Virtual Space Shuntaro - - PowerPoint PPT Presentation

▶

Jan 13, 2024 140 likes •338 views

IETF76 SAMRG Multipoint Video Communication System with 3D Virtual Space Shuntaro Nishiura, Nobuo Kawaguchi Nagoya University / WIDE Project g y y / j Point of this talk Point of this talk. Deployment of Small Group Multicast . l f

SLIDE 1

IETF76 SAMRG

Multipoint Video Communication System with 3D Virtual Space

Shuntaro Nishiura, Nobuo Kawaguchi Nagoya University / WIDE Project g y y / j

SLIDE 2

Point of this talk Point of this talk.

l f “S ll G l i ”

Deployment of “Small Group Multicast”.
New application area for the

“Scalable Adaptive Multicast” p Proposal : Proposal :

3D Virtual Space Multi‐Point Video Comm. App.

I l t ti f O li f 1000 – Implementation for Online conference over 1000

Dynamic selection/classification of destinations.

SLIDE 3

Background Background

S ll G M lti t (SGM )i f th

Small Group Multicast (SGM )is one of the

‘ Desirable ‘ technology in the Internet. Small Group 2~30 people Small Group = 2~30 people… XCAST6 i f h did i

XCAST6 is one of the candidates to support it.
There might be several technologies which

will support “Small Group Multicast”.

So, we have developed a middleware to

bl i ti f t l enable easy migration of protocols.

SLIDE 4

SAMTK

www samtk org

SAMTK

www.samtk.org

http://sourceforge.net/projects/samtk/

Scalable Adaptive Multicast Toolkit
Multi‐platform / Open Source Toolkit for

Multi platform / Open Source Toolkit for Multipoint Communication (in C++ with Qt)

( Wi d / M / Li / BSD) ( Windows/ Mac/ Linux / BSD)

Under development since 2006

S t i f

Support s easy programming for

multi‐point communication applications.

SLIDE 5

SLIDE 6

SAMTK Group Manager

SLIDE 7

SAMTK Architecture

SAMTK Group Web Server (Apache / PHP)

SAM A li ti

(Apache / PHP) HTTP/XML

SAM Applications Group Interface

Application Interface HTTP/XML

SAMTK Core Module Group Interface

Group Management Module

pp

XCAST Pl i ALM

SAMTK Core Module

Protocol Interface

XCAST6 IPv4 XCAST Plugin Plugin

OS (Windows / Mac / Linux / FreeBSD.. )

SLIDE 8

“Killer App” for Multipoint Comm Killer App for Multipoint Comm.

We are looking for “Killer App”.
3D Virtual space Comm. might be the one.

3D Virtual space Comm. might be the one.

Demo on CCNC2009

SAMTK

“Nat Free 3D Video Conf.”

ALR

SAMTK

Group Server

ALR The Internet NAT NAT

SLIDE 9

Group management on 3D space Group management on 3D space

“SAMTK Group Server” with Group Manager

– Currently only supports “Static” group management Currently only supports Static group management

We want “Dynamic” change of the member

through the ‘Position’ and ‘Orientation’ of through the Position and Orientation of the each client.

It is now not a simple “Group” – It is now not a simple “Group”.

SLIDE 10

New 3D Virtual Space App New 3D Virtual Space App

Develop a Virtual Space Server

(tcp‐connected) ( p )

– Space server “Dynamically” form the destination members. – Classify the ‘Visible’ and ‘Audible’ members.

Virtual Server do not transfer media streams
May supports 1000~ clients.

– Not really tested yet… y y

SLIDE 11

SAMTK Architecture

SAMTK Group Web Server (Apache / PHP)

SAM A li ti

(Apache / PHP) HTTP/XML

SAM Applications Group Interface

Application Interface HTTP/XML

SAMTK Core Module Group Interface

Group Management Module

Application Interface

XCAST Pl i ALM

SAMTK Core Module

Protocol Interface

XCAST6 IPv4 XCAST Plugin Plugin

OS (Windows / Mac / Linux / FreeBSD.. )

SLIDE 12

New 3D Video Comm. Architecture

Virtual Space Server

3D Video Comm. Client Group Interface

Application Interface

SAMTK Core Module Group Interface

Group Management Module

Application Interface

XCAST Pl i ALM

SAMTK Core Module

Protocol Interface

XCAST6 IPv4 XCAST Plugin Plugin

OS (Windows / Mac / Linux / FreeBSD.. )

SLIDE 13

3D Video Comm. Architecture

Virtual Space Server

Send Position/Ori.

S d Cli t A’ P iti / O i t ti

Video and Audio Member List

Send Client A’s Position / Orientation

Client A Client B Client C Client D Send Video and Audio

SLIDE 14

Classification of destinations in 3D Classification of destinations in 3D

Classification of Audio Classification of Video

θ

θ2

d d

θ1

Distance d controls volume Distance d controls frame rate. Orientation θ also controls volume (if θ > 180 , less volume) Limit the destination member by θ1 < 45 and θ2 < 90

SLIDE 15

Evaluation of the Current Impl.

3.6Mbps 1.2Mbps 224Kbps Current Implementation uses just Multi‐Unicast

SLIDE 16

Classifying Destinations Classifying Destinations

Audio ‐> volume / compression rate
Video ‐> frame rate / compression rate

Video > frame rate / compression rate

Dst1 Src D t2

Src Dst2

M Router 3

Dst3

2 1 S

SLIDE 17

Conclusion Conclusion

l f “ ill ” f

Development of “Killer App” for SGM.

3D Virtual Space Video Comm.

Dynamic configuration of “Destinations”

Dynamic configuration of Destinations through 3D Virtual Space positioning.

Can reduce the bandwidth of media stream – Can reduce the bandwidth of media stream.

By dividing “Destination Control” with media

stream, the server can handle 1000~ clients.

SLIDE 18

Future Works Future Works

Currently, we only control destinations,

audio volume and video quality through the q y g “Position” and ”Orientation”.

We need to figure out the receiver’s side of
We need to figure out the receiver s side of

bandwidth / congestion.

SICC (Sender initiated Congestion Control) may
SICC (Sender initiated Congestion Control) may
ne of the solutions.