A synthetic aperture microphone array for the meeting room TNO TPD - - PowerPoint PPT Presentation

▶

Feb 18, 2024 169 likes •303 views

Construction of arbitrarily positioned virtual microphones A synthetic aperture microphone array for the meeting room TNO TPD Synthetic aperture microphone array September 23, 2004 1 About OKTO (operation room of the near future)

SLIDE 1

September 23, 2004 Synthetic aperture microphone array 1

TNO TPD

Construction of arbitrarily positioned “virtual microphones”

A synthetic aperture microphone array for the meeting room

SLIDE 2

September 23, 2004 Synthetic aperture microphone array 2

About OKTO (operation room of the near future)

Focuses on the role of information in the process
Tries to relate info from multimodal sources to the ongoing

procedures and hence add semantics

Aims to support the surgical team by monitoring their

actions, scanning and interpreting info, then presenting the relevant info

Heavily relies on “information mediation”, ontologies,

classification methods, image processing, etc

Cooperation with the Reinier de Graaf hospital group,

Egripment motion platform manufacturer, 2Cure electronic patient record system manufacturer

SLIDE 3

September 23, 2004 Synthetic aperture microphone array 3

Project relationships M4 and OKTO

Aiming at tracking and

tracing the ‘meeting’

Detection of clues about the

meeting process, the workflow

Multimodal aspects, including

various data sources

Utterings of meeting members

contain important information

…
Very tight, prescribed

protocols in the OR

OKTO aimed at real time

support for the professional

Fysiological data influence the

process real time

Not that much speech about

the current process

Shared Deviations

SLIDE 4

September 23, 2004 Synthetic aperture microphone array 4

Dimensions AMI (M4) Meetingroom TNO – OR of the Delft Reinier de Graaf hospital

7800 8375 100 130 120 120 3900 175 190 75 175 150 movable pin-up wall 2 x Rear projection board private/ subteam table 120 Height: 190 320 160 Height: 73 Smart board Height room: 293 Anest

Instrum

Dia therm

Height room: 300 600 650 180

PC Light box Audio/video unit

SLIDE 5

September 23, 2004 Synthetic aperture microphone array 5

Layout of an operating room in Delft

Feasible array position F e a s i b l e a r r a y p

i t i

SLIDE 6

September 23, 2004 Synthetic aperture microphone array 6

Array placement in hospital in Voorburg

SLIDE 7

September 23, 2004 Synthetic aperture microphone array 7

Preliminary in vivo C&C-experiments in the Delft Reinier de Graaf hospital (2003)

Preliminary experiments

(High-res version)

Voice controlled application

(High-res version)

SLIDE 8

September 23, 2004 Synthetic aperture microphone array 8

Geometry of our synthetic operating room

SLIDE 9

September 23, 2004 Synthetic aperture microphone array 9

2D finite difference acoustic impulse response

Right Front Left Back

receivers time

Front Back

SLIDE 10

September 23, 2004 Synthetic aperture microphone array 10

Three array configurations explored in vitro

Square; 800 mic’s

S S A

1 2 3 Mondriaan; 2 x 800 mic’s

S S A

Circle; 600 mic’s

S S A

The 3 different array configurations do not differ much in what they gain in SNR 15 dB suppression of unwanted sources This is caused by all the reflections of the operation room Improved results are possible when the (acoustic) geometry of the space is included

1 2 3

SLIDE 11

September 23, 2004 Synthetic aperture microphone array 11

Two processing schemas explored in vitro

L-shape; 400 mic’s

S S A

1 2 3 Method 1

14 dB suppression 9 dB suppression 8 dB suppression

Method 2 1 2 3

19 dB suppression 14 dB suppression 17 dB suppression

SLIDE 12

September 23, 2004 Synthetic aperture microphone array 12

Results of ASR (Dragon) on our synthetic examples

src 1 (method 1; method 2) Esther, kun je mij een pakje steristrips geven Harris iris weergegeven. Rood & herleiden patisserie strips geven niet al src 2 (method 1; method 2) Ter plaatse van de rechter perianale regio bevindt zich een groot infiltraat. Te plaats veranderen miljard aangelegenheden bevindt zich een groot infiltraat. Ter plaatse van de rechter binnenhalen regionen bevindt zich een groot infiltraat. src 3 (method 1; method 2) Kan iemand mij dokter Stassen aan de lijn krijgen Daar Latijnse slagerij geheel ingeven bevindt zich groot infiltraat. Verlanglijst & slagerij vervaardigde zich groot infiltraat.

SLIDE 13

September 23, 2004 Synthetic aperture microphone array 13

Next to do:

Optimization algorithm leading to at least 25 dB S/N ratio

(needed for ASR purposes)

Results for reduced number of mics
Tracking of ‘moving’ sources
‘Real’, standardized experiments (lab, OR)