rtAIM : a real-time implementation of the auditory image model of - - PowerPoint PPT Presentation

▶
rtaim
SMART_READER_LITE
LIVE PREVIEW

rtAIM : a real-time implementation of the auditory image model of - - PowerPoint PPT Presentation

Jan 09, 2024 366 likes •540 views

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University rtAIM : a real-time implementation of the auditory image model of auditory periphery Willem van Engen April 23, 2007 Transport Physics,

slide-1
SLIDE 1

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

rtAIM:

a real-time implementation of the auditory image model of auditory periphery

Willem van Engen

April 23, 2007

slide-2
SLIDE 2

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

Contents

  • Introduction
  • The auditory image model
  • A real-time implementation
  • Conclusion
slide-3
SLIDE 3

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

Introduction

slide-4
SLIDE 4

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

Introduction: a psychoacoustics example

a rate-doubling click train

slide-5
SLIDE 5

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model:

  • verview
  • pre-cochlear processing
  • basilar membrane motion
  • neural activity pattern
  • strobing
  • stabilised auditory image
  • size-shape-covariant auditory image
slide-6
SLIDE 6

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: the ear

slide-7
SLIDE 7

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: the cochlea

basilar membrane 20 kHz 200 Hz

slide-8
SLIDE 8

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: basilar membrane motion

sound input

slide-9
SLIDE 9

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: basilar membrane motion

sound input BMM

slide-10
SLIDE 10

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: strobing

sound input

slide-11
SLIDE 11

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: strobing

sound input

slide-12
SLIDE 12

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

The auditory image model: stabilised auditory image

temporal integration SAI

slide-13
SLIDE 13

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

rtAIM a real-time implementation

  • Continuous processing
  • Real-time
  • Object-oriented design,

cross-platform, open source

slide-14
SLIDE 14

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

Conclusion

  • AIM largely implemented
  • Works in real-time
  • Verification still pending

Current activity: Finish, document, verify Speech-recognition pre-processor

slide-15
SLIDE 15

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

Questions