rtAIM : a real-time implementation of the auditory image model of - PowerPoint PPT Presentation

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University rtAIM : a real-time implementation of the auditory image model of auditory periphery Willem van Engen April 23, 2007 Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Contents ● Introduction ● The auditory image model ● A real-time implementation ● Conclusion Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Introduction Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Introduction: a psychoacoustics example a rate-doubling click train Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: overview ● pre-cochlear processing ● basilar membrane motion ● neural activity pattern ● strobing ● stabilised auditory image ● size-shape-covariant auditory image Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: the ear Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: the cochlea basilar membrane 200 Hz 20 kHz Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: basilar membrane motion sound input Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: basilar membrane motion sound input BMM Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: strobing sound input Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: strobing sound input Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University The auditory image model: stabilised auditory image SAI temporal integration Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University rtAIM a real-time implementation ● Continuous processing ● Real-time ● Object-oriented design, cross-platform, open source Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Conclusion ● AIM largely implemented ● Works in real-time ● Verification still pending Current activity: Finish, document, verify Speech-recognition pre-processor Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology

CNBH, Physiology Department, Cambridge University CNBH, Physiology Department, Cambridge University Questions Transport Physics, Physics Department, Eindhoven University of Technology Transport Physics, Physics Department, Eindhoven University of Technology