Interchangeable Modalities W3C Workshop on MultiModal Interaction - PowerPoint PPT Presentation

Mar 12, 2023 •155 likes •337 views

Interchangeable Modalities W3C Workshop on MultiModal Interaction 22-23 July 2013, New York Background: iSpeech is a Text-to-Speech & Speech Recognition Company Enterprise Enterprise Mobile, Auto, Home, & Fast growing list of

Interchangeable Modalities W3C Workshop on MultiModal Interaction 22-23 July 2013, New York
Background: iSpeech is a Text-to-Speech & Speech Recognition Company Enterprise Enterprise Mobile, Auto, Home, & Fast growing list of Developer Publishing Customers Mobile, Auto, Home Experience Developer and Publishing Consumer Customers 25,000+ developers s Experience 15,000+ devs in 30+ million app Consumers 12 months, 2x downloads growth of 30+ million app downloads
Credibility: Developer Ecosystem > 25K developers registered > 2 billion API calls serviced > 99.9% uptime . Mobile Devs Mobile OEM/OS Auto Home Publishing
Speech: New Frontiers Growth Following New Use Cases Breakdown of Developers by Segment & Activity 1 Entertainment 2 Mobile/Nav 3 eLearning 4 Telephony Developers API Usage
Challenges of Speech Technology  Many technologists have never ‘experienced’ working directly with speech technologies  Uncharted Technology Waters: Audio DSP, NLP, Domain/Grammar/Lexicon, Multimodal UI  Speech mirrors humans; more like ‘wetware’ than ‘software’?  Life-cycle of continuous adaptations and QA
Consideration: Speech Technology Value Chain ASR NLP TTS
Standards & HTLM5 • 25,000 Developers X 10 ways to package web services (APIs and SDKs) And that’s just Cloud, dozens more embedded engines to account • HTML5 adoption – audio playback of TTS ok, audio recording (ASR) not widely used • Example: impact of mature standards on use of Speech Technology: VoiceXML, SSML, SRGS, MRCP
Talkz™ Case Study • Talkz - successor to Drivesafe.ly • Interchangeable Multimodal App • Available today through iTunes
Multi- Modal’s Silver Lining : Universal Accessibility 1st Accesible VoiceOver Smart- Section 508 Mac OS X phone 1998 2005 2009 2000 2006 2013 Global Windows YouTube Public Inclusive Narrator Captions Infrastructure (GPII) “The gap between usability and accessibility is narrowing and with it the digital divide between disabled and non-disabled people .” - Robin Christopherson, AbilityNet
Conclusions for Multi-Modal Developers • Plan to Partner & Partner to Plan • Multimodal is a CENTRAL UI pillar, not an after thought
Craig Campbell Chief Evangelist ccampbell@iSpeech.org www.iSpeech.org/developers

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Programming Modalities Modalities of Programming In 2020, there are three prevalent modalities

Programming Modalities Modalities of Programming In 2020, there are three prevalent modalities you're likely to program in: 1. Interactive Programming You type in a command, press enter, and it is evaluated immediately. 2. Stored Programs

505 views • 6 slides

Marie-France Bellin Technical innovations in existing modalities New imaging modalities

Medical imaging technologies and advances in nuclear medicine and radiology Marie-France Bellin Technical innovations in existing modalities New imaging modalities Increased resolution and contrast PET-CT More precise 3D

482 views • 10 slides

DFG Graduiertenkolleg 1564 (Research Training Group 1564) Imaging New Modalities Multimodal

Imaging New Modalities DFG Graduiertenkolleg 1564 (Research Training Group 1564) Imaging New Modalities Multimodal Image Acquisition and Analysis for Civil Security Applications 1 Imaging New Modalities State-of-the-Art Commercial

382 views • 13 slides

69a History of Massage: Modalities 69a History of Massage: Modalities Class Outline 5 minutes

69a History of Massage: Modalities 69a History of Massage: Modalities Class Outline 5 minutes Attendance, Breath of Arrival, and Reminders 10 minutes Lecture: 25 minutes Lecture: 15 minutes Active study skills: 60 minutes Total 69a

500 views • 23 slides

Ecoregion Placemaking Approach - The living open access model provides interchangeable elements

Climate Change Adaptation & Transformation through an Ecoregion Placemaking Approach - The living open access model provides interchangeable elements for a worldwide economy of knowledge to its users. May 12, 2015 Charles M. Beck,

625 views • 34 slides

69a History of Massage: Modalities 69a History of Massage: Modalities Class Outline 5

488 views • 23 slides

The Use and Application of Physical Agents and Modalities: Can be used for: Physical Agent

The Use and Application of Physical Agents and Modalities: Can be used for: Physical Agent Modalities Certification (PAM) For Occupational Therapists and Certified Occupational Therapy Assistants Kurt Gray, PT, DPT 1 What are Physical Agents

1.38k views • 120 slides

FDE-Modalities and Weak Definability . Odintsov 1 Sergei P 1 Sobolev Institute of Mathematics

FDE-Modalities and Weak Definability . Odintsov 1 Sergei P 1 Sobolev Institute of Mathematics (Novosibirsk, Russia) odintsov@math.nsc.ru (joint work with Heinrich Wansing) Wormshop, 1520.10.2017 Sergei P . Odintsov FDE-Modalities Logic R

754 views • 64 slides

Time Modalities over Many-valued Logics Achille Frigeri Dipartimento di Matematica Francesco

Time Modalities over Many-valued Logics Time Modalities over Many-valued Logics Achille Frigeri Dipartimento di Matematica Francesco Brioschi Politecnico di Milano joint work with Nicholas Fiorentini, Liliana Pasquale, and Paola Spoletini

429 views • 25 slides

Modalities in HoTT Egbert Rijke, Mike Shulman, Bas Spitters 1706.07526 Higher toposes Internal

Higher toposes Internal logic Modalities Sub- -toposes Formalization Modalities in HoTT Egbert Rijke, Mike Shulman, Bas Spitters 1706.07526 Higher toposes Internal logic Modalities Sub- -toposes Formalization Outline 1 Higher

966 views • 52 slides

WHEN TO CHOOSE A CHEMICAL PEEL OVER OTHER MODALITIES NEW FRONTIERS IN COSMETIC MEDICINE AND

WHEN TO CHOOSE A CHEMICAL PEEL OVER OTHER MODALITIES NEW FRONTIERS IN COSMETIC MEDICINE AND MEDICAL DERMATOLOGY (NFCMMD) NOVEMBER 2019 KSENIYA GOLUBETS, MD, MHS SKIN AND LASER SURGERY SPECIALISTS OF NY & NJ 1 INTRO TO PEELS

212 views • 18 slides

WHEN TO CHOOSE A CHEMICAL PEEL OVER OTHER MODALITIES NEW FRONTIERS IN COSMETIC MEDICINE AND

934 views • 52 slides

Modelling word perception and comprehension across modalities Psychology in Big Question 1 PhD

15/09/2017 Modelling word perception and comprehension across modalities Psychology in Big Question 1 PhD student : Danny Merkx Supervisors : Stefan Frank (CLS) Mirjam Ernestus (CLS) Raquel Fernandez (ILLC) Louis ten Bosch (CLS) Research

362 views • 10 slides

Issues to Consider and Elements of Modalities for the CFTA Services Negotiations

Issues to Consider and Elements of Modalities for the CFTA Services Negotiations ECOWAS/UNCTAD/GIZ Stakeholder Consultations on the Development of a Regional Strategy for the CFTA Negotiations Accra, Ghana 9-11 March 2016 Martine Julsaint

1.38k views • 44 slides

Early Vision and Actions other sensory modalities (e.g. audition and haptics) and motor control

Not only vision in computational vision Want to stress the role of vision in guiding and understanding human action and interaction the importance of integration with Early Vision and Actions other sensory modalities (e.g. audition and

330 views • 4 slides

Home Dialysis Modalities Supporting Patient Choice Objectives Review home dialysis therapy

Home Dialysis Modalities Supporting Patient Choice Objectives Review home dialysis therapy in the US and other countries Review the CMS Conditions for Coverage (CfC) related to home dialysis modalities Describe the home dialysis

364 views • 19 slides

Engineering ............ design of the physical ? ....early 90s What do we live for? Is

Engineering ............ design of the physical ? ....early 90s What do we live for? Is technology really for the greater good? Am I going to spend my life with machines? Inspiring moments.......... 1997 I am going to build my blind

538 views • 31 slides

Speech Recognition and Synthesis for Conversational AI Mari Ostendorf University of Washington

Speech Recognition and Synthesis for Conversational AI Mari Ostendorf University of Washington EE596 Spring 2018 Dialogue System Components A Speech Language P Recognition Understanding P L I Dialogue C Management A T I

907 views • 42 slides

Towards Unsupervised Speech-to-Text Translation Yu-An Chung Wei-Hung Weng Schrasing Tong

Towards Unsupervised Speech-to-Text Translation Yu-An Chung Wei-Hung Weng Schrasing Tong James Glass Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge, Massachusetts, USA ICASSP

1.17k views • 16 slides

Almost Unsupervised Text to Speech and Automatic Speech Recognition Yi Ren, Xu Tan, Tao Qin,

Almost Unsupervised Text to Speech and Automatic Speech Recognition Yi Ren*, Xu Tan*, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu Microsoft Research Zhejiang University Motivation ASR and TTS can achieve good performance given large amount

400 views • 13 slides

Structured Discriminative Models for Speech Recognition Mark Gales - work with Anton Ragni,

Structured Discriminative Models for Speech Recognition Mark Gales - work with Anton Ragni, Austin Zhang, Rogier van Dalen September 2012 Cambridge University Engineering Department Symposium on Machine Learning in Speech and Language

697 views • 54 slides

Introduction to Statistical Speech Recognition Lecture 1 CS 753 Instructor: Preethi Jyothi

Introduction to Statistical Speech Recognition Lecture 1 CS 753 Instructor: Preethi Jyothi Course Plan (I) Cascaded ASR System S peech Wavefor m - Acoustic Model ( AM ) Acoustic Analysis - Pronunciation Model ( PM ) Frame # Ac Acoustic

601 views • 32 slides

SI485i Natural Language Processing Set 1 Intro to NLP Fall 2013 : Chambers Assumptions about

SI485i Natural Language Processing Set 1 Intro to NLP Fall 2013 : Chambers Assumptions about You You know how to program Java basic UNIX usage basic probability and statistics (well also review) You will learn

553 views • 12 slides

SpeechRecognition P y thon librar y SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON Daniel

SpeechRecognition P y thon librar y SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON Daniel Bo u rke Machine Learning Engineer / Yo u T u be Creator Wh y the SpeechRecognition librar y? Some e x isting p y thon libraries CMU Sphin x Kaldi

629 views • 23 slides