Hey Furby, call mom! using Skype and VoiceXML Miloslav Pavl ek - - PowerPoint PPT Presentation
Hey Furby, call mom! using Skype and VoiceXML Miloslav Pavl ek - - PowerPoint PPT Presentation
IBM VUT Student Research Project 2006 Hey Furby, call mom! using Skype and VoiceXML Miloslav Pavl ek (pavlim3@fel.cvut.cz) Jaroslav Matouek (matouj2@fel.cvut.cz) Agenda 1. Project Overview 2. Communication Scheme 3. Project Goals
IBM ČVUT Student Research Project 2006 (2 z 11)
Agenda
- 1. Project Overview
- 2. Communication Scheme
- 3. Project Goals
- 4. Project Implementation
- 5. How It Works
- 6. Application Demo
- 7. Summary
IBM ČVUT Student Research Project 2006 (3 z 11)
Project Overview
- Make it possible to
call with Furby
- Use Skype for calling
and VoiceXML for speech dialog
- Communicate with
Furby via BlueTooth
IBM ČVUT Student Research Project 2006 (4 z 11)
Communication Scheme
IBM ČVUT Student Research Project 2006 (5 z 11)
Project Goals
- generate VXML templates for speech
dialog
- get usernames and aliases from user‘s
Skype contact list
- call Skype users selected in dialog
- switch between standard and BT audio
- deal with all Skype statuses (offline, ...)
IBM ČVUT Student Research Project 2006 (6 z 11)
Project Implementation
- application written in C++
– generating VXML – using SkypeAPI for communication with Skype
- audio dialogues in VoiceXML
- using VoiceXML browser Charlie for speech
recognition
- Apache v2.0 webserver – application running as
CGI script
- implemented under OS Windows XP SP2 (using
Skype v2.0)
IBM ČVUT Student Research Project 2006 (7 z 11)
How It Works
1. Browser started with CGI script URL as argument 2. Main dialog generated (with usernames from Skype contact list) 3. User to call selected 4. CGI script called again (username as argument) 5. Make the call in Skype, wait until hang up 6. New dialog generated
IBM ČVUT Student Research Project 2006 (8 z 11)
Application Demo (1)
- See video1_final.avi
- Skype statuses
– Skype N/A – Pending authorization – Refused connection – Offline status
IBM ČVUT Student Research Project 2006 (9 z 11)
Application Demo (2)
- See video2_final.avi
- Speech dialog and calling
- Calling offline/online user
IBM ČVUT Student Research Project 2006 (10 z 11)
Summary
- Application is working – able to make calls
after user requests
- Automatic generating of new speech
baseforms with Charlie browser
- Switching of audio devices not fully
implemented and tested with real Furby
IBM ČVUT Student Research Project 2006 (11 z 11)