Speech Technology in Mobile Phones Part II : Voice based - - PowerPoint PPT Presentation

Speech Technology in Mobile Phones

Part II : Voice based Agriculture Information Systems

Rajesh M. Hegde

rhegde@iitk.ac.in

Associate Professor

• Dept. of EE

Indian Institute of Technology Kanpur

Several pictures used in this presentation have been collected from various sources available on the web and have been acknowledged in the slides.

Topics Covered

• A personalized voice based service on

mobile phones in several Indian Languages : Digital Mandi for the Indian Kisan

• A Hindi speech recognition based system
• n the mobile phone for accessing agro-

commodity prices for the Farmer.

Value Added Services (VAS) in the Agriculture Sector in India

• Computing is becoming human

centered, and multi modal

• Information is available in

various sources and various forms

• Personalized or Service based

Information delivery systems are order of the day

• Important in Indian Context with

huge population and cheap access to cell phone services

• Agricultural Information

systems assume great significance

Network PSTN

SMS Gateway Web/Database Server Asterisk Server

The use of Images, Video, Text, Audio, Voice and Natural dialogue will help use seemingly sophisticated technology in simple and efficient ways to provide information to the Indian Kisan

Multi modal Personalized VAS

Cell Phone based Agriculture Information Systems Digital Mandi for the Indian Kisan

Source : Digital Mandi for the Indian Kisan

Architecture

• Supports Multi modal

Query and Retrieval

Digital Mandi for the Indian Kisan

Digital Mandi : Stake Holders

Digital Mandi for the Indian Kisan

• Cell phone based service for the Indian farmer.
• Provides easy access to the prices of desired crops in

the mandis in which a farmer is interested.

• The service can run on low-end, GPRS enabled cell

phones.

• Can be accessed in more than one way, the simplest

being a one time registration process.

• The one time registration can be done directly from

the phone.

Digital Mandi for the Indian Kisan

• A farmer can choose to listen or/and read the price.

Both will be delivered in his/her native language.

• A farmer can also choose the frequency with which

the prices be delivered to his/her phone.

• The registration process is made simpler by using

features like auto-state detection.

• The service can be accessed even without registration.
• 15000 Farmers in Haryana and 23000 Farmers in

Odisha currently using the System.

System Deployment Overview

• For both Savvy And the Common

Farmer

FARMER REGISTRATION AT APMC / VIA MOBILE PHONE SMS and Voice calls directly placed to The Farmers Mobile Phone Access via GPRS PHONE

REGISTRATION - HINDI

FARMER PROFILE

Version for Hindi Users

• Fusion of multi modal methods

with Farmer Registration Profile in Hindi Version

GPRS MODE

• Fusion of multi modal methods

with Farmer Registration Profile in English Version

GPRS MODE

Version for English Users

Sample SMS and Voice Call in Hindi

SMS/Voice Call Mode

SMS/Voice Call Mode

Sample SMS and Voice Call in Odiya

Live Demo of Digital Mandi GPRS version

• Switch to Cell phone Screen at this point

Available at http://digitalmandi.iitk.ac.in

Speech Recognition Based Access of Agrocommodity Prices in Hindi for Uttar Pradesh Sponsored by DieTY Govt. Of India

Asterisk PBX (PC Debian GNU/Linux) Database Server (PC Debian GNU/Linux) SMS Gateway

Get PNR Status via SMS and Voice Call Get Mandi Price and Store Call information Make a call and follow instructions Getting data from agmarknet.nic.in

Agmarknet Web Server (PC Debian GNU/Linux)

Speech Based Access of Agrocommodity Prices in Hindi Sponsored by TDIL, DieTY Govt. Of India

System Call Flow

1. Dial the tel no. +512-391-5353. Welcome message will play. 2. Prompt for district name. 3. Speak district name from the list. 4. Prompt for haan ya nahin. 5. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the district name. If you say haan, then you will be asked to speak the commodity name. 6. Prompt for commodity name. 7. Speak commodity name from the list. 8. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the commodity name. 9. If you say haan, then the price of commodity will be played out. 10. Prompt for repeat the process. If you want to try the system again say haan else say nahin. 11. If you say haan you can try the overall system again. 12. If you say nahin the system will hangup after thank you prompt.

Live Demo

• Switch to Cell Phone Screen Now
• Dial +91-512-391-5353/

+91-512-671-1453

Questions

rhegde@iitk.ac.in URL : http://202.3.77.107/mips/

?