Ubiquitous Digital Agents (UDA) Suresh Manandhar University of York - PowerPoint PPT Presentation

AMADEUS A rchitectures M achines A nd D evices for E fficient U biquitous S ystems Ubiquitous Digital Agents (UDA) Suresh Manandhar University of York UDA – Ubiquitous Digital Agents

UDA – Ubiquitous Digital Agents

• UDA will allow the construction of a lightweight natural language interaction engine that can be embedded in home PDA 3G PC or mobile appliances • will access a collective UDA TV infrastructure via local or Fridge Digital Assistant central access points in which VCR devices will cooperate in Microwave question answering in a fully distributed manner DVD Washing machine UDA – Ubiquitous Digital Agents

UDA – Ubiquitous Digital Agents

Full NL Processing pipeline… TOKENISER SPELLING TAGGER user query CORRECTOR CHUNKER/ MATCHER DIALOG PARSER ENGINE ANIMATION GESTURE engaging CLIENT PLANNER response UDA – Ubiquitous Digital Agents

Proposed Approach • User supplied Question-Answer pairs • Query expansion module – Meaning equivalent questions/answers – Semantic distance metric – Study existing work on sentence similarity • Dialog manager UDA – Ubiquitous Digital Agents

Query Expansion The cat sat on the mat caterpillar place mat tabby cat canvass feline floorcover UDA – Ubiquitous Digital Agents

Query Expansion How much money can you invest in an ISA buy savings medium of exchange into account dough tie bank account fund spend account UDA – Ubiquitous Digital Agents

Sentence similarity UDA – Ubiquitous Digital Agents

Sentence similarity UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator • Fully working demonstrator without the NL understanding • Provides a platform for trying out ideas • Currently has: – Scanner for food items – Recipe suggestions – Shopping list generator UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator UDA – Ubiquitous Digital Agents

Smart Fridge Demonstrator UDA – Ubiquitous Digital Agents

Thanks for listening… UDA – Ubiquitous Digital Agents