Trans- -Modal Modal Interface Interface Trans Migration - - PowerPoint PPT Presentation
Trans- -Modal Modal Interface Interface Trans Migration Migration Renata Bandelloni, Silvia Berti, Fabio Patern HIIS Laboratory ISTI-CNR Pisa, Italy Mobile HCI 2004 13 - 16 September 2004 University of Strathclyde, Glasgow, Scotland
Mobile HCI 2004 13 - 16 September 2004 University of Strathclyde, Glasgow, Scotland
17 September 2004 Mobile HCI 2004 2
Interface can transfer among different
Interaction Continuity Platform Adaptation Interface Usability
17 September 2004 Mobile HCI 2004 3
Logical description of the application
Platform adaptation
Runtime state of the interface.
Interaction continuity
17 September 2004 Mobile HCI 2004 4
Task Model Abstract User
Platform specific
17 September 2004 Mobile HCI 2004 5
Mapping Mapping & & State State extraction extraction and and Adaptation Adaptation ( ( static static-
runtim e data) data) Migration Migration request request ( ( url url, ,runtim e runtim e data) data) Migration Migration perform ance perform ance ( ( new Url new Url) )
1 1 2 2 3 3 Server Server
17 September 2004 Mobile HCI 2004 6
From the current page -> abstract
Calculation of the most similar abstract
The page supporting the most similar set
In case of multiple similar pages -> the
17 September 2004 Mobile HCI 2004 7
One One to to One One
DeviceB Presentation1 task1 task2 task3 task4 DeviceA Presentation1 task1 task2 task3 task4
One One to to Many Many
DeviceB Presentation1 task1 task2 DeviceB Presentation2 task3 task4 DeviceA Presentation1 task1 task2 task3 task4
Many Many to to One One
DeviceA Presentation1 task1 task2 DeviceA Presentation2 task3 task4 DeviceB Presentation1 task1 task2 task3 task4
17 September 2004 Mobile HCI 2004 8
Many devices supporting Internet
Change modality of input depending on
Natural interaction Multichannel access
17 September 2004 Mobile HCI 2004 9
Louis is at Home and wants to
for this evening. He turns on his personal computer . While Louis is selecting the Mermaid restaurant main page, he realizes that it is getting late Synthesiser: “If you want phone number say phone, if you want to know the location say address, if you want to know the menu of the day say menu. If you want to book a table say book.” Louis: “book“. Synthesiser: “Say your name” Louis: “Louis” Synthesiser: “Say your surname” Louis: “Lestat” Synthesiser: “Say date of reservation” Louis: “ 2 June 2004” Synthesiser: “Say the time of reservation” Louis: “9 pm” Synthesiser: “How many people?” Louis: “three” Synthesizer: “Louis Lestat, you booked a table for three people on 2 June 2004 at 9 pm. Say confirm to confirm your booking and cancel to discard it”. Louis: ”confirm”.
17 September 2004 Mobile HCI 2004 10
Migration Migration Server Server
Task Task Mapping Mapping engine engine
State State extraction extraction
and and Adaptation Adaptation XHTML AUI TASKS
Graphic Graphic Desktop Desktop
VoiceXML AUI TASKS
Vocal Vocal
17 September 2004 Mobile HCI 2004 11
Vocabulary Information organization Different concrete
Not a simple one to one mapping
Task not Supported Task implemented with different concrete
Adaptation of runtime data
1k June 7 10: 00 Re: Cam eleon meeting Mary Rex 2k June 5 12: 20 Learn about Java Luois Lestat 3k June 3 11: 02 Re: Cam eleon meeting George Clow 1k May 25 9: 23 Last minute offer Luois lestat Size Size Date Date &Tim e &Tim e Subject Subject Sender Sender 1k June 7 10: 00 Re: Cam eleon meeting Mary Rex 2k June 5 12: 20 Learn about Java Luois Lestat 3k June 3 11: 02 Re: Cam eleon meeting George Clow 1k May 25 9: 23 Last minute offer Luois lestat Size Size Date Date &Tim e &Tim e Subject Subject Sender Sender
17 September 2004 Mobile HCI 2004 12
(grouping sound) Please say your name. Please say your surname. Please say the date of reservation. Your name is … . Your surname is … . You have booked a table on … and You prefer… What type of menu do you prefer: fish; meat; vegetable (grouping sound) (grouping sound) If you want to cancel the reservation , say delete; If you want to confirm the reservation, say ok (grouping sound).
Grouping Grouping Operator Operator Object Object that that Support Support the task the task “ “ Provide Provide date” date” Task Task not not supported supported in Voice interface in Voice interface
17 September 2004 Mobile HCI 2004 13
Nam e: Louis Date: 3 July
(grouping sound) Please say your name. Please say your surname. Please say the date of reservation. Your name is … . Your surname is … . You have booked a table on … and You prefer… What type of menu do you prefer: fish; meat; vegetable (grouping sound) (grouping sound) If you want to cancel the reservation , say delete; If you want to confirm the reservation, say ok (grouping sound). Your name is Louis
booked a table on 3 3 July July.
17 September 2004 Mobile HCI 2004 14
Migratory interfaces for more natural
Extension for multi-modal interfaces
Distributed migratory interfaces