SLIDE 1 Handy: a new Interaction Device Handy: a new Interaction Device for Vehicular Information Systems for Vehicular Information Systems
G.
Oliviero, U.
Montemurro, A. Paliotti , A. Paliotti
Electric and Electronic Systems Electric and Electronic Systems Elasis Elasis SCpA SCpA – – Fiat Fiat Group Group
G.
Costagliola, S. Di Martino
, F.
Ferrucci
- Dip. di
- Dip. di Matematica
Matematica e e Informatica Informatica Universit Università à di Salerno di Salerno
SLIDE 2
Outline Outline
Motivations Motivations
– – Automotive HMI issues Automotive HMI issues
The proposal The proposal
– – The The Handy Handy device device – – The GUI The GUI – – Some preliminary evaluation Some preliminary evaluation
Conclusions and future work Conclusions and future work
SLIDE 3 Automotive HMI Automotive HMI
Many studies report In Many studies report In-
- Car Telematics Systems induce
Car Telematics Systems induce an heavy visual workload on users, affecting negatively an heavy visual workload on users, affecting negatively road safety. road safety. Due to the safety concerns, US, EU and Japan have Due to the safety concerns, US, EU and Japan have identified as a identified as a short term priority short term priority the research on the research on Human Human-
Machine Interaction for the vehicular domain. for the vehicular domain. Traditional HCI approaches cannot be effectively Traditional HCI approaches cannot be effectively applied to the automotive domain applied to the automotive domain
– – User/driver can dedicate only a few burst of attention to intera User/driver can dedicate only a few burst of attention to interact ct with telematics system. with telematics system. – – ITS can show only a reduced amount of information. ITS can show only a reduced amount of information. – – Automotive users can have very heterogeneous skills Automotive users can have very heterogeneous skills
SLIDE 4 Related work Related work
Alfa Romeo Alfa Romeo Connect Connect
Audi / Volkswagen Audi / Volkswagen BMW BMW iDrive iDrive Jaguar Jaguar S S-
Type
SLIDE 5
The Proposal The Proposal
SLIDE 6 The project objectives The project objectives
Fiat Fiat research centre research centre Elasis Elasis, and University of Salerno , and University of Salerno jointly worked on a EU granted project jointly worked on a EU granted project The goal: to define a novel interface allowing drivers to The goal: to define a novel interface allowing drivers to manage the functionalities of next manage the functionalities of next-
generation telematics systems. systems. The main requirements for the system were: The main requirements for the system were:
– – Reduce the distraction (and in particular the visual workload) Reduce the distraction (and in particular the visual workload) inducted by the system; inducted by the system; – – Easy to use for na Easy to use for naï ïve users; ve users; – – Quick to use for expert users; Quick to use for expert users; – – Cost Cost-
- effective to industrialize in the next 2
effective to industrialize in the next 2-
3 years.
SLIDE 7
Handy Handy’ ’s s Rationale Rationale
Interaction with an ITS consists of three phases: Interaction with an ITS consists of three phases:
1. 1.User has to search on the ITS faceplate the hardware User has to search on the ITS faceplate the hardware control suited for the specific task, control suited for the specific task, 2. 2.then ( then (s)he s)he has to place his/her hand or fingers on that has to place his/her hand or fingers on that (typically small) control, and (typically small) control, and 3. 3.finally ( finally (s)he s)he has to interact with the control in order to has to interact with the control in order to achieve his/her goal. achieve his/her goal.
The main goal of the proposed device is to The main goal of the proposed device is to minimize the distraction of points 1) and 2) minimize the distraction of points 1) and 2)
SLIDE 8 The The Handy Handy device device
The idea is to have a remote The idea is to have a remote device, placed on the driver seat device, placed on the driver seat arm rest, just behind the gear arm rest, just behind the gear lever. lever. The device is characterized by The device is characterized by an ergonomic, comfortable an ergonomic, comfortable shape, recalling hand shape, recalling hand’ ’s palm. s palm. It encompasses: It encompasses:
– – a rotary wheel, placed under the a rotary wheel, placed under the forefinger, forefinger, – – and four and four soft soft-
buttons, ,
One placed under the thumb One placed under the thumb Three under the other fingers. Three under the other fingers.
SLIDE 9 Considerations Considerations
The main advantage introduced by The main advantage introduced by Handy Handy is that users are always aware of both its is that users are always aware of both its position and of the displacement of their position and of the displacement of their fingers with respect to the interaction fingers with respect to the interaction controls. controls. Handy Handy provides the user with at most 7 provides the user with at most 7 actions, fitting the actions, fitting the 7 7± ±2 capacity 2 capacity of the
typical user's processing load typical user's processing load
SLIDE 10 Semantic of the Semantic of the Handy Handy’ ’s s controls controls
The semantic associated with the The semantic associated with the rotations, tilts and clicks of this element rotations, tilts and clicks of this element depends on the active module and state of depends on the active module and state of the system, and is described by a label the system, and is described by a label placed in a specific section of the GUI. placed in a specific section of the GUI. Clickable Clickable and and tiltable tiltable scroll scroll wheel wheel S1 S1 The semantic of these buttons depends on The semantic of these buttons depends on the active module and state of the system, the active module and state of the system, and is described by a label placed in a and is described by a label placed in a specific section of the GUI. specific section of the GUI. SoftButton SoftButton T1, T2, T3 T1, T2, T3 This button is associated to an This button is associated to an “ “escape escape” ” or
“ “abort abort” ” function. It allows us to come up
- function. It allows us to come up
- ne level in a menu hierarchy, as well as
- ne level in a menu hierarchy, as well as
to abort a current interaction. to abort a current interaction. SoftButton SoftButton TB TB Features Features Type Type Control Control
S1 T1 T2 T3 TB
SLIDE 11
The Graphical User Interface The Graphical User Interface
SLIDE 12
Some remarks on Automotive GUIs Some remarks on Automotive GUIs
When designing GUI for telematics When designing GUI for telematics systems, one of the crucial issues is the systems, one of the crucial issues is the amount of information to show: amount of information to show:
– – Too much information leads the user to Too much information leads the user to devote many visual and cognitive resources devote many visual and cognitive resources to identify the needed data among all the to identify the needed data among all the shown on the display. shown on the display. – – Too few information makes a na Too few information makes a naï ïve user ve user unable to effectively exploit the system. unable to effectively exploit the system.
SLIDE 13
GUI main rationale GUI main rationale
The GUI must effectively support the The GUI must effectively support the Handy device. Handy device. The user must always be aware of all the The user must always be aware of all the possible actions possible actions Limit the amount of displayed information Limit the amount of displayed information to avoid visual workload to avoid visual workload
SLIDE 14 The GUI The GUI
Developed by using C#, Altia and Simulink
SLIDE 15
Support for Handy Support for Handy
SLIDE 16 Amount of displayed information Amount of displayed information
The idea is to provide two different GUI layouts, The idea is to provide two different GUI layouts, and to switch between them on the basis of the and to switch between them on the basis of the action carried out by the user: action carried out by the user:
– – If ( If (s)he s)he seems to be about to interact with the system, seems to be about to interact with the system, the GUI displays all the information needed to the GUI displays all the information needed to effectively support the user effectively support the user’ ’s task. s task.
We named this layout We named this layout Interaction Modality Interaction Modality. .
– – If ( If (s)he s)he seems to be not interested in interacting, then seems to be not interested in interacting, then the system goes in the the system goes in the View Modality View Modality, showing only , showing only some module some module-
- specific information, and hiding all the
specific information, and hiding all the controls needed to interact. controls needed to interact.
SLIDE 17
GUI modalities GUI modalities
SLIDE 18 GUI modalities (2) GUI modalities (2)
We can discriminate the user intentions by using We can discriminate the user intentions by using another specific feature of another specific feature of Handy Handy, i.e. a , i.e. a proximity sensor placed in the shell. proximity sensor placed in the shell. In this way it is possible to be aware about the In this way it is possible to be aware about the position of the driver position of the driver’ ’s hand with respect to s hand with respect to Handy Handy: :
– – if user places his/her hand on the device, then if user places his/her hand on the device, then suddenly the system goes into the suddenly the system goes into the Interaction Interaction Modality Modality. . – – If user retracts the hand, then after a certain amount If user retracts the hand, then after a certain amount
- f seconds, the systems come back into the
- f seconds, the systems come back into the View
View Modality Modality. . – – Preliminary experiments indicates that 20 seconds Preliminary experiments indicates that 20 seconds should be an adequate interval. should be an adequate interval.
SLIDE 19 Tactile feedbacks Tactile feedbacks
Haptic feedbacks are used to enhance the user Haptic feedbacks are used to enhance the user awareness of the system state, limiting the visual awareness of the system state, limiting the visual workload. workload. The scroll wheel provides the following kinds of tactile The scroll wheel provides the following kinds of tactile
– – Notches, to inform about the scrolling among the items of a Notches, to inform about the scrolling among the items of a menu or a list; menu or a list; – – Barrier, to notify the end of a list of items; Barrier, to notify the end of a list of items; – – Free movement, to facilitate some scroll operations (for example Free movement, to facilitate some scroll operations (for example
- n the navigation map);
- n the navigation map);
The buttons provide a limited tactile feedback. The buttons provide a limited tactile feedback.
– – If in a specific state there is no function associated to a butt If in a specific state there is no function associated to a button, it
will result locked will result locked
SLIDE 20
Evaluations Evaluations
We compared the menu clustering with: We compared the menu clustering with:
– – Magneti Magneti Marelli Marelli Connect+ Connect+ – – Bosch Vasco Bosch Vasco – – Lancia Lancia Siemens Siemens
All the All the “ “major major” ” functionalities require less functionalities require less “ “interactions interactions” ” than the other solutions than the other solutions
SLIDE 21 Menu clustering Menu clustering
7 5 5 4 8 6 5 3 7 4 3 3 6 4 5 3 1 2 3 4 5 6 7 8 Insert Address Read SMS Call Contact Detour Magneti Marelli Siemens Bosch Proposal
Number of Interactions Number of Interactions
SLIDE 22
Future Work Future Work
SLIDE 23 Conclusions Conclusions
We presented a new interaction device for We presented a new interaction device for automotive systems, together with a suited GUI automotive systems, together with a suited GUI The solution: The solution:
– – Limits the driver Limits the driver’ ’s visual workload, because he has s visual workload, because he has not to not to “ “search search” ” where to place the fingers where to place the fingers – – Is easy to use for na Is easy to use for naï ïve, because in each state all the ve, because in each state all the possible interactions are explained possible interactions are explained – – Is quick to use for skilled, because they can learn Is quick to use for skilled, because they can learn interaction interaction “ “pattern pattern” ” – – Is cost Is cost-
- effective, because it does not require any
effective, because it does not require any particular equipment particular equipment
SLIDE 24 Conclusions (2) Conclusions (2)
Some initial evaluations show that Handy Some initial evaluations show that Handy performs better than: performs better than:
– – touch touch-
- screens and peripheral buttons, because it
screens and peripheral buttons, because it eliminates the highly distracting task of looking at the eliminates the highly distracting task of looking at the
- wn finger to touch the right control;
- wn finger to touch the right control;
– – iDrive iDrive, because it provides a more limited number of , because it provides a more limited number of choices choices
The drawback: only 3 buttons leads to deeper The drawback: only 3 buttons leads to deeper menu hierarchies menu hierarchies Open question: Right Open question: Right-
Hand drive
SLIDE 25 Thank you! Thank you!
Sergio Di Martino Sergio Di Martino Universit Università à di Salerno di Salerno Via Ponte Don Via Ponte Don Melillo Melillo, 84084, Fisciano, SA, Italy , 84084, Fisciano, SA, Italy sdimartino@unisa.it sdimartino@unisa.it +39 +39-
89-
966324
