433-324 Graphics and Interaction Kinds of Interfaces Adrian Pearce - PowerPoint PPT Presentation

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic 433-324 Graphics and Interaction Kinds of Interfaces Adrian Pearce Department of Computer Science and Software Engineering University of Melbourne The University of Melbourne Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Lecture outline Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Basic Categories of Interaction ◮ key-modal ◮ direct manipulation ◮ linguistic Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Key-Modal Interaction ◮ keyboard or function keys ◮ multiple modes ◮ styles ◮ menu-based interaction ◮ question-and-answer ◮ function-key interaction ◮ (structured) voice-based interaction ◮ common for walk-up-and-use systems ◮ system knows current state so can guide user Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Menu-Based Interaction Selection by: ◮ Typing option number or letter ◮ Cursor or tab keys ◮ Pointing and selecting with mouse or trackball ◮ Touch screen ◮ Function key alongside displayed item Can be embedded in other systems Strengths: ◮ Guides users Weaknesses: ◮ Doesn’t well support complex actions ◮ Can be slow Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Direct Manipulation Manipulate individual objects ◮ apply actions directly to objects ◮ display responds immediately Styles ◮ graphical direct manipulation ◮ forms fill-in Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Linguistic Interaction Essentially word and language based Styles ◮ command-line interaction ◮ spoken or text-based natural language Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Why natural language processing is hard Fully general speech recognition, natural-language understanding and generation is a very hard AI problem. Examples: ◮ Time flies like an arrow. ◮ Morty shot Ferdie. He died. ◮ Morty shot Ferdie. He didn’t die. ◮ Morty shot Ferdie. He felt sorry about it. Can be feasible in limited domains, e.g., airline reservations. Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Summary ◮ Classification useful but not rigid ◮ Hybrid systems ◮ e.g. ddd , bash ◮ Multiple styles ◮ Strengths/weaknesses, users’ context Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic Basic Categories of Interaction Revisited ◮ key-modal ◮ direct manipulation ◮ linguistic Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces