433-324 Graphics and Interaction Kinds of Interfaces Adrian Pearce - - PowerPoint PPT Presentation

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

433-324 Graphics and Interaction Kinds of Interfaces

Adrian Pearce

Department of Computer Science and Software Engineering University of Melbourne

The University of Melbourne

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Lecture outline

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Basic Categories of Interaction

◮ key-modal ◮ direct manipulation ◮ linguistic

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Key-Modal Interaction

◮ keyboard or function keys ◮ multiple modes ◮ styles

◮ menu-based interaction ◮ question-and-answer ◮ function-key interaction ◮ (structured) voice-based interaction

◮ common for walk-up-and-use systems ◮ system knows current state so can guide user

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Menu-Based Interaction

Selection by:

◮ Typing option number or letter ◮ Cursor or tab keys ◮ Pointing and selecting with mouse or trackball ◮ Touch screen ◮ Function key alongside displayed item

Can be embedded in other systems Strengths:

◮ Guides users

Weaknesses:

◮ Doesn’t well support complex actions ◮ Can be slow

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Direct Manipulation

Manipulate individual objects

◮ apply actions directly to objects ◮ display responds immediately

Styles

◮ graphical direct manipulation ◮ forms fill-in

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Linguistic Interaction

Essentially word and language based Styles

◮ command-line interaction ◮ spoken or text-based natural language

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Why natural language processing is hard

Fully general speech recognition, natural-language understanding and generation is a very hard AI problem. Examples:

◮ Time flies like an arrow. ◮ Morty shot Ferdie. He died. ◮ Morty shot Ferdie. He didn’t die. ◮ Morty shot Ferdie. He felt sorry about it.

Can be feasible in limited domains, e.g., airline reservations.

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Summary

◮ Classification useful but not rigid ◮ Hybrid systems

◮ e.g. ddd, bash

◮ Multiple styles ◮ Strengths/weaknesses, users’ context

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces

Interface Categories and Styles Key-Modal Direct Manipulation Linguistic

Basic Categories of Interaction

Revisited

◮ key-modal ◮ direct manipulation ◮ linguistic

Adrian Pearce University of Melbourne 433-324 Graphics and Interaction Kinds of Interfaces