Interface Evaluation K. Bouzoubaa Introduction w Why and when to - - PowerPoint PPT Presentation

interface
SMART_READER_LITE
LIVE PREVIEW

Interface Evaluation K. Bouzoubaa Introduction w Why and when to - - PowerPoint PPT Presentation

Human Computer Interface Evaluation K. Bouzoubaa Introduction w Why and when to evaluate? 1. Introduction 4. Types dInteraction 5. Interaction guidelines 6. Web Interaction guidelines 2. Modle Cognitif de lutilisateur Analyse des


slide-1
SLIDE 1

Human Computer Interface

Evaluation

  • K. Bouzoubaa
slide-2
SLIDE 2

Introduction

w Why and when to evaluate?

Analyse des besoins Conception

  • 3. Approche

participative Prototypages

  • 2. Modèle Cognitif de

l’utilisateur Tests d’acceptation Tests du système

Espace IHM

  • 1. Introduction
  • 4. Types d’Interaction
  • 5. Interaction guidelines
  • 6. Web Interaction guidelines

Conception Logicielle Codage

Espace logiciel

  • 7. Conception
  • 8. Evaluation

Réalisation et tests logiciels

slide-3
SLIDE 3

Software Engineering Evaluation

« Software Quality Assurance »

w Software performance w Hardware performance and cost w Maintenance w Safety w Reliability w Interoperability w etc.

slide-4
SLIDE 4

HCI Evaluation Objectives

w Why evaluate ...? w To answer usability questions such as:

– Would the operator be able to quickly answer

emergency calls?

– Was this ticket machine sufficiently simplified to

allow a novice user to easily use it on the first try?

– Is the user familiar with the terminology used in the

interface?

– If the user invokes this command by mistake, will it be

easy for him to correct or leave the system?

slide-5
SLIDE 5

Types of Evaluation

Formative Evaluation

Made during design process and development process With a incomplete version

  • f the software

Summative Evaluation

Made at the end With a final version of the software

slide-6
SLIDE 6

Evaluation Techniques

Analytical (HE)

G.O.M.S.

« Goals, Operators, Methods and Selection rules »

Cognitive Walkthrough è Heuristic Evaluation

  • From previous lectures
  • Nielsen 10 principles
  • Others …

Empirical (User Testing)

è è Shneiderman

Observation Acceptability tests Questionnaires

slide-7
SLIDE 7

Heuristics From Earlier Lectures

w User-centered design

– Know your users – Understand their tasks

w Memory

– Use chunking to simplify information presentation – Minimize working memory

w Color guidelines

– Don’t depend solely on color distinctions (color blindness) – Avoid red on blue text (chromatic aberration) – Avoid small blue details

w Norman’s principles of direct manipulation

– Affordance – Visibility – Feedback

slide-8
SLIDE 8

Heuristic Evaluation

w Performed by expert(s) w Steps

– Inspect UI thorough – Compare UI against heuristics – List usability problems

  • Explain & justify each problem with

heuristics

slide-9
SLIDE 9

HE: Nielsen 10 principles

  • 1. Match the real world
  • 2. Consistency & standards
  • 3. Help & documentation
  • 4. User control & freedom
  • 5. Visibility of system status
  • 6. Flexibility & efficiency
  • 7. Error prevention
  • 8. Recognition, not recall
  • 9. Error reporting, diagnosis, and recovery

10. Aesthetic & minimalist design

slide-10
SLIDE 10
  • 1. Match the Real World

“Speak the user language” w Technical jargon avoided (Type = écrire

  • r Type = int, float)

w Use common words, not jargon

– But use domain-specific terms where appropriate

w Don’t put limits on user defined names (DOS: 12345678.ext) w Allow aliases/synonyms in command languages (remove, del, erase)

– Only 7-18% = probability 2 users name

the same object with the same name

w Metaphors are useful but may mislead

– Example: Trash in Lotus organizer (not

natural)

slide-11
SLIDE 11
  • 2. Consistency and Standards

w Principle of Least Surprise

– Similar things should look and act similar – Different things should look different – Example: share price, stock price, stock quote

w Other properties

– Size, location, color, wording, ordering, …

w Follow platform standards

slide-12
SLIDE 12
  • 3. Help and Documentation

w Users don’t read manuals

– Prefer to spend time working toward their task goals, not

learning about your system

w But manuals and online help are vital

– Usually when user is frustrated or in crisis

w Help should be:

– Searchable – Context-sensitive – Task-oriented – Concrete – Short

slide-13
SLIDE 13
  • 4. User Control and Freedom

w Provide undo w Long operations should be cancelable w All dialogs should have a cancel button

slide-14
SLIDE 14
  • 5. Visibility of System Status

“Feedback”

w Keep user informed of system state

– Cursor change – Selection highlight – Status bar – Don’t overdo it… – Example: Studios MGM (indication du temps d’attente, allées en

forme de labyrinthe, téléviseurs et illusion de progression)

w Response time

– < 0.1 s: seems instantaneous – 0.1-1 s: user notices, but no feedback needed – 1-5 s: display busy cursor – > 5 s: display progress bar

slide-15
SLIDE 15
  • 6. Flexibility and Efficiency

w Provide easily-learned shortcuts for frequent

  • perations

– Keyboard accelerators – Command abbreviations – Bookmarks – History

Fast withdraw 100 DH 200 DH … 2000 DH

slide-16
SLIDE 16
  • 7. Error Prevention

w Selection is less error-prone than typing w Some techniques:

– Text field (type and format: DD/MM/YYYY) – Combo Box – Anticipate {} in Word Processor – But don’t go overboard…

slide-17
SLIDE 17
  • 8. Recognition, Not Recall

“Minimize Memory Load”

w Use menus, not command languages w Use combo boxes, not textboxes w Use generic commands where possible (Open, Save, Copy Paste) w All needed information should be visible

slide-18
SLIDE 18
  • 9. Error Reporting, Diagnosis, Recovery

w Be precise; restate user’s input

– Not “Cannot open file”, but “Cannot open

file named paper.doc”

w Give constructive help

– why error occurred and how to fix it

w Be polite and non blaming

– Not “fatal error”, not “illegal”

w Hide technical details (stack trace) until requested

slide-19
SLIDE 19
  • 10. Aesthetic and Minimalist Design

w “Less is More”

– Omit extraneous info, graphics, features

slide-20
SLIDE 20
  • 10. Aesthetic and Minimalist Design

w Good graphic design

– Few, well-chosen colors and fonts – Group with whitespace – Align controls sensibly

w Use concise language

– Choose labels carefully

slide-21
SLIDE 21

HE: Nielsen 10 principles

Meet expectations

  • 1. Match the real world
  • 2. Consistency & standards
  • 3. Help & documentation

User is the boss

  • 4. User control & freedom
  • 5. Visibility of system status
  • 6. Flexibility & efficiency

Handle errors

  • 7. Error prevention
  • 8. Recognition, not recall
  • 9. Error reporting, diagnosis, and recovery

Keep it simple

  • 10. Aesthetic & minimalist design
slide-22
SLIDE 22

Example

slide-23
SLIDE 23

Example

  • 1. Shopping cart icon is not balanced with its background

white space: minimalist design

  • 2. Good: user is greeted by name: Visibility of system status
  • 3. Red is used both for help messages and for error

messages: Consistency, Match real world

  • 4. “There is a problem with your order”, but no explanation
  • r suggestions for resolution: Error reporting
  • 5. ExtPrice and UnitPrice are strange labels: Match real

world

slide-24
SLIDE 24

Example

  • 7. "Click here“ is unnecessary: Aesthetic & minimalist

design

  • 8. No “Continue shopping" button: User control & freedom
  • 9. Recalculate is very close to Clear Cart: Error prevention
  • 10. “Check Out” button doesn’t look like other buttons:

Consistency

  • 11. Uses “Cart Title” and “Cart Name” for the same

concept: Consistency

  • 12. Must recall and type in cart title to load: Recognition not

recall, Error prevention, Flexibility & efficiency

slide-25
SLIDE 25

Heuristic Evaluation

Advantages

  • Low costs
  • Intuitive technique
  • Simple to apply
  • Usable very early in

the design

Disadvantages

  • Focuses on

problems not on solutions

  • Same design à

à still different problems

slide-26
SLIDE 26

How To Do Heuristic Evaluation

w Justify every problem with a heuristic

– Too many choices on the home page “Minimalist

design”

w List every problem

– Even if an interface element has multiple problems

w Go through the interface at least twice

– Once to get the feel of the system – Again to focus on particular interface elements

w Don’t limit yourself to the 10 Nielsen’s heuristics

– We’ve seen others : affordance, visibility, color

principles, etc.

slide-27
SLIDE 27

Writing Good Heuristic Evaluations

w Heuristic evaluations must communicate well to developers and managers w Include positive comments as well as criticisms

– “Good: Toolbar icons are simple, with good contrast and few

colors (Minimalist design)”

w Be tactful

– Not “the menu organization is a complete mess” – Better “menus are not organized by function”

w Be specific

– Not “text is unreachable” – Better “text is too small, and has poor contrast (black text on dark

green background”

slide-28
SLIDE 28

Suggested Report Format

w What to include

– Problem – Heuristic – Description – Severity – Recommendation (if any) – Screenshot (if helpful)

slide-29
SLIDE 29

Evaluation Techniques

Analytical

G.O.M.S.

« Goals, Operators, Methods and Selection rules »

Cognitive Walkthrough è Heuristic Evaluation

  • Norman’s principles

ü Affordance ü Visibility ü Feedback

  • Nielsen 10 principles
  • Others …

Empirical (User Testing)

è è Shneiderman

Observation Acceptability tests Questionnaires

slide-30
SLIDE 30

Usability Lab

Salle de test Salle d'observation Salle d'observation

Équipe de développeurs Spécialistes des facteurs humains

Caméra dirigée vers la documentation Caméra dirigée sur l'utilisateur

Utilisateur 2

  • u observateur

Caméra dirigée sur l'ordinateur

Murs à vue unidirectionnelle

Enregistrement des évènements

Vue de chaque caméra Station de l'expérimentateur

Écran géant (duplication de l'écran usager)

Contrôle de l'édition et du mixage

User Testing

slide-31
SLIDE 31

User Testing

èObservation è èAcceptability tests èQuestionnaires

slide-32
SLIDE 32

User Testing

  • Observation

♦ Video Saving

♦ Loud thinking ♦ Passive Observation ♦ Ethnographic studies

slide-33
SLIDE 33

User Testing

  • Acceptability Tests

♦ Assumption: measurable usability objectives

(Shneiderman, 1998) Learning time

Performance Error Rate Retention time Subjective Satisfaction

slide-34
SLIDE 34

User Testing

  • Acceptability Tests …

♦ Example 1

Les sujets seront 35 secrétaires n’ayant aucune expérience de

traitement de texte mais une bonne expérience de frappe au clavier (35 à 50 mots/min). Une période de 45 min sera consacrée à de l’entraînement avant l’expérience. Au moins 30 des 35 secrétaires devraient être capables de compléter correctement en 30 min 80% des tâches de frappe et d’édition.

slide-35
SLIDE 35

User Testing

  • Acceptability Tests …

♦ Example 2

Après 4 demi-journées d’utilisation régulière du système, 25 des

35 secrétaires devraient être capables de compléter en 20 min les tâches de niveau plus avancé du second « benchmark » en faisant moins de 6 erreurs. (Test de la performance après une période d’utilisation régulière)

slide-36
SLIDE 36

User Testing

  • Questionnaires

QUIS: The Questionnaire for User Interaction Satisfaction

http://www.lap.umd.edu/QUIS/index.html w The purpose of the questionnaire is to:

guide in the design or redesign of systems

give managers a tool for assessing potential areas of system improvement

provide researchers with a validated instrument for conducting comparative evaluations, and

serve as a test instrument in usability labs

slide-37
SLIDE 37

Hints for better evaluation

w Use multiple evaluators

– Different evaluators find different problems – The more the better – Nielsen recommends 3-5 evaluators

w Alternate HE with UT

– Each method finds different problems – HE is cheaper

slide-38
SLIDE 38

Analyse des besoins Conception Tests du système Tests d’acceptation Conception Logicielle Codage Réalisation et tests logiciels

Espace Logiciel (Informaticien)

Prototype Papier Prototype Numérique Séparation IHM / Noyau

Espace IHM (Informaticien + User)

Évaluation Utilisabilité Guidelines IUG + Web Évaluation Utilisabilité + W3C

Software dev. cycle

slide-39
SLIDE 39

Techniques for Web Content Accessibility Guidelines

slide-40
SLIDE 40

Introduction

w Persons attempting to access the Web may:

– not be able to see, hear, move, or may not be able to process some types of

information.

– not have, or be able to use, a mouse or even a keyboard – have a text-only screen, a small screen, or a slow Internet connection – not speak or understand fluently the language in which the document is written – be in a situation where their eyes, ears, or hands are busy or interfered with. – have an early version of a browser, a voice browser, or an operating system other

than Windows

w Apply Web Content Accessibility Guidelines (WCAG) will: increase accessibility of the applications for people with disabilities

slide-41
SLIDE 41

41

Introduction

w Apply Web Content Accessibility Guidelines (WCAG) will: increase accessibility of the applications for people with disabilities

slide-42
SLIDE 42

42

Introduction

w Apply Web Content Accessibility Guidelines (WCAG) will: increase accessibility of the applications for people with disabilities

slide-43
SLIDE 43
slide-44
SLIDE 44

About WCAG

w W3C Guidelines:

– 14 guidelines. – Each guideline has multiple checkpoints. – Each checkpoint has a priority level (1 - 3). – Each checkpoint has techniques for implementation.

w WAVE toolbar:

– a tool to validate accessiblity

slide-45
SLIDE 45

Table : Priority 1

slide-46
SLIDE 46

Table : Priority 2

slide-47
SLIDE 47

Guideline 1:

Equivalent text to auditory and visual content

Avoid using images as bullets:

Deprecated example: <IMG src="star.gif" alt="* ">

Use alt when using image as the content of a link:

Images available Images not available

if providing link text, put a space in alt:

Example: <A href="welcome.html"><IMG src="welcome.html" alt=" " > Welcome </A>

Use short text equivalent for images:

Example: <IMG src="iconhome.gif" alt="Welcome" >

slide-48
SLIDE 48

When image contains important information use long description:

Image containing important Information longdesc supported by firefox <IMG src="97sales.gif" alt="Sales for 1997“ longdesc="sales97.html">

For user agent that does not support longdesc attribute:

Sales for 1997 [D] <IMG src="97sales.gif" alt="Sales for 1997" longdesc="sales.html"><A href="sales.html" title="Description of 1997 sales">[D]</A>

Guideline 1:

Equivalent text to auditory and visual content

slide-49
SLIDE 49

Describe frame relationships by using longdesc if title alone is not enough:

<html> <head><title>Frame’s title</title></head> <frameset rows="20%,40%"> <frame src="top_left.html" title="top_left" longdesc="longdescleft.html"> <frame src="top_right.html" title="top_right" longdesc="longdescright.html"> </frameset> <!-- Write for browsers that do not support Frame by providing an alternative page -- > < NOFRAMES> This site requires a frames capable browser. If you can see this message you do not have one. To view this document without frames you may click <a href=“main.html">here.</a> </ NOFRAMES> </html>

Guideline 1:

Equivalent text to auditory and visual content

slide-50
SLIDE 50

Alternative presentation of script using the NOSCRIPT element:

<SCRIPT type="text/javascript">document.write("Hello World ! - with JS");</SCRIPT> <NOSCRIPT> Hello World! - without JS</NOSCRIPT> Or: < NOSCRIPT >This page uses Javascript. Your browser either doesn't support Javascript or you have it turned off. To see this page as it is meant to appear please use a Javascript enabled browser.</ NOSCRIPT >

Guideline 1:

Equivalent text to auditory and visual content

slide-51
SLIDE 51

Guideline 2:

Don’t rely on color alone

All information conveyed with color also available without color:

with color without color

Color contrast:

Good use of color contrast Bad use of color contrast

slide-52
SLIDE 52

WAVE Tool:

web accessibility evaluation tool

w used to aid in the web accessibility evaluation process w To validate a public page: http://wave.webaim.org/

slide-53
SLIDE 53

WAVE toolbar

w The WAVE Firefox toolbar provides a mechanism for running WAVE reports directly within Firefox. w The toolbar reports runs entirely within your web browser, no information is sent to the WAVE server. This ensures 100% private and secure accessibility reporting. w To download it: http://wave.webaim.org/toolbar

slide-54
SLIDE 54
slide-55
SLIDE 55