Designing for Conversational UI Angie T errell Design Director, - - PowerPoint PPT Presentation

▶
designing for conversational ui
SMART_READER_LITE
LIVE PREVIEW

Designing for Conversational UI Angie T errell Design Director, - - PowerPoint PPT Presentation

Mar 29, 2023 341 likes •1.45k views

Designing for Conversational UI Angie T errell Design Director, Big Nerd Ranch Designing for Conversational UI Angie T errell Design Director, Big Nerd Ranch Designing for People who Use Conversational UI Angie T errell Design Director,

slide-1
SLIDE 1

Designing for Conversational UI

Angie T errell Design Director, Big Nerd Ranch

slide-2
SLIDE 2

Designing for Conversational UI

Angie T errell Design Director, Big Nerd Ranch

slide-3
SLIDE 3

Designing for People who Use Conversational UI

Angie T errell Design Director, Big Nerd Ranch

slide-4
SLIDE 4

The Landscape

slide-5
SLIDE 5
slide-6
SLIDE 6
slide-7
SLIDE 7
slide-8
SLIDE 8

2025

slide-9
SLIDE 9

2040

slide-10
SLIDE 10

2075

slide-11
SLIDE 11
slide-12
SLIDE 12
slide-13
SLIDE 13
slide-14
SLIDE 14
slide-15
SLIDE 15
slide-16
SLIDE 16

The Challenge

slide-17
SLIDE 17

–Your client

“We need a bot.”

slide-18
SLIDE 18

Getting Started

slide-19
SLIDE 19

User Interface Design

slide-20
SLIDE 20

User Interface Design

  • Select the tasks to support
slide-21
SLIDE 21

User Interface Design

  • Select the tasks to support
  • Determine the structure of the dialogue
slide-22
SLIDE 22

User Interface Design

  • Select the tasks to support
  • Determine the structure of the dialogue
  • Deciding which commands and features are available to the user
slide-23
SLIDE 23

User Interface Design

  • Select the tasks to support
  • Determine the structure of the dialogue
  • Deciding which commands and features are available to the user
  • Letting user specify what they want
slide-24
SLIDE 24

User Interface Design

  • Select the tasks to support
  • Determine the structure of the dialogue
  • Deciding which commands and features are available to the user
  • Letting user specify what they want
  • Making the computer provide feedback on its actions
slide-25
SLIDE 25

User Interface Design

slide-26
SLIDE 26

User Interface Design

  • 1. What is the environment/context?
slide-27
SLIDE 27

User Interface Design

  • 1. What is the environment/context?
  • 2. What will be the common behaviors or modes of the user?
slide-28
SLIDE 28

User Interface Design

  • 1. What is the environment/context?
  • 2. What will be the common behaviors or modes of the user?
  • 3. What are the needs and expectations of the user?
slide-29
SLIDE 29

Guidelines & Principles for Conversational Interfaces

slide-30
SLIDE 30
slide-31
SLIDE 31
  • 1. Prompt-and-Response
slide-32
SLIDE 32
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
slide-33
SLIDE 33
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
slide-34
SLIDE 34
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
slide-35
SLIDE 35
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-36
SLIDE 36
  • 1. Prompt-and-Response
slide-37
SLIDE 37

Intents

slide-38
SLIDE 38

No Intent

slide-39
SLIDE 39

No Intent

Hi Weatherbot.

slide-40
SLIDE 40

No Intent

Hi Weatherbot.

  • Hello. You can request to hear the local weather or weather in

a particular city. Which will it be?

slide-41
SLIDE 41

Partial Intent

slide-42
SLIDE 42

Partial Intent

Weatherbot, what is the weather like in Madison?

slide-43
SLIDE 43

Partial Intent

Weatherbot, what is the weather like in Madison? Okay, I can check the weather in Madison. In what State?

slide-44
SLIDE 44

Partial Intent

Weatherbot, what is the weather like in Madison? Okay, I can check the weather in Madison. In what State? Wisconsin.

slide-45
SLIDE 45

Partial Intent

Weatherbot, what is the weather like in Madison? Okay, I can check the weather in Madison. In what State? Wisconsin. T

  • day’s weather in Madison, Wisconsin is…
slide-46
SLIDE 46

Full Intent

slide-47
SLIDE 47

Full Intent

Weatherbot, what will it be like in San Francisco, California today?

slide-48
SLIDE 48

Full Intent

Weatherbot, what will it be like in San Francisco, California today? T

  • day’s weather in San Francisco, California is…
slide-49
SLIDE 49

Intents

slide-50
SLIDE 50

Close-ended

slide-51
SLIDE 51

Close-Ended

slide-52
SLIDE 52

Close-Ended

What is a top-rated bike pump?

slide-53
SLIDE 53

Close-Ended

What is a top-rated bike pump? The top-rated bike pump is the Vibrelli High Performance Bike Pump for $37.98.

slide-54
SLIDE 54

Close-Ended

What is a top-rated bike pump? The top-rated bike pump is the Vibrelli High Performance Bike Pump for $37.98. Would you like to hear the rest?

slide-55
SLIDE 55

Close-Ended

What is a top-rated bike pump? The top-rated bike pump is the Vibrelli High Performance Bike Pump for $37.98. Would you like to hear the rest? No.

slide-56
SLIDE 56

Close-ended

slide-57
SLIDE 57

Options

slide-58
SLIDE 58

Options

slide-59
SLIDE 59

Options

Would you like french fries or a salad?

slide-60
SLIDE 60

Options

Yes. Would you like french fries or a salad?

slide-61
SLIDE 61

Options

Yes. Would you like french fries or a salad?

don’t do this

slide-62
SLIDE 62

Options

slide-63
SLIDE 63

Options

Which side would you like: french fries or salad?

slide-64
SLIDE 64

Options

Salad. Which side would you like: french fries or salad?

slide-65
SLIDE 65

Options

slide-66
SLIDE 66
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-67
SLIDE 67
  • 2. Recognition over Recall
slide-68
SLIDE 68
  • Luke Wroblewski

“When there's no graphical user interface (icons, labels, etc.) in a product to guide us, our memory becomes the UI.”

slide-69
SLIDE 69

Help

slide-70
SLIDE 70

Help

Score Keeper. You can give a player points, ask for the score, or say help. What would you like?

slide-71
SLIDE 71

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like?

slide-72
SLIDE 72

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say:

slide-73
SLIDE 73

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say:

slide-74
SLIDE 74

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John,

slide-75
SLIDE 75

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points,

slide-76
SLIDE 76

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score,

slide-77
SLIDE 77

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score, start a new game, or

slide-78
SLIDE 78

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score, start a new game, or reset all players.

slide-79
SLIDE 79

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score, start a new game, or reset all players.

slide-80
SLIDE 80

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score, start a new game, or reset all players. So, how can I help?

slide-81
SLIDE 81

Help

Help. Score Keeper. You can give a player points, ask for the score, or say help. What would you like? Here are some things you can say: add John, give John 5 points, tell me the score, start a new game, or reset all players. So, how can I help?

slide-82
SLIDE 82
slide-83
SLIDE 83
slide-84
SLIDE 84
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-85
SLIDE 85
  • 3. Speech Requires Focus
slide-86
SLIDE 86

–Human Factors and Voice Interactive Systems

“[People] lose attention after 10-15 seconds of listening to a prompt.”

slide-87
SLIDE 87
slide-88
SLIDE 88
slide-89
SLIDE 89
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-90
SLIDE 90
  • 4. Always Provide a Fallback
slide-91
SLIDE 91

Fallback

slide-92
SLIDE 92

Fallback

Get off the couch!

slide-93
SLIDE 93

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”.

slide-94
SLIDE 94

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”.

slide-95
SLIDE 95

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”. The available colors are: purple, orange, red, green, and blue.

slide-96
SLIDE 96

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”. The available colors are: purple, orange, red, green, and blue.

slide-97
SLIDE 97

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”. The available colors are: purple, orange, red, green, and blue. Which will it be?”

slide-98
SLIDE 98

Fallback

Get off the couch! I’m sorry, Angie, but I didn’t understand “get off the couch”. The available colors are: purple, orange, red, green, and blue. Which will it be?”

slide-99
SLIDE 99
slide-100
SLIDE 100
slide-101
SLIDE 101
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-102
SLIDE 102
  • 5. Respect People’s Time
slide-103
SLIDE 103
slide-104
SLIDE 104
slide-105
SLIDE 105
slide-106
SLIDE 106
  • 1. Prompt-and-Response
  • 2. Recognition over Recall
  • 3. Speech Requires Focus
  • 4. Always Provide a Fallback
  • 5. Respect People’s Time
slide-107
SLIDE 107

Recap

  • At the present, we cannot interact with machines likes humans
  • Designing a conversational UI does not free us from the most

substantial problems of user interface design

  • Employ the 5 guidelines for conversational UI
slide-108
SLIDE 108
slide-109
SLIDE 109

Thank you.

Core Hubs:
All Converters PDF Hub Video Hub Audio Hub Image Hub File Compressor