ubiquity: designing a multilingual natural language interface - - PowerPoint PPT Presentation

▶
ubiquity
SMART_READER_LITE
LIVE PREVIEW

ubiquity: designing a multilingual natural language interface - - PowerPoint PPT Presentation

Aug 02, 2023 8 likes •871 views

ubiquity: designing a multilingual natural language interface mitcho Michael Yoshitaka Erlewine 2009 SIGIR Workshop on Information Access in a Multilingual World Boston, July 23rd, 2009 ubiquity: designing a multilingual natural language

slide-1
SLIDE 1

mitcho

Michael Yoshitaka Erlewine

2009 SIGIR Workshop on Information Access in a Multilingual World Boston, July 23rd, 2009

ubiquity:

designing a multilingual natural language interface

slide-2
SLIDE 2

ubiquity:

designing a multilingual natural language interface

  • focus on multilingual delivery and interfaces
  • reconsidering the text-based interface
  • localizing ubiquity
slide-3
SLIDE 3

ubiquity:

designing a multilingual natural language interface

  • focus on multilingual delivery and interfaces
  • reconsidering the text-based interface
  • localizing ubiquity
slide-4
SLIDE 4

INTERFACE

USER INFORMATION

slide-5
SLIDE 5

INTERFACE

USER INFORMATION

English Deutsch Español Français Português Русский Italiano Polski Türkçe 日本語 中文

slide-6
SLIDE 6

INTERFACE

USER INFORMATION

slide-7
SLIDE 7

INTERFACE

USER INFORMATION

English Deutsch Español Français Português Русский Italiano Polski Türkçe 日本語 中文

slide-8
SLIDE 8

INTERFACE

USER INFORMATION

English Deutsch Español Français Português Русский Italiano Polski Türkçe 日本語 中文

t h i s t a l k

slide-9
SLIDE 9

EQUIPOTENT MULTILINGUAL INTERFACES

  • not just translating content or localizing interfaces
  • ensuring equal access to information
  • ensuring equal generativity and potential of the

platform

slide-10
SLIDE 10

EQUIPOTENT MULTILINGUAL INTERFACES

  • not just translating content or localizing interfaces
  • ensuring equal access to information
  • ensuring equal generativity and potential of the

platform

slide-11
SLIDE 11

EQUIPOTENT MULTILINGUAL INTERFACES

  • not just translating content or localizing interfaces
  • ensuring equal access to information
  • ensuring equal generativity and potential of the

platform

slide-12
SLIDE 12

“We create communities of people involved in making the Internet experience better for all of us... The Internet is a global public resource that must remain open and accessible.” —Mozilla Manifesto

slide-13
SLIDE 13
slide-14
SLIDE 14

Afrikaans Shqip ﻲﺑﺮﻋ অসমীয়া Euskara Беларуская বাংলা (ভারত) Български català 中文 (简体) 正體中文 (繁體) Hrvatski Čeština Dansk Nederlands English (British) English (US) Esperanto Eesti keel suomi Français Frysk Galego ქართული Deutsch Ελληνικά ગજરાતી תירבע हदी (भारत) Magyar íslenska Bahasa Indonesia Gaeilge Italiano 日本語 Kannada 한국어 Kurdî Latviešu lietuvių kalba Македонски मराठी Norsk bokmål Norsk nynorsk

  • ccitan (lengadocian)

ﯽﺳﺭﺎﻓ Polski Português (do Brasil) Português (Europeu) ਪਜਾਬੀ română Русский српски සිංහල slovenčina slovensko Español (de Argentina) Español (de España) Svenska Telugu ไทย Українська Tiếng Việt Cymraeg

slide-15
SLIDE 15

ubiquity:

designing a multilingual natural language interface

  • focus on multilingual delivery and interfaces
  • reconsidering the text-based interface
  • localizing ubiquity
slide-16
SLIDE 16

BUILDING A SCALABLE INTERFACE PARADIGM

slide-17
SLIDE 17

BUILDING A SCALABLE INTERFACE PARADIGM

The web is offering more and more functionality and API’s...

slide-18
SLIDE 18

BUILDING A SCALABLE INTERFACE PARADIGM

The web is offering more and more functionality and API’s... ...but how do you use them?

slide-19
SLIDE 19

BUILDING A SCALABLE INTERFACE PARADIGM

  • Following the GUI paradigm...

The web is offering more and more functionality and API’s... ...but how do you use them?

slide-20
SLIDE 20

BUILDING A SCALABLE INTERFACE PARADIGM

  • Following the GUI paradigm...
  • add more buttons?

The web is offering more and more functionality and API’s... ...but how do you use them?

slide-21
SLIDE 21

BUILDING A SCALABLE INTERFACE PARADIGM

  • Following the GUI paradigm...
  • add more buttons?
  • add more menus?

The web is offering more and more functionality and API’s... ...but how do you use them?

slide-22
SLIDE 22

CC-BY-SA: flickr.com/photos/daveduarte/2678853923/

slide-23
SLIDE 23

ACM interactions 2008

slide-24
SLIDE 24

CC-BY: flickr.com/photos/striatic/1629254/

slide-25
SLIDE 25
slide-26
SLIDE 26

?

slide-27
SLIDE 27
slide-28
SLIDE 28

CC-BY-SA: flickr.com/photos/ seanosh/3307290530/

Aza Raskin on

text-based interfaces

“...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.”

slide-29
SLIDE 29

CC-BY-SA: flickr.com/photos/ seanosh/3307290530/

Aza Raskin on

text-based interfaces

“...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.”

slide-30
SLIDE 30

a natural language interface

slide-31
SLIDE 31

ubiquity

ubiquity.mozilla.com

slide-32
SLIDE 32

[demo 1] inserting a map into email

(video not included in PDF)

slide-33
SLIDE 33

without ubiquity

slide-34
SLIDE 34

without ubiquity

slide-35
SLIDE 35

without ubiquity

slide-36
SLIDE 36

without ubiquity

slide-37
SLIDE 37

[demo 1] inserting a map into email:

  • ne step with ubiquity

(video not included in PDF)

slide-38
SLIDE 38

[demo 2] translating and emailing web content

(video not included in PDF)

slide-39
SLIDE 39

without ubiquity

slide-40
SLIDE 40

without ubiquity

slide-41
SLIDE 41

without ubiquity

slide-42
SLIDE 42

without ubiquity

slide-43
SLIDE 43

without ubiquity

slide-44
SLIDE 44

[demo 2] translating and emailing web content: fast and straightforward with ubiquity

(video not included in PDF)

slide-45
SLIDE 45

goal: how?

slide-46
SLIDE 46

goal:

accomplish more

  • n the web

how?

slide-47
SLIDE 47

goal:

accomplish more

  • n the web

how?

connect the web with language

slide-48
SLIDE 48
slide-49
SLIDE 49

verbs*

*JavaScript

slide-50
SLIDE 50

ubiquity:

designing a multilingual natural language interface

  • focus on multilingual delivery and interfaces
  • reconsidering the text-based interface
  • localizing ubiquity
slide-51
SLIDE 51
  • The goal: “natural syntax”
  • Users must expect that not all

natural inputs are understandable.

  • But the parser must not add

restrictions which go against the user’s natural syntax.

LOCALIZING UBIQUITY

slide-52
SLIDE 52
  • The goal: “natural syntax”
  • Users must expect that not all

natural inputs are understandable.

  • But the parser must not add

restrictions which go against the user’s natural syntax.

LOCALIZING UBIQUITY

slide-53
SLIDE 53
  • EX: The following must behave equivalently:

(Japanese, a scrambling language)

  • 太郎にボールを投げろ

Tarō-ni ball-o nager=o Tarō-dat ball-acc throw=imper

  • ボールを太郎に投げろ

LOCALIZING UBIQUITY

slide-54
SLIDE 54
  • EX: The following must behave equivalently:

(Japanese)

  • ...投げろ nager=o (imperative)
  • ...投げる nager=u (infinitive)
  • ...投げて nage=te (linking form)

LOCALIZING UBIQUITY

slide-55
SLIDE 55
  • Putting theoretical linguistic research and

insights into practice

  • Writing individual language parsers is

difficult and time-intensive

  • A Principles and Parameters model
  • One universal parser with minimal

language settings

LOCALIZING UBIQUITY

slide-56
SLIDE 56
  • Putting theoretical linguistic research and

insights into practice

  • Writing individual language parsers is

difficult and time-intensive

  • A Principles and Parameters model
  • One universal parser with minimal

language settings

LOCALIZING UBIQUITY

slide-57
SLIDE 57
  • Putting theoretical linguistic research and

insights into practice

  • Writing individual language parsers is

difficult and time-intensive

  • A Principles and Parameters model
  • One universal parser with minimal

language settings

LOCALIZING UBIQUITY

slide-58
SLIDE 58
  • Putting theoretical linguistic research and

insights into practice

  • Writing individual language parsers is

difficult and time-intensive

  • A Principles and Parameters model
  • One universal parser with minimal

language settings

LOCALIZING UBIQUITY

slide-59
SLIDE 59

parser

(animation not included in PDF)

slide-60
SLIDE 60

parser

花子にケーキを送って

(animation not included in PDF)

slide-61
SLIDE 61

花子に 送って ケーキを

parser

(animation not included in PDF)

slide-62
SLIDE 62

花子に 送って ケーキを

V N N

parser

(animation not included in PDF)

slide-63
SLIDE 63

花子に 送って ケーキを

V N N goal

  • bject

parser

(animation not included in PDF)

slide-64
SLIDE 64

花子に 送って ケーキを

V N N goal

  • bject

V ( goal, object )

parser

(animation not included in PDF)

slide-65
SLIDE 65

Argument identification via semantic role

CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...

LOCALIZING UBIQUITY

slide-66
SLIDE 66

CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-67
SLIDE 67

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-68
SLIDE 68

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-69
SLIDE 69

role English Japanese

を に へ で

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-70
SLIDE 70

role English Japanese

  • bject

ø を o に へ で

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-71
SLIDE 71

role English Japanese

  • bject

ø を o goal to に ni, へ e で

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-72
SLIDE 72

role English Japanese

  • bject

ø を o goal to に ni, へ e location at, on で de

LOCALIZING UBIQUITY

Argument identification via semantic role

slide-73
SLIDE 73

[demo 3] ubiquity in Japanese: “hello to Spanish”

(video not included in PDF)

slide-74
SLIDE 74

LOCALIZING UBIQUITY

  • Support for various linguistic structures
  • Equal support for verb-initial and
  • final languages
  • Smart argument-first suggestions
slide-75
SLIDE 75

Minimal language descriptions

branching:
'left', usespaces:
false, joindelimiter:
'', anaphora:
["これ",
"それ",
"あれ"], roles:
[ 

{role:
'object',
delimiter:
'を'}, 

{role:
'goal',
delimiter:
'に'}, 

{role:
'source',
delimiter:
'から'}, 

{role:
'position',
delimiter:
'で'}, 

{role:
'position',
delimiter:
'に'}, 

{role:
'instrument',
delimiter:
'で'}, 

{role:
'alias',
delimiter:
'として'}, ]

LOCALIZING UBIQUITY

slide-76
SLIDE 76

LOCALIZING UBIQUITY

  • An equipotent multilingual platform par excellence
  • Equivalent underlying parse structures
  • Commands via semantic role:

write once, use in any language

  • Easy to add new languages
slide-77
SLIDE 77

LOCALIZING UBIQUITY

  • An equipotent multilingual platform par excellence
  • Equivalent underlying parse structures
  • Commands via semantic role:

write once, use in any language

  • Easy to add new languages
slide-78
SLIDE 78

LOCALIZING UBIQUITY

  • An equipotent multilingual platform par excellence
  • Equivalent underlying parse structures
  • Commands via semantic role:

write once, use in any language

  • Easy to add new languages
slide-79
SLIDE 79

ubiquity 0.5

with Parser 2

slide-80
SLIDE 80

Català Dansk English Español Français Italiano 日本語 Português Svenska 中文

ubiquity 0.5

with Parser 2

Language settings:

slide-81
SLIDE 81

ubiquity 0.5

with Parser 2

slide-82
SLIDE 82

Català Dansk English Português 日本語

ubiquity 0.5

with Parser 2

slide-83
SLIDE 83

ubiquity:

designing a multilingual natural language interface

  • Conclusion
  • broad and equal access to information requires

equipotent multilingual interfaces

  • ubiquity: an equipotent platform par excellence
  • challenging internationalization possible

through application of linguistic research

slide-84
SLIDE 84

ubiquity:

designing a multilingual natural language interface

  • Conclusion
  • broad and equal access to information requires

equipotent multilingual interfaces

  • ubiquity: an equipotent platform par excellence
  • challenging internationalization possible

through application of linguistic research

slide-85
SLIDE 85

ubiquity:

designing a multilingual natural language interface

  • Conclusion
  • broad and equal access to information requires

equipotent multilingual interfaces

  • ubiquity: an equipotent platform par excellence
  • challenging internationalization possible

through application of linguistic research

slide-86
SLIDE 86

mitcho

Michael Yoshitaka Erlewine

by-nc-sa mitcho.com @mitchoyoshitaka

Thank you! Questions?

Core Hubs:
All Converters PDF Hub Video Hub Audio Hub Image Hub File Compressor