An Overview of Human Computation Dr. Ling-Jyh Chen - - PowerPoint PPT Presentation

▶
an overview of human computation
SMART_READER_LITE
LIVE PREVIEW

An Overview of Human Computation Dr. Ling-Jyh Chen - - PowerPoint PPT Presentation

Mar 03, 2023 322 likes •941 views

An Overview of Human Computation Dr. Ling-Jyh Chen (cclljj@iis.sinica.edu.tw) Institute of Information Science, Academia Sinica Dept. of Computer Science & Information Engineering, National Taiwan Normal University NTNU - CSIE 2009/10/14

slide-1
SLIDE 1

2009/10/14 NTNU-CSIE

An Overview of Human Computation

  • Dr. Ling-Jyh Chen (cclljj@iis.sinica.edu.tw)

Institute of Information Science, Academia Sinica

1

  • Dept. of Computer Science & Information Engineering,

National Taiwan Normal University

slide-2
SLIDE 2
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

2

slide-3
SLIDE 3
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.

2

slide-4
SLIDE 4
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.

2

slide-5
SLIDE 5
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.
  • Only
my
dogs
seem
to
understand.

2

slide-6
SLIDE 6
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.
  • Only
my
dogs
seem
to
understand.
  • Happy
talk
happens
over
coffee.

2

slide-7
SLIDE 7
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.
  • Only
my
dogs
seem
to
understand.
  • Happy
talk
happens
over
coffee.
  • She
kissed
me
and
said
yes.

2

slide-8
SLIDE 8
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.
  • Only
my
dogs
seem
to
understand.
  • Happy
talk
happens
over
coffee.
  • She
kissed
me
and
said
yes.
  • I
accidentally
said
yes
to
forever.

2

slide-9
SLIDE 9
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

“Human Cycle”

  • A+
in
Math.
F­
in
Life.
  • I’m
60.
Look
40.
Feel
20.
  • Only
my
dogs
seem
to
understand.
  • Happy
talk
happens
over
coffee.
  • She
kissed
me
and
said
yes.
  • I
accidentally
said
yes
to
forever.
  • ...

2

slide-10
SLIDE 10
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Outline

  • What
is
Human
Computation?
  • Human
Computation
Examples
  • Human
Computation
Issues

3

slide-11
SLIDE 11
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

What is HCOMP?

4

slide-12
SLIDE 12
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

What is HCOMP?

  • Many
tasks
are
trivial
for
humans,
but
very


challenging
for
computer
programs.

4

slide-13
SLIDE 13
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

What is HCOMP?

  • Many
tasks
are
trivial
for
humans,
but
very


challenging
for
computer
programs. “What
is
the
fastest
way
to
get
to
the
airport
 from
Taipei
downtown
in
rush
hour?”

4

slide-14
SLIDE 14
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

You can do it! We can help!

HCOMP

  • If
computer
technologies
can
not
do
it
well,


why
don’t
we
help?


5

slide-15
SLIDE 15
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

You can do it! We can help!

HCOMP

  • If
computer
technologies
can
not
do
it
well,


why
don’t
we
help?


  • The
basic
ideas
of
HCOMP:



1.
Let
everyone
do
what
they
are
good
at! 

2.
Exploit
“human
cycles”!

5

slide-16
SLIDE 16
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

You can do it! We can help!

HCOMP

  • If
computer
technologies
can
not
do
it
well,


why
don’t
we
help?


  • The
basic
ideas
of
HCOMP:



1.
Let
everyone
do
what
they
are
good
at! 

2.
Exploit
“human
cycles”!

  • It
is
a
type
of
collaborative


intelligence
and
crowdsourcing.

5

slide-17
SLIDE 17
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

HCOMP examples

  • There
are
four
types
of
HCOMP
systems
  • Voluntary
  • Open
Source
Software;
Wikipedia
  • Incentive
by
money
  • Amazon
Mechanical
Turk

  • Incentive
by
fun
  • Games
with
a
Purpose
  • You
have
no
other
choices
...
  • CAPTCHA/reCAPTCHA

6

slide-18
SLIDE 18
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

Wikipedia

7

slide-19
SLIDE 19
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

  • A
free
encyclopedia
that
everyone
can
change
  • 271 languages
  • 13,733,046 Articles
  • 752,382,630 Edits
  • 19,005,452 Users

8

slide-20
SLIDE 20
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

  • If the English-language Wikipedia is printed and

bound in book form. (Each volume 25cm tall, 5cm thick, and containing 1,600,000 words or 8,000,000 characters.)

9

slide-21
SLIDE 21
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

  • Wikipedia
is
a
type
of
collaborative
intelligence
  • Knowledge
is
accumulated,
published,
and


accessible
freely

10

slide-22
SLIDE 22
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

  • Wikipedia
is
a
type
of
collaborative
intelligence
  • Knowledge
is
accumulated,
published,
and


accessible
freely

  • But,
be
careful...

10

slide-23
SLIDE 23
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

Mechanical Turk

11

slide-24
SLIDE 24
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Automaton
Chess
Player


Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

12

slide-25
SLIDE 25
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Automaton
Chess
Player


Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

12

slide-26
SLIDE 26
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

13

slide-27
SLIDE 27
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Amazon
Mechanical
Turk
Examples

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

14

slide-28
SLIDE 28
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

15

slide-29
SLIDE 29
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

Games with a Purpose

16

slide-30
SLIDE 30
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

Games with a Purpose

16

slide-31
SLIDE 31
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • PlayPumps

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

17

slide-32
SLIDE 32
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • PlayPumps

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

17

slide-33
SLIDE 33
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • PlayPumps
"It is wonderful to see the children having so much fun on these roundabouts (PlayPumps) while at the same time bringing an essential service to the community." Hennie Wesseling, TNT Director "I witnessed how a simple water pump can transform a village and give its children a chance to thrive." Jay-Z, Def Jam Records CEO and rap artist "Water is intimately linked with education and gender equality. Girls who have to spend time gathering water for the family tend not to be in school. And where schools have sanitation, attendance is higher; especially for girls." Kofi Annan, United Nations Secretary General "Water is essential to life and we are committed to finding solutions that help alleviate its scarcity in some of our neediest communities. The PlayPump concept offers communities and schools an excellent way to access fresh water." Dave Govender, Enviornmental Affairs Manager, Coca-Cola Southern and East Africa "Partnerships are essential if we are to help Mozambique’s education and culture sector, as well as the sector of water and sanitation, to get back on their feet after so many years of devastating war." Angela Van Rynbach, Country Director, United Nations World Food Programme

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

17

slide-34
SLIDE 34
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • GWAP
players
perform
basic
tasks
that
cannot


be
automated.

  • While
being
entertained,
people
produce
useful


data
as
a
side
effect.

  • Pioneered
by
Dr.
Luis
von
Ahn
(CMU)
who


created
the
ESP
game.

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

18

slide-35
SLIDE 35
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

19

slide-36
SLIDE 36
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • GWAP
applications
  • Image/sound/video
annotation
  • Speech/gesture/emotion
recognition
  • Natural
language
understanding
  • Commonsense
reasoning
  • Geospatial
tagging
  • and
more...

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

19

slide-37
SLIDE 37
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • GWAP
applications
  • Image/sound/video
annotation
  • Speech/gesture/emotion
recognition
  • Natural
language
understanding
  • Commonsense
reasoning
  • Geospatial
tagging
  • and
more...

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

19

slide-38
SLIDE 38
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

CAPTCHA

20

slide-39
SLIDE 39
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • CAPTCHA:
Completely
Automated
Public
Turing


test
to
tell
Computers
and
Humans
Apart

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

21

slide-40
SLIDE 40
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

22

slide-41
SLIDE 41
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • reCAPTCHA:
exploit
HCOMP
to
real
problems

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

23

slide-42
SLIDE 42
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • reCAPTCHA:
exploit
HCOMP
to
real
problems

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

23

slide-43
SLIDE 43
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • reCAPTCHA:
exploit
HCOMP
to
real
problems

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

23

slide-44
SLIDE 44
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • reCAPTCHA:
exploit
HCOMP
to
real
problems

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

23

  • Google acquired reCAPTCHA in Sept. 2009!!
slide-45
SLIDE 45
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-46
SLIDE 46
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Optical
Character
Recognition
(OCR)
and/or


Human
Character
Recognition
(HCR):
 complementary,
not
competitive!

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-47
SLIDE 47
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Optical
Character
Recognition
(OCR)
and/or


Human
Character
Recognition
(HCR):
 complementary,
not
competitive!

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-48
SLIDE 48
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Optical
Character
Recognition
(OCR)
and/or


Human
Character
Recognition
(HCR):
 complementary,
not
competitive!

  • Human‐aided
OCR:
using
Computer‐aided
HCR


to
help
OCR

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-49
SLIDE 49
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Optical
Character
Recognition
(OCR)
and/or


Human
Character
Recognition
(HCR):
 complementary,
not
competitive!

  • Human‐aided
OCR:
using
Computer‐aided
HCR


to
help
OCR

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-50
SLIDE 50
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

  • Optical
Character
Recognition
(OCR)
and/or


Human
Character
Recognition
(HCR):
 complementary,
not
competitive!

  • Human‐aided
OCR:
using
Computer‐aided
HCR


to
help
OCR

  • Well,
how
about
Chinese
characters?

Wikipedia | Mechanical Turk | Games with a Purpose | CAPTCHA

24

slide-51
SLIDE 51
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Open Issues of HCOMP

  • System
benchmark

26

slide-52
SLIDE 52
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Open Issues of HCOMP

  • System
benchmark

Quantity Quality

# of outcomes / time # of new outcomes / time queueing time / puzzle response time / puzzle processing time / puzzle . . correctness fidelity usability applicability extensibility . .

26

slide-53
SLIDE 53
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Open Issues of HCOMP

27

slide-54
SLIDE 54
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Open Issues of HCOMP

  • System
design
issues
  • centralized
vs
distributed
system
  • single
vs
multiple
players
per
round
  • single
vs
multiple
outcomes
per
round
  • pure
vs
computer­aided
HCOMP
  • stationary
vs
mobile
players
  • `just
enough’
incentives
  • not
yet
another
HCOMP
system

27

slide-55
SLIDE 55
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Where are we now?

  • Play
GWAP
with
Strategies
  • We
propose
an
analysis
and
design
a
set
of
playing
strategies


for
the
ESP
game

  • We
implement
a
quasi
ESP
game,
called
ESP
Lite,
and
evaluate


the
proposed
strategies
in
real
world.

  • Social
Mobile
Game
  • We
investigate
GWAP‐based
geospatial
tagging
systems.

  • The
implementation
and
real‐world
experiments
are


undergoing.

  • HCOMP
API
  • We
develop
the
HCOMP
API
to
facilitate
future
HCOMP


researches.

  • HCOMP
API
will
become
a
SourceForge
project
soon.
slide-56
SLIDE 56
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Summary

29

slide-57
SLIDE 57
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Summary

  • HCOMP
outsources
certain
steps
of
the


computational
process
to
humans.


  • It
has
shown
promise
in
solving
a
variety
of


problems
that
computer
computation
cannot
 currently
resolve
completely. Let
everyone
do
what
they
are
good
at!

  • HCOMP
is
an
emerging
area/application
with


lots
of
opportunities.

29

slide-58
SLIDE 58
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Make good use of your brain power!

30

slide-59
SLIDE 59
  • Dr. Ling-Jyh Chen, 2009/10/14

NTNU-CSIE

Don’t misuse it !

31

slide-60
SLIDE 60

2009/10/14 NTNU-CSIE

Thanks

http://nrl.iis.sinica.edu.tw/ http://nrl.iis.sinica.edu.tw/GWAP/

32