Augmen'ng Intellect through Wearables and Ar'ficial Intelligence - - PowerPoint PPT Presentation

▶
augmen ng intellect through wearables and ar ficial
SMART_READER_LITE
LIVE PREVIEW

Augmen'ng Intellect through Wearables and Ar'ficial Intelligence - - PowerPoint PPT Presentation

Feb 23, 2023 353 likes •840 views

Augmen'ng Intellect through Wearables and Ar'ficial Intelligence Professor Thad Starner Contextual Compu'ng Group Georgia Ins'tute of Technology Tech Lead/Manager, Google Glass Paths to Augmen'ng Intellect Networked human minds

slide-1
SLIDE 1

Augmen'ng Intellect through Wearables and Ar'ficial Intelligence

Professor Thad Starner Contextual Compu'ng Group Georgia Ins'tute of Technology Tech Lead/Manager, Google Glass

slide-2
SLIDE 2

Paths to Augmen'ng Intellect

  • Networked human minds
  • Ar2ficial Intelligence
  • Augmented Intelligence
slide-3
SLIDE 3

Larry Page & Sergey Brin

  • Reduce the 2me between inten2on and ac2on.
slide-4
SLIDE 4

Providing BeGer Care

slide-5
SLIDE 5

Providing BeGer Care

slide-6
SLIDE 6

Improving Job Training

slide-7
SLIDE 7

Improving Job Training

slide-8
SLIDE 8

Improving Access to Informa'on: Extrac'on Diagram

slide-9
SLIDE 9

Improving Access to Informa'on: Naviga'on

slide-10
SLIDE 10

Improving Communica'on: Speech Transla'on

slide-11
SLIDE 11

Improving Communica'on: Speech Transla'on

slide-12
SLIDE 12

Improving Communica'on: Text Transla'on

slide-13
SLIDE 13

Improving Communica'on: Remote Expert

slide-14
SLIDE 14

Improving Communica'on: Transcrip'on for Hard of Hearing

slide-15
SLIDE 15

Reducing Disability

slide-16
SLIDE 16
slide-17
SLIDE 17

Why Now?

  • Bluetooth 4.0 Low Energy body network standard on mobile

phones star'ng 2013-now

  • Available, high quality mobile speech recogni'on ~2010
  • Low latency cellular network ~2008: LTE/HSPDA
  • Windows interface monopoly broken by smartphones ~2008
  • High sensi'vity GPS ~2007
  • Quality plas2c op2cs ~2003
  • GPS selec2ve availability eliminated 2000
  • High resolu'on small displays ~2000
  • DC-DC converters 70->95% efficiency ~2000
  • Small IMUs ~1998
  • Consumer lithium baXeries ~1997
  • Power efficient processors (StrongARM) 1996
  • CMOS camera 1995->2007
slide-18
SLIDE 18

70 Years of Investment

Vannevar Bush 1945

  • Na2onal Science Advisor
  • OSRD (science for warfare)
  • Raytheon
  • NASA precursor
  • NSF precursor
slide-19
SLIDE 19

Ivan Sutherland 1966

slide-20
SLIDE 20

Microdisplays: Upton @ Bell (1967-1980s)

  • Cued speech
  • Helicopter HUDs for defense
  • Scanning fiber bundles
slide-21
SLIDE 21

Microdisplays: Upton @ Bell (1967-1980s)

  • Private Eye
  • LEDs and scanning mirrors
  • Military & beginnings of

industrial interest

  • Consumer VR 1995
slide-22
SLIDE 22

Microdisplays (1990-now): Panels (Kopin, Displaytech, etc.)

slide-23
SLIDE 23

Networking: 802.15

  • Started as Ad Hoc CommiXee Mee2ng for Wearables

Standards 1997

  • Led by Dick Braley at Fedex
  • Incorporated Bluetooth and Zigbee
slide-24
SLIDE 24

Sensing: CMOS Camera (early 1990s)

  • Eric Fossum
  • NASA JPL (1993-1995)

→ Photobit Corp. → webcam → cameraphones

slide-25
SLIDE 25

Sensing: Iner'al head trackers (late 1990s)

  • Eric Foxlin, MIT (NASA, AFOSR, NRL)
  • Intersense (SBIRs)
  • 3x3mm high precision IMU chips

today

slide-26
SLIDE 26

Sensing: GPS

slide-27
SLIDE 27

Sensing: Speech Recogni'on

  • Bell Lab Audrey 1952; IBM Shoebox
  • HMMs: Ins2tute for Defense Analyses (60s)
  • DARPA Speech Understanding Research 1971-1976: CMU

Hearsay, BBN HWIM, …

  • DARPA/NIST Tasks 80s-90s (ATIS, Switchboard, WSJ, Resource

Management): CMU Sphinx, BBN BYBLOS, SRI DECIPHER

slide-28
SLIDE 28

Sensing: Speech Recogni'on

slide-29
SLIDE 29

Suddenly! Wearable Compu'ng!

slide-30
SLIDE 30

Symbio'c AI

Interweave a computer with something that is already intelligent (i.e., the user)

  • Put cameras where my eyes are
  • Put microphones where my ears are
  • Put mo2on sensors at my hands
  • If possible, look into brain for focus of aXen2on and “intent”

Learn how to interact with the human world by observing a human interac2ng with the world

slide-31
SLIDE 31

Bonus slides

slide-32
SLIDE 32

Improving Learning (op'onal)

PHL & PHR (Morse Code on Glass, audio for piano on Glass, Braille, etc.

slide-33
SLIDE 33

Douglas Engelbart 1962

By 'augmen2ng human intellect' we mean increasing the capability of a man to approach a complex problem situa2on, to gain comprehension to suit his par2cular needs, and to derive solu2ons to problems … we include the professional problems of diplomats, execu2ves, social scien2sts, life scien2sts, physical scien2sts, aXorneys, designers— whether the problem situa2on exists for twenty minutes or twenty years … way of life in an integrated domain where hunches, cut-and- try, intangibles, and the human "feel for a situa2on" usefully co-exist with powerful concepts, streamlined terminology and nota2on, sophis2cated methods, and high-powered electronic aids.

slide-34
SLIDE 34

Douglas Engelbart NLS/Augment

  • the mouse
  • 2-dimensional display edi2ng
  • in-file object addressing, linking
  • hypermedia
  • utline processing
  • flexible view control
  • mul2ple windows
  • cross-file edi2ng
  • integrated hypermedia email
  • remote procedure call protocols
  • hypermedia publishing
  • document version control
  • shared-screen teleconferencing
  • computer-aided mee2ngs
  • formasng direc2ves
  • context-sensi2ve help
  • distributed client-server

architecture

  • uniform command syntax
  • universal "user interface" front-

end module

  • protocols for virtual terminals
slide-35
SLIDE 35

JCR Licklider (DARPA IPTO) 1960

“Man-computer symbiosis” is a subclass of man-machine

  • systems. There are many man-machine systems. At present

however, there are no man-computer symbioses. ... The hope is that, in not too many years, human brains and compu2ng machines will be coupled together very 2ghtly and that the resul2ng partnership will think as no human brain has ever thought and process data in a way not approached by the informa2on-handling machines we know today.

slide-36
SLIDE 36

Rod Brooks: Embodied Cogni'on

slide-37
SLIDE 37

Pursuing Consumer Product: Possible → Prac'cal in 25 years

slide-38
SLIDE 38

Interface: Consumer (Georgia Tech & MIT)

(US Air Force Lab. Grad. Fellow, Industrial Consor2a, NSF )

slide-39
SLIDE 39

Interface: Task Guidance (CMU)

(NSF ERC, NSF, DARPA)

slide-40
SLIDE 40

Interface: Augmented Reality (Columbia)

(ONR, NSF)

slide-41
SLIDE 41

Microdisplays: VR HMDs (early 1990s)

(NASA, DARPA)

slide-42
SLIDE 42

Microdisplays: Military, Industrial, Hobbyist (90s)

slide-43
SLIDE 43

Microdisplays: Video Viewers (early 2000s)

slide-44
SLIDE 44

Microdisplays: On-the-go Displays

(MicroOptical 1997) (Google Glass 2013)

slide-45
SLIDE 45

Bonus Slides

slide-46
SLIDE 46

Other Topics

  • Web search (Google NSF)
  • Ques2on answering (IBM Watson, govt academia, industry)
  • Bone conduc2on audio
  • Auto-awesome
  • BaXeries
  • DC-DC
slide-47
SLIDE 47