Detecting - - PowerPoint PPT Presentation

▶
detecting cognitive load during simultaneous
SMART_READER_LITE
LIVE PREVIEW

Detecting - - PowerPoint PPT Presentation

Sep 22, 2022 223 likes •558 views

Detecting Cognitive Load during Simultaneous Interpretation using EEG Phase Synchronization

slide-1
SLIDE 1
  • Detecting Cognitive Load during Simultaneous Interpretation using

EEG Phase Synchronization

  • 2019/12/14

2019@Haruko Yagura AHC-Lab, IS, NAIST 2019/12/14

slide-2
SLIDE 2
  • 2019/12/14

2019 @Haruko Yagura AHC-Lab, IS, NAIST 1

  • Ø

Ø Ø 2-315 Ø 話者と通訳者が交互に話す Ø 工場視察や表敬訪問など Ø

slide-3
SLIDE 3
  • simultaneous interpreter

Ø Extreme multitasking; speaking, listening, memory, translation

Cognitive load

Cm

,1+

m0 am

[

d 2

+[Daniel+, 2011]

ya ], 2019/12/14 2 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-4
SLIDE 4
  • Ø
  • Ø
  • 2019/12/14

3 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-5
SLIDE 5
  • B:

A +B↑

  • A:

[Cowan, 2005] [Mizuno, 2015]

2019/12/14 4 2019 @Haruko Yagura AHC-Lab, IS, NAIST

Ø

slide-6
SLIDE 6
  • ]hkoblV

VfKocHemKocV ]

  • 676-89(7

658B +7 hkoblM 68E7

HI

]PH [P

v4 V VinKa 6)7 sz 61B ,7 RP 61EB +7

240rPH RP

2019/12/14 5 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-7
SLIDE 7

[Koshkin+, 2018]

B: Grand average ERPs for L1(Russian) and L2(English) N1(120-160ms)

P1(40-60ms)

2019/12/14[S 6 2019 @Haruko Yagura AHC-Lab, IS, NAIST

Ø 04 Ø 1) ]2- 2) 0 L10] L20] Ø

  • aSP402]

] Ø EEG

  • Ponset4msP

EEG(ERPs) ERPi

  • 2

P)filter-outr Pl [ ,+ Ø 1) N1P1b 2) b

A: load-low B: load-medium C: load-high

P1 N1

1 ERP l

ERP

  • t

l →N1/P1 l

slide-8
SLIDE 8
  • Ø →

Ø

Ø

  • Ø
  • 2019/12/14

7 2019 @Haruko Yagura AHC-Lab, IS, NAIST

Ø 50ms

  • Ø EEG

(ERP:N1-100ms, P150ms)

slide-9
SLIDE 9

ASSR)

ASSR[, 2006]

A:CF-1000Hz, MF-40Hz SAM B:CF-1000Hz, MF-80Hz SAM C:1000Hz, tone-pip (CF:-carrier frequency, MF::-modulation frequency)

Ø _ Ø

  • (_

Ø

  • Ø
  • Ø 40HzASSR

[Tiitinen+1993 ][Griskova+2011] [Roth+,2013]

n Auditory Steady-State Response

2019/12/14[] 8 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-10
SLIDE 10

ASSRITC [Yokota+,2017]

N-back

Ø ITC--1 -- Ø n-back Ø n-back(n=1 , n =2 ) 40Hz ASSR Ø 40HzASSR ITC Ø ITC ITC: n = 2 < n =1 , p<0.05 Ø

  • [Yokota+, 2015, 2017]

n40Hz-ASSR

  • (ITCInter-trial coherence)
  • 2019/12/14

9 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-11
SLIDE 11
  • The value of ITC

The value of value

ITC

2019/12/14 10 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-12
SLIDE 12
  • Ø ASSR

Ø

2019/12/14 11 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-13
SLIDE 13

40Hz-ASSR ITC

  • 40Hz
  • ASSR
  • 2019/12/14

12 2019 @Haruko Yagura AHC-Lab, IS, NAIST

ASSR

slide-14
SLIDE 14
  • 40Hz-ASSRITC

ITC <

2019/12/14 13 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-15
SLIDE 15
  • Ø

Ø ASSR Ø

2019/12/14 14 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-16
SLIDE 16
  • n 10

range; 46-71mean= 55.1SD = 2.54 C S15

  • Ø
  • 2019/12/14

15 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-17
SLIDE 17

40Hz-ASSRAuditory steady-state response

ü 5212229822,0807:198:42 ), 5050:218215952221 229.7.(

2019/12/14H 16 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-18
SLIDE 18

: 40Hz-ASSR

n NHK ASSR

  • 60
  • 5

2019/12/14 17 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-19
SLIDE 19
  • n →

n →

  • →

Mizuno, 2015, Matsubara, 2012)

→

  • 60
  • 2019/12/14

18 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-20
SLIDE 20

(EEG)

nbaeH PQcdZf

Ø 3C - E 03 Ø D:D300G 0;:0G 10305:3G F 3:3

2019/12/14X 19 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-21
SLIDE 21

ITC

nITC t3 T

Ø where f is a frequency, ch is the channel number, f Ø k is phases of frequency f and electrode ch, k is a trial number, and K is the number of trials. ITCs were calculated for Ø each news over the three central electrodes (C3, Cz, and C4). ITCs were then averaged over the electrodes

Ø 4 (C1 ((,3

  • Ø

3zI( 4ITC Ø [Griskova+2011]

2019/12/14 20 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-22
SLIDE 22

ITC

  • Cognitive

load is low near 1) Cognitive load is High(near 0)

The value of ITC The value of value

  • [koshikin+,2018]

[Yokota+,2015, 2017]

2019/12/14 21 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-23
SLIDE 23
  • Ø

Ø Ø

2019/12/14 22 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-24
SLIDE 24

ITC

  • TR; mean = 0.55sd = 0.22SW; mean=0.48sd = 0.20
  • (ITC: < )

Shadowing

nTR (translation:) nSW(Shadowing: ) Ø ITC TR > SW (p<0.001)

2019/12/14 23 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-25
SLIDE 25
  • n dGiecgl[E(,
  • 0999))1

n+zv0239(1

  • zH324odGi
  • Sz29243222

l 324onTkT-

  • shbGad]Eo

NTEsSt

2019/12/14urp 24 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-26
SLIDE 26

TRITC

n,[WIS+RS ,]+RSb ,333424 +013 n+Iar]T, 9,++ar n+,nA] TCIA ,tTCIA9 ]iRSA

2019/12/14e 25 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-27
SLIDE 27
  • nT
  • n
  • 2019/12/14IC

26 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-28
SLIDE 28
  • n T HI

IAzIW SAzI n T-z-z 0ICI ARI4 n AAS AASI

2019/12/14T 27 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-29
SLIDE 29
  • 5MPHLOMS-7BMSLC-9PPCBHVDPHLFDDEEMOP

KMCDJMEPHKRJLDMRPHLDONODHLF,-L DON PRC:JM MLDSMJLM ND

  • MMLC8ORPDV:PDBMDODLBDMERCHMO PDC PDODPNMLPD

ODEJDBPDKMRLMEBMFLHHSDTMO JMCHLKMCHEHDCL ABP 8DROMPBHDLBDODPDOB SMJNN

  • MML-7HKMMLC8ORPDV1PHKHMLMERKL

TMOJMCEOMKDRCHMOPDC PDODPNMLPDODBMOCDCSHTDOAJD DJDBOMDLBDNJMFONPPDKCROHLFTJHLF2OMLHDOPHLRKL LDROMPBHDLBDSMJN

  • 7AOH3RKNOHDP7DOADO16HDADLJ4.HLCDO47LFJR

LC-0DPHV8DROJDEEDBPMEBMFLHHSDBMLOMJJMCMLRCHMOPDJDBHSD DLHML8DR OMNPBMJMFHSMJNN

2019/12/14Y 2019 @Haruko Yagura AHC-Lab, IS, NAIST 28

slide-30
SLIDE 30
  • 2019/12/14

29 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-31
SLIDE 31
  • 2019/12/14

30 2019 @Haruko Yagura AHC-Lab, IS, NAIST

slide-32
SLIDE 32

ITC

F ch: : fch k : K: [Yokota+,2017]

2019/12/14 31 2019 @Haruko Yagura AHC-Lab, IS, NAIST