Using keystroke logging in your research ... and in your classroom - - PowerPoint PPT Presentation

▶
using keystroke logging in your research and in your
SMART_READER_LITE
LIVE PREVIEW

Using keystroke logging in your research ... and in your classroom - - PowerPoint PPT Presentation

Dec 13, 2022 137 likes •534 views

Using keystroke logging in your research ... and in your classroom Marille Leijten & Luuk Van Waes University of Antwerp | Belgium Overview 1. Introduction Which areas of research use keystroke logging? 2. Research How do you set up a

slide-1
SLIDE 1

Using keystroke logging in your research ... and in your classroom

Mariëlle Leijten & Luuk Van Waes University of Antwerp | Belgium

slide-2
SLIDE 2
slide-3
SLIDE 3

Overview

3

  • 1. Introduction

Which areas of research use keystroke logging?

  • 2. Research

How do you set up a keystroke logging research study with Inputlog?

  • 3. Teaching

How do you provide your students with process feedback in the classroom?

  • 4. Inputlog 9‐Beta

How to log Chinese script?

slide-4
SLIDE 4

Inputlog

  • Windows (additional logging in MS Word)
  • Writing modes
  • keyboard and mouse movements & clicks
  • speech: Dragon Naturally Speaking
  • focus: window monitoring (resources)
  • Analyses
  • Graphs
  • Pre and post processing
  • Play‐back

Leijten, M., & Van Waes, L. (2013)

Free download for researchers

www.inputlog.net

slide-5
SLIDE 5

Writing process research

Process observation provides data for research on:

  • cognitive writing processes
  • writing strategies
  • writing development
  • translation studies
  • L1 versus L2 writing
  • writing from sources
  • live subtitling
  • clinical diagnosis (e.g. dyslexia, dementia, aphasia)
  • literary writers
  • etc.
slide-6
SLIDE 6

KSL with Inputlog: an introduction

slide-7
SLIDE 7

General analysis

slide-8
SLIDE 8

Research

How do you set up a keystroke logging research study with Inputlog?

slide-9
SLIDE 9

Leijten, M., & Van Waes, L. (2020 – in press). Designing Keystroke Logging Research in Writing, Chinese Journal of Second Language Writing

Designing keystroke logging research

9

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

The Research Flow

slide-10
SLIDE 10

10

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

New, previous or other document Copy task

slide-11
SLIDE 11

11

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

Data cleaning

slide-12
SLIDE 12

12

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

Data categorisation

slide-13
SLIDE 13

13

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

Basic analyses

  • general
  • linear
  • summary
  • pause
  • revision
  • s‐notatation

Visual analyses

  • process graph
  • source network
  • fluency graph

Specific analyses

  • source
  • fluency
  • bigram
  • word pause
  • linguistic
  • token
  • copy task
slide-14
SLIDE 14

14

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

Basic analyses

  • general
  • linear
  • summary
  • pause
  • revision
  • s‐notatation

Visual analyses

  • process graph
  • source network
  • fluency graph

Specific analyses

  • source
  • fluency
  • bigram
  • word pause
  • linguistic
  • token
  • copy task
slide-15
SLIDE 15

Process graph

slide-16
SLIDE 16

Pause (threshold of  2000ms)

Pauses (ms) Characters

Characters produced Document length Cursor position

Time (minutes)

deleted text

slide-17
SLIDE 17

Writing in the main document

Time (minutes) Characters

Sources

Consulting external source(s)

Main document

Pauses (ms)

Characters produced Document length Cursor position

slide-18
SLIDE 18

Consulting external source(s)

Writing in the main document

Time (minutes) Characters

Sources Main document Writing at the point of utterance

Time (minutes)

Sources Main document

Pauses (ms)

Characters produced Document length Cursor position Writing within the text produced so far

slide-19
SLIDE 19

Characters produced Cursor position

Time (minutes) Characters

Sources Main document Local revisions at the point of utterance Global revisions (in the beginning

  • f the text)

Time (minutes)

Sources Main document

Pauses (ms)

Document length

‐ 60%

Writing at the point of utterance

slide-20
SLIDE 20

20

Process graphs

Linear writing process Singular global revision episode Recursive writing process Multiple global revision episodes

slide-21
SLIDE 21

Leijten, M., & Van Waes, L. (2020 – in press). Designing Keystroke Logging Research in Writing, Chinese Journal of Second Language Writing

Designing keystroke logging research

21

data collection record data preparation preprocessing data analysis inputlog data preparation postprocessing data analysis statistical reporting case/group

The Research Flow

slide-22
SLIDE 22

Teaching

How to bring process feedback to the classroom?

The Inputlog report function

slide-23
SLIDE 23

Bring process data to the classroom

Challenges:

  • technical
  • pedagogical
  • statistical
slide-24
SLIDE 24

How to bring the process to class?

lots of data lost in data

slide-25
SLIDE 25

Analyze

3000+ variables 15 variables

slide-26
SLIDE 26

Process reports: user friendly

slide-27
SLIDE 27

Process report: Example

slide-28
SLIDE 28

28

slide-29
SLIDE 29

Report

slide-30
SLIDE 30

Process graph

slide-31
SLIDE 31

Instructional movie

31

slide-32
SLIDE 32

Pedagogy: Process feedback flow

Benchmark process report

slide-33
SLIDE 33

Inputlog 9 - Beta

How to log Chinese script?

Logging Chinese script

slide-34
SLIDE 34

Logging Chinese script

Thanks to:

  • prof. WANG Junju

CHENG Wei XU Cuiqin

slide-35
SLIDE 35

Screenshot Inputlog 9 beta

slide-36
SLIDE 36

Example

slide-37
SLIDE 37

Next steps

  • Develop analyses for Chinese logging
  • Bring more ‘intelligence’

‐ big data studies ‐ pattern analysis ‐ machine learning

slide-38
SLIDE 38

www.inputlog.net

Good luck on using keystroke logging in your research… and in your classroom