Understanding the Learners Actions when using Mathematics Learning - - PowerPoint PPT Presentation

▶
understanding the learners actions when using mathematics
SMART_READER_LITE
LIVE PREVIEW

Understanding the Learners Actions when using Mathematics Learning - - PowerPoint PPT Presentation

Jun 22, 2023 115 likes •479 views

Understanding the Learners Actions when using Mathematics Learning Tools Wolfgang Mller Paul Libbrecht PH Weingarten CERMAT PH Karlsruhe Daniel Herding RWTH Aachen Sandra Rebholz Felix Tscheulin PH Weingarten PH Weingarten

slide-1
SLIDE 1
  • Understanding the Learners’

Actions when using Mathematics Learning Tools

Paul Libbrecht CERMAT PH Karlsruhe Sandra Rebholz PH Weingarten Daniel Herding RWTH Aachen Wolfgang Müller PH Weingarten Felix Tscheulin PH Weingarten

slide-2
SLIDE 2
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

The Problems

  • a teacher explains concepts in a lecture
  • he assigns exercises
  • students can try...
  • how are they checked?
  • paper corrections
  • self-corrections, peer-corrections
  • ...intelligent tutoring systems
slide-3
SLIDE 3
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Interactive Exercises: Risks

  • cognitive load (technical & conceptual)
  • tiniest bugs become huge
  • irrelevant parts
  • frustration of unachieved exercises
  • they need to be managed by teacher!
slide-4
SLIDE 4
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Interactive Exercises: Risks

  • cognitive load (technical & conceptual)
  • tiniest bugs become huge
  • irrelevant parts
  • frustration of unachieved exercises
  • they need to be managed by teacher!

It didn’t accept my answer as correct, despite clear syntax (checked by the syntax checker) and my answer being correct. (LeActiveMath evaluation 2007)

slide-5
SLIDE 5
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Interactive Exercises: Risks

  • cognitive load (technical & conceptual)
  • tiniest bugs become huge
  • irrelevant parts
  • frustration of unachieved exercises
  • they need to be managed by teacher!

It didn’t accept my answer as correct, despite clear syntax (checked by the syntax checker) and my answer being correct. (LeActiveMath evaluation 2007) I am going round in circle in this exercise. Should I have set up things differently? (SAiL-M evaluation 2011)

slide-6
SLIDE 6
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Outline

  • problem statement
  • learning tools
  • proposed solution
  • techniques
  • demo
  • related works
  • open avenues

intro • tools • solution • techniques • demo • outlook

slide-7
SLIDE 7
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra
slide-8
SLIDE 8
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra

intro • tools • solution • techniques • demo • outlook

slide-9
SLIDE 9
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

intro • tools • solution • techniques • outlook

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra
slide-10
SLIDE 10
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

intro • tools • solution • techniques • demo • outlook

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra
slide-11
SLIDE 11
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

intro • tools • solution • techniques • demo • outlook

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra
slide-12
SLIDE 12
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

intro • tools • solution • techniques • demo • outlook

Learning Tools

  • for undergraduate mathematics teachers
  • SquiggleM: relations, bijection, ...
  • ComInM: induction
  • MoveItM: isometries, composition
  • SetSails: boolean algebra
slide-13
SLIDE 13
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Integrated Play, Learning Analytics

  • start at the LMS
  • collect tracks of the usage
  • present tracks to teachers:
  • in summary form
  • in individual form
  • as much as needed so that the teacher

understands what happened

  • ur approach:

intro • tools • solution • techniques • demo • outlook

slide-14
SLIDE 14
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Integrated Play, Learning Analytics

  • start at the LMS
  • collect tracks of the usage
  • present tracks to teachers:
  • in summary form
  • in individual form
  • as much as needed so that the teacher

understands what happened

  • ur approach:

SMALA

intro • tools • solution • techniques • demo • outlook

slide-15
SLIDE 15
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA Architecture

SMALA

acti- vities

LMS

Course

resource resource

intro • tools • solution • techniques • demo • outlook

slide-16
SLIDE 16
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA Architecture

SMALA

acti- vities

LMS

Course

resource resource

logs in authenticates social nets

intro • tools • solution • techniques • demo • outlook

slide-17
SLIDE 17
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA Architecture

SMALA

acti- vities

LMS

Course

resource resource

logs in authenticates social nets

how to deploy creates

intro • tools • solution • techniques • demo • outlook

slide-18
SLIDE 18
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA Architecture

SMALA

acti- vities

LMS

Course

resource resource

logs in authenticates social nets

how to deploy creates

logs in

intro • tools • solution • techniques • demo • outlook

slide-19
SLIDE 19
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

Learning- Tool

logs

launch tool

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-20
SLIDE 20
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

start tool session

Learning- Tool

logs

launch tool

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-21
SLIDE 21
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

start tool session

Learning- Tool

logs

launch tool

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-22
SLIDE 22
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

start tool session

Learning- Tool

logs

launch tool

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-23
SLIDE 23
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

start tool session

Learning- Tool

logs

launch tool

automatic assessement

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-24
SLIDE 24
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

SMALA

acti- vities

LMS

Course

resource resource

start tool session

Learning- Tool

logs

launch tool

automatic assessement

log views log views log views

intro • tools • solution • techniques • outlook

SMALA Architecture

slide-25
SLIDE 25
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Components

  • Learners’ browser:
  • in Moodle or StudIP
  • identity reading ⇒

pseudonym, session

  • Smala server: logging
  • Servlet front
  • flexible authorization

(signature, origin...)

  • events in PList format
  • OpenJPA storage of events
  • Smala server: log-views
  • social network

authentications (teachers, admin)

  • how-to-deploy

explanations

  • JPA queries
  • JSP rendering
  • all open-source

intro • tools • solution • techniques • demo • outlook

slide-26
SLIDE 26
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Summary views

  • statistical overviews
  • to get a broad feeling

intro • tools • solution • techniques • demo • outlook

slide-27
SLIDE 27
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Summary views

  • statistical overviews
  • to get a broad feeling

intro • tools • solution • techniques • demo • outlook

slide-28
SLIDE 28
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Session Views

  • individual track
  • often

anonymous

  • understand

what went

  • wrong
  • right

intro • tools • solution • techniques • demo • outlook

slide-29
SLIDE 29
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Demo: Semi-Automatic Assessment

  • Squiggle M
  • play randomly
  • send a mail: I am lost
  • check mail
  • reply

intro • tools • solution • techniques • demo • outlook

slide-30
SLIDE 30
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Semi-Automatic Assessment

  • utility of exercise feedback:
  • eval performance, learn from error
  • automatic feedback never complete
  • mostly « the standard »
  • approach: semi-automatic assessment
  • learners use tips and feedback of the system
  • seek help when that is insufficient
  • complementarity of tool and teacher

intro • tools • solution • techniques • demo • related • outlook

Photo by Wolfgang Müller, PH Weingarten 2012 CC-BY
slide-31
SLIDE 31
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Evaluation

  • ~ 150 users, 1000 sessions, 25’000 events
  • conclusions:
  • tool starts and transparently logs: ok
  • no real bother about privacy
  • but have to offer alternatives
  • help-seeking paradigm works
  • used little, but sufficient to answer

intro • tools • solution • techniques • demo • outlook

slide-32
SLIDE 32
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Related Work

  • SCORM
  • single sign on attempts (eg. LTI)
  • current toolset insufficient for analytics
  • Jacareto: full recording... too detailed!
  • Formid
  • no anonymity, scenario binding
  • LOCO-analyst
  • events not enough flexible

intro • tools • solution • techniques • demo • outlook

slide-33
SLIDE 33
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Open Avenues

  • enhance logging for SquiggleM and MoveItM
  • (show graph, show the moves' log?)
  • better client implementation
  • applets a burden (but scrape well)
  • summary views enrichment
  • teachers’ analysis process
  • visually rich displays

intro • tools • solution • techniques • demo • outlook

slide-34
SLIDE 34
  • Paul Libbrecht et al- CICM 2012 - Bremen

(c) Pädagogische Hochschule Karlsruhe - CC-BY-SA

Summary

  • learners benefit of automated feedback
  • ... but may need more
  • semi-automatic-feedback
  • needs understanding what they did
  • architecture proposed and deployed
  • worked well for ~150 students
  • bases on a single delivery and logging server
  • privacy issues acceptably addressed

intro • tools • solution • techniques • demo • outlook

slide-35
SLIDE 35

Thank you.