Properties and Applications of Wrong Answers in Online Educational - - PowerPoint PPT Presentation

▶

properties and applications of wrong answers in online

Properties and Applications of Wrong Answers in Online Educational - - PowerPoint PPT Presentation

Apr 09, 2024 12 likes •235 views

Properties and Applications of Wrong Answers in Online Educational Systems Radek Pel anek, Ji r Rih ak Masaryk University Brno Wrong answer Wrong answer Learner input to wrongly answered question Radek Pel anek,

slide-1

SLIDE 1

Properties and Applications of Wrong Answers in Online Educational Systems

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak

Masaryk University Brno

slide-2

SLIDE 2

Wrong answer

Wrong answer Learner input to wrongly answered question

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-3

SLIDE 3

Wrong answers

Feedback for teachers

common mistakes of a class

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-4

SLIDE 4

Wrong answers

Detecting level of knowledge 5 × 5 = 30 5 × 5 = 24 5 × 5 = 17

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-5

SLIDE 5

Wrong answers

Question construction

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-6

SLIDE 6

Wrong answers

Problem in user interface

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-7

SLIDE 7

Wrong answers

. . . and much more

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-8

SLIDE 8

Systems

matmat.cz basic arithmetic elementary school

utlinemaps.org

geography high school practiceanatomy.com human anatomy university

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-9

SLIDE 9

Systems

simple tasks adaptivity - selection of questions > 200 000 answers

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-10

SLIDE 10

Wrong Answers - Geography

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-11

SLIDE 11

Common Wrong Answers Countries common border, similar size, same first latter importance of practice context - Madagascar

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-12

SLIDE 12

Common Wrong Answers - Geography

...

Romania Norway Sweden

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-13

SLIDE 13

Confusion Graph

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-14

SLIDE 14

Item Clustering

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-15

SLIDE 15

Cross-system Comparison

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-16

SLIDE 16

Categories of Wrong Answers TopWA - most common wrong answer CWA - other common wrong answers - > 5% Other Missing - question skipped by learner

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-17

SLIDE 17

System comparison

Basic Arithmetic Geography Human Anatomy

frequency T

pWA

CWA Other Missing

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-18

SLIDE 18

System comparison - Response time

T

pWA

CWA Other Missing Correct

Basic Arithmetic Geography Human Anatomy

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-19

SLIDE 19

System comparison - Probability of Leaving

T

pWA

CWA Other Missing Correct

Basic Arithmetic Geography Human Anatomy

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-20

SLIDE 20

System comparison - Future Success

future success

T

pWA

CWA Other Missing Correct

Basic Arithmetic Geography Human Anatomy

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-21

SLIDE 21

Categories of Wrong Answers TopWA, CWA, Other, Missing equally distributed linear behaviour similar behaviour in different domains good measure of wrongness - interval variable

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers

slide-22

SLIDE 22

Wrong Answers

Wrong answers

are easy to collect has many applications: question and hint construction, feedback and inspiration, . . . Contributions item clustering measure of wrongness

Radek Pel´ anek, Jiˇ r´ ı ˇ Rih´ ak Wrong Answers