An Intelligent Discussion-Bot for Guiding Student Interactions in - - PowerPoint PPT Presentation
An Intelligent Discussion-Bot for Guiding Student Interactions in Threaded Discussions Jihie Kim Erin Shaw ? Grace Chern Donghui Feng University of Southern California Information Sciences Institute PedDiscourse Kim et al. Outline
Kim et al. PedDiscourse
University of Southern California Information Sciences Institute ?
Kim et al. PedDiscourse
Kim et al. PedDiscourse
Kim et al. PedDiscourse
Past
Massachusetts
Development, USC Ongoing
~500 past students, ~150 current students Over 7000 messages
Kim et al. PedDiscourse
Kim et al. PedDiscourse
Discussion-bot refers questioner to most similar discussion
(as an explanation)
Kim et al. PedDiscourse
. . .
Kim et al. PedDiscourse
S1 S2 S1 I am still confused. I understand it is in the same address space as the parent process, where do we allocate the 8 pages of mem for it? And how do we keep track of .....? … I am sure it is a simple concept that I am just missing. S3 read the student documentation for the Fork syscall …
…
The Professor gave us 2 methods for forking threads from the main
where does it get created and take its 8 pages from? Do you have to calculate ......? If so how? Where does it store its PCReg .......? Any suggestions would be helpful. If you use the first implementation...., then you'll have a hard limit on the number of threads....If you use the second implementation, you need to.... Either way, you'll need to implement the AddrSpace::NewStack() function and make sure that there is memory available.
Kim et al. PedDiscourse
e.g. person who asks many questions on a particular topic
e.g. long vs. short discussions e.g. threads that reach an agreement on a topic versus threads that have unanswered queries e.g. effect of instructor intervention
e.g. topic changes over a semester
Kim et al. PedDiscourse
data from an undergraduate CS Course
100 200 300 400 500 600 # of threads 1 3 5 7 9 11 13 15 18 20 31 # of posts
data from a graduate CS Course
2 4 6 8 10 12 14 16 18 1 2 3 4 5 6 8 9 10 12 16
# of threads # of posts
two messages
be programmed or related technical concepts
Kim et al. PedDiscourse
T:4830 T:4711 T:4716
10 20 30 40 50 60 70 Period 1 Period 2 Period 3 Period 4 Period 5 Period 6 Tim e Number of Messages 6 5 4 3 2 1
Topic Shifts within Threads Topic Distribution over Time
Kim et al. PedDiscourse
Inspired by (Austin, 1962; Searle, 1969)
Give advice or suggest a solution Suggest SUG Answer with a short phrase or few words Simple Answer SANS Ask question about a specific problem Question QUES Object to an argument or suggestion Object OBJ Elaborate on a previous argument or question Elaborate ELAB Support an argument or suggestion Support SUP Criticize an argument Criticize CRT Correct a wrong answer or solution Correct CORR Praise an argument or suggestion Compliment COMP Command or announce Command ANNO Give answer requiring a full description of procedures, reasons, etc. Complex Answer CANS Confirm or acknowledge Acknowledge ACK Description Name Speech Act
(Feng, Shaw, Kim, Hovy, HLT/NAACL 2006)
Kim et al. PedDiscourse
Acknowledge ACK Complement COMP Correct CORR Object OBJ Suggest SUG Elaborate ELAB Support SUP Criticize CRT Simple Answer SANS Complex Answer CANS Announcement ANNO Question QUES Name Code 1 ACK/SUP CORR/OBJ ELAB ANS/SUG ANNO QUES Code 3 NEG NEUT POS Code 2
Code 1 Code 2 Code 3
% agreement: 81 Kappa: 0.70 % agreement: 63 Kappa: 0.54 % agreement: 92 Kappa: 0.58
Observed agreemnt - Chance agreemnt Kappa = --------------------------------------------------------- Total observed - Chance agreemnt
Kim et al. PedDiscourse
ANS-SUG ANS-SUG/QUES S1 S2 S1 I am still confused. I understand it is in the same address space as the parent process, where do we allocate the 8 pages of mem for it? And how do we keep track of .....? … I am sure it is a simple concept that I am just missing. S3 ANS-SUG read the student documentation for the Fork syscall …
…
The Professor gave us 2 methods for forking threads from the main
where does it get created and take its 8 pages from? Do you have to calculate ......? If so how? Where does it store its PCReg .......? Any suggestions would be helpful. If you use the first implementation...., then you'll have a hard limit on the number of threads....If you use the second implementation, you need to.... Either way, you'll need to implement the AddrSpace::NewStack() function and make sure that there is memory available. QUES
Kim et al. PedDiscourse
29.2 A question about a problem, including question about a previous message QUES 8.1 An elaboration (of a previous message) or description, including elaboration of a question or an answer ELAB 9.7 A correction or objection (or complaint) to/on a previous message CORR- OBJ 37.8 A simple or complex answer to a previous question. Suggestion or advice ANS-SUG 6.7 Information, Command or Announcement INFORM 8.5 An acknowledgement, compliment or support in response to a previous message ACK-SUP- COMP % Description Speech Act
Kim et al. PedDiscourse
[categ_person] am a [tech_term] do [categ_person] have to look at the [tech_term] in the same [tech_term] look at the for example , . [categ_person] should let [me/him/her/us] know not seem to look at [or/and] do seems like in [tech_term] stated in yes am helps but depends Answer Classifier (AC) do [categ_person] have to do [categ_person] need to [tech_term] [tech_term] [tech..] ? is there a better does this mean that [categ_wh] should [categ_person] [categ_person] was wondering [or/and] do [categ_person] is there a [tech_term] ? do [categ_person] [tech_term] ? can [categ_person] is there ? thanks ? [categ_wh ] will do confused Question Classifier (QC) 4-grams 3-grams 2-grams 1-gram Category
Kim et al. PedDiscourse
QC=yes AC=no QC=yes AC=no M1 QC = yes AC = no M2 QC=no AC=yes QC=no AC=yes M2 M1 M3 QC=yes AC=no M1 QC=no AC=yes QC=yes AC=no QC=no AC=yes M2 QC=yes AC=no M1 QC=no AC=yes QC=yes AC=no M2 M3 M3 M4
Kim et al. PedDiscourse
2001)
Litman 1993)
Shaw, Kim, Hovy HLT-NAACL 2006)
al., 2006)
Kim et al. PedDiscourse