Hot Topics in Course Redesign: What about the English Department? - - PowerPoint PPT Presentation

Hot Topics in Course Redesign: What about the English Department?

National Center for Academic Transformation Redesign Alliance Second Annual Conference Orlando, FL, March 16-18, 2008

• Dr. Jim Wohlpart

Associate Dean, College of Arts and Sciences Florida Gulf Coast University

Pearson Knowledge Technologies Intelligent Essay Assessor

Parameters of the IEA

• Narrowly prescribed prompts
• 100-500 word essays

Programming the IEA

• Input electronic version of textbook
• Input 200 (human) scored essays

Limits of the IEA

• Provides score only (no feedback)
• Repeat of phrases/analysis flagged as

potential plagiarism

Spring 2003 Short Essay Question (Visual Arts)

Module I Exam (Visual Arts): Identify the element of form in Albert Paley’s public sculpture, Cross Currents. How does the form of the work create meaning or experience? What do you think this meaning or experience could be? (350-500 words)

Increase in Student Learning: Module Exam (Part 2)

0% 10% 20% 30% 40% 50% Traditional 6% 26% 46% 21% Redesign 8% 39% 45% 7% 4's 3's 2's 1's

Short Essay Questions: Grade Distribution

0% 20% 40% 60% 80% 100% Inaccurate 46% 38% 19% Accurate 54% 62% 81% Human IEA Re-Scored

IEA Inter-rater Reliability: All Essays (803)

Produced by

Jim Wohlpart Associate Dean, Arts and Sciences

With special thanks to

National Center for Academic Transformation Pearson Knowledge Technologies Prentice Hall Publishers Instructional Technology (FGCU) Humanities and Arts Faculty (FGCU)