Auto-grading for 3D Modeling Assignments in MOOCs Swapneel Mehta - - PowerPoint PPT Presentation

▶
auto grading for 3d modeling assignments in moocs
SMART_READER_LITE
LIVE PREVIEW

Auto-grading for 3D Modeling Assignments in MOOCs Swapneel Mehta - - PowerPoint PPT Presentation

Aug 02, 2023 183 likes •673 views

Auto-grading for 3D Modeling Assignments in MOOCs Swapneel Mehta Nitin Ayer Chirag Raman Sameer Sahasrabudhe Motivation 2 SKANI101XA Basic 3D Animation Using Blender Introductory course on 3D animation Motivation User Workflows Proposed

slide-1
SLIDE 1

Auto-grading for 3D Modeling Assignments in MOOCs

Swapneel Mehta Nitin Ayer

Chirag Raman

Sameer Sahasrabudhe

slide-2
SLIDE 2

Motivation

2

slide-3
SLIDE 3

SKANI101XA Basic 3D Animation Using Blender

Introductory course on 3D animation

Motivation User Workflows Proposed System Summary

3

slide-4
SLIDE 4

SKANI101XA Basic 3D Animation Using Blender

Introductory course on 3D animation The course has been offered five times with an average of ~4000 enrolled students!

Motivation User Workflows Proposed System Summary

4

slide-5
SLIDE 5

SKANI101XA Basic 3D Animation Using Blender

Introductory course on 3D animation The course has been offered five times with an average of ~4000 enrolled students! Assignments include generating simple 3D models

Motivation User Workflows Proposed System Summary

5

slide-6
SLIDE 6

Modeling Assignment

Motivation User Workflows Proposed System Summary

A drill activity early in the course to demonstrate basic concepts of face selection and extrusion The intention is for the students to exactly follow the steps of the drill

6

slide-7
SLIDE 7

Modeling Assignment

Motivation User Workflows Proposed System Summary

7

slide-8
SLIDE 8

Modeling Assignment

Motivation User Workflows Proposed System Summary

8

slide-9
SLIDE 9

Modeling Assignment

Motivation User Workflows Proposed System Summary

9

slide-10
SLIDE 10

Modeling Assignment

Motivation User Workflows Proposed System Summary

10

slide-11
SLIDE 11

General Errors

Motivation User Workflows Proposed System Summary

Incomplete Model!

11

slide-12
SLIDE 12

General Errors

Motivation User Workflows Proposed System Summary

Incomplete Primitive! - Cube instead of Torus

12

slide-13
SLIDE 13

Motivation

Motivation User Workflows Proposed System Summary

Around 25% of the students submit the first assignment Submissions are .blend files, not images

13

slide-14
SLIDE 14

Motivation

Motivation User Workflows Proposed System Summary

Around 25% of the students submit the first assignment Submissions are .blend files, not images

Grading is a resource intensive task!

14

slide-15
SLIDE 15

Typical User Workflows

15

slide-16
SLIDE 16

IITBombayX

Motivation User Workflows Proposed System Summary

16

slide-17
SLIDE 17

Students Motivation User Workflows Proposed System Summary

IITBombayX

17

slide-18
SLIDE 18

Instructors Students Motivation User Workflows Proposed System Summary

IITBombayX

18

slide-19
SLIDE 19

Students Instructors Content Management System Motivation User Workflows Proposed System Summary

IITBombayX

19

slide-20
SLIDE 20

Students Instructors Content Management System Coursework Motivation User Workflows Proposed System Summary

IITBombayX

20

slide-21
SLIDE 21

Students Instructors Learning Management System Content Management System Motivation User Workflows Proposed System Summary

IITBombayX

21

slide-22
SLIDE 22

Students Instructors Learning Management System Content Management System Assignment Motivation User Workflows Proposed System Summary

IITBombayX

22

slide-23
SLIDE 23

Students Instructors Learning Management System Content Management System Submissions (.blend) Motivation User Workflows Proposed System Summary

IITBombayX

23

slide-24
SLIDE 24

Students Instructors Learning Management System Content Management System Motivation User Workflows Proposed System Summary

IITBombayX

Submissions (.blend)

24

slide-25
SLIDE 25

Students Instructors Learning Management System Content Management System Submissions Motivation User Workflows Proposed System Summary

IITBombayX IITBombayX

Submissions (.blend)

25

slide-26
SLIDE 26

Assessments Students Instructors Learning Management System Content Management System Motivation User Workflows Proposed System Summary

IITBombayX

26

slide-27
SLIDE 27

Assessments Students Instructors Learning Management System Content Management System Motivation User Workflows Proposed System Summary

IITBombayX

27

slide-28
SLIDE 28

Assessments Students Instructors Learning Management System Content Management System Assessments Motivation User Workflows Proposed System Summary

IITBombayX

28

slide-29
SLIDE 29

Proposed System Auto-grading for 3D Modeling Assignments in MOOCs

29

slide-30
SLIDE 30

Students Instructors Learning Management System Content Management System Auto-grader Motivation User Workflows Proposed System Summary

IITBombayX

30

slide-31
SLIDE 31

Students Instructors Learning Management System Content Management System Auto-grader Rubric Motivation User Workflows Proposed System Summary

IITBombayX

31

slide-32
SLIDE 32

Students Instructors Learning Management System Content Management System Submission Auto-grader Rubric Motivation User Workflows Proposed System Summary

IITBombayX

32

slide-33
SLIDE 33

Students Instructors Learning Management System Content Management System Submission Auto-grader Rubric Submission Motivation User Workflows Proposed System Summary

IITBombayX

33

slide-34
SLIDE 34

Students Instructors Learning Management System Content Management System Auto-grader Rubric Submission Comparer Motivation User Workflows Proposed System Summary

IITBombayX

34

slide-35
SLIDE 35

Students Instructors Learning Management System Content Management System Auto-grader Rubric Submission Comparer Assessor Motivation User Workflows Proposed System Summary

IITBombayX

35

slide-36
SLIDE 36

Students Instructors Learning Management System Content Management System Auto-grader Rubric Submission Comparer Assessor Motivation User Workflows Proposed System Summary

IITBombayX

36

slide-37
SLIDE 37

Students Instructors Learning Management System Content Management System Assessments Auto-grader Rubric Submission Comparer Assessor Motivation User Workflows Proposed System Summary

IITBombayX

37

slide-38
SLIDE 38

Attributes extracted from the .blend files

Comparer

01 | Object Placement (Location, Rotation) 02 | Polygon Count 03 | Number of Objects 04 | Additional Free Parameter

Motivation User Workflows Proposed System Summary

38

slide-39
SLIDE 39

Implemented as a Python script using the Blender 3D API

Comparer

Motivation User Workflows Proposed System Summary

39

slide-40
SLIDE 40

Generates assessments and feedback from the Comparer output using instructor specified grading policy

Assessor - Grading Policy

Motivation User Workflows Proposed System Summary

ATTRIBUTE 1 Object Placement At origin, identity rotation Otherwise Polygon Count 576 +/- 100 Otherwise Number of Objects 1 Otherwise Additional Parameter (Type) Torus Otherwise

40

slide-41
SLIDE 41

Grades are assigned as an ordinal score in the range [0, 5]

Assessor

Motivation User Workflows Proposed System Summary

41

slide-42
SLIDE 42

Grades are assigned as an ordinal score in the range [0, 5] FUTURE EXTENSIONS:

  • Perform direct mesh-based evaluation
  • Provide customized feedback

Assessor

Motivation User Workflows Proposed System Summary

42

slide-43
SLIDE 43

Assessor

Motivation User Workflows Proposed System Summary

43

slide-44
SLIDE 44

Summary

44

slide-45
SLIDE 45

Introduced a stand-alone auto-grading module that incorporates an instructor defined rubric for the automatic assessment

  • f submitted 3D modeling assignments

Motivation User Workflows Proposed System Summary

45

slide-46
SLIDE 46

Future directions include integration with LTI tools, incorporating an intelligent sub-module for direct mesh-based evaluation, and providing customized feedback

Motivation User Workflows Proposed System Summary

46

slide-47
SLIDE 47

Thank you! Questions?

47