Portfolio-Based Assessment Rubric Training 1 Learning Activity 1: - - PowerPoint PPT Presentation

portfolio based assessment rubric training
SMART_READER_LITE
LIVE PREVIEW

Portfolio-Based Assessment Rubric Training 1 Learning Activity 1: - - PowerPoint PPT Presentation

Portfolio-Based Assessment Rubric Training 1 Learning Activity 1: Welcome & Introductions Welcome & Introductions 2 Welcome & Introductions 3 3 Assessor Training: Learning Outcomes Discuss the rubric rating and scoring


slide-1
SLIDE 1

Portfolio-Based Assessment Rubric Training

1

slide-2
SLIDE 2

Learning Activity 1:

Welcome & Introductions Welcome & Introductions

2

slide-3
SLIDE 3

Welcome & Introductions

3 3

slide-4
SLIDE 4

Assessor Training: Learning Outcomes

  • Describe a rubric and its use.

Describe a rubric and its use.

  • Define and label the components of a
  • Define and label the components of a

rubric. rubric.

  • Describe the structure of the
  • Describe the structure of the

Portfolio Portfolio-based rubric. based rubric.

  • Identify the characteristics of
  • Identify the characteristics of

effective portfolio review included in effective portfolio review included in the Portfolio the Portfolio-based rubric. based rubric.

4

  • Discuss the rubric rating and scoring

Discuss the rubric rating and scoring system. system.

  • Interpret the individual rating
  • Interpret the individual rating

components and associated rating components and associated rating scale. scale.

  • Practice applying the rubric grid on a
  • Practice applying the rubric grid on a

sample portfolio. sample portfolio.

  • Examine and
  • Examine and

appraise appraise a sample a sample portfolio using the rubric. portfolio using the rubric.

  • Evaluate and
  • Evaluate and

justify justify your review and your review and scoring of a sample portfolio. scoring of a sample portfolio.

slide-5
SLIDE 5

Facilitator Training: Learning Outcomes

  • Describe a rubric and its use.

Describe a rubric and its use.

  • Define and label the components of a
  • Define and label the components of a

rubric. rubric.

  • In particular: Describe the structure of
  • In particular: Describe the structure of

the Portfolio the Portfolio-based rubric. based rubric.

  • Identify the characteristics of effective
  • Identify the characteristics of effective

portfolio review included in the portfolio review included in the Portfolio Portfolio-based rubric. based rubric.

  • Discuss the rubric rating and scoring
  • Discuss the rubric rating and scoring

system. system.

  • Interpret the individual rating
  • Interpret the individual rating

components and associated rating components and associated rating scale. scale.

  • Practice applying the rubric grid on a

Practice applying the rubric grid on a sample portfolio. sample portfolio.

  • Examine and
  • Examine and

appraise appraise a sample a sample portfolio using the rubric. portfolio using the rubric.

  • Evaluate and
  • Evaluate and

justify justify your review and your review and scoring of a sample portfolio. scoring of a sample portfolio.

  • Use the Facilitator’s Manual and
  • Use the Facilitator’s Manual and

requisite materials and resources to requisite materials and resources to lead workshops at their own lead workshops at their own institutions. institutions.

  • Apply and demonstrate the principles
  • Apply and demonstrate the principles

learned during their Facilitator’s learned during their Facilitator’s workshop. workshop.

5

slide-6
SLIDE 6

Online Component

Completed Completed Prior to Prior to this Workshop this Workshop

6 6

slide-7
SLIDE 7

Pre-Test

7

slide-8
SLIDE 8

Participant’s Manual

8

slide-9
SLIDE 9

OHIO’S PLA RUBRIC

9

  • High Standards

High Standards

  • Consistency

Consistency

slide-10
SLIDE 10

Learning Activity 2:

Rubric Concepts Review Rubric Concepts Review

8

slide-11
SLIDE 11

THE RUBRIC

CRITERIA AND SCORING

11

slide-12
SLIDE 12

DOCUMENTATION

12

slide-13
SLIDE 13

DOCUMENTATION

13

  • Align with specific course objectives &

learning outcomes

  • Documents show specific & relevant:
  • Skills
  • Knowledge
  • Values
  • Attitudes
  • Understanding
  • Achievements
  • Experiences
  • Competencies
  • Training & Certifications
slide-14
SLIDE 14

CRITERIA

14

slide-15
SLIDE 15

CRITERIA

15

  • Sources of Learning
  • Demonstration of Learning
  • Evidence of Learning
  • Mastering Knowledge and Skills
  • Reflection on Learning
  • Presentation
slide-16
SLIDE 16

CRITERIA

16

Sources of Learning

  • Document learning experiences
  • Relate the learning experiences to the stated course

learning outcomes

  • Examine and show how prior learning meets/fulfills the

stated course outcomes

  • Document and describe learning experiences
  • Align past learning with the course learning outcomes
slide-17
SLIDE 17

CRITERIA

17

Demonstration of Learning

Elements support course learning outcomes & field of study

  • Training certificate
  • Training record
  • Transcript
  • Work samples
  • Business plan
  • Publications
  • Performance Reviews
  • Photographs/videos

/multimedia

  • PowerPoint

presentations

  • Official documents
  • f learning

experiences

slide-18
SLIDE 18

Kolb’s Learning Cycle

18

slide-19
SLIDE 19

CRITERIA

19

Mastering Knowledge & Skills

  • Optimal length experiences that are concrete & specific
  • Sustained application of knowledge & skills
  • Knowledge application to varied learning & problem solution
slide-20
SLIDE 20

CRITERIA

20

Reflection on Learning

  • Self-evaluation and critical reflection application & articulation
  • Ability to implement strategies
  • Introspection & cognizance of concrete experience knowledge
slide-21
SLIDE 21

CRITERIA

21

Presentation

  • Required documents included
  • Clear & well organized
  • Quality of documentation (including grammar and spelling)
slide-22
SLIDE 22

RATINGS & SCORING

Ratings are between 0

  • 3
  • 0 - Does not meet
  • 1 – Partially meets
  • 2 – Meets
  • 3 - Exceeds

22

3

?

2 1

slide-23
SLIDE 23

RATINGS & SCORING

Scoring runs between 0

  • 18
  • 12 – Recommended successful score
  • 1 – the least # score required in each
  • f the six criteria

23

18 18

?

slide-24
SLIDE 24

Learning Activity 3:

The Rubric in Application The Rubric in Application

Entire Group Entire Group

24

slide-25
SLIDE 25

OUR GOAL

25

Determine how well they align with each criteria What is here? What is missing? Discussion about all.

slide-26
SLIDE 26

26

  • Are all required documents included?

DETERMINING COMPLETENESS

  • Organize the portfolio elements in a

way that makes sense to you.

  • If applicable, what is missing?
slide-27
SLIDE 27

27

  • Does the documentation fulfill the criteria?
  • How should it be scored?
  • What is your rationale for scoring the

components?

FULFILLMENT OF CRITERIA

slide-28
SLIDE 28

28

  • Find consensus as a group on portfolio ratings
  • Compare them to your individual scores
  • Have you changed your mind on any ratings?

COMPARING INDIVIDUAL AND GROUP RATINGS

slide-29
SLIDE 29

29

  • How do the original assessor’s ratings compare

to your individual and the group ratings?

  • What do you agree and disagree on?
  • Did this exercise cause you to change any of

your ratings?

COMPARING OUR RATINGS AGAINST THE ORIGINAL ASSESSOR’S

slide-30
SLIDE 30

30

  • What should you do if a portfolio is incomplete?
  • Your institution may have policies and procedures to
  • follow. Do you know what they are?

BORDERLINE/INCOMPLETE PORTFOLIOS

slide-31
SLIDE 31

31

  • Some omissions/changes may be rectified by

requesting minor improvements/documents

  • What are your institution’s policies and procedures?

ADDRESSING CHANGES/RESUBMISSION

slide-32
SLIDE 32

Learning Activity 4:

The Rubric in Application II The Rubric in Application II

Small Groups

32

slide-33
SLIDE 33

33

  • 1. Review one portfolio in small groups
  • 2. Determine how well it aligns with each criteria

OUR GOAL

slide-34
SLIDE 34

34

  • What components does this portfolio have?

IDENTIFY COMPONENTS

slide-35
SLIDE 35

35

  • Identify which portfolio components will be

examined

  • Sort out unneeded documents
  • Organize the components you will use

IDENTIFY RELEVANT COMPONENTS

slide-36
SLIDE 36

36

  • Does it look complete?
  • Is anything missing?
  • Identify what is needed, if anything

PORTFOLIO COMPLETENESS

slide-37
SLIDE 37

37

  • Where each component fits
  • How well it aligns with learning outcomes

ALIGNMENT TO CRITERIA

slide-38
SLIDE 38

38

  • Components:

REVIEW AND SCORE

  • Show clear evidence of mastery of

course learning outcomes & competencies

  • Align with Rubric expectations
slide-39
SLIDE 39

39

  • Responding to portfolios that need more work

BORDERLINE/INCOMPLETE PORTFOLIOS

  • Within your institution’s

policies/procedures, adequately communicate to student what is needed.

  • Writing clear rationales assists with

the request/resubmission process.

slide-40
SLIDE 40

40

  • Review original ratings
  • Do their rationales provide more insight?
  • Would they provide impetus to change your

scores?

ORIGINAL ASSESSOR’S SCORES

slide-41
SLIDE 41

Learning Activity 5:

The Rubric in Application III The Rubric in Application III

Pairs

41

slide-42
SLIDE 42

42

  • 1. Review one portfolio in pairs
  • 2. Determine how well it aligns with each criteria

OUR GOAL

slide-43
SLIDE 43

43

  • Identify which portfolio components will be

examined

  • Are there documents that are not relevant?
  • Organize the components to be assessed

IDENTIFY RELEVANT COMPONENTS

slide-44
SLIDE 44

44

  • Does it look complete?
  • Is anything missing?
  • If so, what?

PORTFOLIO COMPLETENESS

slide-45
SLIDE 45

45

  • Where does each component fit within the six

criteria?

  • How well does it align with learning outcomes?

ALIGNMENT TO CRITERIA

slide-46
SLIDE 46

46

  • Do the Components:

REVIEW AND SCORE

  • Show clear evidence of mastery of

course learning outcomes & competencies?

  • Align with Rubric expectations?
slide-47
SLIDE 47

47

  • Were there any borderline scores?
  • How will you deal with this?

BORDERLINE/INCOMPLETE PORTFOLIOS

slide-48
SLIDE 48

48

  • Review original assessor’s ratings
  • Do you agree with their rationales for scoring?
  • Based on these, will you change your scores?

ORIGINAL ASSESSOR’S SCORES

slide-49
SLIDE 49

Learning Activity 6:

Facilitating a Workshop Facilitating a Workshop

Pairs: Role

  • playing

49

slide-50
SLIDE 50

50

  • To prepare you to facilitate a training session on your

campus.

OUR GOAL

slide-51
SLIDE 51

51

  • Follows same format as Participant manual
  • More information to assist in leading a workshop

THE FACILITATOR’S MANUAL

slide-52
SLIDE 52

52

Manual “Key”: Provides overview and visual cues

KEY

slide-53
SLIDE 53

53

Icons: Indicate modes and materials

KEY

slide-54
SLIDE 54

54

Learning Activities: Descriptive headings are numbered

KEY

slide-55
SLIDE 55

55

Format: Indicates large to small group activity

KEY

slide-56
SLIDE 56

56

Time: Estimates time needed to complete an activity

KEY

slide-57
SLIDE 57

57

Materials: List of what you will need for the activity

KEY

slide-58
SLIDE 58

58

Portfolio Components: Lists the name of the portfolio or components to be used

KEY

slide-59
SLIDE 59

59

PowerPoint: Lists the name of the PowerPoint to be used

KEY

slide-60
SLIDE 60

60

Overview: List of what will be covered

KEY

slide-61
SLIDE 61

61

Learning Objectives: LO’s for that activity

KEY

slide-62
SLIDE 62

62

Narration/Instructions: Separated into two columns

KEY

slide-63
SLIDE 63

63

Script: Text that facilitator will

  • say. Boldface indicates

instructions and normal type is to be read out loud

KEY

slide-64
SLIDE 64

64

Slide: Column on right contains thumbnails of associated slides

KEY

slide-65
SLIDE 65

65

Consistent Organization: For each Learning Activity

LEARNING ACTIVITES

slide-66
SLIDE 66

66

QUESTIONS?

slide-67
SLIDE 67

67

  • Work in pairs
  • Take turns as Facilitator using Activity #5
  • Portfolio Evaluation List can be used as reference
  • Main facilitator will circulate to assist you and answer

questions

ROLE PLAYING ACTIVITY A

slide-68
SLIDE 68

68

  • Discuss and review
  • Questions and comments
  • How may we improve on this activity?

WRAPPING UP ACTIVITY A

slide-69
SLIDE 69

69

  • Work in pairs
  • Switch roles and use Activity #5
  • Portfolio Evaluation List can be used as reference
  • Main facilitator will circulate to assist you and

answer questions

ROLE PLAYING ACTIVITY B

slide-70
SLIDE 70

70

  • Discuss and review
  • Questions and comments
  • How may we improve on this activity?

WRAPPING UP ACTIVITY B

slide-71
SLIDE 71

Learning Activity 7:

Workshop Wrap Up Workshop Wrap Up

Entire Group

71

slide-72
SLIDE 72

LET’S REVIEW THE MAIN POINTS

72

You have accomplished the following:

  • Explained a rubric and its

use

  • Recalled and understood

the components and structure of the rubric

  • Identified the

characteristics of an effective portfolio

  • Discussed and employed

the rubric rating and scoring system

  • Interpreted the individual

rating components and associated rating scale

  • Practiced applying the

rubric grid on a sample portfolio

  • Examined and appraised

both good and bad sample portfolios using the rubric

  • Evaluated and justified

your review and scoring of sample portfolios

slide-73
SLIDE 73

73

This is the time to ask remaining questions you may have

FINAL QUESTIONS?

slide-74
SLIDE 74

Final Activity 8:

Workshop Evaluation & Post test Workshop Evaluation & Post test

Individually

74

slide-75
SLIDE 75

Place your screenshot here

POST TEST

Three-part assessment

  • 1. Workshop evaluation
  • 2. Rubric knowledge
  • 3. Portfolio evaluation

75

slide-76
SLIDE 76

76

Link to assessment: (Link here)

WHAT YOU’LL NEED

  • Computer
  • Link to assessment
  • Rubric,
  • Portfolio (name/number here)
  • Portfolio evaluation list
slide-77
SLIDE 77

THANKS!

Any questions?

Remember to take both manuals with you once you’ve completed the assessments

7777

slide-78
SLIDE 78

Licen ensing s state atemen ent a and D DOL d L discla laimer er

This workforce solution was funded by a grant awarded by the U.S Department of This workforce solution was funded by a grant awarded by the U.S Department of Labor’s Employment and Training Administration. The solution was created by the Labor’s Employment and Training Administration. The solution was created by the grantee and does not necessarily reflect the official position of the U.S Department of grantee and does not necessarily reflect the official position of the U.S Department of

  • Labor. The Department of Labor makes no guarantees, warranties, or assurances of
  • Labor. The Department of Labor makes no guarantees, warranties, or assurances of

any kind, express or implied, with respect to such information, including any any kind, express or implied, with respect to such information, including any information on linked sites and including, but not limited to, accuracy of the information on linked sites and including, but not limited to, accuracy of the information or its completeness, timeliness, usefulness, adequacy, continued information or its completeness, timeliness, usefulness, adequacy, continued availability, or ownership. availability, or ownership.

78

This work is licensed under the Creative Commons This work is licensed under the Creative Commons Attribution 4.0 International License. It is attributed to Attribution 4.0 International License. It is attributed to Ohio TechNet. To view a copy of this license, visit Ohio TechNet. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ http://creativecommons.org/licenses/by/4.0/

slide-79
SLIDE 79

79

CONTACT INFORMATION CONTACT INFORMATION

Bowling Green State University Barb Henry Lorain County Community College: Carrie Delaney (cdelaney@lorainccc.edu) Karin Hooks (khooks@lorainccc.edu) University of Cincinnati Maureen Schomacher