A case for Learning and A case for Learning and U sing the - PowerPoint PPT Presentation

A case for Learning and A case for Learning and U sing the Standards U sing the Standards Joint Committee on Standards for Educational Joint Committee on Standards for Educational Evaluation Evaluation Arlen Gullickson Gullickson, Chair , Chair Arlen Presented to ERCB Conference at Tunica Presented to ERCB Conference at Tunica February, 2006 February, 2006

The Joint Committee on The Joint Committee on Standards for Educational Standards for Educational Evaluation Evaluation � AAC AAC � � ASCD ASCD � � AEA AEA � � AIHEC AIHEC � � AERA AERA � � CCSSO CCSSO � � NSBA NSBA � � NAESP NAESP � � CSSE CSSE � � NLPES NLPES � � AASA AASA � � CES CES � � NCME NCME � � CREATE CREATE � � APA APA � � NEA NEA �

Mission Mission The Joint Committee is incorporated The Joint Committee is incorporated exclusively for setting evaluation exclusively for setting evaluation standards and promoting their use… … standards and promoting their use The standards it creates are certified The standards it creates are certified as American National Standards as American National Standards

Purpose- -objectives objectives Purpose � Provision of Provision of training and technical training and technical � assistance assistance � Research and development Research and development associated associated � with the interpretation and use of the with the interpretation and use of the standards standards � Dissemination Dissemination of and clearinghouse for of and clearinghouse for � information information � Revision Revision of the Standards as needed, and of the Standards as needed, and � expansion of their use in new directions expansion of their use in new directions

Who developed these Who developed these standards? standards? � Joint Committee Joint Committee – –members representing members representing � practitioners and researchers practitioners and researchers � Hundreds of teachers, administrators, Hundreds of teachers, administrators, � board members and others involved in board members and others involved in evaluation evaluation � National Panel of Writers appointed by National Panel of Writers appointed by � Committee Committee � Validation Panel Validation Panel �

A few assertions to show why A few assertions to show why these standards are so important these standards are so important

In Cognition In Cognition Evaluation is ranked as the highest, most complex skill (Bloom’s Taxonomy)

IN EDUCATION Everyone evaluates! Everyone evaluates!

IN EDUCATION Everyone thinks their own evaluative judgments are sound A majority don’t know that their evaluative judgments are sound

IN EDUCATION When evaluations are conducted and used in sound ways they can be of substantial benefit

IN EDUCATION When evaluations are conducted in unsound ways they can be extremely detrimental to all affected parties

IN EDUCATION Knowledge and use of the evaluation standards can make all the difference in assuring sound rather than unsound evaluations–whether you are the evaluator, evaluatee, or just a concerned stakeholder

Standards Books & Chronology of Standards Books & Chronology of Development Development � Program Evaluation Standards Program Evaluation Standards � � 1981, 1994 1981, 1994 � rd edition currently under revision � 3 3 rd edition currently under revision � � Personnel Evaluation Standards Personnel Evaluation Standards � � 1988 1988 � nd edition currently under revision � 2 2 nd edition currently under revision (See (See � jc.wmich.edu— —Field Trial Materials) Field Trial Materials) jc.wmich.edu � Student Evaluation Standards Student Evaluation Standards � � 2003 2003 �

Purpose and Use of Standards Purpose and Use of Standards � To To improve practice improve practice of educational of educational � evaluation (program, personnel and evaluation (program, personnel and student) student) � To present criteria for judging To present criteria for judging evaluation evaluation � plans , , procedures and reports procedures and reports plans � To provide guidelines for institutions To provide guidelines for institutions � concerned with education (pre- -K through K through concerned with education (pre graduate schools) graduate schools) � To reduce errors and poor evaluation To reduce errors and poor evaluation � practices practices

Who Can Use the Standards Who Can Use the Standards � School School Boards and Superintendents to Boards and Superintendents to � select, monitor, and implement plans select, monitor, and implement plans � Administrators Administrators to implement plans to implement plans � � K K- -16 16 educators to inform their practice educators to inform their practice � � Researchers/consultants Researchers/consultants to develop plans to develop plans � of education evaluation of education evaluation � Any person Any person involved in or affected by involved in or affected by � educational evaluation educational evaluation

Definitions by Joint Definitions by Joint Committee… … Committee � Standard: Standard: � � “ “Principle commonly agreed to by people Principle commonly agreed to by people � engaged in the professional practice of engaged in the professional practice of evaluation for the measurement of the evaluation for the measurement of the value or the quality of an evaluation” ” value or the quality of an evaluation ( Joint Committee, 1981)

Standards’ ’ Substance Substance Standards � Standards serve 4 attributes of sound Standards serve 4 attributes of sound � evaluation: evaluation: � Propriety Propriety � � Utility Utility � � Feasibility Feasibility � � Accuracy Accuracy �

Components of a Standard Components of a Standard Statement of the Standard Statement of the Standard 1. 1. Explanation Explanation 2. 2. Rationale Rationale 3. 3. Guidelines for application Guidelines for application 4. 4. Common errors Common errors 5. 5. Illustrative cases with discussion Illustrative cases with discussion 6. 6. Supporting documentation Supporting documentation 7. 7.

Propriety Standards Propriety Standards Propriety Standards help to ensure that Propriety Standards help to ensure that evaluations will be conducted legally, conducted legally, evaluations will be ethically, and with due regard for the welfare ethically, and with due regard for the welfare of those involved in the evaluation, as well of those involved in the evaluation, as well as those affected by its results. as those affected by its results.

Propriety Standards Propriety Standards Student Program Student Program � P1 Service to Students P1 Service to Students � P1 Service Orientation P1 Service Orientation � � � P2 Appropriate Policies P2 Appropriate Policies � P2 Formal Agreements P2 Formal Agreements � � and Procedures and Procedures � P3 Rights of Human P3 Rights of Human � � P3 Access to P3 Access to Subjects Subjects � Evaluation Information Evaluation Information � P4 Human Interactions P4 Human Interactions � � P4 Treatment of P4 Treatment of � � P5 Complete and Fair P5 Complete and Fair � Students Students Assessment Assessment � P5 Rights of Students P5 Rights of Students � � P6 Disclosure of P6 Disclosure of � � P6 Balanced P6 Balanced Findings Findings � Evaluation Evaluation � P7 Conflict of Interest P7 Conflict of Interest � � P7 Conflict of Interest P7 Conflict of Interest � � P8 Fiscal Responsibility P8 Fiscal Responsibility �