2017-18 Non Public Test Security Training Office of the State - - PowerPoint PPT Presentation

2017-18 Non Public Test Security Training

January 26, 2018

Office of the State Superintendent of Education

2

Agenda

• Test Security
• ACCESS for ELLs
• Alternate Assessments
• PARCC

Test Security

2017-18

4

Test Security Agenda

• Overview of Test Security and Integrity in the District
• Roles and Responsibilities
• Before Testing

– School Test Security Plan

• During Testing

– Test Environment and Prohibited Actions

• After Testing

5

Test Security Objectives

Non Public Test Coordinators will be able to:

• locate DC test security laws and guidance and be aware of new

policy changes

• differentiate roles, responsibilities, and requirements by State, LEA,

and School level as defined by the DC Test Integrity Act

• understand what the LEA and Non Public School are required to do

before, during, and after testing

• identify the characteristics of a strong and robust School Test Plan

(STP) and submit STPs in the new QuickBase Application format

• understand how to create a secure testing environment and be

aware of prohibited actions for test administration

6

• All test security forms and guidelines are posted at:

–https://osse.dc.gov/service/test- security-and-incident-forms

• Additional training materials and resources are posted at:

–https://osse.dc.gov/page/test- coordinators-training Materials for this Training

Overview of Test Security and Integrity in the District

Vision for Test Security

OSSE’s goal is for schools and local education agencies (LEAs) to deliver a uniform and equitable statewide assessment program. For assessments to yield fair and accurate results the assessments must be administered in consistent and standardized conditions; the best way to ensure that

• ccurs

is to ensure educators understand and recognize acceptable and unacceptable assessment practice.

8

9

Test Security 2018: Important Dates

Task Date(s)

OSSE Non Public Test Security Training

• January 26, 2018

School Test Plans Due to OSSE

• 15 business days prior to the first

day of the testing window Statewide Testing Windows

• ACCESS for ELLs 2.0: February 26 –

April 13 2018

• MSAA: March 19 – May 4, 2018
• PARCC: April 9 – May 25, 2018

Monitoring During Testing

• Ongoing throughout the assessment

window Affidavit Submission Due Date

• 10 days after the last day of test

administration

10

• Partnership for Assessment of Readiness for College & Careers

(PARCC)

– Subject(s): English language arts/literacy and mathematics

• Grades/Courses: Yearly in grades 3-8 and one assessment in high school
• Multi-State Alternate Assessment (MSAA)

– Subject(s): English language arts/literacy and mathematics – Grades/Courses: Yearly in grades 3-8 and in grade 11

• ACCESS for ELLs 2.0

– Subject(s): English language proficiency – Grades/Courses: Grades K-12

Statewide Assessments for 2018

11

Laws, Regulations, and Compliance Documents:

• Testing Integrity Act of 2013
• Testing Integrity Act Amendments in 2015
• District of Columbia Test Security Guidelines for 2017-18
• Assessment Test Coordinator and Administrator Manuals

All reference documents are posted on OSSE’s Test Security Website:

• http://osse.dc.gov/service/test-security-and-incident-forms

Key Test Integrity Documents

12

Key components of the Test Integrity Act of 2013 include:

• Definition of key terms and roles
• LEA and school requirements
• OSSE requirements
• Prohibitions, sanctions, and appeals

Testing Integrity Act of 2013

13

Key changes in the Test Integrity Act Amendments in 2015:

• Further defines Districtwide assessments as those used for

accountability

• Shifts test plan creation and submission from LEA to school level

responsibility

• Shifts test plan submission from 90 days to 15 days prior to

assessment

• Requires OSSE to approve test plan 5 days prior to assessment
• Allows use of approved electronics for testing
• Requires OSSE to provide training and guidance 45 days prior to

testing

• Shifts NDA from signed agreement to distributed notification

statement

Testing Integrity Act Amendments 2015

14

Key components of the Test Security Guidelines:

• Minimum requirements for maintaining strict test security procedures
• Explanation and additional details stipulated in the Test Integrity Act

and Amendments – OSSE role and responsibilities – LEA role and responsibilities – School responsibilities – Testing environment and exceptional circumstances – Monitoring and auditing test security

Test Security Guidelines

15

Key updates to 2017-2018 Test Security Guidelines

• ACCESS for ELLs 2.0 assessment now considered a statewide

assessment

• School Test Security Plan requirement changes
• Additional guidance provided in the following areas:

– Special circumstances for MSAA and ACCESS for ELLs 2.0 administration – Prohibited Actions – Secure and Active Proctoring

Test Security Guidelines: 2017-2018 Updates

16

Test Coordinator/Administrator Manuals are available for:

• PARCC
• MSAA
• ACCESS for ELLs 2.0

Assessment manuals provide:

• Critical instructions for Test Coordinators, Technology

Coordinators, and Test Administrators Procedures and protocols to complete before, during, or after administration

• All manuals can be found at: https://osse.dc.gov/page/test-

coordinators-training

Test Coordinator and Administrator Manuals

Roles and Responsibilities

Enter Heading

OSSE, LEAs, and Schools each have unique roles and responsibilities to ensure there is consistent and secure districtwide test administration.

18

• Establish policy, regulations, and

guidelines

• Train/support LEAs & schools
• Review and approve School Test

Plans

• Monitor Statewide testing
• Conduct test integrity review
• File School Test Plans w/OSSE
• Monitor Statewide testing
• Report/investigate breaches
• Collect and submit affidavits

OSSE Responsibilities

High-Level Test Security Responsibilities

LEA Responsibilities Non Public School Responsibilities

• Create/submit School Test Plans to LEA
• Protect security of secure materials
• Administer and Monitor Statewide assessments
• Identify authorized personnel
• Train authorized personnel
• Distribute test integrity notification statement
• Maintain a test security file
• Ensure integrity of testing environment
• Report breaches of test security
• Sign/submit test security affidavits

• Authorized Personnel
• Test Integrity Coordinator
• Test Monitor
• Test Administrator
• Other roles:

– Test Proctor – Special Populations Coordinator – Technology Coordinator

Key Assessment Roles

19

Any individual who has access to statewide assessment materials or are directly involved in the administration of a statewide assessment. Requirements:

• Complete testing integrity training developed by OSSE
• Receive test integrity and security notification statement
• Report breaches of test security
• Cooperate in testing integrity and security investigations
• Refrain from prohibited activities
• Read all applicable directions and guidance

Authorized Personnel

20

The individual(s) designated by the LEA to be responsible for testing integrity and security for the LEA and all of the schools/campuses under its purview during the statewide assessment.

In 2017-2018 the LEA may designate up to three individuals to carry out the responsibilities

• ne for each assessment; PARCC/ DC Science, MSAA and ACCESS for ELLs 2.0.

Requirements:

• Designate, support, and train test monitors
• Attend testing security and integrity training
• Submit school test plans for each school/campus under the LEA’s purview
• Monitor test administration at schools
• Report any breach of testing security or deviation from test plan
• Investigate, document and report to OSSE any breach or deviation
• Sign, collect (10 days post) and submit (15 days post) testing integrity affidavit

Test Integrity Coordinator (LEA)

21

Individual designated by test integrity coordinator to be responsible for testing integrity and security for school/campus site. In 2017-2018 the LEA may designate up to three individuals to carry out the responsibilities, one for each assessment; PARCC, MSAA and ACCESS for ELLs 2.0. Requirements:

• Designate, support, and train all authorized personnel at school site on test

administration and security

• Attend testing security and integrity training
• Create and submit school test plan to test integrity coordinator
• Create and disseminate school test plan
• Oversee security of all secured materials while in school
• Support authorized personnel administering the test
• Sign and submit affidavits to test integrity coordinator post-testing

Test Monitor (Non Public School)

22

Individuals identified by the test monitor to be responsible for administering the assessment to students. Requirements:

• Conduct the testing sessions as outlined in the appropriate test administrator

manuals

• Establish the testing climate within the test location
• Coordinate the distribution and return of testing materials to and from

students

• Ensure that students who require accommodations receive the appropriate

accommodations in TA’s testing group

• Account for and maintain the security of all test materials under TA’s purview

Test Administrator (TA)

23

Test Proctor

• Assist test administrator with test administration and classroom management, work

under their supervision

• May administer accommodations
• May be a volunteer

Special Populations Coordinator

• Assists the Test Monitor in identifying and documenting all testing accommodations

needed for students

• Trains test administrators to administer accommodations
• Monitors testing for the correct and secure implementation of accommodations
• Coordinates alternate assessments (if applicable to school)

Technology Coordinator

• Assists the Test Monitor in preparing administrator and student devices for secure

testing according to vendor directions

• Troubleshoots any technology problems that may arise

Other Roles

24

Before Testing

Key Before Testing Tasks

OSSE LEA School

• Issue testing security

standards

• Train on testing security

standards

• Issue testing security

and integrity notification statement to LEAs

• Review and approve

school test plans

• Establish standards for

test monitoring

• Identify authorized

personnel

• Collect and submit

school test plans to OSSE

• Distribute testing

security and integrity notification

• Attend Training
• Establish and submit to

LEA the school test plan

• Receive test materials
• Inventory test materials
• Distribute test materials
• Review all test manuals
• Conduct test

administration and security training

• Develop and maintain

Test Security Files

• Prepare technology to

create secure environment

• Notify students and

families of testing

26

27

• Notification must be distributed to all authorized personnel

involved in Statewide testing prior to access of secure test materials or administration.

• Notification statement includes a list of requirements and

responsibilities for all authorized personnel.

• Signatures and submission to OSSE are not required.
• Notification statement has been posted to OSSE’s website

here: http://osse.dc.gov/service/test-security-and- incident-forms

Test Security and Integrity Notification Statement

28

OSSE is responsible for developing training for test integrity and security. Attendance at OSSE Test Security Training is required for all Non Public School Coordinators.

• Non Public Coordinators training responsibilities include:

– Train test monitors and all authorized personnel at LEA/school in State, LEA, and school policy and procedures – Training must include:

• Distribution of Testing Integrity and Security Notification

Statement to all authorized personnel

• Review of School Test Plan
• Review of Test Security Guidelines
• Review of Test Administration Procedures
• Review of vendor-supplied testing manual(s)

Test Security Training

29

Who requires training?

– Test Monitors – Test Administrators – Test Proctors – Authorized Personnel

How should training be documented?

– The following may be placed in the school’s Test Security File:

• Training Materials
• Sign-In Sheets
• Statewide Testing Integrity and Security Notification
• Statement Distribution Roster (signatures not required)

Test Security Training (continued)

30

All Test Coordinators and Test Administrators are responsible for reviewing and implementing the guidance in the vendor- supplied assessment administration manuals – PARCC Test Coordinator and Administrator Manuals – MSAA Test Administration Manual

Reviewing Guidelines and Resources

School Test Security Plan

32

School Test Security Plan

OSSE requires each school to provide the following information in a school test plan:

– Names and contact information for test coordinators and key

personnel

– Assessments associated with the school plan* – Secure Materials Management – Reporting Irregularities – Irregularities Investigations – Prohibited Actions – Logistics – Assurances – PearsonAccessNext Test Sessions and Test Administrators – A list of authorized personnel – A detailed testing schedule

* Each school may have up to three test security plans, one for each assessment (PARCC/DC Science, MSAA, and ACCESS for ELLs 2.0). If the school decides to submit one plan for all assessments the plan will be due 15 business days prior to the earliest assessment.

33

School Test Plan: OSSE Approvals/Feedback

The school plan serves as your official communication with OSSE

• n your plan for administering districtwide assessments and, OSSE

monitors will visit schools during testing and assess the accuracy of your plan. School plans must be submitted to OSSE for final approval at least 15 business days prior to the first day of testing. OSSE reviews and approves all school plans and provides technical assistance to schools whose plans need improvement prior to and during testing.

School Test Security Plan (cont.)

• Succinct
• Clear
• Organized
• Thoughtful
• Thorough

Characteristics of a weak school test security plan

• Difficult to follow
• Incomplete
• Not thoughtfully prepared
• Generic Responses

34

Characteristics of a strong school test security plan

TEST SECURITY PLAN WALKTHROUGH https://octo.quickbase.com/db/bmiq8feda

35

36

Non Public Test Coordinator Homepage

• Links to important test security

documents

• Instructions on how to access

test plans

• Click ”New Test Plan” to add a

new test plan

37

Support Documents

• 2018 School Test Security Plan

Instructions

• 2018 Test Security File Documents
• 2018 TS Training Attendance

(Optional)

38

Assessments and Start and End Dates

School test security plans include PARCC, DC Science, MSAA and ACCESS for ELLs 2.0. Schools should select all of the tests the plan is designed to cover. Schools are encouraged to submit separate plans for each assessmentsuite. Once the assessment(s) are selected, the application will ask for start and end dates for each assessment. The start day entered will be used to calculate the test plan due date.

39

General Information

• Select the Non Public School from the

School Name Field

• Double Click the “Related LEA” spaces

to select the LEA(s) your test plan will need to have approved

40

General Information

• Enter all LEA and School user

information for the assessment selected

41

Secure Materials Management

• Complete all answers in this section
• Toggle of the yellow “i” throughout

the plan to see example responses or helpful hints.

42

Reporting Irregularities

• Complete all answers in this section
• In the fields that allow you to select

more than one choice, make sure to check all that apply

43

Irregularities Investigations

Make sure to complete all answers in this section

44

Prohibited Actions

Only select ”yes” if your school has additional prohibited actions.

45

Logistics

• Make sure to include name and title
• Answer these questions thoughtfully

and thoroughly

46

Assurances

New for 2017-2018 test administration, assurances are updated so that LEAs must provide an assurance that all trainings will occur before the first day of testing. This is a change from 2016-2017 that required all assurances to be completed before submission of the test security plan.

47

PearsonAccessNext

Before submitting a test security plan, test sessions and test administrators must be added to the PearsonAccessNext system. Only check this box if all student tests have been assigned to a test session and a test administrator.

48

Authorized Personnel and Test Schedule

• Click on hyperlinks to download file

formats for each attachment

• Edits, Amended , or Additional

attachments can be added in attachments 2-6 of each file

49

After School Plan Submission

Once a school test security plan is approved, portions of the plan will be locked. The “After School Plan Submission” and “Authorized Personnel and Test Schedule” sections will remain active and allow test coordinators to communicate with OSSE about minor deviations in their plan. Please not for train please select “Training” for the status so OSSE does not review the exemplar.

50

Notify Students and Families

Students Families

• Prepare students to participate in

the PARCC/DC Science or MSAA/DC Science Alternate

• Provide opportunities for practice
• Explain purpose and dates of

testing

• Encourage positive attitudes about

testing

• Ensure accommodations are

identified

• School/LEA must provide families

with a letter regarding the dates and purpose of the statewide assessments

• Copies of letters sent home must

be kept on file for the test monitor’s review

• A template with English and other

translated versions of the letter will be available on the OSSE website for school use

https://osse.dc.gov/publication/assessments-parent-letter- template

During Testing

Key During Testing Tasks

OSSE LEA School

• Support test integrity

coordinators and test monitors

• Monitor assessment

administration at school sites

• Support test monitors
• Monitor assessment

administration at school sites

• Maintain hard copy

school security file

• Follow school test plan
• Administer assessment
• Document handling of

secure materials on chain of custody form

• Follow the test

directions

• Actively monitor and

manage test environment

• Report irregularities,

incidents and/or breaches of security

52

53

• School test security files must contain:
• School test plan(s)
• Documentation of any changes to or deviations from school test plan(s),

including records of make-up test groups

• Training attendance sheet
• Copies of all incident forms
• Documentation of all irregularities
• Documentation of recommendations for invalidated student scores
• Chain-of-custody documentation: receipt and return of secure test materials
• Test administration concerns/notes
• Signed test security affidavits
• Parent notification letter and accommodations notification letter
• School test security hard copy files must be kept on file for four

years

Maintaining a Test Security File

54

• Document minor deviations from the testing plan in the School Security

File

• Submit incident reports via:

– OSSE website or phone at (202) 304-3269

• Non Public Test Coordinators, Any authorized personnel, all
• thers
• All forms are posted online here: http://osse.dc.gov/service/test-

security-and-incident-forms

Reporting Test Irregularities/Incidents

55

The following should be documented with an incident report:

– Student becomes ill or injured and cannot complete a testing session they have already started – Student or staff member is in possession of a cell phone/unauthorized device or uses said device in an active testing environment – Students and/or staff take actions that could constitute as cheating/coaching – Students and/or staff are in possession of materials that could constitute as cheating – Secure testing materials are lost of left unsupervised – Student does not receive the appropriate accommodations – All students must leave the testing environment due to an emergency or drill – A technical issue causes students to not complete an active testing session before the close of a school day

The following do not need to be documented with an incident report:

– Technical issues that cause minor delays in test timing for a student or group of students – Assigning a student a different device during testing – Student behavior that does not disrupt a test session or interfere with that student, or other students, completing the test session (e.g., one student is relocated but able to complete testing) – Substituting test administrators and/or proctors

When to Submit an Incident Report

56

• OSSE and Non Public Test Coordinators are responsible for

monitoring test administration

• Statewide Assessment Auditor General Observation Checklist
• The Statewide Assessment Auditor General Observation Checklist

will be posted on OSSE’s website here: http://osse.dc.gov/service/test-security-and-incident-forms

Test Administration Monitoring

57

• During testing, Non Public Coordinators are responsible

for: – Investigating, documenting, and reporting to OSSE any findings and recommendations for remediation of a failure of the test security plan or other test integrity/security protocol

Non Public Test Security Reporting

Test Environment and Prohibited Actions

60

• Wall displays with tested content or test taking strategies must

be removed/covered in testing room, hallways, stairwells, bathrooms, etc. throughout testing.

• Displays must be covered prior to the first day of testing and

remain covered for the duration of active statewide assessments.

Non-Permissible Bulletin and Wall Displays

61

Recommendations for Testing Environment:

– Seat students in every other seat – Arrange monitors back-to-back – Seat students back-to-back – Seat students in a semi-circle – Seat students in widely spaced rows or in every other row

Special Considerations

– Test students in a one-on-one setting in the following circumstances:

• If the student requires the human scribe accommodation on

any assessment

• Complete the speaking unit of ACCESS for ELLs 2.0

Room Setup

62

• Test administrators must follow the closeout protocol detailed in

the TAM for each student. TAs are to read the script and/or provide the student the closeout instructions handout.

– TAs are not permitted to tell/ask students to check their work. – Sample approved statement: “Are you finished and ready to close

• ut your test?”
• Test administrators may dismiss students or students may sit

quietly or read books/complete activities not related to the assessed subject.

– Examples: Crossword puzzle after math; Sudoku puzzle after ELA

• Test materials must be collected by the test administrator or

proctor prior to the student receiving any other materials.

Closeout Procedures and Materials After Tests

63

• Cell phones may not be used in the testing environment by students or test

administrators.

• During the administration of paper based tests, no cell phones may be in the

testing environment at any point during testing.

• During the administration of computer-based tests, school test monitors and

school technology coordinators may use cell phones for technical support

• If a student or students’ testing device(s) experiences technical problems that

prevent the student(s) from normal continuation of testing, the test administrator must alert the test monitor and technology coordinator.

• All technical problems and delays which significantly impact the administration of

the assessment must be reported and documented by the test monitor as an incident through the incident reporting protocol.

Cell Phones and Prohibited Electronics

64

• Grade-level appropriate calculators will be available on the test platform on

calculator sections of mathematics units for computer based tests.

• Students may use hand-held, grade appropriate calculators on calculator sections
• f assessments.
• No calculators are allowed on non-calculator sections, except when specified by a

student’s IEP.

• Test administrators must confirm that calculator memories have been cleared.
• Prohibited calculating devices:

– Calculators with College Algebra System (CAS) features; – Tablets, laptops or personal digital assistants (PDAs) or phone-based calculators, except those that are being used as devices for computer-based testing; and – Calculators and electronic devices with “QWERTY” keyboards, except where expressly mandated by an IEP or Section 504 plan.

Use of Calculators and Devices

65

Individual statewide assessments may permit additional support materials, which will be specified in the testing manual if permitted. In the event that additional support materials are permitted:

• Additional support materials must be located in a pre-determined location in

the testing room;

• All guidance and instructions regarding additional support materials must be

followed; and

• If schools allow students to bring their own permissible/specific support

materials, they must be given to the school test monitor or test administrator prior to testing to ensure that the tools are appropriate for testing (e.g., tools do not have any writing or pre-stored information on them).

Support Materials

66

• Dictionaries or thesauruses
• Bilingual, word-to-word

dictionaries, without definitions, phrases, sentences, or pictures, are an allowable accommodation for English Learner (EL) students)

• Any unauthorized resource or

reference material that defines, explains, or illustrates ELA terminology or concepts or

• therwise provides unauthorized

assistance during testing. English Language Arts/Literacy

• Mathematical formulas and

conversion tables other than the grade-specific, vendor-supplied material

• Mathematics Reference Sheets
• ther than the grade-specific,

vendor-supplied material.

• Any resources that define, explain,
• r illustrate mathematical

terminology or concepts or

• therwise provides unauthorized

assistance during testing;

• Non approved or unauthorized

calculators Mathematics

Prohibited Materials

67

• It is a violation of test integrity if a student does not receive their

appropriate testing accommodations or if a student receives an accommodation they are not entitled to.

• Students need to be familiar and comfortable with all necessary

accommodation(s) BEFORE the assessment – practice tests and tutorials are a resource.

• Any unique/non-standard accommodations not included in the manuals

for an assessment must be approved by OSSE prior to their use on statewide tests.

• An emergency accommodations form will be available online for

temporary accommodations in the event of student injury (e.g. a scribe for a student with a broken wrist).

Test Integrity and Accommodations

68

• Absences/Makeups

– Makeup testing should be included in the schedule in the School Test Plan. – Schools may schedule makeup tests across grades/subjects in the same room, but timing should be the same. – Students are not allowed to return to a testing session which they have exited after starting (except if approved by OSSE).

• Homebound students

– Homebound students must participate in testing. – Test monitor works with test integrity coordinator and notify OSSE in the School Test Plan.

• Testing at alternative sites

– All eligible public school students must participate in testing. – Test monitor works with test integrity coordinator and OSSE.

Exceptional Circumstances

69

• Homeschool students

– Homeschool students in public education must participate in testing. – Test monitor works with LEA on participation and notifies OSSE in School Test Plan.

• Significant medical emergencies

– May apply for Medical Exemption with support from physician. – School may apply to OSSE for an exemption using the Medical

Exemption Form.

• Weather, Natural Disaster, Fire Alarm or School-wide Emergency

– If there is a school-wide emergency requiring evacuation, follow the

LEA/school-wide emergency protocol.

– Student safety first, then document and submit an incident report to

OSSE.

Exceptional Circumstances

70

LEAs must ensure that all eligible students enrolled at their LEA, including students in non-public settings participate in statewide assessments. Non-publics are considered a school/campus under the purview of the LEA. Non-public requirements:

• Compliance with Testing Integrity Act of 2013, Amendment of 2015,

Test Security Guidelines and vendor manuals

• Creation and submission to LEA of enrollment School Test Plan for

students at that site

Non-Public Placements

72

Under the Testing Integrity Act of 2013, all authorized personnel are prohibited from: – Test Fraud: Academic Coaching – Cheating – Test Tampering Failure to comply with the prohibitions are considered violations of test security.

Authorized Personnel and Prohibited Actions

73

Reviewing, reading, or looking at test items or student responses before, during, or after administering the Statewide assessment, unless specifically permitted in the test administrator’s manual

• There should be no interaction with the content on any secure assessment by

an authorized personnel.

• Authorized personnel should not look at or review any test content or student

responses (including on scratch paper).

Assisting students in any way with answers to test questions using verbal or nonverbal cues before, during, or after administering the assessments

• Examples may include:

– Answering test or content-specific questions from students – Interacting in any way with student responses, including on scratch paper – Providing verbal or nonverbal cues to indicate performance (e.g., “good job,” “check your work,” shaking head)

TI Act Violations: Test Fraud/Coaching

74

• Allowing any form of cheating
• Failing to actively supervise students at all times during test sessions
• Allowing students to view or practice secure test items before or after

the scheduled testing time

• Using or allowing students use of unapproved electronics or cell phone

during the administration of a Statewide assessment

• Allowing students to use notes, references, or other aids, unless the

test administrator’s manual or an approved accommodation specifically allows

TI Act Violations: Cheating

75

• Altering student responses in any manner
• Photocopying, or in any way reproducing , or disclosing secure test

items or other materials related to Statewide assessments

• Altering the test procedures stated in the formal instructions

accompanying the Statewide assessments

• Having in one’s personal possession secure test materials except during

the scheduled testing dates and times

• Making or having in one’s possession answer keys before the

administration of the Statewide assessment; except that it shall not be prohibited to have an answer key for a Statewide assessment that has already been administered and released by OSSE

TI Act Violations: Test Tampering

76

• Leaving secure test materials in a non-secure location or unattended by

authorized personnel

• Making a false certification on any Statewide assessment forms

established and required by OSSE

• Being present in the test environment or handling the test materials for
• ne’s own child or family member
• Failing to count all test booklets and answer documents before allowing

any pupil to leave the testing room and/or to ensure that all pupils have properly logged off the computer system

• Failing to observe the test material chain of custody procedures as
• utlined in the school test security plan.

TI Act Violations: Test Tampering (cont.)

77

Failure to comply with the prohibitions will not be considered a violation if an action is:

– Necessary to provide for an accommodations explicitly identified in an IEP,

504 Plan, or EL Plan; or

– Limited to supporting students to stay on task and focused.

Supporting students to stay on task and focused includes:

– Announcements to entire testing group of time remaining on test – Announcements to entire testing group reminding students to stay on task – Announcements to entire testing group reminding students to abide by school and/or LEA rules and/or processes – Verbally, but with minimal disruption to other students, waking up a student who has fallen asleep while testing – Verbally, but with minimal disruption to other students, addressing an individual student’s disruptive behavior

Exceptions to Violations in TI Act

78

In addition to the guidance in the Testing Integrity Act, the assessment administration manuals clearly specify what can and cannot be said during secure testing. Test administrators are expected to follow the scripts provided in the assessment administration manuals. Test administrators and proctors may provide support to students with logging in. Technology coordinators may address technology issues such as computers freezing, batteries dying, student getting kicked off the platform.

– Note: This does not include guidance on how to use the accessibility features on the platform. Practice with the platform functionalities must be completed prior to testing.

Additional Test Administrator Guidance

After Testing

Key After Testing Tasks

OSSE LEA School

• Collect affidavits
• Verify data
• Sign affidavits
• Collect and submit

affidavits (from test monitors and test integrity coordinators) to OSSE within 15 days of the end of testing

• File and execute LEA plan
• f action in response to

any significant incidents deemed by OSSE as needing follow up response

• Package and return or

dispose of secure test materials as per vendor instructions

• Document any missing

materials and remaining incidents

• Sign and submit affidavits

(from Non Public test monitors only) to LEA test integrity coordinator within 10 days of end of testing

• Document any remaining

incidents

80

81

• Within 10 days after the conclusion of testing, Non Public

Test Coordinators and Test Administrators must: – Submit signed affidavits to all LEA Test Coordinators

• Within 15 days after the conclusion of testing, LEAs must:

– File with OSSE the signed affidavits

Affidavits

82

• OSSE reviews every allegation of test security violation to

determine the appropriate course of action.

• OSSE reviews test security protocols and data to ensure the

tests were administered with fidelity.

• OSSE establishes standards for the investigation of any alleged

violation of a law, regulation, or policy relating to testing security.

• LEAs are also required to investigate allegations of test security

violations and/or provide additional information to OSSE regarding allegations.

• New for 2016-17, LEAs have the opportunity to lead test

integrity investigations of their OSSE Identified schools.

Test Integrity Investigations

83

If an LEA, school, and/or individual knowingly and willingly violates the Testing Integrity Act, they may incur the following sanctions: LEA/School:

• Payment of expenses incurred as a result of the violation;
• Administrative fine; and/or
• Invalidation of test scores

Individual:

• Denial, suspension, revocation or cancellation of, or restrictions on

issuance or renewal of OSSE-issued license for a minimum of one year;

• Payment of expenses incurred as a result of the violation; and/or
• Administrative fine

Sanctions for Violations

Questions?

ACCESS for ELLs 2.0

2017-18 Test Administration

86

ACCESS for ELLs 2.0 Objectives

LEA Test Coordinators will be able to:

• identify ACCESS for ELLs 2.0 testing dates, administrative roles, and

testing platform

• describe ACCESS for ELLs 2.0 test administration procedures

87

ACCESS for ELLs 2.0Assessment

ACCESS for ELLs 2.0 is a secure large-scale English language proficiency assessment administered to Kindergarten through 12th grade students who have been identified as English Learners. It is given annually in WIDA Consortium member states to monitor students’ progress in acquiring academic English. WIDA English Language Development Standards Domains Listening Speaking Reading Writing

88

• Test Administrators (TAs)- are responsible for administering the Test to

students

• Test Coordinators (TCs)- are responsible for managing the administration of

the ACCESS for ELLs 2.0 Assessment

• TAs and TCs are responsible for reviewing the District of Columbia’s ACCESS

for ELLs Checklist located on www.WIDA.us

Who Can Administer ACCESS

89

Before Test Administration

• Log in to your WIDA account and agree to the Non-Disclosure and User Agreement
• Log in to WIDA AMS and agree to test security terms
• Watch all tutorials located in the Preparing dropdown menu in the ACCESS for ELLs

2.0 Training course

• Review the District and School Test Coordinator Manual
• Add new students to WIDA AMS and assign them test sessions
• Watch all tutorials located in the Testing dropdown menu in the ACCESS for ELLs 2.0

Training course

Test Coordinator Tasks

90

During Test Administration

• Coordinate ordering additional test materials if warranted
• Monitor student progress in WIDA AMS
• Securely store all test materials

Test Coordinator Tasks

91

After Test Administration

• View the After Testing tutorial located in the Afterward dropdown menu in

the ACCESS for ELLS 2.0 Training course

• Prepare any test materials to be returned to DRC

Test Coordinator Tasks

92

Before Test Administration

• Log in to your WIDA account and agree to the Non-Disclosure and User Agreement
• Log in to WIDA AMS and agree to test security terms
• Download and print the Test Administration Manual to become familiar with policies

and procedures

• Print any additional materials needed to administer the test
• Watch any tutorials located in the TEsting dropdown menu in the ACCESS for ELLs

2.0 Training course

Test Administrator Tasks

93

• Take the Online Administration Quiz

– Log in to www.WIDA.us – View the training modules for each test being administered – TAs must score an 80% or higher on each quiz – Training certificates will be updated as a record of completion

Test Administrator Tasks

94

Test Administrator Tasks

Click the training tile for the test you will be administering. You can only administer tests for trainings you have completed.

95

During Test Administration

• Monitor and supervise students during the testing session
• Distribute test tickets to students when they are ready to begin testing
• Follow directions provided in the manuals and scripts
• Collect and account for all test materials and return them to the TC

Test Administrator Tasks

96

After Test Administration

• View the After Testing tutorial from the Afterward dropdown menu in the

ACCESS for ELLs 2.0 Training course

• Work with the TC to ensure all testing materials have been collected and

returned

Test Administrator Tasks

Questions?

Alternate Assessments

2017-18 Test Administration

99

Alternate Assessment Objectives

LEA Test Coordinators will be able to:

• identify MSAA testing dates, administrative roles, and testing

platform

• describe MSAA test administration procedures

100

The Multi-State Alternate Assessment (MSAA) was developed to ensure that all students with significant cognitive disabilities are able to participate in an assessment that measures what they know and can do in relation to grade-level State Content Standards

Multi-State Alternate Assessment

Participation Criteria Criteria Descriptors The student has a significant cognitive disability A disability or multiple disabilities that significantly impact intellectual functioning and adaptive behavior The student in learning content linked to grade- level content standards Goals and instruction listed in the IEP for the student are linked to the enrolled grade-level content standards The student requires extensive, direct individualized instruction and substantial supports to achieve measureable gains in a grade-and age-appropriate curriculum

(a) extensive, repeated, individualized

instruction and support

(b) substantially adapted materials and

individualized methods

101

• Test Administrators (TAs)- are responsible for administering the Test to

students

• Test Coordinators (TCs)- are responsible for managing the administration of

the MSAA test

Who Can Administer the MSAA

Who can perform actions in the MSAA Online Assessment System?

102

Before Test Administration

• Complete the MSAA test administration training for TCs

– focuses on information in the Test Administration Manual (TAM) – helps safeguard testing integrity – TCs are not required to take the final quiz – www.msaaassessment.org

Test Coordinator Tasks

Module Module Title Module 1 MSAA Overview Module 2 Test Design and Experience Module 3 Completing the Student Information Module 4 Create Users and Orgs Module 5 Student Response Check and the Early Stopping Rule Module 6 Navigating the MSAA Online Assessment System

103

During Test Administration

• Monitor the administration of the Test
• Ensure that students and TAs have the proper materials and resources
• Maintain test security
• Report inappropriate test practices
• Report security violations and test irregularities to OSSE
• Ensure all tests have been submitted or closed by May 4, 2018

Test Coordinator Tasks

104

After Test Administration

• Securely shred all printed copies of the Test, Directions for Test

Administration (DTAs), scoring rubrics, and student work

• Ensure all items listed on the Test Coordinator Checklist are completed

Test Coordinator Tasks

105

Before Test Administration

• Activate TA account
• Complete the MSAA test administration training

– view the Online MSAA Test Administration Training Modules for TAs – complete the Final Quiz with an 80% accuracy score or higher

Test Administrator Tasks

Module Module Description Module 1 MSAA Overview Module 2 Test Design and Experience Module 3 Completing the Student Information Module 4 Accessibility Features and Accommodations Module 5 Student Response Check and Early Stopping Rule Module 6 Navigating the MSAA Online Assessment System

106

During Test Administration

• Read the DTA for the Test assigned to the student
• implement the DTA as written and complete test administration
• Provide accommodations as outlined in the Accessibility Features and

Accommodation section

• Maintain test security
• Report security violations and test irregularities to the TC

Test Adminstrator Tasks

107

After Test Administration

• Ensure all tests have been submitted and/or closed by the TC on May 4
• Complete the Accommodations: After Test Tab
• Complete the End of Test Survey (EOTS)

Test Administrator Tasks

108

When to Contact OSSE or MSAA

Test Administrators, Contact Test Coordinators when: You have questions you can’t find the answers to in the TAM “How do I…?” You do not have a user account The wrong name is associated with your account

You do not have the necessary MSAA System permissions to make your requested change

Test Administrators and Test Coordinators contact MSAA Service Center when: You have questions you can’t find the answers to in the TAM “How do I…?” You encounter an error or unusual behavior in the MSAA Online Assessment System

Provide the MSAA Service Center with: Contact information Student name Error message Operating system

Test Coordinators contact OSSE when: You do not have the necessary MSAA System permission to make your requested change You have state specific questions

Questions?

PARCC

2017-18 Test Administration

111

PARCC Objectives

LEA Test Coordinators will be able to:

• identify testing dates, administrative roles, and testing platform
• describe test administration procedures

PARCC

Partnership for Assessment of Readiness for College and Careers Grades Assessed 3-8 and once in high school Content Assessed English/Language Arts and Math 2018 Testing Dates April 9 – May 25

(Paper accommodation tests April 9- May 18)

Required Training Test Security Training for LEA Test Coordinators OSSE Contact Cassie Lynott, Cassie.Lynott@dc.gov Websites PARCC Pearson PARCC Website Pearson Access Next

112

113

PARCC Assessment Roles

LEA PARCC Coordinator

LEA Test Integrity Coordinator

School PARCC Coordinator

School Test Monitor SPED Coordinator Technology Coordinator Test Administrators Proctors Authorized Personnel

114

PARCC Test Admin. Responsibilities

LEA PARCC Coordinator

Confirm/Complete student registration

115

PARCC Test Admin. Responsibilities

School PARCC Coordinator

Create PAN accounts for authorized personnel Review PNP to ensure accommodations have been accurately entered Create test sessions in PearsonAccessNext and assign students to the appropriate test sessions Administer an infrastructure trial via the PAN training site Close all testing sessions when student testing is complete Destroy testing tickets and student scratch paper in accordance with PARCC policies Return test booklets and secure materials to Pearson in accordance with PARCC policies

116

PARCC Test Admin. Responsibilities

PARCC Technology Coordinator

Attend Pearson Technology Coordinator Training Webinar (recommended) Confirm school technology meets the requirements of the PARCC assessments Download new TestNav application update Setup proctor cache through PAN Administer an infrastructure trial via the PAN training site (optional) Provide technical support to School Test Coordinators during testing Delete proctor cached material after testing is complete

117

PARCC Test Admin. Responsibilities

PARCC Special Education Coordinator

Create policies for the equitable assignment of PARCC accommodations and accessibility features Complete the PNP for each student at the school Train Test Administrators who are administering accommodations and accessibility features Support Test Administrators and the School PARCC Coordinator during testing

118

PARCC Registration

Action Date/Deadline Resources

PearsonAccessNext Opened

• Jan. 12

PearsonAccessNext PARCC SR/PNP Field Definitions Guide (attached) PARCC SR/PNP Field Definitions Template (attached) PARCC Test Coordinator Manual PARCC Accessibility Features and Accommodations Manual 2017-18 OSSE Districtwide Assessments Participation Policy

Register high school students for PARCC

• Feb. 23

Verify PARCC registration for students in grades 3-8

• Feb. 23

Complete PNP for all students with accommodations

• Feb. 23

Complete PNP accessibilityfeatures for all students Prior to submitting PARCC School Test Security Plans Shipment of test manuals and accommodated materials to schools Begin shipping on March 21

PARCC Field Testing

119

To continuously supply new test items, field test items are included on assessments. These items do not count toward a student's score. They provide data that allows decisions to be made about their potential future use on the assessment. PARCC field test items

• Math field test items are embedded throughout each

assessment.

• ELA field test items are an additional unit to the test and taken

by select grades. For the 2017-18 school year administration of PARCC, students in grades 5 and 8 will take the field test. Take the additional unit into consideration when planning schedules for this assessment.

120

* Grades 5 and 8 will take the 2018 ELA field test. These grades will take four units of ELA, rather than three.

PARCC 2018 Testing Times

Subject Grade # of Units Unit Time ELA

3 3 75 minutes 4 3 90 minutes 5* 4 90 minutes 6-7 3 90 minutes 8* 4 90 minutes High School 3 90 minutes

Math

3-5 4 60 minutes 6-8 3 80 minutes High School 3 90 minutes

121

PearsonAccessnext

• Provide user accounts to staff members
• Confirm student registration entered by OSSE
• Provide accessibility features and accommodations via the Personal Needs

Profile

• Setup testing sessions
• Administer assessments and monitor progress

122

TestNav8

• Update all technology to the most recent version of TestNav8
• Complete infrastructure trial (optional)
• Set up a proctor cache machine
• Assess students

Personal Needs Profile (PNP)

Documenting student needs in the PNP provides students with the appropriate test form and technological supports and communicates to the test administrator what supports to provide for the student.

123

Personal Needs Profile (PNP)

Documenting accommodations and accessibility features

in PAN is required for all students who receive them. The PNP holds information that allows PAN to assign accurate testing forms, accessibility features, and accommodations to each student. PNP information must be accurately entered for students prior to a step called “preparing test sessions” so students receive the appropriate test forms.

124

125

Importing and Exporting SR/PNP File

The Student Registration/Personal Needs Profile Field Definitions document provided by PARCC offers detailed instructions on how to import an SR/PNP file and what information belongs in each column of the file.

SR/PNP Field Definitions

Personal Needs Profile (PNP)

PARCC student accommodations should be uploaded into Pearson by Feb. 23. This will ensure schools receive accurate materials prior to the PARCC testing window. Accessibility features, test sessions, and test administrators must be uploaded into Pearson when test security plans are submitted.

126

127

PAN includes accommodation and accessibility feature reminders that will show up next to a student’s name in the “Students in Session” section of PAN.

A&AF Reminders

128

Train your TAs on the codes for accommodations and accessibility features, so they are familiar with them and can recognize if students have been assigned the appropriate features, or if students are missing any features prior to beginning their test. This chart is located on the back

• f the PARCC TC Manual.

A&AF Reminders

Questions?

130

OSSE Points of Contact

Area Topic Point of Contact

Assessment Policy Every Student Succeeds Act (ESSA) Danielle Branson Data, Reporting, Business Rules Chanon Bell Test Integrity and Security Special Populations Michael Craig Test Administration NAEP Swea Hart PARCC Cassie Lynott DC Science Daniel Alcazar-Roman MSAA Michael Craig WIDA ACCESS Education and Engagement LEA/School Workshops and Trainings Nikki Stewart; Cassie Lynott

Thank you!