Innovative Approaches to Alternate Assessm ent Design: Tennessee - - PowerPoint PPT Presentation

Innovative Approaches to Alternate Assessm ent Design: Tennessee Grade 2 Alternate Assessm ent

CCSSO 2017 National Conference on Student Assessment

• Dr. Nakia Towns, Assistant Commissioner, Data & Research Division

Our Vision

Districts and schools in Tennessee will exemplify excellence and equity such that all students are equipped with the knowledge and skills to successfully embark upon their chosen path in life.

2

Our Priorities

3

Our Big Goals

4

Grade 2 Design

• Optional Administration – This assessment offered to

districts at no additional cost and only at the district’s option

• Designed to help ensure that our youngest students are

strengthening foundational literacy and math skills

• This assessment is part of an overarching strategy to

improve early grades instruction and student learning

– Kindergarten Entry Inventory Screener – Voluntary Pre-K Program Criteria & Funding – Read to Be Ready Coaching Network – Read to Be Ready Summer Camps – Pre-K/K Student Growth Portfolios for Teacher Evaluation – Third Grade Individual Value-Added Data for Teacher Evaluation

Grade 2 Assessm ent Overview

6

• Criterion-referenced assessment versus norm-

referenced.

– Designed to replace the SAT-10, which was optional for grades K – 2 from 2011-2016 in Tennessee.

• Designed to only assess Tennessee Academic

Standards.

– Will provide teachers, leaders, parents, and community members information on how our students are performing at the end of second grade on Tennessee- specific standards. – Provides information on progress in advance of third grade, before the first year for student and school accountability.

Grade 2 Assessm ent Overview

7

• July 2016 – Item Review
• September 2016 – Gen Ed Field Test and Passage Review
• October 2016 – Alternate Field Test
• April – May 2017 – Operational Administration
• Summer 2017 – Standard Setting
• Fall 2017 – Individual, School, and District Score Reports

Grade 2 Assessm ent Design Tim eline

8

• 98 of 144 districts administered the Grade 2 assessment

this spring, driven by positive feedback from the fall field test:

– 96% of educators agreed or strongly agreed that the items on the ELA field test align with the TN state standards. – 92% of educators agreed or strongly agreed that the items on the Mathematics field test align with the TN state standards. – Educators “felt the test length and rigor was a good fit for second graders.” And “thought the amount and quality of questions was very appropriate for second grade.”

Grade 2 Assessm ent: Initial Reception from the Field

9

Grade 2 Mathem atics Blueprint

10

Subdomain Number of Points Percent of Test Computation with Whole Numbers 17 29 Number Relationships and Patterns 14 24 Measurement Concepts 13 22 Data and Geometric Concepts 9 15–16 Problem Solving 5–6 9–10 Total 58–59 100

Administered in two (2) subparts, 40 and 42 minutes long.

• The mathematics test will focus approximately:

– 70% of the assessment items on major work of the grade and – 30% of the items on supporting and additional work.

• Student mastery of fluency, ability to problem solve,

and understanding of the grade level standards will be assessed.

• Students will be assessed on their ability to connect

topics across the grade level domains.

Grade 2 Mathem atics Overview

11

Non-Contextual Fluency

• 1-point item; aligned to a single standard
• Fill-in-the-blank format
• Multiple-select format

Multiple Choice

• 1-point item; aligned to a single standard

Grade 2 Mathem atics Item Types

12

Multi-part

• 2-point item; aligned to a single standard
• Contains multiple parts

Integrated

• 5–6 point item; aligned to two or more standards
• Contains multiple parts

Grade 2 Mathem atics Item Types

13

Grade 2 Mathem atics: Integrated Item

14

Grade 2 ELA Blueprint

15

Literature Subtest 42 Total Items Points

% Reading 15 30 Writing 5 10 Foundational Literacy (Phonics and Word Recognition, Vocabulary Acquisition, Word Composition, and Sentence Composition) 20 40 Listening 10 20 Total 50 100

Informational Text Subtest 44 Total Items Points

% Reading 15 28 Writing 5 9 Foundational Literacy (Phonics and Word Recognition, Vocabulary Acquisition, Word Composition, and Sentence Composition) 19 35 Listening 10 19 Fluency 5 9 Total 54 100

Administered in four (4) subparts, each 40 – 42 minutes long.

The integrated format will assess students based upon questions derived from both literary passages and informational text in order to determine their mastery of the standards in the following areas:

• Reading Comprehension
• Foundational Literacy Skills
• Language
• Conventions/Grammar/Spelling
• Writing
• Listening
• Foundational Literacy Fluency

Grade 2 ELA Overview

16

Reading Comprehension

• 1-point multiple-choice items
• Passage-based items

Foundational Literacy

• Phonics and Word Recognition

– 2-point multiple-select items – Based on words from the passage

• Vocabulary Acquisition

– 1-point multiple-choice items – Based on words from the passage

Grade 2 ELA Item Types

17

Foundational Literacy (continued)

Word Composition and Sentence Composition

• 1-point multiple-choice items
• Based on sentences about the passage

Writing

• 5-point writing prompt
• Prompt is based on ideas in a short reading passage

that is read to students

• Requires students to write a response that is at least

three or four sentences to answer two passage-related questions

Grade 2 ELA Item Types

18

Holistic Writing Rubric

19

Holistic Writing Rubric

20

Listening

• Sentence-based

– 1-point multiple-choice items – Graphic answer choices – Sentences and questions read to students

• Passage-based

– 1-point multiple-choice items – Some have graphic answer choices – Some have text answer choices – Passages, questions, and text answer choices read to students

Grade 2 ELA Item Types

21

Fluency

• 5-point item scored using a rubric

– Students have two minutes to read 20 sentences

• Students read as many sentences as possible in the

time allowed, identifying each as true or not true

Grade 2 ELA Item Types

22

• Oral Reading Fluency is typically assessed in situations

where students “read aloud from a passage while their reading errors (i.e., miscues) and reading rate are recorded” (Price et al., 2012, p. 2).

– Does not connect decoding skills to a measure of comprehension – It requires substantial one-on-one time per student – It does not address the “need to pay closer consideration to

• ral reading’s often ignored counterpart, silent reading”

(Price et al., 2012, p. 2).

Beyond Oral Reading Fluency

23

Grade 2 ELA Fluency Item

24

• The Foundational Literacy Fluency item is a measure of

fluency that connects students’ basic decoding skills with their comprehension at the sentence level.

‒ Students’ reading fluency and comprehension will be assessed through the use of yes or no responses to independently read sentences containing second grade vocabulary. ‒ The number of sentences that students answer correctly will be translated into a 0–5 score.

Examples:

• A fish can swim.
• It is dark at night.
• A hen is a plant.
• A rock is very soft.

Grade 2 Alternate Design

• The new alternate assessment for second grade replaces

the historical TCAP-Alt portfolio assessment.

• Tennessee educators participated in the item review

and their input was a critical part of the assessment design to ensure quality, rigor, and accessibility.

• The Grade 2 Alternate was designed using a similar

process as MSAA and TCAP-Alt:

– Developing Alternate Assessment Targets (AATs) from the grade level standards, – Developing Underlying Concepts (UCs) from the AATs – Developing item families consisting of four “tiers” of “levels” from the AATs and UCs

Grade 2 Alternate Assessm ent Design Overview

26

• The assessment begins with Tier 1 items and progress

with Tier 2, Tier 3, and Tier 4 items before reverting back to Tier 3 items, then Tier 2 items, and ending with Tier 1 items, as shown below.

• Operational assessment consists of a single form and

with a range of 6-10 items per tier.

Grade 2 Alternate Assessm ent Design Overview

27

• Paper and pencil test delivered in three pieces: (1) test

item booklet, (2) student response cards, and (3) answer sheet to record answers.

– ELA and math only – 30-35 multiple choice questions for each content area – Includes constructed response items in ELA – Answer cards on perforated paper – Teacher completes the answer sheet – Assessment may be administered over multiple days, multiple times as needed for the student

• If the district chooses to administer the Grade 2

GenEd assessment, students in second grade who qualify for the alternate must be assessed as well.

Grade 2 Alternate Assessm ent Design Overview

28

• The table below details Spring 2017 Grade 2 TCAP-Alt
• perational test design for ELA and Mathematics.
• Spring 2018 updates to include additional field test

positions and reduced MC operational points (33/32)

Grade 2 Alternate Assessm ent Test Design

29

#Passages # Items

Content Area Literature Informa- tional Text Multiple Choice Constructed Response Total Total # Points**

ELA 2 2 32 2 34 38 Math

• 35
• 35

35

* Literature and Informational Text passages have 6–7 items each. **Multiple-choice (MC) items are valued at 1 point. Constructed-response (CR) items are valued at 3 points.

Con- tent

Category

Academic Standard Tier 4 Tier 3 Tier 2 Tier 1 ELA

Reading: Literature

2.RL.7 Use information gained from the illustrations and words in a print or digital text to demonstrate understanding of its characters, setting, or plot. Use illustrations to answer questions about the characters, setting, key events, or problem/solution in a story. Use illustrations to answer questions about the characters, setting, key events, or problem/solution in a story. Use illustrations to identify a character’s traits or feelings, a setting or plot Use illustrations to identify a character’s traits or a setting.

ELA

Reading: Informa- tional Text

2.RI.1 Ask and answer such questions as who, what, where, when, why, and how to demonstrate understanding of key details in a text. Answer why or how questions about key details in a passage. Answer who, what, where, and when questions about key details in a passage. Identify important people, an event, or a key detail in a passage. Identify important people or an event in a passage.

Grade 2 Alternate Assessm ent – Item Sam pling

30

Grade 2 Alternate Assessm ent Content Em phasis

31

ELA Strand Grade 2 Reading Literature 37% Reading Informational Text 26% Reading Foundational 10% Vocabulary 10% Writing 16% Mathematics Domain Grade 2 Operations and Algebraic Thinking 25% Number and Operations Base Ten 45% Number and Operations Fractions

• Measurement and Data

30% Geometry

• Grade 2 Assessment designed to focus deeply on

early numeracy and literacy skills

• Grade 2 Alternate Assessment built off same

premise, utilizing design principles established in MSAA – tiered items and aligned to standards.

• Tennessee is eliminating portfolio models for all

TCAP-ALT assessments in grades 2 – 11.

• Grade 2 and Grade 2 Alternate Assessments are part of

an overarching strategy to improve K-3 results and ensure equity for all students.

Conclusion

32

Dist stricts a s and nd sc schools s in T n Tenne nnesse ssee will e exemplify excellen ence and eq equity s such ch t that a all studen ents are e eq equipped ed w with t the k knowled edge e and skills t to su successf ssfully embark on t n their c chose sen n path i in n life.

Excellence | Optimism | Judgment | Courage | Teamwork