Language Levels and Modalities How to Conduct Comprehensive Assessment and Intervention
Hawaii Speech-Language-Hearing Association Nickola Wolf Nelson, PhD, CCC-SLP Professor Emerita, Western Michigan U. nickola.nelson@wmich.edu
Language Levels and Modalities How to Conduct Comprehensive - - PowerPoint PPT Presentation
Language Levels and Modalities How to Conduct Comprehensive Assessment and Intervention Hawaii Speech-Language-Hearing Association Nickola Wolf Nelson, PhD, CCC-SLP Professor Emerita, Western Michigan U. nickola.nelson@wmich.edu Speaker
Hawaii Speech-Language-Hearing Association Nickola Wolf Nelson, PhD, CCC-SLP Professor Emerita, Western Michigan U. nickola.nelson@wmich.edu
– Receive(d) royalties from publications that inform this presentation:
through Adolescence. Boston, MA: Allyn & Bacon.
lab approach to language instruction and intervention. Baltimore, MD: Paul H. Brookes Publishing, Inc. [out of print]
Test of Integrated Language and Literacy Skills (TILLS). Baltimore, MD: Paul H. Brookes Publishing, Inc.
– Financial compensation from ASHA for this Webinar and Part II on Curriculum-Based Language Intervention
– Grants from U.S. Department of Education, Office of Special Education Programs supporting work on the Writing Lab Approach, and from the Institute of Education Sciences, National Center for Special Education Research (Grant R324A100354), for standardization of TILLS. However, the opinions in this presentation are those of the author and not the U.S. government.
– None
– Coauthors of Test of Integrated Language and Literacy Skills (TILLS) -- Drs. Elena Plante, Nancy Helm-Estabrooks, & Gillian
Hotz
– Coauthors of the Student Language Scale (SLS) – Drs.
Barbara M. Howes & Michele A. Anderson
– Codevelopers of The Writing Lab Approach -- Dr. Christine
Bahr, Adelia Van Meter, Kalamazoo Public Schools
– Dozens of graduate assistants, collaborating teachers, and participating students
NOTE: Case examples are composites of real students with some details modified to mask identity. All had parental permission and gave their assent for their work to be shared under protocols approved by the Western Michigan University Human Ss Insitutional Review Board.
with oral-written language disorders, dyslexia, and specific comprehension deficits
problems at the sound/word level and the sentence/discourse level
implement a classroom-based writing lab approach to address students’ comprehensive language and literacy needs
interpretable results
language levels-by-modalities assessment model
Skills (TILLS)
assessment and intervention
– Kindergarten/Grade 1 – Middle elementary – Later elementary – Middle to secondary school
RtI Tier 1 RtI Tier 2 RtI Tier 3 / Assessment/ Identification IEP for SLD Screening or Referral Assessment & Identification of SLI IEP for SLD Note: PSW = Pattern of Strengths and Weaknesses; IEP = Individualized Education Program; SLD = Specific Learning Disability; S/LI = Speech or Language Impaired Formal Assessment (SLS + TILLS) SLS + TILLS
Students Classified as Speech/Language Impaired and Learning Disabled in a Single Cohort Followed Longitudinally
10 20 30 40 50 60 70 Kdg 1st 3rd 5th Percentage of Special Ed. Grade Level SLI LD
Based on data reported by Mashburn, A. J., & Myers, S. S. (2010). Advancing research on children with speech-language impairment: An introduction to the Early Childhood Longitudinal Study—Kindergarten Cohort. Language, Speech, and Hearing Services in Schools, 41, 61-69.
Language Disorders Learning Disabilities Reading Disorders
Language Disorders LD (Dyslexia) Reading Disorders
Dyslexia Oral Language Disorders
disorder in one or more of the basic psychological processes involved in understanding or in using language, spoken or written that may manifest itself in the imperfect ability to listen, think, speak, read, spell, or do mathematical calculations. (IDEA 2004, §602.30, Definition)
Note: IDEA = Individuals with Disabilities Education Improvement Act (2004)
disorder in one or more of the basic psychological processes involved in understanding or in using language, spoken or written that may manifest itself in the imperfect ability to listen, think, speak, read, spell, or do mathematical calculations. (IDEA 2004, §602.30, Definition)
Note: IDEA = Individuals with Disabilities Education Improvement Act (2004)
Cognitive Processes Language Processes (Oral and Written) Academic Performance
Think of Reading and Writing as Language Processes, not JUST “achievement” Think of Phonemic Awareness as Language Processes. May be under umbrella of “Cognitive Process”
result in people having difficulties with specific language skills, particularly reading.
difficulties with other language skills such as spelling, writing, and pronouncing words.
however, its impact can change at different stages in a person’s life.
to a pattern of learning difficulties characterized by problems with accurate or fluent word recognition, poor decoding, and poor spelling abilities” (p. 67).
The purpose of this letter is to clarify that there is nothing in the IDEA that would prohibit the use of the terms dyslexia, dyscalculia, and dysgraphia in IDEA evaluation, eligibility determinations, or IEP
However, regardless of whether a child has dyslexia or any other condition explicitly included in this definition of “specific learning disability,” or has a condition such as dyscalculia or dysgraphia not listed expressly in the definition, the LEA must conduct an evaluation in accordance with 34 CFR §§300.304-300.311 to determine whether that child meets the criteria for specific learning disability or any of the other disabilities listed in 34 CFR §300.8, which implements IDEA’s definition of “child with a disability.”
OSERS reminds SEAs and LEAs about previous guidance regarding the use of MTSS, including RTI, and timely evaluations,1 specifically that a parent may request an initial evaluation at any time to determine if a child is a child with a disability under IDEA (34 CFR §300.301(b)), and the use of MTSS, such as RTI, may not be used to delay or deny a full and individual evaluation under 34 CFR §§300.304-300.311 of a child suspected of having a disability.
In determining whether a child has a disability under the IDEA, including a specific learning disability, and is eligible to receive special education and related services because of that disability, the LEA must conduct a comprehensive evaluation under §300.304, which requires the use of a variety of assessment tools and strategies to gather relevant functional, developmental, and academic information about the child. This information, which includes information provided by the parent, may assist in determining: 1) whether the child is a child with a disability; and 2) the content of the child’s IEP to enable the child to be involved in, and make progress in, the general education
Language comprehension & Formulation
ideas/message
analyze vocabulary, sentences, & discourse
recognition Word recognition & Production
words using phonology & morphology
nounce/ spell/write words Sentence/ discourse level Expressive Receptive Sound/ word level
language (Tomblin & Zhang, 2006)
and nonphonological language skills as separate factors (Bishop & Snowling, 2004; Catts, Adlof, & Ellis Weismer, 2006; Tunmer & Chapman, 2012)
D Word Recognition C Oral Language Comprehension R Reading Comprehension
Vocabulary Part of C
Simple View of Reading (SVR; Gough & Tunmer, 1986) Simple View of Reading Redux (Tunmer & Chapman, 2012)
You can find this diagram on the Internet simply by Googling “reading rope.” The citation is: Scarborough, H. S. (2001). Connecting early language and literacy to later reading (dis) abilities: Evidence, theory, and practice. In S. Neuman & D. Dickinson (Eds.), Handbook for research in early literacy (pp. 97- 110). New York: Guilford Press.
explain dyslexia and specific language impairment (SLI)
– Phonological skills (sound/word level) – Nonphonological skills (sentence/discourse level)
(Bishop & Snowling, 2004; Catts, Adlof, Hogan, & Weismer, 2005)
Good listening comp + sentence formulation when talking Low reading decoding + fluency + spelling + word inflection when writing Average in both Low Reading + Low Oral Language High sound/word skills and surface reading Good Reading Decoding + Poor Comprehension
Sentence/Discourse Ability Sound/Word Ability Dyslexia Specific Comprehension Deficit Spoken + Written Disorder Normal Language
(Bishop & Snowling, 2004; Catts, Adlof, Hogan, & Weismer, 2005; Catts, Adlof, & Weismer, 2006; Ramus, Marshall, Rosen, & van der Lely, 2013)
Comprehensive planning – What next?
Does the child have needs?
What kinds
spoken and/or written language?
profile?
problems?
What should we target?
important
make a difference
What kinds
intervention?
model
modalities)
sound/word and sentence/ discourse)
(sound/word level) as needed
sentence/discourse level)
Formal Assessment
information
student’s strengths and weaknesses compared to peers
as standardized
materials for intervention
Informal Assessment
information
this student, but not clear how performance compares to peers
deeper; repeat
assessment and intervention
Student Language Scale (SLS)
Consider teacher, parent, and student input on the SLS
Multiple sources Co-norming Student Rating Scale
language/literacy disorders;
student perspectives to contribute to planning; and
students with and without language/literacy concerns.
Gen Ed. Teacher SLS in 3rd Grade Parent SLS in 3rd Grade
January January
Gen Ed. Teacher SLS in 4th Grade Parent SLS in 4th Grade A Little More than One Year Later
May May
High sensitivity 90% of 68 students with LLD identified accurately as having problems
High specificity 90% of 203 students with NL identified accurately as not having problems
Sensitivity Specificity Teacher 61/68 = .90** 182/203 = .90** Parent 203/239 = .85* 1065/1290 = .83* Student 66/90 = .73 257/419 = .61
Correlation between Items 1-8 and total TILLS for Teachers = .752** Parents = .613**
Consider teacher, parent, and student input on the SLS
Multiple sources Co-norming Student Rating Scale
Correlation between Items 3-4 and Sound/Word Composite: Teachers = .671** Parents = .595**
Consider teacher, parent, and student input on the SLS
Multiple sources Co-norming Student Rating Scale
Correlation between Items 1- 2, 5-8 and Sentence/Discourse Composite: Teachers = .720** Parents = .570**
(Nelson, Plante, Helm-Estabrooks, & Hotz, 2016)
discipline specific
discourse boundaries
Nelson, N. W., Plante, E., Helm-Estabrooks, N., & Hotz, G. (2015). Test of Integrated Language and Literacy SkillsTM (TILLS™). Brookes Publishing Co., Inc.
Assessing Phonological language skills Use Nonwords or pseudo-words Use Real words
Grade 2. Phonics and Word Recognition
Know and apply grade-level phonics and word analysis skills in decoding words.
– Distinguish long and short vowels when reading regularly spelled one- syllable words. – Know spelling-sound correspondences for additional common vowel teams. – Decode regularly spelled two-syllable words with long vowels. – Decode words with common prefixes and suffixes. – Identify words with inconsistent but common spelling-sound correspondences. – Recognize and read grade-appropriate irregularly spelled words.
Grade 3. Phonics and Word Recognition
word analysis skills in decoding words.
– Identify and know the meaning of the most common prefixes and derivational suffixes. – Decode words with common Latin suffixes. – Decode multisyllable words. – Read grade-appropriate irregularly spelled words.
Fluency
Know and apply grade-level phonics and word analysis skills in decoding words.
Use combined knowledge of all letter- sound correspondences, syllabication patterns, and morphology (e.g., roots and affixes) to read accurately unfamiliar multisyllabic words in context and out of context.
Grade 5. Phonics and Word Recognition
Sound/Word Level – Formal assessment
“If the word is bip, and we take away the first sound, the word becomes[hesitate]… ip.” “If the word is stig, and we take away the first sound, the word becomes… tig.”
Does the student
Does the student
The Principal’s Daughter We have a principal. The principal has a daughter. Her name is Sara. She wants to be a clown. She came Monday. ... She had on makeup. .. She looked scary. … Some children cried. … She took off her wig. The children were happy. They knew Sara. Example
read fluently
Sound/Word Level – Formal assessment using real words
The Little Dog There was a dog. He was little. He was brown. He was white. A car almost hit him. It was in front of our school. He was scared. He was okay. Example to illustrate sentence combining.
Discourse: 4/20 = 20% SS 2 Sentence: 4/4 = 1.00 SS 7 Word: 18/23 = 78% SS 3
Discourse Score: 18/20 content units = 90% WE-Disc SS = 10 Sentence Score: 18 content/7 T-units =2.57 WE-Sent SS = 11 Word Score: 74/88 wds without error = 84% WE-Word SS = 0 18
back to me exactly the same way.”
numbers to you, I want you to listen carefully and say them back to me in backward order.”
Curriculum-related language assessment (Norm- referenced measures can be) Curriculum-based language assessment (Requires use of materials from the student’s actual curriculum)
Informational Text
Ask and answer such questions as who, what, where, when, why, and how to demonstrate understanding of key details in a text.
Identify the main topic of a multiparagraph text as well as the focus of specific paragraphs within the text.
Describe the connection between a series of historical events, scientific ideas or concepts, or steps in technical procedures in a text. Literature
Ask and answer such questions as who, what, where, when, why, and how to demonstrate understanding of key details in a text.
Recount stories, including fables and folktales from diverse cultures, and determine their central message, lesson, or moral.
Describe how characters in a story respond to major events and challenges.
Common Core State Standards (Grade 2)
Informational Text
Determine the meaning of symbols, key terms, and other domain- specific words and phrases as they are used in a specific scientific or technical context relevant to grades 9-10 texts and topics.
Analyze the structure of the relationships among concepts in a text, including relationships among key terms (e.g., force, friction, reaction force, energy).
Analyze the author's purpose in providing an explanation, describing a procedure, or discussing an experiment in a text, defining the question the author seeks to address.
Literature
Determine the central ideas or information of a primary or secondary source; provide an accurate summary that makes clear the relationships among the key details and ideas.
Evaluate various explanations for actions or events and determine which explanation best accords with textual evidence, acknowledging where the text leaves matters uncertain.
“I’m going to read you a story. Listen carefully. Your job is to tell the story back to me just like I tell it to you.” [score as retained content units]
“Remember the story [Tommy the Trickster/The Rubber Raft]? Tell me the story again. Try to remember as much as you can. Start now.”
– “…two new territories. Each…” – “President…his…”
– He did
– “topic the teacher makes her class write about the first day of school every year” … “usual first writing assignment”
– if…then, but, when, etc. – however, therefore, consequently
Halliday, M.A.K., & Hasan, R. (1976). Cohesion in English. London: Longman.
Rachel [Ron] wants to politely turn down an invitation for a party she thinks will be boring. What do you think Rachel [Ron] would say?
Discourse: 4/20 = 20% SS 2 Sentence: 4/4 = 1.00 SS 7 Word: 18/23 = 78% SS 3
She
Discourse: 10/20 = 50 SS=3 Sentence: 10/5 = 2.0 SS=11 Word: 35-1=34/35 = 97 SS=11
*Took 30 min
Vocabulary – Formal assessment
bat
eagle Not a single definition Requires student to activate semantic awareness
Factor Reference Structure
(Semipartial Correlations)
Final Communality Estimate Factor 1 Factor 2 Phonemic Awareness 0.547 0.074 0.550 Non-word Spelling 0.600 0.067 0.642 Non-word Reading 0.734
0.786 Reading Fluency 0.406 0.077 0.325 Written Expression Word Score 0.409 0.009 0.267 Story Retelling
0.500 0.345 Vocabulary Awareness 0.229 0.472 0.629 Listening Comprehension 0.009 0.548 0.476 Reading Comprehension 0.264 0.420 0.589 Following Directions 0.153 0.409 0.412 Social Communications 0.075 0.476 0.428
Identify language/literacy disorder
– Vocab Aware – NW Spell – NW Read – WE- Discourse
6-7 year olds 8-11 year olds
– Phoneme Aw – NW Spell – Rdg Comp – Reading Fluency – WE-Word
– Vocab Aware – Phoneme Aw – NW Rep
12-18 year olds
Profile strengths and weaknesses
Sound/Word Composite Score Sentence/Discourse Composite Score
Sd/Wd (low) < Sent/Disc Dyslexia Sd/Wd = Sent/Disc (both low) LLD, S/LI, LD Sd/Wd > Sent/Disc (low) Specific Comprehension Deficit
Track change
Good listening comp + sentence formulation when talking Low reading decoding + fluency + spelling + word inflection when writing Average in both Low Reading + Low Oral Language High sound/word skills and surface reading Good Reading Decoding + Poor Comprehension
Sentence/Discourse Ability Sound/Word Ability Dyslexia Specific Comprehension Deficit Specific Language Impairment Normal Language
History of articulation difficulties Working on /l/ Getting RtI Tier 2 help for reading delays
Core subtests
Sound/word 48 Sentence/discourse 73
Consistent with diagnosis of dyslexia?
Good listening comp & sentence formulation Low reading decoding & fluency & spelling High in both? Low in both? High sound/word skills and surface reading? Low comprehension in listening and reading?
Sentence/Discourse Ability Sound/Word Ability School Classification: S/LI-speech Only Should there be more? Dyslexia Dx is appropriate
Teacher and Parent SLS for 7;10, Grade 2 Parent SLS Gen Ed Teacher SLS
Sound/word 50 Sentence/discourse 71
Core subtests
Which quadrant?
Good listening comp & sentence formulation Low reading decoding & fluency & spelling High in both? Low in both? High sound/word skills and surface reading? Low comprehension in listening and reading?
Sentence/Discourse Ability Sound/ Word Ability
LD as primary eligibility (rdg). Also gets help in class (co-taught by special ed teacher and other assignments read to her). Reading decoding and fluency goals on IEP. Should there be goals related to oral language? Written expression and spelling?
Sound-symbol association (alphabetic principle)
sound-symbol association automatic
– Make page for “My Sounds & Letters Book” – Symbol chip (avoid letter names) – Precise articulation; attention to distinctive features
– From array of easily distinguished sounds/letters ee p t m _o_ s a_e
Identify words with inconsistent but common spelling-sound correspondences.
(Orthographic Principle)
– Single consonant multiple vowels – Multiple consonants single vowel
– Single vowel multiple consonants – Multiple vowels single consonant
– Common “word families”
– Common “chunks” -ing, -tion, un-, dis-
Misses orthographic cues about how to pronounce vowels Reading fluency is a big problem
Is student aware of inflectional and derivational morphemes? Is student using relatively better sentence/ discourse skills to assist with fluency? Is student monitoring comprehension – “Does that make sense?”
Decode words with common Latin suffixes.
Distinguish long and short vowels when reading regularly spelled one-syllable words.
reading and spelling
reading strategies
Read grade- appropriate irregularly spelled words.
for SLPs [online course] http://support.lexercise.com/entries/20510387- lexercise-professional-education-courses
Theory and application of the association method. Hattiesburg, MS: University Press of Mississippi.
program for reading, spelling, and speech (LiPS; formerly called Auditory Discrimination in Depth). Austin, TX: ProEd.
learning problems. Washington, DC: Children’s Hospital National Medical Center.
Based Reading Instruction: A Review of the Literature. The Journal of Special Education, 40, 171-183.
Reading & Writing: A Word Study Curriculum. Evanston, IL: Learning by Design.
Identified as having a learning disability Reading goals on IEP ADHD No history of spoken language problems Is there evidence of any?
Core subtests
Sound/word 91 Sentence/discourse 66
Consistent with diagnosis of dyslexia?
Good listening comp & sentence formulation? Low reading decoding & fluency & spelling? High in both? Low in both High sound/word skills and surface reading? Low comprehension in listening and reading?
Sentence/Discourse Ability Sound/Word Ability School Classification: LD-Reading Impairment Only + ADHD NOT best fit for dyslexia, but words in context are low Needs: Listening comp Reading comp Vocabulary (semantic relations) Social comm *Stories may be relative strength
“Use of curriculum contexts and content for measuring a student’s language intervention needs and progress” (Nelson, 1989)
– Does the student have the language skills to learn the (reading/math/social studies) curriculum?
“The goal in interviewing is to have participants talk about things of interest to them and to cover matters of importance to [you] in a way that allows participants to use their own concepts and terms.” (Stainback & Stainback, 1988, p. 52)
Lists and labels about strengths and needs
thing about school?
worst thing? Anecdotes about specific events
“bored”?
the math lesson, and I didn’t know what to do.”
Question Target
Procedures
skills are required? Expected Response [ER] Identify language skills and strategies effective students use
student currently do? Observed Response [OR] Observe student’s current independent attempt
student learn to do differently? Mismatch between ER OR Use dynamic assessment to establish instructional procedures and targets
curricular task be scaffolded and changed? Bridge from OR ER Design scaffolding to help student make connections; modify task only if necessary
Curriculum-based language assessment & intervention: 4 Questions
task require?
student do currently?
might the student learn to do differently?
should the task be scaffolded or modified?
school and each could hold 5 bikes, how many bikes could park at the school?
– ER: 5 x 5 = 25 – Child OR: “10”
how you figured that out?
– Child OR: 5 + 5 = 10
that a little closer and see if we can figure it out.
– First draw the problem – Then do the math
First draw the problem: (Think aloud) Then do the math:
5 (racks) x 5 (bikes each) = 25
Does that make sense? Does it match the picture?
If there were 5 bike racks at the school and each could hold 5 bikes, how many bikes could park?
Then do the math… First draw the problem: (Think aloud) Does that make sense? Does it match the picture?
available otherwise.
when they are co-normed on the same standardization sample.
teachers, and students—the language levels X modalities model does this.
are more important for planning than a specific label.
child has S/LI, LD, or dyslexia.
Badian, N. A. (1999). Reading disability defined as a discrepancy between listening and reading comprehension: A longitudinal study
Berninger, V. W., Vaughan, K. Abbott, R. D., Begay, K., Coleman, K. B., Curtin, G., Hawkins, J.. M., & Graham, S. (2002). Teaching Spelling and Composition Alone and Together: Implications for the Simple View of Writing. Journal of Educational Psychology 2002, Vol. 94, No. 2, 291–304 Bishop, D. V. M., & Snowling, M. J. (2004). Developmental dyslexia and specific language impairment: Same or different? Psychological Bulletin, 130(6), 858-886. Catts, H. W., Adlof, S. M., Hogan, T. P., & Ellis Weismer, S. (2005). Are specific language impairment and dyslexia distinct disorders? Journal of Speech, Language, and Hearing Research, 48(6), 1378-1396. Gough, P. B., & Tunmer, W. E. (1986). Decoding and reading disability. Remedial and Special Education, 7, 6-10. Hoover, W. A. & Gough, P. B. (1990). The simple view of reading. Reading and Writing, 2, 127-160. Nation , K., Clarke, P., Marshall, C. M., & Durand, M. (2004). Hidden language impairments in children: Parallels between poor reading comprehension and specific language impairment? J. of Speech, Language, and hearing Research, 47(1), 199-211. Nelson, N. W., Plante, E., Helm-Estabrooks, N., & Hotz, G., (2016). Test of Integrated Language and Literacy Skills (TILLS). Baltimore, MD: Paul H. Brookes Publishing Co. Ramus, F., Marshall, C. R., Rosen, S., & van der Lely, H. K. J. (2013). Phonological deficits in specific language impairment and developmental dyslexia: Towards a multidimensional model. Brain, 136, 630–645. Scarborough, H. (2001). Connecting early language and literacy to later reading (dis)abilities: Evidence, theory, and practice. In S.B. Newman & D.D. Dickinson (Eds.), Handbook of early literacy research (pp. 97–110). New York: Guilford Press. Silliman, E. R., & Berninger, V. W. (2011). Cross-disciplinary dialogue about the nature of oral and written language problems in the context of developmental, academic, and phenotypic profiles. Topics in Language Disorders, 31(1), 6-23. Stanovich, K. E. (1994). Annotation: Does dyslexia exist? The Journal of Child Psychology and Psychiatry and Allied Disciplines, 35(4), 579-595. Tunmer, W. E., & Chapman, J. W. (2007). Language-related differences between discrepancy-defined and non-discrepancy-defined poor readers: A longitudinal study of dyslexia in New Zealand. Dyslexia, 13(1), 42-66. Tunmer, W. E., & Chapman, J. W. (2012). The simple view of reading redux: Vocabulary knowledge and the independent components hypothesis. Journal of Learning Disabilities, 45, 453-466.