Archive

Posts Tagged ‘standardized tests’

Ten Criteria for Effective ELA/Reading Diagnostic Assessments

Diagnostic assessments are essential instructional tools for effective English-language Arts and reading teachers. However, many teachers resist using these tools because they can be time-consuming to administer, grade, record, and analyze. Some  teachers avoid diagnostic assessments because these teachers exclusively focus on grade-level standards-based instruction or believe that remediation is (or was) the job of some other teacher. To be honest, some teachers resist diagnostic assessments because the data might induce them to differentiate instruction—a daunting task for any teacher. And some teachers resist diagnostic assessments because they fear that the data will be used by administrators to hold them accountable for individual student progress.

To ameliorate these concerns, let’s agree to the ten criteria for effective ELA/reading diagnostic assessments:

1. Diagnostic assessments should be designed to be administered “whole class.” While one-on-one time with a student is wonderful; it just isn’t a practical approach for teachers with class sizes pushing forty in many schools. I won’t throw the baby out with the bath water on this one. Individual assessments are sometimes necessary as double-checks or refinements, and an individual fluency assessment is a must for elementary, middle, and some high school students. However, my experience is that effective whole class diagnostic assessments can produce results that are just as reliable and prescriptive as the time-consuming individual assessments.

2. Diagnostic assessments should be brief. Despite the oft-repeated dictum, assessment is not really instruction.

3. Diagnostic assessments should be designed to  measure only what they purport to measure. For example, a diagnostic fluency assessment that produces  inaccurate  results because it uses unfamiliar terminology or difficult names is useless. A grammar assessment that pretends to measure correct  usage by having students match a past perfect participle to its definition does not accomplish its purpose.

4. Diagnostic assessments should measure important ELA/reading concepts or skills. Although we may disagree on a few of the details, few teachers would argue that assessing a student’s reading level is not as important as assessing a student’s ability to correctly name the four classifications of sentences.

5. Diagnostic assessments should help the teacher determine the relative strengths and weaknesses of the individual student, and not just those of the class. A teacher needs more information than simply what to emphasize in instruction or what to re-teach to “most” of the class.

6. Diagnostic assessments should be quantitative. Although qualitative assessment, such as a class discussion, is useful to inform direct instruction, internally and externally valid and reliable assessments that produce hard numbers  provide objective baselines for instruction, and guide later formative and summative assessments.

7. Diagnostic assessments should be designed to measure academic skills and abilities within our control. Although cognitive ability, family background, culture, socio-economic status, and language certainly impact what students know, these important variables are beyond the scope of useful diagnostic assessments. We need diagnostic assessments that won’t  isolate these variables. For example, a diagnostic assessment  that measures only the phonetic regularities common to English and Spanish, ignores those sound-spellings exclusive to English that all students need to master. Or as a further example, knowing that there is a racial/ethnic achievement gap in ELA/reading is of less value than knowing the specific components of a literacy gap that teachers can effectively address.

8. Diagnostic assessments should be easy to grade and record. Teachers need to spend their prep times using data to inform their instruction, and less time on correction and paperwork. Well-designed assessments can be multiple choice or matching. Recording matrices need to be designed so that they are simple to use, analyze, and plan for differentiated instruction.

9. Diagnostic assessments should be designed to help teachers inform their instruction. Teachers need specificity. If a teacher cannot teach to the data gained from the assessment, of what use is the assessment? For example, complicated and time-consuming normed reading comprehension assessments provide little instructional practicality. Other than individual reading levels, which can be gained from simple word recognition tests, fluencies, or even the self-administered “five finger method,” knowing the degree to which a student can “draw conclusions” does little to impact instruction. Of course, we need to teach those skills measured by reading comprehension tests or the annual standardized test, but we waste time using diagnostic assessments to glean this data, when we will teach these skills to all of our students anyway.

10. Diagnostic assessments should be comprehensive and not random samples. Qualitative spelling inventories, reading tests, phonics tests, grammar tests, mechanics tests, and vocabulary tests that are based on random samples of skills can only help teachers identify an approximate ability/developmental level or that a student has problems in that instructional area. By their very nature, random sample tests are “missing” something. Good diagnostic assessments are designed to quantify everything that needs to be learned in the particular area of focus.

Over the years I have created, field-tested, and revised a battery of ELA/reading assessments that meet the criteria described above. You are welcome to download a comprehensive consonant and vowel phonics assessment, three sight word assessments, a spelling-pattern assessment, a multi-level fluency assessment, six phonemic awareness assessments, a grammar assessment, and a mechanics assessment free of charge from my website. Most of these assessments are multiple choice and are administered “whole class.” All have recording matrices to help the teacher plan for individual and small group instruction. Once, teachers administer these assessments and analyze the data, many will wish to purchase my teaching resources Teaching Grammar and MechanicsTeaching Essay StrategiesTeaching Reading Strategies, and Teaching Spelling and Vocabulary to differentiate instruction precisely according to the data of these diagnostic assessments. Why re-invent the wheel?

Grammar/Mechanics, Reading, Spelling/Vocabulary, Study Skills , , , , , , , , , , , , , , ,

Should We Teach Standards or Children?

This may well be professional suicide. But, it’s time to come out of the closet. I say I teach the standards, but I really teach children.

As an educational publisher and author, I sell books that address state and national standards in English-language Arts and reading. The standards-based movement has clearly taken over the publishing and educational establishment. For example, in California, a district cannot purchase programs with state-allocated district monies unless these programs are on the approved list. How does the publisher get on the list? Standards and money. Every instructional component must be explicitly tied to state standards. The review process is time-consuming and expensive.

As a presenter and staff developer, I have taught hundreds of workshops and in-services on meeting the standards. No district or school will hire a consultant or presenter who does not promise to teach these standards.

As a teacher, I am reminded ad nauseam to “teach the standards.” Since I am a reading specialist, hiding inside the Trojan horse of English-language Arts in an underperforming middle school, I quietly administer reading and spelling assessments to my students. It won’t come as much of a surprise to most of you that the diagnostic data indicate that some students have severe reading and spelling deficits.

Here then is the crux of the issue. The underlying pre-suppositions, results, and practice of standards-based instruction can be diametrically opposed to differentiated instruction, according to the diagnostic needs of our children. This is especially true in the field of reading instruction.

The underlying pre-suppositions of the standards-based movement accept a priori that education is solely a behavioral science. We critics of this assumption would argue that much of teaching, learning, and parenting is culturally-bound and intuitive. In other words, some of effective teaching is truly an art form. We critics are not above using the scientific method and learning theory to debunk the behavioral purists. For example, the standards-based-movement begs the vital question regarding its linear scope and sequence of grade level standards: Do we really learn that way? Many teachers in my fields of English-language Arts and reading would argue the contrary. In fact, anyone who has taught the basic parts of speech to sophomores in high school won’t be surprised to learn that excellent teachers from elementary school-to middle school-to last year’s freshman class taught the same parts of speech. In other words, some learning may be recursive, not linear. Teachers, students, and parents are the critical variables here.

It’s time to take a hard look at the results of the standards-based movement. Yes, there was education before this movement took center stage. Since standards-based state assessments have taken precedence, the few nationally-normed tests that we still use nationwide, such as the NAEP and SAT 1, do not support the efficacy of the standards-based movement. Last I checked, we still underperform in reading and we still haven’t solved the “achievement gap.”

As is frequently the case in education, an idea takes on a life of its own in practice. A conversation a few years back with a fellow English teacher was instructive, but chilling. In discussing the results of our informal reading assessments, he looked over the clearly demonstrated reading deficits in his testing data and then said, “I teach the grade level standards. I’m not paid to go back and teach everything that the students don’t know.” He accepted a job as an administrator in our district the next year. Now, I am not over-critical of administrators… They are held accountable to implement standards-based instruction and to increase the all-important state and/or district standards-based test scores. However, administrators have got to do better than the principal who refused to implement reading intervention programs at her under-performing school because “The elementary teachers are supposed to teach reading; that’s their job, not ours. We teach middle school standards here.”

It’s easy to whine at the devolution of academic freedom and the sorry state of education that has been relegated to a series of standards-based grade level scope and sequence charts, with benchmarks or task analyses tacked on to provide the pretense of specificity. It’s harder to offer solutions, but here are a few thoughts.

True educators need to be subversive. Hasn’t rebellion always been part and parcel of our profession? Teachers have always been on the outside, looking in. However, good teachers know how to compromise in order to maintain sanity for the benefit of their students and themselves. Educators need to smile at the principal’s insistence that every assignment must have the state standard listed. We need to post our standards for the day on our whiteboards, Smartboards®, overhead projectors, or LCDs. We shouldn’t give it a second thought. We know what we need to teach and we need to save ourselves for that task. As one principal told me in my first year of teaching… “Choose your battles, Mark. Do you want to die on this hill?”

This is not to say that educators should not fight the good fight. Here are three tips to save your scalp from parroted dictums and standards mantras, while you carry on the battle to teach children, not just the standards:

1. Do teach the grade level standards. Really. After all, they are rather innocuous. Rarely have I heard a teacher say that we shouldn’t be teaching such and such a standard. However, control the time allotted to teaching these standards and insist on your academic freedom here. When challenged as to why you are teaching a lesson or skill that is not explicitly listed as a grade level standard, cite previous or advanced grade level standards that address your remedial or advanced grade level instruction.

2. Patiently argue that some students need to “catch up, to keep up.” Justify concurrent remediation or acceleration and grade level instruction by citing diagnostic data. Let data plead your case. For example, if instructed not to teach to diagnosed deficits, ask the principal/district supervisor to write a letter to the parents of students to alleviate you of this responsibility, against your informed judgment. They won’t, but they won’t bother you for awhile.

3. Explain that that any criticism is not about really about what you teach, but rather about how you teach. You are scaffolding instruction, according to the demonstrated diagnostic needs of your students in order to teach the grade level standards. You are making the standards comprehensible and in order to do so, you must differentiate instruction. How you teach is a matter of academic freedom.

The religious adherence to the standards-based movement? This too will pass. Until such time, teach the standards, but also teach your students.

The author, Mark Pennington, is an educational author, seventh grade teacher, staff developer, and blues harmonica player. His Teaching Reading Strategies is a comprehensive reading intervention curriculum, which includes multiple choice reading assessments and many others on two CDs, blending and syllabication activities, phonemic awareness and phonics workshops, comprehension worksheets, multi-level fluency passages on eight CDs, 390 flashcards, posters, games, and more to differentiate reading instruction. Available on the Pennington Publishing website.

Reading , , , , , , , , , , , , , , , , ,