Archive

Posts Tagged ‘formative assessments’

Common Core State Standards Fear-mongering

Standards and Accountability

A recent discussion on my favorite site, the English Companion Ning, made me take a critical look at just what has engendered the recent demands for increased accountability in our public schools. Both Democrats and Republicans are playing the blame game and teachers are the easiest targets. As a public school teacher, my initial response has been defensive; however, upon a bit of reflection I’m thinking that teachers may well largely be to blame–not for the “sorry state of public education” as our critics claim, but for the very accountability movement that is being used to attack us. We teachers are often our own worst enemies.

A bit of history helps put things in perspective. Back in the 1970s and early 1980s teachers felt that our norm-referenced testing, such as the ITBS, SAT, CTBS, MAT, provided data that did not measure what we are teaching. We used sophisticated psychometric criticisms such as sampling and measurement error and socio-political criticisms such as bias to largely rid ourselves from the nuisances of these exams. We teachers went wild. Authentic assessments, multiple-measure assessments, and no assessments ruled the educational landscape. I once taught a sophomore world history class for an entire year without giving any traditional tests.

However, with teacher-created assessments, testing manufacturers lost money. Educational Testing Services and others do not like to lose money. So, the test manufacturers changed tactics. They asked for and gave teachers what teachers said they wanted–tests that purport to test what we teach. In other words, criterion-referenced standards tests. And the standards-based movement was born.

Teachers were even asked to develop their own subject area standards. A seemingly bottom-up initiative. How inclusive! Each state department of education, county office of education, and most school districts funded the creation of these subject area content standards documents. I joined other colleagues in spending countless hours developing the English-language Arts Standards for my own school district.

Now the test-makers were happy. They had the basis of a new revenue stream. And, now because the tests ostensibly test what teachers teach, administrators, politicians, and even billionaire do-gooders can hold us accountable and measure teacher/school/district/state performance. The zenith? Our Common Core National Standards.

Teachers helped create this mess. We enabled the accountability movement that is choking teacher creativity, teacher autonomy, and teacher initiative. And our students are the ones who are paying the greatest price. In replacing normed-reference testing with criterion-reference testing, we replaced something bad with something worse. “Meet the new boss.” Not the same as the old boss. Apologies to Pete Townshend.

And now the standards-based movement is so endemic that any challenges to teaching to the test or resisting accountability standards are viewed with wonderment by many in our profession. The standards-based movement with its frame of accountability is fully entrenched. Newer teachers have known nothing else.

A personal example will bring this home. I teach middle school ELA with a bright group of twenty-something colleagues. I am constantly perceived as being the ornery one because I challenge their logical applications of the standards-based accountability status-quo. For example, just recently I’ve questioned their proposals to change our allocation of instructional minutes to reflect the percentage of questions on the California Standards Test. Why shouldn’t we teach structural analysis for six-percent of our instructional minutes, if six-percent of the test consists of structural analysis test questions? they ask. I’ve already lost the battle to save our intervention classes for reading and writing instruction. Now, they are standards-based classes with curriculum designed to remediate instruction in such critical elements as “author’s purpose.” Instruction is limited to the “power standards” found on the California Department of Education website. I did throw a fit last week when one of my colleagues complained that it took her most of an hour to teach the eighth grade ELA theme standard to an EL newcomer who spoke, maybe 100 words of English.

Sigh. More on Valerie Strauss’ Washington Post site.

Response from Maja Wilson, author of Rethinking Rubrics in Writing Assessment (Heinemann, 2006) and the recent article, “First blame the teachers then the parents”  in the Washington Post.

Mark,

This is why I argue that trying to get and maintain a “seat at the table” is ultimately counterproductive. The meal served at the table of power is unhealthy, the conversation is stilted (actually, there isn’t much conversation–lots of orders given and followed) and those who partake leave with indigestion. That’s what happened when teachers created standards–following orders at the table–that were then used against them as the basis first for high-stakes standardized tests, and then as a springboard for national standards created by a corporation created by governors and business interests (Achieve Inc).

Instead, we should create, set, and decorate another table, then serve a tasty and healthy meal there. We could invite as many people to join as possible, and then enjoy a rich conversation and lots of laughter together as we dine.

Michael (another poster to Maja’s initial post) may be right that the problem is that we can’t agree on what to serve at that table. But hey, even a potluck would be tastier, healthier, and more socially edifying than the cardboard and nails currently on the Department of Education’s menu.

The writer of this article, Mark Pennington, is an educational author of teaching resources to differentiate instruction in the fields of reading and English-language arts. His comprehensive curricula: Teaching Grammar and MechanicsTeaching Essay StrategiesTeaching Reading Strategies, and Teaching Spelling and Vocabulary help teachers differentiate instruction with little additional teacher prep and/or specialized training.

Reading, Writing , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Ten Criteria for Effective ELA/Reading Diagnostic Assessments

Diagnostic assessments are essential instructional tools for effective English-language Arts and reading teachers. However, many teachers resist using these tools because they can be time-consuming to administer, grade, record, and analyze. Some  teachers avoid diagnostic assessments because these teachers exclusively focus on grade-level standards-based instruction or believe that remediation is (or was) the job of some other teacher. To be honest, some teachers resist diagnostic assessments because the data might induce them to differentiate instruction—a daunting task for any teacher. And some teachers resist diagnostic assessments because they fear that the data will be used by administrators to hold them accountable for individual student progress.

To ameliorate these concerns, let’s agree to the ten criteria for effective ELA/reading diagnostic assessments:

1. Diagnostic assessments should be designed to be administered “whole class.” While one-on-one time with a student is wonderful; it just isn’t a practical approach for teachers with class sizes pushing forty in many schools. I won’t throw the baby out with the bath water on this one. Individual assessments are sometimes necessary as double-checks or refinements, and an individual fluency assessment is a must for elementary, middle, and some high school students. However, my experience is that effective whole class diagnostic assessments can produce results that are just as reliable and prescriptive as the time-consuming individual assessments.

2. Diagnostic assessments should be brief. Despite the oft-repeated dictum, assessment is not really instruction.

3. Diagnostic assessments should be designed to  measure only what they purport to measure. For example, a diagnostic fluency assessment that produces  inaccurate  results because it uses unfamiliar terminology or difficult names is useless. A grammar assessment that pretends to measure correct  usage by having students match a past perfect participle to its definition does not accomplish its purpose.

4. Diagnostic assessments should measure important ELA/reading concepts or skills. Although we may disagree on a few of the details, few teachers would argue that assessing a student’s reading level is not as important as assessing a student’s ability to correctly name the four classifications of sentences.

5. Diagnostic assessments should help the teacher determine the relative strengths and weaknesses of the individual student, and not just those of the class. A teacher needs more information than simply what to emphasize in instruction or what to re-teach to “most” of the class.

6. Diagnostic assessments should be quantitative. Although qualitative assessment, such as a class discussion, is useful to inform direct instruction, internally and externally valid and reliable assessments that produce hard numbers  provide objective baselines for instruction, and guide later formative and summative assessments.

7. Diagnostic assessments should be designed to measure academic skills and abilities within our control. Although cognitive ability, family background, culture, socio-economic status, and language certainly impact what students know, these important variables are beyond the scope of useful diagnostic assessments. We need diagnostic assessments that won’t  isolate these variables. For example, a diagnostic assessment  that measures only the phonetic regularities common to English and Spanish, ignores those sound-spellings exclusive to English that all students need to master. Or as a further example, knowing that there is a racial/ethnic achievement gap in ELA/reading is of less value than knowing the specific components of a literacy gap that teachers can effectively address.

8. Diagnostic assessments should be easy to grade and record. Teachers need to spend their prep times using data to inform their instruction, and less time on correction and paperwork. Well-designed assessments can be multiple choice or matching. Recording matrices need to be designed so that they are simple to use, analyze, and plan for differentiated instruction.

9. Diagnostic assessments should be designed to help teachers inform their instruction. Teachers need specificity. If a teacher cannot teach to the data gained from the assessment, of what use is the assessment? For example, complicated and time-consuming normed reading comprehension assessments provide little instructional practicality. Other than individual reading levels, which can be gained from simple word recognition tests, fluencies, or even the self-administered “five finger method,” knowing the degree to which a student can “draw conclusions” does little to impact instruction. Of course, we need to teach those skills measured by reading comprehension tests or the annual standardized test, but we waste time using diagnostic assessments to glean this data, when we will teach these skills to all of our students anyway.

10. Diagnostic assessments should be comprehensive and not random samples. Qualitative spelling inventories, reading tests, phonics tests, grammar tests, mechanics tests, and vocabulary tests that are based on random samples of skills can only help teachers identify an approximate ability/developmental level or that a student has problems in that instructional area. By their very nature, random sample tests are “missing” something. Good diagnostic assessments are designed to quantify everything that needs to be learned in the particular area of focus.

Over the years I have created, field-tested, and revised a battery of ELA/reading assessments that meet the criteria described above. You are welcome to download a comprehensive consonant and vowel phonics assessment, three sight word assessments, a spelling-pattern assessment, a multi-level fluency assessment, six phonemic awareness assessments, a grammar assessment, and a mechanics assessment free of charge from my website. Most of these assessments are multiple choice and are administered “whole class.” All have recording matrices to help the teacher plan for individual and small group instruction. Once, teachers administer these assessments and analyze the data, many will wish to purchase my teaching resources Teaching Grammar and MechanicsTeaching Essay StrategiesTeaching Reading Strategies, and Teaching Spelling and Vocabulary to differentiate instruction precisely according to the data of these diagnostic assessments. Why re-invent the wheel?

Grammar/Mechanics, Reading, Spelling/Vocabulary, Study Skills , , , , , , , , , , , , , , ,