Showing posts with label achievement. Show all posts
Showing posts with label achievement. Show all posts

Friday, July 11, 2008

THE RESEARCH TRIANGLE. SORT OF.

As a student of education policy, my foremost personal goal is to keep my teacher sensibility and credibility from permanently draining away. Reading research reports, with their inevitable earnest calls for still more research, authoritative policy claims and suggestions, one understands that the base of the research-policy-practice triangle is practice, the apex being the conjunction of research and policy. Practice is a kind of collection pan (or audition stage) for ideas generated by scholarly investigation and clever policy-making.

Teachers serve as both subjects and objects of reform, but—with the exception of classroom-based action research, a phrase that causes your average doctoral student’s lip to curl—seldom go out looking to gather data or propose policy on a wider scale. They wait for the next finding, prescription or mandate to come down the pike, then either wrap the new guidelines around their old practice or attempt to ignore scholarship and policy altogether.

Some see this as evidence of a regrettable autonomy still present—despite the best efforts of education publishers—in the act of teaching. Others (people who work in schools, mainly) see these habits as a defense mechanism. No matter how many studies are conducted, no matter how large the data sets and innovative the statistical modeling, no matter how muscular the policy lever—kids keep coming to school, and teachers have no choice but to keep their heads down and teach them, somehow.

There’s been a little dustup over another one of Jay Greene’s papers, just released by the Manhattan Institute: Building on the Basics: The Impact of High-Stakes Testing on Student Proficiency in Low- Stakes Subjects. Greene’s shabby scholarship was roundly criticized about six months ago, when he and colleague Catherine Shock counted course titles in university catalogues, and developed a math-to-multiculturalism ratio, proving that Ed schools and teachers didn’t give a rip about mathematics achievement. Greene took some heat for that, eventually re-characterizing the data as “an amusement.”

This time, Greene and co-authors Marcus Winters and Julie Trivitt investigate the question of whether narrowing curriculum to put greater emphasis on two tested subjects (math and reading) in Florida schools might have a negative impact on student achievement in other subjects. Their answer? No.

Eduwonkette and other bloggers have raised lots of questions about technical aspects of the study’s research design, and the fact that the report was embargoed, not subject to traditional peer review, before hitting cyberspace; these are the kinds of inquiries that won’t be satisfied until long after the titular core message (“building on the basics” is a good and justifiable thing) has become conventional wisdom. Sherman Dorn cranked out an engaging essay on “the reworking of intellectual credibility in the internet age (which) will involve judgments of status as well as intellectual merit.” And an “Anonymous Peer Review” poster on the Ed Week blog set up, point by point, technical issues of concern in the piece, including some that are obvious even to research lightweights. For example, the study uses two years of math and reading achievement data and one year of test scores in science. That’s right—one year. I’m no statistician—but isn’t it hard to do growth comparisons with only one set of numbers?

Some tidbits from the report:

We find that students attending schools designated as failing in the prior year made greater gains on the state’s science exam than they would have done if their school had not received the F sanction.

There are two important reasons that we might expect schools deemed to be failing to respond positively. Those that have received an F grade for the first time may be shamed into improving their performance. Those that have received at least one failing grade may decide to raise their performance because they fear attrition of their student body.

Though there is some disagreement about which aspect of the accountability policy was effective (the threat of vouchers or the shame of an F grade), each of these analyses found that the policy improved the math and reading proficiency of students in public schools designated as failing.

While the hard-core researchers duke it out, let me step aside here and think like a teacher. Greene and his colleagues, through the Manhattan Institute (“turning intellect into influence”) have released a study strongly suggesting several things, some of which will be appealing to Florida legislators:

· Don’t worry too much about schools cutting back on science or other academic subjects to meet math and literacy targets, because it doesn’t really matter, in the long run. Science scores are likely to go up, statistically, if math and reading scores go up—and that’s good enough for us.

· Schools can “decide” to raise their performance after being shamed and threatened.

· The policy of giving schools failing grades improves their reading and math proficiency. And now we have evidence that it improves all subjects, whether we spend time teaching them or not. Failure, therefore, is a great motivator.

· Sanctions work, and are much less expensive than investing in improved instruction, engaging curriculum or retaining effective teachers.

Florida is a state with nearly 11,000 National Board Certified Teachers. The National Council on Teacher Quality, commenting acerbically on the recent—generally positive—National Research Council report on National Board Certification, said this:

Teachers from advantaged schools and states with financial incentives were more likely to participate in the certification process. Board-certified teachers are more likely to remain in the field than other teachers, and are more likely to move to assignments in high-performing schools with lower rates of poverty.

When policy and research “decide” that perhaps a robust science program really isn’t a necessity in a failing school, where are the Board-certified teachers going to migrate? Where might an accomplished science teacher seek refuge from the trickle-down effects of policy and research, along the bottom of the triangle?

Monday, April 21, 2008

GET OUT YOUR POM-POMS: PREP ASSEMBLY

As a retired NEA member, I get their monthly Works4Me e-newsletter, a cheery little number usually dedicated to small, homey tips and tricks for making a classroom run more smoothly—items on the order of inexpensive (but cute!) bulletins boards and what to do when those darned kids forget their pencils.

I skim W4M because I want to know what’s important to teachers, what they care deeply about—enough to share with a million of their colleagues. The well-established gap between practice and policy is usually on full display, but I hold out hope, every month, that Works4Me will feature a hard-hitting column on six ways to retain promising novice colleagues, or a creative lesson on inspiring civic awareness and responsibility in high school juniors. But no.

This month’s Works4Me left me slack-jawed, however. The lead article was titled “Peppy Test Prep.” Quoting:

"We have a pep assembly for the third and fourth graders a couple of days before standardized testing starts. Two teachers pretend they are cheerleaders and shake pompoms as they give a ‘pep’ talk about doing a good job on the tests, getting a good night's rest, etc. We have three teachers sit in desks and pretend to be examples of how not to take the test. One keeps turning around and bothering his neighbor, one cries, and one is not paying attention to directions.”

If I had any doubt about the piece being legitimate, the use of the phrase “bothering his neighbor” was pure teacher-speak. This was the real deal, sent from a teacher in South Dakota, who felt that a good dose of, unh, pep was the ticket to raising student achievement, and was generously sharing some bright ideas on effective ways to boost those all-important scores:

“Another teacher is showing the ‘right’ way to take the test. Breakfast is provided for the students and the teachers/helpers on testing mornings. We also borrow an archway from the local hardware store and put Christmas lights on it with a sign that says, ‘Entering Testing Zone’. We set it up in the hallway that leads to the third and fourth grade rooms. The lights are on whenever we are testing."

There’s a disclaimer from the NEA printed on the page—they’re just providing space for their members to “share” (and soliciting advertisers to pay for that space). Still—showcasing a member who feels that putting up the third grade equivalent of prom decorations and offering a special full breakfast on testing days is the right way to prepare kids for the rigors of standardized testing seems more than a little schizophrenic to me.

I live in union country. And I know that many—maybe most—of my teaching colleagues are marginally interested in the state and federal policies that shape their work. I understand--they’re busy. But blanket testing of kids beginning in the third grade has a major impact on the instructional cycle, curriculum development and resource distribution. We need a more thoughtful response than a pep assembly.

How about organizing members to demand that tests mandated by NCLB be spaced throughout the school year to minimize disruption to the instructional flow and actually assess progress? Why not lobby for teams of third grade teachers to write the tests, to ensure their alignment to reasonable but challenging third-grade skills and knowledge? And if a good breakfast makes such a difference in academic success, why isn’t the NEA sending out articles on rallying the community to feed kids every morning?

Sunday, November 11, 2007

More Ed Links: Suffering Children: The Effects of Trauma on Learning, or, Another Reason to Question the Field of Education’s Narrow Focus on Pedagogy

Note: the point is not that traumatized children can't learn. But the effects of trauma create yet another barrier and challenge (on top of other basics like HUNGER) that too many inner-city children, in particular, have to overcome.

How can we expect teachers to respond to the deep needs of these suffering children in overcrowded classrooms? How can we hope to solve the "education" problem if we don't address the effects of trauma?

What is Posttraumatic Stress Disorder (PTSD)?

“An anxiety disorder associated with serious traumatic events and characterized by such symptoms as survivor guilt, reliving the trauma in dreams, numbness and lack of involvement with reality, or recurrent thoughts and images.”

How Many “At-Risk” Children Develop PTSD?

Rates of PTSD are much higher in children and adolescents recruited from at-risk samples. The rates of PTSD in these at-risk children and adolescents vary from 3 to 100%. For example, studies have shown that as many as 100% of children who witness a parental homicide or sexual assault develop PTSD. Similarly, 90% of sexually abused children, 77% of children exposed to a school shooting, and 35% of urban youth exposed to community violence develop PTSD.

How Does PTSD Affect These Children?

In one study of children in foster care, 64% who had experienced sexual abuse had PTSD, and 42% who had experienced physical abuse fulfilled the PTSD criteria. Moreover, 18% of the children who were not abused also met PTSD criteria, presumably because they had witnessed violence. . . . .

In addition to the symptoms of numbing, hyperarousal, and recollections of the event that adults experience, children often become unable to participate in the normal developmental experiences of childhood, such as visiting friends and participating in after-school activities. In addition, the quality of schoolwork is likely to be significantly compromised. The compromised ability to participate in the normal developmental experiences of childhood has far-ranging impact, even when and if the initial underlying symptoms that are the basis for diagnosing PTSD are resolved.

Furthermore, a host of emotional and behavioral problems frequently arise as a result of PTSD and are not part of the criteria for categorical diagnosis. These include disruptive behavior disorders, eating disorders, sexual acting out, other risk-taking activities, depression, the full range of anxiety disorders, dissociation, mood lability, violence, and difficulty concentrating.

More Effects on Achievement and Young Brains:

This new understanding of the way childhood trauma affects memory and the brain has important implications for public health policy. One example would be the case of inner-city children who have witnessed violent crimes in their neighborhoods and families. If this kind of stress can cause damage to brain areas involved in learning and memory, it would put these children at a serious academic disadvantage in ways and for reasons that programs such as Head Start may be unable to address. Studies confirm this: in war-torn Beirut, traumatized adolescents with PTSD, as compared to non-traumatized adolescents who were without PTSD, lagged behind in academic achievement.28

Effects on Inner-city Adolescent Girls, in Particular:

Most inner-city adolescent girls have been exposed to some kind of trauma and most have experienced psychological distress as a result, according to a study by researchers at the National Center for PTSD and their colleagues. Many of these girls go on to develop full or partial post-traumatic stress disorder (PTSD), a disorder that can result in poor quality of life for inner-city youth. . . .

  • 85.5% witnessed community violence
  • 55.5% witnessed shootings
  • 38.9% witnessed stabbings
  • 13.3% witnessed homicides
  • 4.5% were shot or stabbed themselves
  • 36% used weapons
  • 24% had been arrested
  • 20% had spent time in jail
  • 67.7% heard about friend or family homicide
  • 32% witnessed physical abuse at home
  • 16% experienced physical abuse at home
  • 11% experienced sexual abuse at home
  • 30% experienced sexual abuse outside of home
  • 10% had been raped
  • 13% could be diagnosed with current PTSD
  • 11% could be diagnosed with partial PTSD

Study of 113 Inner-City Children:

The author of the Philadelphia study, Hallam Hurt, M.D., Chair of the Neonatology Division at Albert Einstein Medical Center (Philadelphia), followed 113 inner-city children from birth until they were seven years old. . . .

By age seven, 74 percent of the children in the study had heard gunfire and 13 percent had witnessed a shooting or stabbing in their own home. 60 percent reported that they worry some or much of the time that they may get killed or die; 20 percent sometimes wished that they were dead; 19 percent had seen a dead body outside their homes.

Even more alarming, children exposed to violence suffered from a variety of personal problems and performed poorly in school.

"This fits," according to Dr. Bremner, "into the context of a range of studies -- both in animals and humans -- showing that stress can have a deleterious effect on brain systems involved in memory. This kind of damage may well underlie difficulties with new learning and cognition that cause poor academic performance in these children." It may also mean that helping these children lead better lives may not be as simple as removing them from the stressful environment.

Effects on the Brain More Broadly: An Explanation of Why PTSD is So Difficult to Treat

Findings show how trauma disables normal brain functioning and highlight deficits in basic mechanisms of learning and memory. Recent findings also show that a common neurological basis explains altered emotional responses in veterans with PTSD, and that fear learning caused by trauma is different from other types and may explain why it is more difficult to treat.