Disturbing (But, Alas, Predictable) Policy Outcomes for Teachers and Doctors’ Pay-4-Performance

Counting up the many differences between doctors and teachers make comparisons about pay-for-performance policies unlikely. Here’s a few:

*Doctors go to school four years to secure an M.D. and  then another two to six years (of which most are clinical  practice) to garner a specialty; most teachers spend two years, maybe three (of which six months to a year are in supervised classroom practice) to earn a bachelors and then a master’s degree in education; those who receive alternative certification have little to no time in supervised teaching prior to becoming the teacher of record.

*Doctors see patients one-on-one; teachers teach groups of 20 to 35 students all day.

*Most U.S. doctors get paid on a fee-for-service basis, nearly all public school teachers are salaried.

*Evidenced-based practice of medicine in diagnosing and caring for patients is more fully developed and used by doctors than the science of teaching and learning available to and accessed by teachers.

*Medicine is largely male-dominated while K-12 schooling is female-dominated.

*In terms of both social status and respect, polls rank doctors higher than teachers.

Enough?

With so many differences between doctors and teachers in training,  work, social, political, and institutional behaviors, why even compare the two?

The answer is that business-inspired medical and educational policymakers eager to reduce costs while improving health care and public schools have seized on pay-for-performance as a high-profile tool to accomplish both increased efficiencies and improved performance. Because of this fundamental similarity, untoward outcomes not only can be predicted from past incarnations of such policies but also have already emerged across both institutions. Here are just two.

Incentives corrupt measures.

Since the mid-1970s, social scientists have criticized the use of specific quantitative measures to monitor or steer policies because those implementing such policies alter their practices to insure better numbers. In the previous post, I gave instances of how Medicare and private insurers use of “quality measures” have distorted doctors’ practices. The work of social scientist Donald T. Campbell and economists in the mid-1970s about the perverse outcomes of incentives was available but went ignored. Campbell wrote in 1976.

“The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor” (Campbell 1976, p.54)

Campbell used examples drawn from statistics on police solving crimes (p. 55), the Soviets setting numerical goals in industry (p. 57), and the U.S.’s use of “body counts” in Vietnam as evidence of winning (p.58). For public schools, Campbell said that “achievement tests are … highly corruptible indicators (p.57).”

That was nearly forty years ago. In the past decade, researchers have documented  (also see here) the link between standardized test scores and narrowed instruction to prepare students for test items, instances of  state policymakers fiddling with cut-off scores on tests, increased dropouts, and straight out cheating. Although how the distortions occur are unclear, the evidence confirms Campbell’s insight.

Easy To Measure Indicators Trump Hard To Measure Ones

Few in medicine or education question that some indicators are easier to quantify than others. In medicine, for example, hospital mortality and surgical procedures are fairly easy to measure but the results even when compared to other hospitals and surgeons hide as much as they reveal about effective health care. So it is with standardized tests.

Easily accessible test scores have led to evaluating teachers on the basis of student performance. In Los Angeles, Washington, D.C., and  states–responding to federal incentives in Race to the Top–value-added measures have become a staple for determining effective teaching. Moreover, because test scores are easy (and inexpensive) to gather, more tests have been added across the nation giving a misleading, even inaccurate, gloss to the numbers. (For an extreme example, see here; a critique of piece is here and response here).

Because test scores are inexpensive and efficient to collect, they draw attention away from important but hard-to-measure aspects of teaching and learning such as student engagement, rapport between teachers and students, academic climate in classrooms, and principal leadership. Cumulative practitioner experience and stories about teaching over centuries have established these as crucial factors in working with gifted and vulnerable students. For physicians, quantifying the relationship with patients is just as hard to grasp leaving insurers with the leeway to evaluate physician quality by using readily available statistics on, for example, whether or not doctors give antibiotics within six hours to patients who might have pneumonia (see previous post).

Thus, over time, teachers and doctors come to see the “quality” measures used to evaluate and pay them as perverse eroding loyalty they have to their students, the institution, and the very process itself. Perhaps, the oath that medical school graduates take upon receiving the M.D. degree should also be taken by policymakers eager for pay-for-performance: Do no harm.

5 Comments

Filed under comparing medicine and education

5 responses to “Disturbing (But, Alas, Predictable) Policy Outcomes for Teachers and Doctors’ Pay-4-Performance

  1. I would love to share your articles with others but you don’t have a button for sharing other than through email…..any way you can get a twitter/facebook share option installed…..?

    Miriam Cutelis

  2. LeAnna Webber

    Many very good points here… I have always found that whatever gets measured gets the intense focus…and in my 15 years as an educator I have seen the unintended consequences of focusing on easy-to-measure standardized tests. I’m curious about the teacher education timelines you state. In my experience in Ohio, most teachers have a 4 year bachelors degree PLUS a Master’s which is a 2 year program. No one I work with is teaching with fewer than 4-5 years of college coursework.

    • larrycuban

      LeAnna,
      Thanks for comment. There is variation in how many years of college coursework folks take before receiving a bachelor’s and master’s degree, especially with the growth of alternative credentialing programs for teachers. While a century ago, you could teach in many districts with a high school diploma, you now need a four-year bachelor’s degree. In many states a masters is required to stay in teaching. Nonetheless, compared to becoming a licensed physician and lawyer, more years of formal schooling are required.

  3. It may be worth making the comparison here between the police (who have also been subjected to similar reforms) and teachers. This American Life had a good episode on this-essentially, when the police started to be rewarded for higher clearance rates, they were put under a lot of pressure to fudge numbers, miscategorize crimes, and even create crimes to “make the cut.” These kinds of reforms have never worked out well, as far as I can see.

    • larrycuban

      Thanks for suggesting the comparison. Donald Campbell–who I cite in the post–makes the same point in his 1976 article.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s