Friday, January 04, 2008

Iraqi death toll shrinks

Three weeks before the 2006 midterm elections gave Democrats control of Congress, a shocking study reported on the number of Iraqis who had died in the ongoing war. It bolstered criticism of President Bush and heightened the waves of dread -- here and around the world -- about the U.S. occupation of Iraq.

Published by The Lancet, a venerable British medical journal, the study used previously accepted methods for calculating death rates to estimate the number of "excess" Iraqi deaths after the 2003 invasion at 426,369 to 793,663; the study said the most likely figure was near the middle of that range: 654,965.

The number has since become a talking point for left-wing commentators, and many have looked closely at the methodology to see why it's an order of magnitude or more greater than other estimates.

How to explain the enormous discrepancy between The Lancet's estimation of Iraqi war deaths and those from studies that used other methodologies? For starters, the authors of the Lancet study followed a model that ensured that even minor components of the data, when extrapolated over the whole population, would yield huge differences in the death toll. Skeptical commentators have highlighted questionable assumptions, implausible data, and ideological leanings among the authors, Gilbert Burnham, Riyadh Lafta, and Les Roberts.

Some critics go so far as to suggest that the field research on which the study is based may have been performed improperly -- or not at all. The key person involved in collecting the data -- Lafta, the researcher who assembled the survey teams, deployed them throughout Iraq, and assembled the results -- has refused to answer questions about his methods.

Over the past several months, National Journal has examined the 2006 Lancet article, and another [PDF] that some of the same authors published in 2004; probed the problems of estimating wartime mortality rates; and interviewed the authors and their critics. NJ has identified potential problems with the research that fall under three broad headings: 1) possible flaws in the design and execution of the study; 2) a lack of transparency in the data, which has raised suspicions of fraud; and 3) political preferences held by the authors and the funders, which include George Soros's Open Society Institute.

Officials at Iraq Body Count strongly opposed the Iraq war yet issued a detailed critique of the Lancet II study. Researchers wading into a field that is this fraught with danger have a responsibility not to be reckless with statistics, the group said. The numbers claimed by the Lancet study would, under the normal ratios of warfare, result in more than a million Iraqis wounded seriously enough to require medical treatment, according to this critique. Yet official sources in Iraq have not reported any such phenomenon. An Iraq Body Count analysis showed that the Lancet II numbers would have meant that 1,000 Iraqis were dying every day during the first half of 2006, "with less than a tenth of them being noticed by any public surveillance mechanisms." The February 2006 bombing of the Golden Mosque is widely credited with plunging Iraq into civil war, yet the Lancet II report posits the equivalent of five to 10 bombings of this magnitude in Iraq every day for three years.

"In the light of such extreme and improbable implications," the Iraq Body Count report stated, "a rational alternative conclusion to be considered is that the authors have drawn conclusions from unrepresentative data."

(Hat tip: Little Green Footballs)

No comments: