How many people have been killed in the wars in Afghanistan, Iraq, Syria, Yemen and Somalia? On Nov. 18, a UN press briefing on the war in Yemen declared authoritatively that it had so far killed 5,700 people, including 830 women and children. But how precise are these figures, what are they based on, and what relation are they likely to bear to the true numbers of people killed?
Throughout the U.S.-led war in Afghanistan, the media has cited UN updates comparing numbers of Afghans killed by “coalition forces” and the “Taliban.” Following the U.S. escalation of the war in 2009 and 2010, a report by McClatchy in March 2011 was headlined, “UN: U.S.-led forces killed fewer Afghan civilians last year.” It reported a 26 percent drop in U.S.-led killing of Afghan civilians in 2010, offset by a 28 percent increase in civilians killed by the “Taliban” and “other insurgents.”
This was all illustrated in a neat pie-chart slicing up the extraordinarily low reported total of 2,777 Afghan civilians killed in 2010 at the peak of the U.S.-led escalation of the war.
Neither the UN nor the media made any effort to critically examine this reported decrease in civilians killed by U.S.-led forces, even as U.S. troop strength peaked at 100,000 in August 2010. Pentagon data showed a 22 percent increase in U.S. air strikes, from 4,163 in 2009 to 5,100 in 2010, and U.S. special forces “kill or capture” raids exploded from 90 in November 2009 to 600 per month by the summer of 2010, and eventually to over 1,000 raids in April 2011.
Senior U.S. military officers quoted in Dana Priest and William Arkin’s book, Top Secret America, told the authors that only half of such special forces raids target the right people or homes, making the reported drop in resulting civilian deaths even more implausible.
If McClatchy had investigated the striking anomaly of a reported decrease in civilian casualties in the midst of a savagely escalating war, it would have raised serious questions regarding the full scale of the slaughter taking place in occupied Afghanistan. And it would have revealed a disturbing pattern of under-reporting by the UN and the media in which a small number of deaths that happened to be reported to UN officials or foreign reporters in Kabul was deceptively relayed to the world as an estimate of total civilian war deaths.
The reasons for the media’s reluctance to delve into such questions lie buried in Iraq. During the U.S. military occupation of Iraq, controversy erupted over conflicting estimates of the numbers of Iraqis killed and details of who killed them. If more UN officials and journalists had dug into those conflicting reports from Iraq and made the effort to really understand the differences between them, they would have been far better equipped to make sense of reports of numbers of people killed in other wars.
The critical thing to understand about reports on numbers of civilians killed in wars is the difference between “passive reporting” and scientific “mortality studies.”
When I was investigating the conflicting reports of civilian deaths in Iraq, I spoke with Les Roberts, an epidemiologist at Columbia University’s School of Public Health and one of the co-authors of two comprehensive mortality studies conducted in occupied Iraq in 2004 and 2006.
Les Roberts had conducted mortality studies in war zones for many years, including studies in Rwanda in 1994 and the Democratic Republic of Congo (DRC) in 2000 that are still widely cited by the media and Western politicians without the taint of controversy that was immediately attached to his and his colleagues’ work in Iraq.
In 2004, Roberts and his colleagues conducted a scientific epidemiological study of mortality in Iraq since the U.S. invasion. They concluded that “about 100,000 excess deaths, or more” had resulted from the first 18 months of U.S.-led invasion and occupation. They also found that, “Violent deaths were mainly attributed to coalition forces,” and, “Most individuals killed by coalition forces were women and children.”
Both Nancy Youssef of McClatchy (then Knight Ridder) and John Simpson of the BBC also reported that U.S.-led forces, not Iraqi resistance fighters, were probably responsible for most civilian deaths in Iraq, based on figures published by the Iraqi Health Ministry.
On Sept. 25, 2004, the Miami Herald carried a report by Youssef under the headline, “U.S. attacks, not insurgents, blamed for most Iraqi deaths.” A Health Ministry official told Youssef, “Everyone is afraid of the Americans, not the fighters. And they should be.”
But after John Simpson noted the same pattern in the next Health Ministry report on the BBC’s flagship Panorama news program, the BBC received a phone call from the occupation government’s Health Minister disavowing his own ministry’s published data on who was killing who in Iraq. The BBC retracted its story and subsequent Health Ministry reports no longer assigned responsibility for civilian deaths to either party in the conflict.
Les Roberts and his colleagues completed an even larger mortality study in Iraq in 2006, by which time they found that an estimated 650,000 Iraqis had died in the first three years of the war. Both their studies revealed much higher mortality rates than had been reported by Iraqi hospitals, the Health Ministry, the Western media or “Iraq Body Count”, a much-cited Western compilation of data from such “passive” sources.
As each of their studies was released, Roberts and his colleagues became targets of blistering campaigns by U.S. and British officials to dispute and dismiss their findings. The critics didn’t make educated critiques of their methodology, which was state-of-the-art in their field, but mostly just insisted that they were out of line with other reports and so must be wrong.
These campaigns were so successful in throwing mud in the water and confusing the media and the public that corporate media became very reluctant to attach any credibility to this otherwise solid evidence that the U.S.-led war in Iraq was far more deadly than most people in the West had realized. Corporate media took the easy way out and began referring to numbers of civilian deaths in Iraq only in vague, politically safe terms, if they mentioned them at all.
In reality, the huge discrepancy between the results of these mortality studies and “passive reporting” was exactly what epidemiologists expected to find in a conflict zone like occupied Iraq.
As Les Roberts and his colleagues have explained, epidemiologists working in war zones typically find that passive reporting only captures between 5 percent (in Guatemala, for example) and 20 percent of the total deaths revealed by comprehensive mortality studies. So their finding that passive reporting in Iraq had captured about one in 12 actual deaths was consistent with extensive research in other war-torn countries.
In the U.K., Prime Minister Tony Blair dismissed the “Lancet survey ” out of hand, claiming that, “Figures from the Iraqi Ministry of Health, which are a survey from the hospitals there, are in our view the most accurate survey there is.”
But in 2007, the BBC obtained a set of leaked documents that included a memo from Sir Roy Anderson, the chief scientific adviser to the U.K.’s Defense Ministry, in which he described the epidemiologists’ methods as “close to best practice” and their study design as “robust.”
The document trove included emails between worried British officials admitting that the study was “likely to be right” and that “the survey methodology used here cannot be rubbished, it is a tried and tested way of measuring mortality in conflict zones.” But the very same official insisted that the government must “not accept the figures quoted in the Lancet survey as accurate.”
Other mortality surveys conducted in Iraq have produced lower figures, but there are legitimate reasons to regard the work of Les Roberts and his colleagues as the gold standard, based on their experience in other conflicts and the thoroughness of their methods.
Other surveys were conducted by the occupation government, not by independent researchers, inevitably making people reluctant to tell survey teams about family members killed by occupation forces. Some studies excluded the most war-torn parts of Iraq, while one was based only on a single question about deaths in the family as part of a lengthy “living conditions” survey.
The authors of the most recent study, published in the PLOS medical journal in 2013, a decade after the invasion, have acknowledged that it produced a low estimate, because so much time had elapsed and because they did not interview any of the more than 3 million people who had fled their homes in the most devastated areas. They made adjustments to compensate for such factors, but those adjustments themselves were deliberately conservative. However, their estimate of 500,000 violent civilian deaths