Thursday, March 25, 2004
Another dodgy dossier
A poll showing that most Iraqis were happier now was widely and uncritically reported - but was it accurate?
Media reports treated last week's poll of Iraqis, commissioned by the BBC, ABC News and others, as the population's definitive word on the war. "Iraqis happier without Saddam" trumpeted headlines, in response to the claim that 57% think life is better now than it was before the war. The poll of 2,737 Iraqis was carried out in February by Oxford Research International (ORI), which describes it as "a national survey" and "representative". President Bush's official blog gave it an approving nod: "Thanks to the bravery of our troops, and the principled, consistent leadership of our president, we are leaving Iraq better than we found it."
But how representative of Iraqi views is it? Western companies have conducted polls, but their findings are unconvincing. In October Zogby International and the American Enterprise magazine said they had conducted "the first scientific poll of the Iraqi public". Yet their sample was small: 600 Iraqis in Basra, Mosul, Kirkuk and Ramadi.
Polling in any post-war setting is difficult, and there are additional problems in Iraq. The UN says there is "a dearth of demographic information about Iraq's population over the past several decades". As a consequence of Ba'ath party secrecy, questions remain about the distribution of ethnic and religious groups and social classes. Iain Murray, a statistician based in Washington, says that for a poll to be representative, "matching the sample to the country's demography is absolutely key. Otherwise, you simply cannot be sure that you are not weighting the sample unconsciously towards or away from any section of society."
So how did ORI weight its sample for class and religion, to achieve results that, according to the BBC, "reflected Iraq's distribution of population, balance between men and women, and religious and ethnic mix"? It didn't....