sa国际传媒

Skip to content
Join our Newsletter

Dubious polls hurt credibility, democracy: pollsters

OTTAWA 鈥 A dubious poll purporting to show Justin Trudeau trailing in his own Montreal riding has set off alarm bells in an industry already struggling to regain credibility after some spectacular failures to gauge election outcomes.
xxxVKA-TRUDEAU01110.jpg
A poll commissioned by the NDP showed that Liberal Leader Justin Trudeau was trailing in his own riding. The real purpose was to rattle him prior to last Thursday's debate.

OTTAWA 鈥 A dubious poll purporting to show Justin Trudeau trailing in his own Montreal riding has set off alarm bells in an industry already struggling to regain credibility after some spectacular failures to gauge election outcomes.

The poll of voters in Papineau, conducted by CROP and commissioned by the NDP, suggested the Liberal leader was running 11聽points behind New Democrat Anne Lagace Dowson.

It was strategically leaked to some media outlets Thursday a few hours before Trudeau was to face off against NDP Leader Tom Mulcair and Conservative Leader Stephen Harper in a debate on the economy.

The immediate objective was clear: Rattle the Liberal leader and put him off his game.

But it also had a longer range goal: Break the three-way logjam by persuading Canadians not to waste their votes on a party whose leader can鈥檛 even win his own seat.

The Liberals charged that the poll had over-sampled NDP supporters and under-sampled Liberal supporters. Five reputable pollsters who examined the methodology at the request of The Canadian Press agreed that the survey did indeed seem flawed in a number of ways, skewing the results.

Another survey, conducted by Mainstreet Research for Postmedia and involving a sample more than twice the size of the CROP poll, was released the next day with markedly different results, suggesting Trudeau was five points ahead of Lagace Dowson.

As part of its survey, CROP asked respondents how they voted in the 2011 election: 32 per cent said NDP, just 14 per cent said Liberal 鈥 far from the vote share each party actually had last time, 28 and 38 per cent respectively.

Some deviation can be expected; people forget or lie about how they voted. But such a big discrepancy should have raised 鈥渉uge questions鈥 about how representative the survey sample truly was, said Christian Bourque, executive vice-president of Leger Marketing.

But even had CROP鈥檚 methodology been beyond doubt, Bourque is disturbed by the idea of a pollster鈥檚 research being used 鈥渁 bit like guerrilla polling鈥 by a political party to destroy an opponent鈥檚 prospects. 鈥淭o me it does look like or sound like survey bombing, much like photo bombing.鈥

The Papineau poll flap is a cautionary tale for so-called progressive voters who are being urged by various groups to vote strategically for the opposition party best positioned to defeat Harper鈥檚 Conservatives. National poll numbers tell voters nothing about individual ridings, and riding polls aimed at helping them can be badly flawed or misleading.

Guidelines established by the industry鈥檚 voluntary professional watchdog, the Marketing Research and Intelligence Association, caution polling firms against marketing a product under the guise of market research, Bourque noted. Conducting a poll for a party to advance its own political interests treads too close to the line for Bourque鈥檚 comfort and 鈥渄oes not do our industry any good.鈥

CROP vice-president Youri Rivest did not respond to a request for comment.

Mainstreet is not doing any partisan polling during this election but has done some polling in the past for municipal campaign candidates. Mainstreet president Quito Maggi said his firm would never allow a client to leak survey results to score political points.

鈥淚n fact, my contract with Postmedia, they can鈥檛 publish a poll if I say they can鈥檛 publish a poll. It doesn鈥檛 matter how newsworthy it might be, if I don鈥檛 feel it鈥檚 responsible, they can鈥檛 publish it,鈥 he said.

Among other things, Maggi said he wouldn鈥檛 allow publication of a riding poll that surveyed fewer than 600 respondents or that had a margin of error greater than four percentage points, 19 times in 20. The CROP poll surveyed 375 Papineau voters and had a margin of error of over five points.

Maggi suggested that CROP may not have known the NDP would leak its poll. However, the NDP leaked a CROP survey targeting Bloc Qu茅b茅cois Leader Gilles Duceppe a couple of weeks earlier.

The controversy comes as the polling industry is attempting to salvage its reputation with the creation of the new Canadian Association for Public Opinion Research. Its founding chairman, Ipsos Public Affairs head Darrell Bricker, has railed against shoddy polls.

鈥淎ll of this MUST stop,鈥 Bricker and Ipsos partner John Wright wrote in 2011. 鈥淲e are distorting our democracy, confusing voters, and destroying what should be a source of truth in election campaigns 鈥 the unbiased, truly scientific public opinion poll.鈥