Skip to main content
The Globe and Mail
Support Quality Journalism.
The Globe and Mail
First Access to Latest
Investment News
Collection of curated
e-books and guides
Inform your decisions via
Globe Investor Tools
Just$1.99
per week
for first 24 weeks

Enjoy unlimited digital access
Enjoy Unlimited Digital Access
Get full access to globeandmail.com
Just $1.99per week for the first 24weeks
Just $1.99per week for the first 24weeks
var select={root:".js-sub-pencil",control:".js-sub-pencil-control",open:"o-sub-pencil--open",closed:"o-sub-pencil--closed"},dom={},allowExpand=!0;function pencilInit(o){var e=arguments.length>1&&void 0!==arguments[1]&&arguments[1];select.root=o,dom.root=document.querySelector(select.root),dom.root&&(dom.control=document.querySelector(select.control),dom.control.addEventListener("click",onToggleClicked),setPanelState(e),window.addEventListener("scroll",onWindowScroll),dom.root.removeAttribute("hidden"))}function isPanelOpen(){return dom.root.classList.contains(select.open)}function setPanelState(o){dom.root.classList[o?"add":"remove"](select.open),dom.root.classList[o?"remove":"add"](select.closed),dom.control.setAttribute("aria-expanded",o)}function onToggleClicked(){var l=!isPanelOpen();setPanelState(l)}function onWindowScroll(){window.requestAnimationFrame(function() {var l=isPanelOpen(),n=0===(document.body.scrollTop||document.documentElement.scrollTop);n||l||!allowExpand?n&&l&&(allowExpand=!0,setPanelState(!1)):(allowExpand=!1,setPanelState(!0))});}pencilInit(".js-sub-pencil",!1); // via darwin-bg var slideIndex = 0; carousel(); function carousel() { var i; var x = document.getElementsByClassName("subs_valueprop"); for (i = 0; i < x.length; i++) { x[i].style.display = "none"; } slideIndex++; if (slideIndex> x.length) { slideIndex = 1; } x[slideIndex - 1].style.display = "block"; setTimeout(carousel, 2500); } //

ROB Insight is a premium commentary product offering rapid analysis of business and economic news, corporate strategy and policy, published throughout the business day. Visit the ROB Insight homepage for analysis available only to subscribers.

To borrow part of a phrase from our compatriot Neil Young, Statistics Canada's National Household Survey looks like Hiroshima. It's a barren statistical wasteland of flawed data scarred by the fallout from Ottawa's 2010 demolition of the long-form census. At best, it's a deeply flawed guide for policy makers – especially regarding the people most in need of government policy.

The long-awaited survey on income and housing trends, taken in 2011 but not released until Wednesday, is supposed to be the first large-scale measure of where Canadians stand economically since the Great Recession of 2008-09, which segments of our population have bounced back and which were left behind, whether gaps of inequality have closed or have become gulfs.

Story continues below advertisement

It doesn't do that – because it can't.

While the survey is in theory supposed to be a follow-up to the prerecession data from the 2006 census, the two use wildly different methodologies. One was a compulsory national census, with a response rate of 93.5 per cent. It was replaced with a voluntary survey of less than one-third of Canadian households, with a response rate of 68.6 per cent. Like any survey, it must be extrapolated over the entire population, it has margins of error, it has statistical biases based on who was willing to respond and who wasn't. (For example, it's generally accepted that the lowest-income segments of the population are typically the least likely to respond to voluntary surveys.)

In short, the two methods simply don't make for apples-to-apples comparisons. In the all-important income survey report, Statscan doesn't even try. It treats the survey as a new, standalone set of statistics with no previous benchmarks against which to measure it.

While this is all fine and good as a snapshot in time, and as a benchmark against which to measure future surveys, this means that Canada as a nation has no reliable way to gauge the impact of the biggest economic downturn in 70 years on its population. We've missed it. It's gone.

For example, we know from analysis of available U.S. data that in the first three years of recovery following the Great Recession, 95 per cent of the income gains in the United States went to the top 1 per cent of earners. We can be suitably appalled by such a statistic. Did something similar happen in Canada, or are we much more egalitarian, have much better social supports to prop up lower incomes in times of recession and recovery, etc.? We have no idea. We just don't have two reliably comparable sets of data, pre- and post-recession, to accurately draw any such conclusions.

Where this matters most is with Canada's lowest-income earners – and it's this segment that Statistics Canada singles out with its most damning assessment of the inadequacy of the survey.

"Low-income estimates from the 2011 National Household Survey [NHS] compared with previous censuses show markedly different trends than those derived from other surveys and administrative data such as the Survey of Labour and Income Dynamics or the T1 Family File," Statscan noted in its report, referring to other statistical estimates the national agency compiles. "Data to support quality estimates of low-income trends require a stable methodology over time that has similar response patterns. With the new methodology of the NHS, estimates of low income are not comparable with the census-based estimates produced in the past."

Story continues below advertisement

So, the people potentially most hurt by the recession – and, based on the U.S. finding, perhaps least participating in the recovery – don't appear to be accurately measured or represented by this survey. For governments, that means that perhaps the most crucial information in terms of guiding and assessing the past success and future direction of social policy isn't there. Now, they must operate in a statistical wasteland of their own making.

David Parkinson is a contributor to ROB Insight, the business commentary service available to Globe Unlimited subscribers. Click here for more of his Insights, and follow him on Twitter at @parkinsonglobe .

Your Globe

Build your personal news feed

  1. Follow topics and authors relevant to your reading interests.
  2. Check your Following feed daily, and never miss an article. Access your Following feed from your account menu at the top right corner of every page.

Follow the author of this article:

View more suggestions in Following Read more about following topics and authors
Report an error Editorial code of conduct
Due to technical reasons, we have temporarily removed commenting from our articles. We hope to have this fixed soon. Thank you for your patience. If you are looking to give feedback on our new site, please send it along to feedback@globeandmail.com. If you want to write a letter to the editor, please forward to letters@globeandmail.com.

Welcome to The Globe and Mail’s comment community. This is a space where subscribers can engage with each other and Globe staff. Non-subscribers can read and sort comments but will not be able to engage with them in any way. Click here to subscribe.

If you would like to write a letter to the editor, please forward it to letters@globeandmail.com. Readers can also interact with The Globe on Facebook and Twitter .

Welcome to The Globe and Mail’s comment community. This is a space where subscribers can engage with each other and Globe staff. Non-subscribers can read and sort comments but will not be able to engage with them in any way. Click here to subscribe.

If you would like to write a letter to the editor, please forward it to letters@globeandmail.com. Readers can also interact with The Globe on Facebook and Twitter .

Welcome to The Globe and Mail’s comment community. This is a space where subscribers can engage with each other and Globe staff.

We aim to create a safe and valuable space for discussion and debate. That means:

  • Treat others as you wish to be treated
  • Criticize ideas, not people
  • Stay on topic
  • Avoid the use of toxic and offensive language
  • Flag bad behaviour

If you do not see your comment posted immediately, it is being reviewed by the moderation team and may appear shortly, generally within an hour.

We aim to have all comments reviewed in a timely manner.

Comments that violate our community guidelines will not be posted.

UPDATED: Read our community guidelines here

Discussion loading ...

To view this site properly, enable cookies in your browser. Read our privacy policy to learn more.
How to enable cookies