I’m aghast. Over on TechCrunch, a site known as much for its gossip-mongering as its tech reporting, John Biggs is reporting (sort of) on a study that he claims demonstrates children who get computers in developing nations get worse grades in school.
Here’s the link: Study: Mixing School-age Kids and Computers makes for Bad Stuff.
I’m a researcher and there are so many things wrong with John’s throwaway piece that my head is reeling…
The greatest mistake is that correlation does not equal cause. That’s the mantra of all researchers, because it’s typically impossible and illogical to connect cause and effect when you aren’t studying that specific relationship.
A classic example: smokers are less healthy than non-smokers. Smokers have ashtrays in their houses while non-smokers do not. Therefore, ashtrays make you unhealthy.
John quotes unpublished (e.g. non-peer reviewed) research:
“In a draft of an article that the Quarterly Journal of Economics will publish early next year, the professors report finding “strong evidence that children in households who won a voucher received significantly lower school grades in math, English and Romanian.” The principal positive effect on the students was improved computer skills.”
John explains his bias up front, at least, when he says “I’ve always believed that computers, in a general sense, are not a panacea for developing nations…” but in his zeal to have this unpublished research substantiate his position, he completely misses the point that it’s convenient but inaccurate to conclude that since the children whose families won vouchers for computers received lower grades it must therefore mean that the introduction of computers into those families caused the lower grades.
A possible alternative explanation: families that didn’t have computers gained a computer through the voucher program and the parents then spent more spare time playing with the computer than supervising their children’s studies. Ergo, their lower grades could have been caused by a change in their homework and study habits, not use of the computer itself.
Probable? Dunno. Possible? You bet. But in this sort of apparently sloppy research (and, sorry John, lazy reporting) it is ignored in the rush to use “research” to substantiate an existing perspective.
John does share anecdotal qualitative data about his own behavioral patterns as a way to explain why he is (presumably) searching for this sort of data: “I believe computers are an important tool but without supervision they are a massive distraction. I am paid, in a sense, to putz around on the Internet and let me tell you that it changes brain chemistry and thought patterns. I’m more distracted, less polite, and unable to maintain a train of thought for more than an hour.”
I’ll just say: if you’re going to report academic research, please, please focus on what the researchers actually say in their research, and be skeptical of conclusions, particularly of correlational survey data of this nature.
You’ll note that I do not share my own views about this topic here. Why? Because they’re irrelevant to the topic I’m writing about. Op-Eds are not reporting…