You're reading: Posts Tagged: bad maths

Here’s How Little I See Your Point

You may have seen an article linked to last week, written by Jordan Weissmann at The Atlantic. The article was titled ‘Here’s How Little Math Americans Actually Use At Work‘, although mysteriously this journalist makes use of some mathematical analysis of survey data, and not only that, the data appears to show that 94% of Americans claim to use mathematics as part of their daily job.

The article discusses people’s misconceptions about the future utility of what they were learning, as well as the divide between using ‘any math’ and ‘advanced math’, which includes calculus, algebra and statistics. The number of Americans who admitted to using this type of maths appears to drop off once you get to anything more complicated than fractions, and also presented is an analysis of this divide by job type.

A very well-written and thoughtful response to this has already been posted at mathematics professor Bret Benesh’s blog, which gives four reasons why the article annoyed him (and probably several other people too).

Investigative journalist attempts to test whether GCSE maths is ‘dumbed down’

Barnie Choudhury, principal lecturer at the University of Lincoln’s school of journalism with a background in investigative journalist, is taking the GCSE examinations in an attempt to “test whether or not the allegations made in recent years that exams had been ‘dumbed down’ were true”. An article in the Lincolnshire Echo says:

He sat his O-level in maths in 1981 and came out with a B grade.
If he does not match this when the GCSE grades are revealed in August, Mr Choudhury believes this will prove that exams today are harder.

Flaws in the experimental methodology left as an exercise for the reader, although Mr Choudhury hints at some when he is quoted saying:

A part of me is hoping that journalists are right – that exams are easier. But I see my daughter’s mathematics work now and I don’t know any of it. So I thought if she was going through the pain, then so would I and I’d see for myself how tough the exams are.
But now I’m wishing I hadn’t started. It has not been dumbed down at all – if anything, I’m finding it more difficult the second time around, even though I’m older and I’ve sat lots of exams in my life. Maybe my brain has slowed down but it really is difficult.

Source: University of Lincoln lecturer inspired to take maths GSCE by his children.

Visualising the wrong data on the Guardian data blog

This visualisation shows for each council or unitary authority how many hours a week you’d need to work, earning minimum wage, in order to pay the median rent for a one-bed flat. The minimum wage is a national constant.

No justification is given for using the median rent. In a fair world, the median rent should be paid by someone on the median income. Assuming that people earning the minimum wage are the lowest earners1 and make up X% of the population, then an upper bound for rent paid by people earning minimum wage should be the Xth percentile, if housing is provided fairly2.

Continue reading “Visualising the wrong data on the Guardian data blog” on cp’s mathem-o-blog

A Dismal Performance from the Dismal Science

Paul J. Ferraro and Laura O. Taylor ask, “Do Economists Recognize an Opportunity Cost When They See One? A Dismal Performance from the Dismal Science

One expects people with graduate training in economics to have a deeper understanding of economic processes and reasoning than people without such training. However, as others have noted over the past 25 years, modern graduate education may emphasize mathematics and technique to the detriment of economic reasoning. One of the most important contributions economics has to offer as a discipline is the understanding of opportunity cost and how to apply this concept to all forms of decision making. We examine how PhD economists answer an introductory economics textbook question that requires identifying the relevant opportunity cost of an action. The results are not consistent with our expectation that graduate training leads to a deeper understanding of the concept. We explore the implications of our results for the relevance of economists in policy, research, and teaching.

Importantly, given four options, only 21.6% of respondents chose the correct one. They performed worse than chance. Some feeble statistical analysis is performed by the authors.

This challenges none of my views about economists: none of them can do maths; none of them can do statistics; what they do has very little rational basis; they are terrible at designing questions for undergrads that don’t require you to make assumptions, often drawing heavily on cultural knowledge.

Found via MetaFilter, which compares the problem to the Monty Hall problem in probability. Nowhere near, in my opinion.

Pricing bot interactions

Carlos Bueno writes about a book “Computer Game Bot Turing Test”. This, he says, is:

one of over 100,000 “books” “written” by a Markov chain running over random Wikipedia articles, bundled up and sold online for a ridiculous price. The publisher, Betascript, is notorious for this kind of thing.

He writes that the pricing bots on Amazon Marketplace have got hold of this book and are “fight epic price wars” over it.

So with “Turing Test” we have a delightful futuristic absurdity: a computer program, pretending to be human, hawking a book about computers pretending to be human, while other computer programs pretend to have used copies of it. A book that was never actually written, much less printed and read.

He then talks about his own book (Lauren Ipsum; a children’s story about computer science) and how he saw pricing bots fighting over this. The book is print-on-demand, so a bot claiming to have a used copy could simply buy a new copy and resell it for a profit. Then the bots started to undercut the retail price! Finally, the Amazon pricing bot put his book on sale at 28% discount (and Amazon swallows the difference).

My reaction to this algorithmic whipsawing has settled down to a kind of helpless bemusement… After all, I no longer have a choice. The price is now determined by the complex interaction of several independent computer programs, most of which don’t actually have a copy to sell.

Read the whole story: How Bots Seized Control of My Pricing Strategy.

Why I like some bad maths stories

My two most recent posts here have been about a story reporting a coincidence as more exceptional that it is and ‘bad maths’ reported in the media. Both are examples of mathematical stories being reported in a way that is not desirable. Somehow, though, I like the whist story and dislike the PR equations. I have been thinking about why this might be the case.

The PR-driven, media-friendly but meaningless equations from the first article are annoying because they present an incorrect view of mathematics and how mathematics can be applied to the real world. Applications of mathematics are everywhere and compelling, yet the equations in these sorts of equations seem to present little more than vague algebra. The commissioned research with seemingly trivial aims I find more difficult because, as commenters on that article pointed out, it is really difficult to decide what is trivial. Still, reporting that a biscuit company has commissioned research into biscuit dunking is either meaningless PR or else a matter of internal interest, and certainly nothing like what I expect mathematicians do for a living.

Coming back to our Warwickshire whist drive: what do I like about this story? It too presents incorrect information about mathematics and the real world, claiming that the event, four perfect hands of cards dealt, is so unlikely that it is only likely to happen once in human history (and it happened in this village hall!).

I think the difference is that the mathematics used, combinatorics and probability, appear to be correctly applied. The odds quoted, 2,235,197,406,895,366,368,301,559,999 to 1, are widely reported and I see no reason to doubt them.

The problem, then, is one of modelling assumptions. Applying a piece of mathematics to the real world involves describing the scenario, or a simplified version of it, in mathematics, solving that mathematical model and translating the solution back to the real world scenario. In this case, the description of the scenario in mathematics assumes that the cards are randomly distributed in the pack. This modelling assumption, rather than the mathematics, is where the error lies.

The result is still a bad maths news story, presenting a mathematical story as something other than what it is, but while the PR formulae are of little consequence, this incorrect application of a correct combinatorial analysis is something we can learn from.

‘Bad maths’ news stories

On the Math/Maths Podcast, we frequently cover ‘bad maths’ stories. A recent example was the bobbing apples story we spoke about in episode 71: Halloween Fruit Special. This proposed a “mind-bogglingly complicated equation”, provided by a supermarket, for finding the perfect bobbing apple:

D = 3 x (2 + T^2) x M / (10 x T), where D is diameter, T is typical texture of an apple, and M is average mouth size.

Along with another formula from a rival supermarket (I reproduce this as reported; I imagine the second equals is supposed to be a plus):

B = (BU + S) x (C = BI), where B is bobability, BU is buoyancy, S is size, C is colour and BI is biteability.

A headline like “Mathematician finds formula for the perfect bobbing apple” is a tell-tale sign of bad maths in the news. Or is it? Actually there are several types of story that all appear under this same style of headline.

A couple of years ago Simon Singh launched a mini-campaign against ‘phoney formulae’ being reported in the news. Simon describes being asked by a PR company for an equation to say that the perfect shopping day coincided with the launch of a shopping exhibition, saying to the PR company,

I would engineer the equation so that the graph peaked on the day you require. There would be no real science behind the equation, but it would look sensible and convincing.

and getting the response,

Your ideas and formulas are perfect and exactly what we are looking for and it would be great to confirm you working with us.

As well as calling them “absurd PR equations”, Simon also gave a more serious warning, saying this,

demeans mathematics and science by giving the impression that academics waste their time on frivolous topics and are willing to come up with the appropriate answer if someone is prepared to pay them enough money.

A 2004 BBC article, “Formula for the perfect formula“, claims the origin of this media fascination with formulae was a piece of work by Len Fisher on how to dunk biscuits, sponsored by a biscuit company. What is described in that article is, I think, something subtly different from what Simon is railing against.

Len seems to be taking corporate sponsorship to do real experiments (the original article describes a “two-month investigation”), just that they are experiments with fairly trivial goals. The article describes a scientist who is aware that newspapers just want “to make a story look scientific” but motivated by a desire to communicate science to the public through any means available. In the case of the biscuit dunking, Len is quoted describing the physical processes and saying: “As with most things in physics, we can write equations which govern this”.

I doubt the biscuit manufacturer cared in advance how long a biscuit should be dunked for (though they are presumably interested in getting their brand in the news) and Len claims to be doing real science to answer the question. I have also heard people describe being approached by PR companies with ready-made meaningless formulae to which the approachee is asked to put their name, on behalf of some brand. This seems similar to but slightly different from Simon’s case, where he is apparently asked to manufacture a realistic-looking piece of pseudo-mathematics to back up a pre-determined conclusion, or Len’s, where a brand name is associated with some trivial piece of research.

Simon also speaks about the danger of confusing real research with these PR equations. In Math/Maths 52: World’s Smallest Klein Bottle we covered side-by-side the formula for the perfect cup of tea and that for the perfect golf putt. The former appears to be just PR for a milk company but the latter, although you could imagine a headline like “Mathematicians discover the formula for the perfect putt” being dumb PR for a golf equipment company, appears to be based on genuine research. Using mathematics to improve the performance of sports people and manufacturing of sports equipment is big business. The author, a physics professor at Yale, filed a patent in 2005 through the university for a golf training aid, marketed through a spin-off company. This was described by the Dean of the Engineering Faculty at Yale as “a great example of the joy in practical application of basic science and engineering“. Over in the UK, I expect this would be an example of ‘knowledge-transfer’ and much sought-after evidence of the positive impact university research has on wider society.

There is another interesting case, when a real piece of research is explained using a metaphor which then gets reported as its real purpose. This may be what happened in a 2010 story in the Guardian, which is about a paper on Recursive Binary Sequences of Differences published in Complex Systems that we spoke about on Math/Maths 7. Attempting to explain potential applications to blending problems, the researcher seems to have given the trivial example of pouring coffee. The work is reported under the headline “How to pour the perfect cup of coffee” with explanation: “Years of research have resulted in the definitive way to pour the best second cup of coffee”. I don’t know what happened here but it looks to me like some number theory with potential applications to chemistry is being presented in a way that might lead you to believe it is one of Simon’s “absurd PR equations”.

So what have we learned? Rail against bad maths in the media when you see it, but be careful to check you’ve found what you think you’ve found and be aware there are levels of severity.