Oh, for the halcyon days of yore—or would it be more accurate to say your Halcion® days?—when men were men and women were women and all knowledge could be reduced accurately and reliably to a number whether we were able to understand what that number meant or not. (Sigh!) When, in a criminal case, a judge would demand and get a digit or two that would tell him (or her) without undue complexity, deceit, or obfuscation whether a defendant was insane at the time of the offense and whether they were competent to stand trial.
My neighbor recently observed about life with all due solemnity, the answer is “42”. This was clearly a Shakespearian moment, whether it was to be or not was another question (entirely). I understood his meaning the way Jazz was understood in the fifties. Snap your fingers in agreement. Forty-two is a number and, therefore, reliable and certain. No need to bother one’s self with messy opinions from competing experts, just let the numbers answer the complex questions and move along.
None of this would have been possible if not for science and the role it plays in helping us understand our world. Science’s primary role these days is to get rid of the vagaries and dispatch problems so that we don’t have to trouble ourselves with thought. If a common measure could be applied to all phenomena, we wouldn’t have to think about anything, just look up the answer. “Forty-two, hell, I got 56 and I wasn’t even awake yet. At my best, I can get a 95. Whatchyou got?”
Probably our first conscious contact with numbers that we took as meaningful was our IQ. At least when I was growing up, we were given IQ tests, but the scores were never revealed, except by one kid who somehow penetrated the sanctum sanctorum of the office where the tests were kept. Then, everyone got to hear about the numbers because the kid would be spouting off about how gifted he or she (usually a he) was, while everyone else would guess about their own IQ. But, it was a valuable piece of information… or so we thought.
It’s true that IQ is valuable because IQ tests are the most stable, that is, they are more likely to give you similar results upon retesting than almost any other type of psychological test. Of course, what they don’t tell you is what the numbers really mean. The answer is simple enough. IQ correlates with academic success. The reason these tests were previously used in schools was to weed out those who would likely go on to college from those who likely would not. The reason that these tests stopped being used with the same frequency is that they are expensive and time consuming. More than that, the rules changed. With the proliferation of colleges and universities, education became democratized, which means that those who did not score so high on IQ tests might still excel by working harder.
Then, there is the pull from below, which has even less to do with IQ. Back in the day, we worried about grades. They still do where I live now, except now parents, friends, and family are more proactive, even aggressive, to insure academic success. I recently heard a story about a local community in which a principal tried to raise the quality of education at his school. The way the story was related to me was that the principal left town after a series of drive by shootings at his house when he was home with his family. He was demanding too much of students, apparently. “If you had just fixed the grades like your predecessor,” the message seemed to be, “everything would have been all right.” It’s simply amazing what can be done with numbers. You can even extend your life expectancy, although you may have to leave town to do it.
With this new creative use for numbers, we find that grades can be raised by first lowering the bar. Let the fat kid believe he is a great high jumper by changing the ruler to measure his leaps. His inch is everyone else’s millimeter. A little more fudging and he can be ready for the Olympics. The measuring is still accomplished with numbers, but they don’t have the same meaning they had before. Here is where the influence of voodoo is felt most strongly.
Physicians, too, give magic to numbers. Going back to TV advertising in the 1960s, one can see how many dentists recommended one brand of toothpaste over another, what the Journal of the American Medical Association said you should take to control your headache, or what doctors give to their families to treat stomach upset. Most of the advertising of the time included some numbers to impress us.
But, let’s look at academic research for a moment before we plunge in and look at the numbers ourselves to see what they tell us. First of all, consider the possibility that most physicians are just like you or me. They don’t want to read stuff that is extraneous, not if they can get the information quickly and without effort. Most of us would rather be doing something else. But keeping up on medical research is part of a physician’s livelihood.
How to save time? The answer is to read the abstract at the beginning of professional articles. This provides all necessary information about the contents of the article without undue thought. It will even give you a few numbers to demonstrate, albeit briefly, the strength of the research results. No muss. No fuss. Wow, that’s really impressive that they can do that. But how is it done?
This reminds me of the coffee commercial on TV in the 70s with the people in a well-known restaurant raving about the coffee. Just how did they do that? Come to find out years later that they offered a fancy meal to average folks with inexpensive tastes. They wined and dined them. Then, at the end of the meal they ask the question, “How did you like the coffee?” “It’s the best I ever tasted.” Then, they tell them what they were drinking, not Starbuck’s (which didn’t exist then), but the very same brand of instant coffee they would have every morning on their way to work. There’s a look of happy surprise. (Cut! It’s a wrap! This kind of stuff is ready for prime time.)
So, the physician is taking an idle moment in his/her office to skim the abstract of an article on how a medication for depression can be used for anxiety or psychosis, maybe even cancer. It finishes with some numbers about probability and effect size. (Effect size means, how strong is the effect of the treatment on the research subjects when compared to the controls, the amount of outcome data that is accounted for by that difference.) The doctor reflects aloud to himself, “Very impressive! Maybe I’ll use that drug for indigestion next time to see how it works. If the patient improves, I might include it in my list of treatments for indigestion and irritable bowel syndrome, too. It could be useful. Time to get back to work!”
What the doctor doesn’t know is how the research was done. That’s okay. They probably weren’t trained in statistics anyway. Maybe they don’t know how research is designed. When you think research design, think of that coffee commercial, that is, what were the conditions in which participants’ responses were measured. Were there any alternative explanations for the outcome that might explain what was really happening? Was the data gathering carefully controlled or might subjects have been influenced in some way?
But nobody has time to bother with that stuff. We all have other more important things to do. That’s how a doctor might prescribe a medication he knows next to nothing about and how a patient may demand the medication after watching the commercials that lard our favorite television shows. The side effects can be flu-like symptoms, migraine headaches, incontinence, death. No problem! “Ask your doctor if this might be the right treatment for you.” The doc might be watching the same TV show you are. Maybe he or she is thinking about how many people will be coming to the office the following day and asking for the medication they just heard about. And there are the numbers, always those darned numbers, incontrovertible proof. It’s hard not to be overwhelmed with the power of it all.