The 2016 Presidential Election was NOT the Death of Data

Now that the presidential election is a couple of weeks in our rear window, I thought it a good time to comment on some data aspects of the election. Driving to work the morning after the election I listened to national program announce that the election results signaled "the death of data" because the polls had been so terribly wrong. Others have written about the data's failure.

That's simply not true. First, some polls did a pretty good job predicting the outcome. Whether or not those polls should have been considered outliers will be debated in the polling community for many years.

However, I want to focus on another issues. For this discussion, let's concede that "most of the polls were wrong". That's still not the death of data. At worst, it's the death of survey data.

For decades, social scientists have known that self-reported activities often don't match behaviors. Perhaps the most famous example is the Tucson Garbage Project. Political pollsters, and those who report on them, should always keep in mind that they're merely getting people's statements about what they are going to do. They are not getting any information on actual actions. In other words, they don't have empirical data.

How would you use empirical data to predict a presidential outcome? Just ask Alan Lichtman. Lichtman's "13 Keys to the White House" model has correctly predicted every presidential election since 1984 and it doesn't use polling data. Instead, it was created by looking at historical voting data (in other words, empirical data) from 1860 through 1980. There are 13 true/false indicators. If enough of them come up "against", then it predicts the incumbent party in the White House will lose the popular vote to the challenging party. It says nothing about the electoral college.

That distinction between popular vote and electoral college is very important. Lichtmans' model correctly predicted Gore's popular vote win in 2000. It did not predict Bush's electoral college victory because it doesn't predict anything about the electoral college. It can't be considered either right or wrong on the electoral college.

Sometimes, the 13 Keys are clear fairly early the election cycle. At least once, Lichtman made his prediction two years ahead of the election. This time around, his prediction was later in the cycle and he predicted a Trump victory. After the election, he was hailed by some as being one of just a few who predicted correctly.

Now if you've been paying attention up to this point, you might say "Wait a minute. You said that Lichtman predicts the popular vote, not the electoral college and Clinton won the popular vote. Therefore he was wrong!".

On the surface it would appear that way. However, the final Key that turned "against" the incumbent party involved third party candidates. A significant third party vote was a signal against the incumbents. When Lichtman made his prediction, it looked very much like Gary Johnson would be a significant third party influence. In the end though, all the third party votes combined were under 5%. In other words, this Key actually went in favor of the incumbent party and, sure enough, Clinton won the popular vote.

Admittedly, calling this particular Key true or false involved polling data on the third parties, but the Key itself was developed with empirical data and the 13 empirically developed Keys once again predicted correctly. The worst you can say about Lichtman's prediction is the he predicted a Key wrong but the Keys themselves predicted correctly.

That's far from "the death of data".

Cheating Age or Aging Cheaters

This article is a bit over a year old but I ran across it today and was struck by the the easy acceptance of the conclusions.

Since it's behind a pay wall, here's a short summary: A study was done using data from the Ashley-Madison dating web site. For those who missed last year's headlines, this site is for people already in a committed relationship who want to find someone to cheat with. Researchers looked at the ages of registered users and found a statistically significant bump in the distribution for ages ending in "9".

The conclusion is that people are more likely to cheat when they are approaching a milestone birthday (30, 40, 50, etc.). They get stressed about aging and reach out for a little excitement.

That's certainly a possible explanation. However,  I think they overlook another simpler explanation - people lie about their age. If you're anywhere in the 40 to 45 range and you want to claim you're in your 30's then 39 is more believable than 38, 37, 36, etc. 

I think this explanation is at least as likely as the first. Keep in mind, everyone on this web site is trying to CHEAT. They're all dishonest. Why wouldn't they lie about their age? 

Data matters - but only if you accept it.

In my classes I regularly tell students that statistical controversy is rarely about the number crunching, it's about the data.

I recently posted a link to an article about political polling. Summary? The data was wrong so the predictions were wrong.

However, there's another data problem and, perhaps, it's the most common problem. What should you do when you think something is true but you have data that contradicts it? Statistically, you're supposed to go with the data and change what you thought was true.

People who know statistics might recognize this situation. You have a null hypothesis, Ho, and the data leads to a small p-value. This means you should reject Ho and conclude that the alternative hypothesis, Ha, is true instead.

Unfortunately people tend to fall the other way. If the data contradicts their beliefs, they reject the data. This is true even among those who have scientific and statistical training.

The People's Pharmacy recently wrote about a new study that "exonerates" eggs. This is one of many studies that contradict that old idea the eggs are unhealthy because of dietary cholesterol. All the data shows that eggs are healthy. Yet the article states:

"It’s hard to teach old dogs new tricks. Many health professionals will find it challenging to accept the new data from the Finnish Heart Study. But the writing has been on the wall for quite a few years that the evidence supporting dietary cholesterol as the culprit behind heart disease was weak."

Health professionals, people with significant scientific training, will stick with their old beliefs and reject the data.

The limits and challenges of public opinion polling

With the Presidential primaries in full swing, the polls were pretty far off in Michigan.

This article provides some possible explanation. It also talks about the difficulty of getting proper samples and the importance of asking the right questions.