Thursday, September 18, 2014

Ideas: Problems with "Fact Checking"


I recently came across a link on Facebook to a claim that "Over Half of all Statements Made on Fox News are False," based on a story in theTampa Bay Times' PunditFact. My first reaction was that I had no more reason to trust the Tampa Bay Times than to trust Fox, making the story  pure partisan assertion, so I followed the link to see what support it offered. To their credit, they listed the statements on Fox that they based their claim on and provided the basis for their conclusions. But looking at them in detail, their evaluation was clearly biased in favor of what they wanted to believe.
The clearest case was one where they said a claim they liked was mostly true when, on their evidence, it was  false. The claim was: The people who want President Barack Obama impeached "are all white, they're all older, and guess what, they're in the far right wing of the Republican Party." According to the poll information they cited, about 33 percent of the public wanted Obama impeached. There is no way that older whites in the far right wing of the Republican party could make up anything close to 33 percent of the public. According to the poll information, about 17% of non-whites wanted Obama impeached—a lower percentage than of whites, but quite a lot more than zero. The statement should have been rated as mostly false.
....
To their credit, PunditFact takes advantage of the opportunity provided by hypertext to provide detailed explanations of their ratings. Looking at those explanations, I conclude that:
1. PunditFact interprets disagreement with them and the experts they choose to consult as either false or mostly false.
2. PunditFact judges statements they like not by whether they are actually true but by whether a much weaker claim along similar lines is. Thus they implicitly convert "they're all white, they're all older, and guess what, they're in the far right wing of the Republican Party," a claim that is clearly false, into "people who are white, older, and right wing Republicans are more likely to want Obama impeached than people who are not," and then judge it mostly true. 
They take the opposite approach to statements they don't like. Converting what Dobbs actually said to "Because of President Barack Obama’s failure to "push job creation" I would rate as "pants on fire"—a flat lie by PunditFact.

No comments: