Skip to main content

Avoiding Confirmation Bias

+
JMJ

I found this article on Dr. Roberto's website and think that is gives some good insights on how to avoid the deep pit of confirmation bias.

P^3




Avoiding Confirmation Bias

Earlier this year, Tom Stafford wrote a column for the BBC's website about how to combat confirmation bias.  In other words, how do we avoid the problem of searching for and relying on data that confirm what we already believe (while dismissing or avoiding data that contradict our pre-existing beliefs)?  

Stafford recalls a famous set of experiments by Charles Lord,  Lee Ross, and Mark Lepper.  In one classic study from several decades ago, they looked at how people's attitudes toward the death penalty changed after being exposed to two contrasting studies - one demonstrating a powerful deterrent effect for the death penalty and another showing the exact opposite finding.   Lord, Ross, and Lepper found that people's attitudes polarized after looking at the two studies.  Why?  They assimilated the data in a biased way, relying heavily on the information that supported their pre-existing beliefs.  

Stafford describes a second experiment that these scholars conducted.  In this subsequent research, they compared two strategies for trying to combat confirmation bias.  They analyzed the impact of two different sets of instructions for people.   They were given these instructions before looking at the data.  Stafford summarizes what these scholars discovered: 

For their follow-up study, Lord and colleagues re-ran the biased assimilation experiment, but testing two types of instructions for assimilating evidence about the effectiveness of the death penalty as a deterrent for murder. The motivational instructions told participants to be "as objective and unbiased as possible", to consider themselves "as a judge or juror asked to weigh all of the evidence in a fair and impartial manner". The alternative, cognition-focused, instructions were silent on the desired outcome of the participants’ consideration, instead focusing only on the strategy to employ: "Ask yourself at each step whether you would have made the same high or low evaluations had exactly the same study produced results on the other side of the issue." So, for example, if presented with a piece of research that suggested the death penalty lowered murder rates, the participants were asked to analyse the study's methodology and imagine the results pointed the opposite way.

They called this the "consider the opposite" strategy, and the results were striking. Instructed to be fair and impartial, participants showed the exact same biases when weighing the evidence as in the original experiment. Pro-death penalty participants thought the evidence supported the death penalty. Anti-death penalty participants thought it supported abolition. Wanting to make unbiased decisions wasn't enough. The "consider the opposite" participants, on the other hand, completely overcame the biased assimilation effect – they weren't driven to rate the studies which agreed with their preconceptions as better than the ones that disagreed, and didn't become more extreme in their views regardless of which evidence they read.

Comments

Popular posts from this blog

SSPX and the Resistance - A Comparison Of Ecclesiology

Shining the light of Church Teaching on the doctrinal positions of the SSPX and the Resistance. Principles are guides used to aid in decision making.  It stands to reason that bad principles will lead to bad decisions. The recent interactions between Rome and the SSPX has challenged a number of closely held cultural assumptions of people in both sides of the disagreement. This has resulted in cultural skirmishes in both Rome and the SSPX. Since it is the smaller of the two, the skirmishes have been more evident within the SSPX.  The cultural fault-line that Bishop Fellay crossed appears to be linked to two points of Catholic Doctrine: Ecclesiology and Obedience.  The cultural difference of view points is strong enough that it has resulted in the expulsion of a number of members.  It should also be noted that some other priests expelled since the beginning of the latest interactions (starting in 2000) held the same view points and have joined with the l...

The Curious Case of Steve Skojec and the Dangers of Deep Diving into the Crisis Sub-Titled: The Failings of Others

 + JMJ It's been a while now since Steve Skojec sold 1P5 and abandoned the Catholic Faith. I've been a 'Trad' since 1982 and in those 40+ years I seen this death-spiral before with a similar end point. It seems that anyone who jumps into the fray unprepared for the enormous task of righting wrongs will, eventually, become discouraged by not the task but the people who surround them.   I remember when Skojec complained of the treatment his family received from a traditional priest.  This seems to have been the start of the end for him. So what can we learn from the likes of Steve Skojec, Michael Voris (maybe?), Louie Verrecchio, Gerry Matatix and other celebrity Catholics? Probably quite a lot about what not to do. First, don't burn out on the crisis?  When you burn out, on work or anything else, little things assume a more greater importance than they are due.   This is one of my 'canary in the coal mine' signals that I've been stretching myself too th...

Morning and Evening and other sundry Prayers

+ JMJ Along the theme of P^3 (Prayer, Penance, Patience), and for my own reference ... here is a collection of Morning and Evening prayers from the Ideal Daily Missal along with some additional prayers. In this crisis of the Church, I do not think it is possible to do too much prayer, penance and have patience. P^3

Church Militant TV and the SSPX - Again

+ JMJ The old narrative used to be that the SSPX was 'schismatic' and 'excommunicated'. Now the excommunication has been lifted for a number of years and the only ones who think it still has effect are the 'resistors'. That leaves the other opponents of the SSPX with the label 'schismatic'. Make it clear, the conservative Catholics have issues with the SSPX probably because they violate some of their assumptions about the Faith and this crisis of the Church. Church Militant TV is one of these the exists along the Catholic thought spectrum. They like the Traditional Mass but must ensure that they don't get tarred with the same 'schismatic' brush that the liberals use against the SSPX.  So what do they do, they use the same brush against the SSPX. The funny thing is that even when the Church does speak, they don't want to listen and persist in calling the SSPX 'schismatic'. Here's a transcript of the latest s...

Comparision of the Tridentine, Cranmer and Novus Ordo Masses

+ JMJ I downloaded the comparison that was linked in the previous article on the mass (here) . ... a very good reference! P^3 From: Whispers of Restoration (available at this link) . CHARTING LITURGICAL CHANGE Comparing the 1962 Ordinary of the Roman Mass to changes made during the Anglican Schism; Compared in turn to changes adopted in the creation of Pope Paul VI’s Mass in 1969 The chart on the reverse is a concise comparison of certain ritual differences between three historical rites for the celebration of the Catholic Mass Vetus Ordo: “Old Order,” the Roman Rite of Mass as contained in the 1962 Missal, often referred to as the “Traditional Latin Mass.”The Ordinary of this Mass is that of Pope St. Pius V (1570) following the Council of Trent (1545-63), hence the occasional moniker “Tridentine Mass.” However, Trent only consolidated and codified the Roman Rite already in use at that time; its essential form dates to Pope St. Gregory the Great (+604), in whose time the R...