Skip to main content

Avoiding Confirmation Bias

+
JMJ

I found this article on Dr. Roberto's website and think that is gives some good insights on how to avoid the deep pit of confirmation bias.

P^3




Avoiding Confirmation Bias

Earlier this year, Tom Stafford wrote a column for the BBC's website about how to combat confirmation bias.  In other words, how do we avoid the problem of searching for and relying on data that confirm what we already believe (while dismissing or avoiding data that contradict our pre-existing beliefs)?  

Stafford recalls a famous set of experiments by Charles Lord,  Lee Ross, and Mark Lepper.  In one classic study from several decades ago, they looked at how people's attitudes toward the death penalty changed after being exposed to two contrasting studies - one demonstrating a powerful deterrent effect for the death penalty and another showing the exact opposite finding.   Lord, Ross, and Lepper found that people's attitudes polarized after looking at the two studies.  Why?  They assimilated the data in a biased way, relying heavily on the information that supported their pre-existing beliefs.  

Stafford describes a second experiment that these scholars conducted.  In this subsequent research, they compared two strategies for trying to combat confirmation bias.  They analyzed the impact of two different sets of instructions for people.   They were given these instructions before looking at the data.  Stafford summarizes what these scholars discovered: 

For their follow-up study, Lord and colleagues re-ran the biased assimilation experiment, but testing two types of instructions for assimilating evidence about the effectiveness of the death penalty as a deterrent for murder. The motivational instructions told participants to be "as objective and unbiased as possible", to consider themselves "as a judge or juror asked to weigh all of the evidence in a fair and impartial manner". The alternative, cognition-focused, instructions were silent on the desired outcome of the participants’ consideration, instead focusing only on the strategy to employ: "Ask yourself at each step whether you would have made the same high or low evaluations had exactly the same study produced results on the other side of the issue." So, for example, if presented with a piece of research that suggested the death penalty lowered murder rates, the participants were asked to analyse the study's methodology and imagine the results pointed the opposite way.

They called this the "consider the opposite" strategy, and the results were striking. Instructed to be fair and impartial, participants showed the exact same biases when weighing the evidence as in the original experiment. Pro-death penalty participants thought the evidence supported the death penalty. Anti-death penalty participants thought it supported abolition. Wanting to make unbiased decisions wasn't enough. The "consider the opposite" participants, on the other hand, completely overcame the biased assimilation effect – they weren't driven to rate the studies which agreed with their preconceptions as better than the ones that disagreed, and didn't become more extreme in their views regardless of which evidence they read.

Comments

Popular posts from this blog

What the heck is a congregation of "Pontifical Right"

+ JMJ In a discussion with a friend the question occurred to me that I didn't actually know was is involved in being a religious order of 'pontifical right'. I had a vague notion that this meant they reported to Rome as opposed to the local diocese. I'm also aware that, according to the accounts I have heard, the Archbishop received 'praise' and the written direction to incardinate priests directly into the SSPX.  This is interesting because it implies that the SSPX priests were no longer required to incardinate in the local diocese but in the SSPX. This is something that belongs to an order of 'pontifical right'. Anyway here's some definitions: Di diritto pontificio is the Italian term for “of pontifical right” . It is given to the ecclesiastical institutions (the religious and secular institutes, societies of apostolic life) either created by the Holy See or approved by it with the formal decree, known by its Latin name, Decretu

The Curious Case of Steve Skojec and the Dangers of Deep Diving into the Crisis Sub-Titled: The Failings of Others

 + JMJ It's been a while now since Steve Skojec sold 1P5 and abandoned the Catholic Faith. I've been a 'Trad' since 1982 and in those 40+ years I seen this death-spiral before with a similar end point. It seems that anyone who jumps into the fray unprepared for the enormous task of righting wrongs will, eventually, become discouraged by not the task but the people who surround them.   I remember when Skojec complained of the treatment his family received from a traditional priest.  This seems to have been the start of the end for him. So what can we learn from the likes of Steve Skojec, Michael Voris (maybe?), Louie Verrecchio, Gerry Matatix and other celebrity Catholics? Probably quite a lot about what not to do. First, don't burn out on the crisis?  When you burn out, on work or anything else, little things assume a more greater importance than they are due.   This is one of my 'canary in the coal mine' signals that I've been stretching myself too thin

De Veritate - St. Thomas Aquinas - What is necessary to believe explicitly?

I was recently introduced to a work of St. Thomas De Veritate ( Source ) in the course of an argument concerning the minimum content of explicit faith.  When I submitted the following quote as proof: Theological faith, that is, a supernatural faith in Revelation, is necessary, and this is an effect of grace (D 1789); nemini unquam sine ilIa contigit iustificatio (D 1793). As far as the content of this faith is concerned, according to Hebr. 11, 6, at least the existence of God and retribution in the other world must be firmly held, necessitate medii (by the necessity of means) with explicit faith. In regard to the Trinity and the Incarnation, implicit faith suffices. The supernatural faith necessary for justification is attained when God grants to the unbeliever by internal inspiration or external teaching a knowledge of the truths of Revelation, and actual grace to make the supernatural act of faith. Cf. De verite 14, I I.Ott - Fundamentals of Dogma p241 In response my opponent wrot

Thirty Days Prayer to Our Lady -

+ JMJ Providence has cast this prayer in my path twice in the last week.  I decided to post it here in order to have a copy handy. P^3 Prayer Penance Patience Source Intro Prayer With the condition of affairs in the cultural, political and physical world in a state of disarray we enter Lent - Ash Wednesday - February 25th - 2004 - more compelled then ever to pursue, diligently and faithfully, our personal road to holiness. It is a long, difficult path each of us treads, however, we do know the journey can be sweeter and more blessed if we travel it with others. Jesus has told us: "Wherever two or more are gathered in my name, I am with you." And there are many other biblical passages, as well, that urge us to love and help one another. A 'Thirty Day Prayer to the Blessed Virgin Mary ' was said by many Catholics during troubled times in their lives up until Vatican II. While looking through old stored away boxes, I came across a small white prayer b

Morning and Evening and other sundry Prayers

+ JMJ Along the theme of P^3 (Prayer, Penance, Patience), and for my own reference ... here is a collection of Morning and Evening prayers from the Ideal Daily Missal along with some additional prayers. In this crisis of the Church, I do not think it is possible to do too much prayer, penance and have patience. P^3