Skip to main content

You’ve Been Hacked – The Psychology of Disinformation and How to Protect Yourself

By Valerie Tarico ~

Once seeded, viral misinformation exploits weaknesses in how the human mind determines what’s real.

Most people genuinely care about truth. I don’t mean that we tell the truth all of the time—though most of us mostly do—but that we very much want to know what is real. Reality can knock you flat if you don’t see it coming.

Misreading the natural world or social cues was often lethal for our hunter-gatherer would-be ancestors, and we ourselves are descended from the ones who got it right. Truth-seeking, in other words, was written into our genetic code long before it was written into our moral and legal codes. Why, then, is it so easy for social media flurries, conspiracy theories, religions, viral ideologies, or political disinformation campaigns to get us believing utter bullshit?

A volunteer at a “Crisis Pregnancy Center” tells a young pregnant woman that abortion causes cancer.

A cat lover insists that neutered cat colonies work to eliminate feral cats.


A Youth for Christ leader tells teens that atheists are unhappy.

A conservative Facebook friend says that migrants at the border are mostly gang members and criminals.

A liberal Facebook friend says they’re mostly fleeing near-certain violence or death.



Each of these claims is both falsifiable and false, and when we see other people embrace and spread ideas or “facts” that seem obviously false to us, we often assume they either don’t care about truth or are flat-out liars. But that is lazy thinking, and more than a little arrogant. Yes, people on the other side are less than fully truthful. So are you. And yes, some people are habitual liars or even sociopaths. And yes, people who aren’t sociopathic sometimes decide for one reason or another that the end justifies the means. But when people spread falsehoods—even stuff that seems like transparent hooey from the outside, they mostly believe what they say. A lie can travel half way around the world while the truth is putting on its shoes, so goes the oft repeated saying. But lies travel only when people believe them. That is why most propaganda uses partial or decontextualized truths to create misconceptions and distort priorities.

Truth-Seeking Opens Vulnerabilities.

Those who professionally traffic in partial truths and disinformation—like some ideologues, political strategists, marketing experts or corporate- and state-level information warfare specialists analyze and exploit our desire to know what is real. One common and highly effective way they play us is by convincing us that only we and a small group of enlightened folks like us have the inside scoop.

Human beings are social information specialists, and we gain standing with each other by sharing insider knowledge. Gossip is a great example, and provides the basis for social marketing. OMG, have you heard??! But so are conspiracy theories, whose believers wind their way through rabbit warrens of logic to find secret knowledge that has been deliberately buried—which they then publish in a-mazing detail. Religious ideologies teach that they alone hold the answer to life’s mysteries. Some spawn secret societies or hidden rituals, while external symbols like a silver cross necklace, a yarmulke, or a hijab signal the embrace of exclusive Truths, and thus raise status in the eyes of fellow believers.

Social media provide fertile ground in which insider knowledge takes root, and—as we all know—falsehoods (especially partial truths masquerading as whole truths) spread like invasive weeds. Some of these falsehoods are deliberately seeded by ideologues, propagandists, disinformation specialists; others spring up naturally from the constant shift and flow and recombination of information in the human ideosphere. Once seeded, all viral bullshit exploits weaknesses in how the human mind determines what’s real. These include:

Tribal Boundaries—Social networks largely determine what information flows past us.

Identity Filters—Who we are, meaning our genetics and lived experience, our interests and values, our cognitive strengths and weakness, and our emotional makeup all play roles in determining what gets our attention.

Delightful Surprises—We are drawn like proverbial moths to the unexpected and counter-intuitive, which trigger the thrill of discovery and secret knowledge.

Thinking Fast—In the face of competing priorities and overwhelming quantities of information coming at us, we fall back on intuition, gut feel, and other cognitive shortcuts, only rarely applying higher order reasoning to carefully scrutinize a set of propositions or evidence.

Groupthink—Whenever possible, again for the sake of efficiency in information processing, we let other members of our tribe do the analysis for us and consider the task done.

Authority Hierarchies—We bypass thinking altogether by looking to trusted authorities which can be individuals, institutions, or sacred texts—not necessarily relevant experts—and accept as fact what they say.

The Consensus Shortcut—We treat the preponderance of opinion as if it were a preponderance of evidence.

Saturation Seduction—We succumb to messages that are repeated, ubiquitous and consistent whether they are backed by evidence or not.

Motivated Reasoning—Even when we do take the time to construct an analysis of our own, we often start with what we want to be true, what fits our worldview or what benefits us directly, and then reason backwards from there.

Confirmation Bias—Once true believers or disinformers get us to believe something, then we ourselves often take over their work, ignoring or rejecting information that might show us wrong.

Pleasures of Superiority—Certain emotions including the feelings of righteousness, moral disgust, or jeering laughter close us off to people and ideas who might challenge us.

Panic—When flooded with emotion—especially fear—higher-order reasoning vanishes and we simply stampede.

Bolster Your Defenses

It is impossible to get away from these dynamics, but there are things we can do to minimize their power. What, you ask? As odd as it sounds, religion may offer some ideas.

When people spread falsehoods—even stuff that seems like transparent hooey from the outside, they mostly believe what they say.Viral religions that make dubious truth claims often include a set of rules, scripts, advisories, structures and dogmas aimed at preventing defection. In other words, they outline the exact opposite of what one should do if one is actually interested in figuring out what is real.

Here are some of the advisories from Bible-believing Christianity, the religion of my youth: Have faith that what the Bible says is true and you will find evidence that fits. Believe and be saved. One Way. Lean not unto your own understanding. Be wary of secular and scientific expertise. Recite statements of faith. The fool has said in is heart there is no God. Trust and obey, for there’s no other way. Outsiders are conduits for evil, and they will try to tempt you. Avoid spiritual pornography (writings that take a skeptical point of view). Don’t be “unequally yoked” with unbelievers. Be in the world, not of it. Preach the gospel to every creature. Doubt is weakness; pray it away. Feel the love of Jesus and the power of the Holy Spirit flowing through you. Surround yourself with fellow Christians. Come to church every Sunday morning (and Sunday evening, and Wednesday evening, and maybe Tuesday night Bible Study).

Worship services are structured to elicit emotion and a sense of unity that causes people to suspend disbelief, and repetition cements the deal. In past generations, physical architecture evolved to help with this; the vast spaces inside of cathedrals disoriented the cerebellum, triggering feelings of transcendence. But now most denominations simply rely on the cadence of familiar mutually-reinforcing stories and precepts delivered by familiar authorities in the company of like-minded people who envelop the believer in a warm, supportive and morally-superior community of people who have got it right.

To the degree that this fits your Facebook friend list or Twitter feed or news and entertainment choices or activist network, my former religion, as a highly successful mind virus, points inadvertently toward a cure:

Get yourself out of the sanctuary so that you can shake off the sweet, soothing lull of the choir and escape saturation seduction. Find silence.

Trust doubt. Identify real experts and expertise, but question orthodoxies—especially those with strong emotional appeal. Be wary of salvific Truths preached by admired authorities. Deploy your capacity for critical thinking—not just when you want to denigrate evil outsiders and their obvious falsehoods, but rather in those times and places where you congregate with people who share your values and views. Voice misgivings. Tolerate uncertainty.

Lastly, reject the oh-so-satisfying idea that all heretics must be evil. Seek the company of people who don’t think like you. Listen for kernels of truth and wisdom spoken by enemies of your tribe. They may not be able to break out of their disinformation silos, but you, at least, can break out of yours.



Valerie Tarico is a psychologist and writer in Seattle, Washington. She is the author ofTrusting Doubt: A Former Evangelical Looks at Old Beliefs in a New Light and Deas and Other Imaginings, and the founder of www.WisdomCommons.org. Her articles about religion, reproductive health, and the role of women in society have been featured at sites including The Huffington Post, Salon, The Independent, Free Inquiry, The Humanist, AlterNet, Raw Story, Grist, Jezebel, and the Institute for Ethics and Emerging Technologies. Subscribe at ValerieTarico.com.

Comments

Popular posts from this blog

THE FRIGHTENING FACE

By David Andrew Dugle ~ O ctober. Halloween. It's time to visit the haunted house I used to live in. When I was five my dad was able to build a big modern house. Moving in before it was complete, my younger brother and I were sleeping in a large unfinished area directly under the living room. It should have been too new to be a haunted house, but now and then I would wake up in the tiny, dark hours and see the blurry image of a face, or at least what I took to be a face, glowing, faintly yellow, high up on the wall near the ceiling. I'm not kidding! Most nights it didn’t appear at all. But when it did show itself, at first I thought it was a ghost and it scared me like nothing else I’d ever seen. But the face never did anything; unmoving, it just stayed in that one spot. Turning on the lights would make it disappear, making my fears difficult to explain, so I never told anyone. My Sunday School teachers had always told me to be good because God was just behind m

The Blame Game or Shit Happens

By Webmdave ~ A relative suffering from Type 1 diabetes was recently hospitalized for an emergency amputation. The physicians hoped to halt the spread of septic gangrene seeping from an incurable foot wound. Naturally, family and friends were very concerned. His wife was especially concerned. She bemoaned, “I just don’t want this (the advanced sepsis and the resultant amputation) to be my fault.” It may be that this couple didn’t fully comprehend the seriousness of the situation. It may be that their choice of treatment was less than ideal. Perhaps their home diabetes maintenance was inconsistent. Some Christians I know might say the culprit was a lack of spiritual faith. Others would credit it all to God’s mysterious will. Surely there is someone or something to blame. Someone to whom to ascribe credit. Isn’t there? A few days after the operation, I was talking to a man who had family members who had suffered similar diabetic experiences. Some of those also suffered ea

Reasons for my disbelief

By Rebekah ~ T here are many layers to the reasons for my disbelief, most of which I haven't even touched on here... When I think of Evangelical Christianity, two concepts come to mind: intense psychological traps, and the danger of glossing over and missing a true appreciation for the one life we know that we have. I am actually agnostic when it comes to a being who set creation in motion and remains separated from us in a different realm. If there is a deistic God, then he/she doesn't particularly care if I believe in them, so I won't force belief and instead I will focus on this one life that I know I have, with the people I can see and feel. But I do have a lot of experience with the ideas of God put forth by Evangelical Christianity, and am confident it isn't true. If it's the case god has indeed created both a physical and a heavenly spiritual realm, then why did God even need to create a physical realm? If the point of its existence is to evolve to pas

Are You an Atheist Success Story?

By Avangelism Project ~ F acts don’t spread. Stories do. It’s how (good) marketing works, it’s how elections (unfortunately) are won and lost, and it’s how (all) religion spreads. Proselytization isn’t accomplished with better arguments. It’s accomplished with better stories and it’s time we atheists catch up. It’s not like atheists don’t love a good story. Head over to the atheist reddit and take a look if you don’t believe me. We’re all over stories painting religion in a bad light. Nothing wrong with that, but we ignore the value of a story or a testimonial when we’re dealing with Christians. We can’t be so proud to argue the semantics of whether atheism is a belief or deconversion is actually proselytization. When we become more interested in defining our terms than in affecting people, we’ve relegated ourselves to irrelevance preferring to be smug in our minority, but semantically correct, nonbelief. Results Determine Reality The thing is when we opt to bury our

Christian TV presenter reads out Star Wars plot as story of salvation

An email prankster tricked the host of a Christian TV show into reading out the plots of The Fresh Prince of Bel Air and Star Wars in the belief they were stories of personal salvation. The unsuspecting host read out most of the opening rap to The Fresh Prince, a 1990s US sitcom starring Will Smith , apparently unaware that it was not a genuine testimony of faith. The prankster had slightly adapted the lyrics but the references to a misspent youth playing basketball in West Philadelphia would have been instantly familiar to most viewers. The lines read out by the DJ included: "One day a couple of guys who were up to no good starting making trouble in my living area. I ended up getting into a fight, which terrified my mother." The presenter on Genesis TV , a British Christian channel, eventually realised that he was being pranked and cut the story short – only to move on to another spoof email based on the plot of the Star Wars films. It began: &quo

Why I left the Canadian Reformed Church

By Chuck Eelhart ~ I was born into a believing family. The denomination is called Canadian Reformed Church . It is a Dutch Calvinistic Christian Church. My parents were Dutch immigrants to Canada in 1951. They had come from two slightly differing factions of the same Reformed faith in the Netherlands . Arriving unmarried in Canada they joined the slightly more conservative of the factions. It was a small group at first. Being far from Holland and strangers in a new country these young families found a strong bonding point in their church. Deutsch: Heidelberger Katechismus, Druck 1563 (Photo credit: Wikipedia ) I was born in 1955 the third of eventually 9 children. We lived in a small southern Ontario farming community of Fergus. Being young conservative and industrious the community of immigrants prospered. While they did mix and work in the community almost all of the social bonding was within the church group. Being of the first generation born here we had a foot in two