<
https://futurism.com/artificial-intelligence/study-do-what-chatgpt-tells-us>
"In a matter of only a few years, AI chatbots have become a common part of many
of our daily lives, even though they remain deeply flawed systems.
The reality is that chatbots like OpenAI’s ChatGPT, Google’s Gemini, or
Anthropic’s Claude still make regular mistakes. According to an October study
by the
BBC, even the most advanced AI chatbots gave wrong answers a whopping
45 percent of the time.
But many users don’t understand that reality. As detailed in a new paper,
University of Pennsylvania postdoctoral researcher Steven Shaw and marketing
professor Gideon Nave found that in a series of experiments, users tended to
take the output of ChatGPT at face value even when it gave them the incorrect
answer.
Across a series of experiments, participants were asked to answer a variety of
reasoning and knowledge-based questions. Despite making the use of ChatGPT
optional, over 50 percent of them chose to use the chatbot to answer the
questions.
The researchers were testing a key theory: whether users would be willing to
believe what the AI was telling them regardless of accuracy, in what they
termed a “cognitive surrender” that effectively overrode their intuition and
deliberation process.
In the most striking experiment, involving 359 participants, participants
followed AI’s correct advice 92.7 percent of the time — and a
still-considerable 79.8 percent of the time when the AI gave them the wrong
answer."
Via Violet Blue’s
Threat Model - Cybersecurity: March 31, 2026
https://www.patreon.com/posts/cybersecurity-31-154388966
Cheers,
*** Xanni ***
--
mailto:xanni@xanadu.net Andrew Pam
http://xanadu.com.au/ Chief Scientist, Xanadu
https://glasswings.com.au/ Partner, Glass Wings
https://sericyb.com.au/ Manager, Serious Cybernetics
