https://www.umt.edu/news/2023/07/070523test.php
"MISSOULA – New research from the University of Montana and its partners
suggests artificial intelligence can match the top 1% of human thinkers on a
standard test for creativity.
The study was directed by Dr. Erik Guzik, an assistant clinical professor in
UM’s College of Business. He and his partners used the Torrance Tests of
Creative Thinking, a well-known tool used for decades to assess human
creativity.
The researchers submitted eight responses generated by ChatGPT, the application
powered by the GPT-4 artificial intelligence engine. They also submitted
answers from a control group of 24 UM students taking Guzik’s entrepreneurship
and personal finance classes. These scores were compared with 2,700 college
students nationally who took the TTCT in 2016. All submissions were scored by
Scholastic Testing Service, which didn’t know AI was involved.
The results placed ChatGPT in elite company for creativity. The AI application
was in the top percentile for fluency – the ability to generate a large volume
of ideas – and for originality – the ability to come up with new ideas. The AI
slipped a bit – to the 97th percentile – for flexibility, the ability to
generate different types and categories of ideas.
“For ChatGPT and GPT-4, we showed for the first time that it performs in the
top 1% for originality,” Guzik said. “That was new.”
He was gratified to note that some of his UM students also performed in the top
1%. However, ChatGTP outperformed the vast majority of college students
nationally."
[...]
"Guzik said he asked ChatGPT what it would indicate if it performed well on the
TTCT. The AI gave a strong answer, which they shared at the conference:
“ChatGPT told us we may not fully understand human creativity, which I believe
is correct,” he said. “It also suggested we may need more sophisticated
assessment tools that can differentiate between human and AI-generated ideas.”"
Via Wayne Radinsky.
Cheers,
*** Xanni ***
--
mailto:xanni@xanadu.net Andrew Pam
http://xanadu.com.au/ Chief Scientist, Xanadu
https://glasswings.com.au/ Partner, Glass Wings
https://sericyb.com.au/ Manager, Serious Cybernetics
