Categories: News

Using generative AI may weaken critical thinking, says study

A new paper has found generative AI can potentially cause overreliance on the tool and diminished critical thinking.

<h2><span data-contrast&equals;"auto">A new study from Carnegie Mellon University and Microsoft Research Cambridge has found evidence that using generative AI &lpar;GenAI&rpar; like ChatGPT&comma; Copilot and Gemini could lead to weakened critical thinking skills&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;h2>&NewLine;<p><span data-contrast&equals;"auto">The paper adds to a wealth of other research that looks at the effects of GenAI on cognitive processes such as memory and creativity&comma; raising further questions about how we employ GenAI both in the workforce and in education&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><a href&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;latest-print-issue&sol;" target&equals;"&lowbar;blank" rel&equals;"noopener"><b>Read the latest print edition of <em>School News<&sol;em> online HERE&period;<&sol;b><&sol;a><&sol;p>&NewLine;<h4><b><span data-contrast&equals;"auto">The study<&sol;span><&sol;b><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;h4>&NewLine;<p><span data-contrast&equals;"auto">Researchers recruited 319 white-collar workers &lpar;termed &OpenCurlyDoubleQuote;knowledge workers”&rpar; who regularly used generative AI&period; Participants were asked to self-describe three real examples where they used generative AI to complete a task&comma; and share how they used critical thinking in the process&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Researchers found that the more confident a user was in the GenAI tool and&sol;or the less confident they were in their own skills and abilities&comma; the less critical thinking they employed&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Critical thinking was defined according to an existing framework of six types of learning&colon; knowledge&comma; comprehension&comma; application&comma; analysis&comma; synthesis and evaluation&period;<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<figure id&equals;"attachment&lowbar;32947" aria-describedby&equals;"caption-attachment-32947" style&equals;"width&colon; 300px" class&equals;"wp-caption alignnone"><img class&equals;"size-medium wp-image-32947" src&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;wp-content&sol;uploads&sol;2025&sol;02&sol;emiliano-vittoriosi-vEN1bsdSjxM-unsplash-300x225&period;jpg" alt&equals;"" width&equals;"300" height&equals;"225" &sol;><figcaption id&equals;"caption-attachment-32947" class&equals;"wp-caption-text">Image by Emiliano Vittoriosi on Unsplash&period;<&sol;figcaption><&sol;figure>&NewLine;<p><span data-contrast&equals;"auto">The paper also found that when a task was considered &OpenCurlyDoubleQuote;low stakes”&comma; respondents reported using less critical thinking&period;<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">&OpenCurlyDoubleQuote;W<&sol;span><span data-contrast&equals;"auto">hile AI can improve efficiency&comma; it may also reduce critical engagement&comma; particularly in routine or lower-stakes tasks in which users simply rely on AI&comma; raising concerns about long-term reliance and diminished independent problem-solving&comma;” reads the paper&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">&OpenCurlyDoubleQuote;Knowledge workers’ trust and reliance on GenAI doing the task can discourage them from critically reflecting on their use of the tools&period; Users often adopt a mental model that assumes AI is competent for simple tasks&&num;8230&semi; This mental model&comma; however&comma; can lead to overestimating AI capabilities&period;”<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Researchers found that users who had a positive experience with a GenAI tool where an accurate or high-quality answer had been provided in the past were more likely to trust GenAI and therefore less likely to employ critical thinking skills&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Worryingly&comma; some respondents believed information provided by GenAI was always accurate and of high quality&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Some respondents who reported high trust in the GenAI also reported low self-confidence&period;<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<blockquote>&NewLine;<p><span data-contrast&equals;"auto">&OpenCurlyDoubleQuote;This self-doubt led them to accept GenAI outputs by default&period;”<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<&sol;blockquote>&NewLine;<p><span data-contrast&equals;"auto">The paper also noted that although respondents perceived GenAI to be competent at low stakes tasks and therefore requiring less oversight in these instances&comma; &OpenCurlyDoubleQuote;it is risky for users to only apply critical thinking in high-stakes situations&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">&OpenCurlyDoubleQuote;Without regular practice in common and&sol;or low-stakes scenarios&comma; cognitive abilities can deteriorate over time&comma; and thus create risks if high-stakes scenarios are the only opportunities available for exercising such abilities&period;”<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Additionally&comma; GenAI was found to have an effect on <&sol;span><i><span data-contrast&equals;"auto">how<&sol;span><&sol;i><span data-contrast&equals;"auto"> users employed critical thinking&period; In the knowledge and comprehension domains&comma; critical thinking changes from information gathering to verification&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">When applying knowledge&comma; users employ critical thinking to integrate AI responses appropriately&comma; rather than problem-solving for a given task&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<figure id&equals;"attachment&lowbar;32948" aria-describedby&equals;"caption-attachment-32948" style&equals;"width&colon; 300px" class&equals;"wp-caption alignnone"><img class&equals;"size-medium wp-image-32948" src&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;wp-content&sol;uploads&sol;2025&sol;02&sol;compare-fibre-Y8TiLvKnLeg-unsplash-300x200&period;jpg" alt&equals;"" width&equals;"300" height&equals;"200" &sol;><figcaption id&equals;"caption-attachment-32948" class&equals;"wp-caption-text">Using GenAI could change how we deploy critical thinking&period; Image by Compare Fibre on Unsplash&period;<&sol;figcaption><&sol;figure>&NewLine;<p><span data-contrast&equals;"auto">For the analysis&comma; synthesis and evaluation aspects of critical thinking&comma; users employed task stewardship&comma; or oversight of the task&comma; rather than executing these aspects directly&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Researchers posited a possible explanation could be that the use of GenAI causes users to &OpenCurlyDoubleQuote;underinvest” in critical thinking&period; However&comma; as the study did not establish causation &lpar;i&period;e using GenAI always leads to diminished critical thinking&rpar;&colon; &OpenCurlyDoubleQuote;it is possible that fostering workers’ domain expertise and associated self-confidence may result in improved critical thinking when using GenAI&period;”<&sol;span><span data-ccp-props&equals;"&lbrace;&quot&semi;134233117&quot&semi;&colon;false&comma;&quot&semi;134233118&quot&semi;&colon;false&comma;&quot&semi;201341983&quot&semi;&colon;0&comma;&quot&semi;335551550&quot&semi;&colon;1&comma;&quot&semi;335551620&quot&semi;&colon;1&comma;&quot&semi;335559685&quot&semi;&colon;0&comma;&quot&semi;335559737&quot&semi;&colon;0&comma;&quot&semi;335559738&quot&semi;&colon;0&comma;&quot&semi;335559739&quot&semi;&colon;160&comma;&quot&semi;335559740&quot&semi;&colon;279&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Another interpretation of results is that GenAI may be a form of &OpenCurlyDoubleQuote;cognitive offloading” where users depend on AI for tasks where they lack confidence&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&quot&semi;134233117&quot&semi;&colon;false&comma;&quot&semi;134233118&quot&semi;&colon;false&comma;&quot&semi;201341983&quot&semi;&colon;0&comma;&quot&semi;335551550&quot&semi;&colon;1&comma;&quot&semi;335551620&quot&semi;&colon;1&comma;&quot&semi;335559685&quot&semi;&colon;0&comma;&quot&semi;335559737&quot&semi;&colon;0&comma;&quot&semi;335559738&quot&semi;&colon;0&comma;&quot&semi;335559739&quot&semi;&colon;160&comma;&quot&semi;335559740&quot&semi;&colon;279&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">&&num;8220&semi;Confidence in AI is associated with reduced critical thinking effort&comma; while self-confidence is associated with increased critical thinking effort&period;”<&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<h4><b><span data-contrast&equals;"auto">GenAI in education<&sol;span><&sol;b><span data-contrast&equals;"auto"> <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;h4>&NewLine;<p><span data-contrast&equals;"auto">This year&comma; UNESCO dedicated the <&sol;span><a href&equals;"https&colon;&sol;&sol;www&period;unesco&period;org&sol;en&sol;articles&sol;unesco-dedicates-international-day-education-2025-artificial-intelligence" target&equals;"&lowbar;blank"><span data-contrast&equals;"none">International Day of Education<&sol;span><&sol;a><span data-contrast&equals;"auto"> to the theme of Artificial Intelligence&period; The theme was aimed at generating conversations about AI and its uses for education&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">In high income countries&comma; more than two-thirds of secondary school pupils are using GenAI to produce work and teachers are using the technology to help with marking&comma; lesson preparation&comma; and administrative tasks like sending emails&period; Still&comma; according to a UNESCO survey&comma; only 10 percent of schools and universities have an official framework for using AI&period; Additionally&comma; more schools and counties are implementing technology ban policies&comma; like New Zealand’s recent mobile phone ban in classrooms&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;<p><span data-contrast&equals;"auto">Although there is widespread hope that AI could improve the education sector by providing classroom tools such as <&sol;span><a href&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;2025&sol;02&sol;warm-and-friendly-or-competent-and-straightforward-what-students-want-from-ai-chatbots-in-the-classroom&sol;" target&equals;"&lowbar;blank"><span data-contrast&equals;"none">chatbots<&sol;span><&sol;a><span data-contrast&equals;"auto"> that provide <&sol;span><a href&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;2024&sol;12&sol;revolutionising-education-through-ai-a-thoughtful-approach&sol;" target&equals;"&lowbar;blank"><span data-contrast&equals;"none">targeted learning support<&sol;span><&sol;a><span data-contrast&equals;"auto">&comma; and <&sol;span><a href&equals;"https&colon;&sol;&sol;www&period;schoolnews&period;co&period;nz&sol;2025&sol;01&sol;boosting-new-zealands-education-standards-with-artificial-intelligence&sol;" target&equals;"&lowbar;blank"><span data-contrast&equals;"none">lightening teacher workload<&sol;span><&sol;a><span data-contrast&equals;"auto">&comma; there are also valid concerns about the ethics of using AI in the classroom&comma; and its implications for teaching and learning&period; <&sol;span><span data-ccp-props&equals;"&lbrace;&rcub;"> <&sol;span><&sol;p>&NewLine;

Explore our latest issue...
Naomii Seah

Naomii Seah is a writer and journalist from Tāmaki Makaurau Auckland, Aotearoa New Zealand. She has been covering education in New Zealand since 2022.

Recent Posts

Union considers legal action over cuts to resource teachers

NZEI Te Riu Roa is considering legal action against the government for the disestablishment of…

7 days ago

NZQA: AI-marking now a reality

NZQA is implementing AI-marking for all Year 10 written assessments from this year onwards, following…

7 days ago

Financial literacy is about more than personal responsibility – wealth and inequality should be part of the new curriculum

Teaching personal financial responsibility isn't enough. Children should be taught broader economic context, argue New…

7 days ago

Achieving optimal sound quality in education spaces

When students can't hear the teacher, they can't learn properly. Sound quality matters in education…

7 days ago

Discover Ōtautahi Christchurch and its learning opportunites

The Garden City is rich with learning opportunities, no matter what subject or part of…

7 days ago

School leaders share stories for Unteach Racism project

Teaching Council of Aotearoa launch school leaders’ stories project with Unteach Racism to challenge institutional…

2 weeks ago