
Is the Use of AI by Knowledge Workers Reducing Critical Thinking?
Introduction
Generative AI (GenAI) tools like ChatGPT and Microsoft Copilot are transforming how we work, how we study, how we prepare for meetings, but what does this mean for our critical thinking skills?
This study explores how generative AI tools influence critical thinking among knowledge workers. As these tools become more common, they raise questions about how they affect cognitive effort and confidence. This research surveyed 319 knowledge workers, collecting 936 examples of how they used generative AI in their tasks.
The study examined two main questions:
- when and how do users engage in critical thinking with AI, and
- when does AI make critical thinking easier or harder?
Title: The Impact of Generative AI on Critical Thinking: Reductions in Cognitive Effort and Confidence Effects
Link: The Impact of Generative AI on Critical Thinking
Peer Review Status: Peer Reviewed, presented at CHI Conference on Human Factors in Computing Systems
Citation:
Lee, H.-P., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers. CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.
Methodology
The researchers used an online survey (n=319) targeting knowledge workers who use generative AI at least once a week.
Participants provided detailed examples of using AI for three types of tasks: creation, information processing, and advice. They rated their confidence in completing the tasks with and without AI, as well as the cognitive effort required for six types of critical thinking activities based on Bloom’s taxonomy: recall, comprehension, application, analysis, synthesis, and evaluation.
The study also measured each participant’s general tendency to reflect on their work and their overall trust in AI.
Results and Findings
The study found that knowledge workers perceive reduced cognitive effort when using AI, especially when they have high confidence in the tool’s capabilities.
Conversely, those with high self-confidence reported more effort in verifying and integrating AI outputs.
Key findings include:
Critical Thinking Shifts Toward Verification and Integration
When using GenAI, knowledge workers reported spending less time on information gathering and more time verifying the accuracy of AI outputs. For example, participants often cross-referenced AI-generated content with external sources or their own expertise to ensure reliability. This shift reflects a move from task execution to task stewardship, where workers focus on guiding and refining AI outputs rather than generating content from scratch.
Confidence in AI Reduces Critical Thinking Effort
The study found that higher confidence in GenAI’s capabilities was associated with less perceived effort in critical thinking. In other words, when workers trusted AI to handle tasks, they were less likely to critically evaluate its outputs. Conversely, workers with higher self-confidence in their own skills reported engaging in more critical thinking, even though they found it more effortful.
Motivators and Barriers to Critical Thinking
Participants cited several motivators for critical thinking, including the desire to improve work quality, avoid negative outcomes, and develop professional skills. However, barriers such as lack of time, limited awareness of the need for critical thinking, and difficulty improving AI responses in unfamiliar domains often prevented workers from engaging in reflective practices.
GenAI Reduces Effort in Some Areas, Increases It in Others
While GenAI tools reduced the effort required for tasks like information retrieval and content creation, they increased the effort needed for activities like verifying AI outputs and integrating them into workflows. This trade-off highlights the dual role of GenAI as both a facilitator and a complicator of critical thinking.
Critiques of the Research or Additional Areas of Potential Study
To start, I am always weary of research conducted by the industry itself, and Microsoft is a huge player in today’s AI. So I tend to read these studies extremely critically and take them as always needing and begging for further study.
The study relies on self-reported data, which may be subject to bias or inaccuracies.
This study lacks any cross-cultural perspectives in that it was conducted in Enlish only, and focused on youngish, tech savy workers.
Additionally, it does not account for long-term impacts on critical thinking skills.
Future research could explore:
- Longitudinal studies to observe changes in critical thinking over time.
- Rapid, evolving studies due to the rapid evolution of AI tools.
- Experiments that measure critical thinking performance rather than self-perception.
- Cross-Cultural Studies
- Studies across all age groups
- Studies with non Knowledge Workers
- Studies with students.
Conclusion
I keep a folder of quotes from pundits lamenting the death of civil society with each new technological advancement for my class on “The Media.” The printing press, radio, television, cable TV, the Internet, and social media—all were predicted to destroy us.
Meh.
I do believe generative AI tools are massively disrupting workflows, effort, outputs, and critical thinking. I see it firsthand in the college classroom.
As Generative AI evolves, tools must support – not undermine- critical thinking. While AI can enhance efficiency and reduce effort, it also risks fostering overreliance and diminishing critical engagement.
By reducing the perceived effort of critical thinking, Generative AI may weaken independent problem-solving skills. As users shift from direct engagement to oversight, they must balance efficiency gains with maintaining cognitive skills.
AI designers should prioritize features that promote critical thinking while preserving efficiency. This research highlights the need for systems that encourage reflective thinking and help users critically assess AI-generated outputs.
Ultimately, the study underscores the importance of maintaining a critical mindset in an increasingly AI-driven world.
P.S.
Now that you’re here thinking about critical thinking, I would be remiss if I didn’t recommend one of the guides I keep within arm’s reach at my desk. This book contains over 60 structured techniques that enhance thinking processes, and I highly recommend it.
