Is the Use of AI by Knowledge Workers Reducing Critical Thinking?

Is the Use of AI by Knowledge Workers Reducing Critical Thinking?

Introduction

Generative AI (GenAI) tools like ChatGPT and Microsoft Copilot are transforming how we work, how we study, how we prepare for meetings, but what does this mean for our critical thinking skills?

This study explores how generative AI tools influence critical thinking among knowledge workers. As these tools become more common, they raise questions about how they affect cognitive effort and confidence. This research surveyed 319 knowledge workers, collecting 936 examples of how they used generative AI in their tasks.

The study examined two main questions:

  • when and how do users engage in critical thinking with AI, and
  • when does AI make critical thinking easier or harder?

Title: The Impact of Generative AI on Critical Thinking: Reductions in Cognitive Effort and Confidence Effects

Link: The Impact of Generative AI on Critical Thinking

Peer Review Status: Peer Reviewed, presented at CHI Conference on Human Factors in Computing Systems

Citation:
Lee, H.-P., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers. CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.

Methodology

The researchers used an online survey (n=319) targeting knowledge workers who use generative AI at least once a week.

Participants provided detailed examples of using AI for three types of tasks: creation, information processing, and advice. They rated their confidence in completing the tasks with and without AI, as well as the cognitive effort required for six types of critical thinking activities based on Bloom’s taxonomy: recall, comprehension, application, analysis, synthesis, and evaluation.

The study also measured each participant’s general tendency to reflect on their work and their overall trust in AI.

Results and Findings

The study found that knowledge workers perceive reduced cognitive effort when using AI, especially when they have high confidence in the tool’s capabilities.

Conversely, those with high self-confidence reported more effort in verifying and integrating AI outputs.

Key findings include:

Critical Thinking Shifts Toward Verification and Integration
When using GenAI, knowledge workers reported spending less time on information gathering and more time verifying the accuracy of AI outputs. For example, participants often cross-referenced AI-generated content with external sources or their own expertise to ensure reliability. This shift reflects a move from task execution to task stewardship, where workers focus on guiding and refining AI outputs rather than generating content from scratch.

Confidence in AI Reduces Critical Thinking Effort
The study found that higher confidence in GenAI’s capabilities was associated with less perceived effort in critical thinking. In other words, when workers trusted AI to handle tasks, they were less likely to critically evaluate its outputs. Conversely, workers with higher self-confidence in their own skills reported engaging in more critical thinking, even though they found it more effortful.

Motivators and Barriers to Critical Thinking
Participants cited several motivators for critical thinking, including the desire to improve work quality, avoid negative outcomes, and develop professional skills. However, barriers such as lack of time, limited awareness of the need for critical thinking, and difficulty improving AI responses in unfamiliar domains often prevented workers from engaging in reflective practices.

GenAI Reduces Effort in Some Areas, Increases It in Others
While GenAI tools reduced the effort required for tasks like information retrieval and content creation, they increased the effort needed for activities like verifying AI outputs and integrating them into workflows. This trade-off highlights the dual role of GenAI as both a facilitator and a complicator of critical thinking.

Critiques of the Research or Additional Areas of Potential Study

To start, I am always weary of research conducted by the industry itself, and Microsoft is a huge player in today’s AI.  So I tend to read these studies extremely critically and take them as always needing and begging for further study.

The study relies on self-reported data, which may be subject to bias or inaccuracies.

This study lacks any cross-cultural perspectives in that it was conducted in Enlish only, and focused on youngish, tech savy workers.  

Additionally, it does not account for long-term impacts on critical thinking skills.

Future research could explore:

  • Longitudinal studies to observe changes in critical thinking over time.
  • Rapid, evolving studies due to the rapid evolution of AI tools.
  • Experiments that measure critical thinking performance rather than self-perception.
  • Cross-Cultural Studies
  • Studies across all age groups
  • Studies with non Knowledge Workers
  • Studies with students.  

Conclusion

I keep a folder of quotes from pundits lamenting the death of civil society with each new technological advancement for my class on “The Media.” The printing press, radio, television, cable TV, the Internet, and social media—all were predicted to destroy us.

Meh.

I do believe generative AI tools are massively disrupting workflows, effort,  outputs, and critical thinking. I see it firsthand in the college classroom.

As Generative AI evolves, tools must support – not undermine- critical thinking. While AI can enhance efficiency and reduce effort, it also risks fostering overreliance and diminishing critical engagement.

By reducing the perceived effort of critical thinking, Generative AI may weaken independent problem-solving skills. As users shift from direct engagement to oversight, they must balance efficiency gains with maintaining cognitive skills.

AI designers should prioritize features that promote critical thinking while preserving efficiency. This research highlights the need for systems that encourage reflective thinking and help users critically assess AI-generated outputs.

Ultimately, the study underscores the importance of maintaining a critical mindset in an increasingly AI-driven world.

P.S.

Now that you’re here thinking about critical thinking, I would be remiss if I didn’t recommend one of the guides I keep within arm’s reach at my desk. This book contains over 60 structured techniques that enhance thinking processes, and I highly recommend it.

Structured Analytic Techniques for Intelligence Analysis

The Role of Research in Crafting Effective Corporate Messaging

The Role of Research in Crafting Effective Corporate Messaging

As a firm grounded in research—whether it’s surveys, focus groups, or data analysis—there’s nothing more frustrating than a client wanting to skip the groundwork and dive straight into messaging.

Sure, we’d all love to pull compelling slogans out of thin air like some sort of corporate magician, but without solid research, that trick usually falls flat. Crafting effective corporate messaging isn’t about winging it; it’s about doing the legwork to ensure your message resonates with the right people, at the right time.

So, why exactly does research play such a pivotal role in this process? And how can it make your messaging as effective as your most data-driven decision? Let’s dive in.

Why Research is Vital for Corporate Messaging

Research is the backbone of any successful messaging strategy, plain and simple.  Without it, you’re just throwing spaghetti at the wall and hoping something sticks.

Solid corporate research provides the insights you need to understand your audience, pinpoint their needs, and create a message that doesn’t just speak, but sings. A well-researched message is not only engaging and memorable—it’s relevant. And when it’s relevant, it resonates.

Beyond understanding your audience, research keeps you informed about industry trends, competitor strategies, and untapped opportunities. Want to stay competitive in a fast-moving market? It’s not enough to have a great message—you need to ensure that message evolves with the shifting landscape. Research is what helps you stay ahead, rather than chasing the pack.

I would go as far as to say as someone who has polled and conducted focus groups across the United States, there is not a single time I have conducted research and not learned something significant.  

Understanding Your Audience with Data-Driven Insights

We hate to break it to you, but you are not your audience.  Nor is your spouse, nor is you neighbor, nor is your cousin.  

What appeals to your executive team, family, and friends won’t necessarily click with the people you’re trying to reach.

Enter data-driven insights. Whether it’s from surveys, focus groups, or analyzing social media trends, data helps you understand who your audience really is—their demographics, preferences, psychology, and most importantly, their pain points.

These insights let you craft a message that speaks directly to their needs and desires.

And let’s be honest—people pay attention when you talk about them. When you make it about solving their problems, not just listing your features, they’re far more likely to engage and convert.

How to Tailor Corporate Messages for Maximum Impact

Once you’ve got your research and audience insights in hand, it’s time to create messaging that lands with maximum impact. Here are a few tricks of the trade:
    • Keep it Simple: Corporate jargon is a fast way to lose your audience. No one wants to decode a message, so use clear, straightforward language that gets to the point.
    • Be Authentic: Authenticity isn’t just a buzzword—it’s a necessity. Audiences can smell insincerity a mile away. Be transparent, honest, and relatable in your messaging. Build trust first, sell second.
    • Tell a Story: Want your message to stick? Wrap it in a story. People remember narratives much better than a dry list of facts. Use real-life examples, case studies, or a compelling anecdote to drive your point home.
    • Focus on Audience Needs: Your audience doesn’t care how your product works; they care what it can do for them. Make your message about the benefits they’ll experience, whether it’s solving a problem, saving time, or making life easier.  Focus on how it makes them feel.
    • Test and Refine: Even the best messaging can improve. Before you roll out a campaign to the masses, test it with a small segment of your audience. Use their feedback to fine-tune your message until it hits the right note.
The critical part of this is testing and refining.  Even the best laid, researched based plans can go awry in the execution.

Conclusion

In the end, crafting effective corporate messaging isn’t a guessing game—it’s a science backed by research. When you take the time to understand your audience and leverage data-driven insights, you can create messaging that doesn’t just speak—it resonates. Keep it simple, be authentic, tell a story, and focus on the benefits. And, of course, always be ready to test, tweak, and refine. With research as your guide, your corporate communications will make a lasting impact that doesn’t just land—it sticks – and maybe most importantly, in the long run the investment saves you money and limits mistakes.