Software developer at crossroads, AI code vs traditional coding

AI's Productivity Paradox: How ChatGPT Bans Impacted Coders & What It Means for Your Workflow

"Discover the surprising ways a ChatGPT ban affected software developers in Italy, revealing crucial lessons about AI's role in productivity and skill development."


The rise of generative AI tools like ChatGPT has sparked intense debate. Are these technologies a boon to productivity, or do they introduce new challenges? While many celebrate AI's potential to automate tasks and boost output, recent research suggests the reality is far more complex. A groundbreaking study analyzed the impact of Italy's ChatGPT ban on software developers, revealing surprising insights about AI's heterogeneous effects on productivity.

Italy's ban on ChatGPT in early 2023 offered a unique opportunity to study the real-world effects of restricted AI access. Researchers tracked the coding output and quality of over 36,000 GitHub users in Italy and other European countries, using a difference-in-differences framework to isolate the ban's impact. The findings challenge the simplistic notion that AI universally boosts productivity, highlighting the importance of user experience and task complexity.

This article delves into the study's findings, exploring how the ChatGPT ban affected developers with varying levels of experience. We'll examine the short-term consequences of restricted AI access, uncover the unexpected ways developers adapted, and discuss the implications for businesses and individuals navigating the evolving landscape of AI-powered work.

AI Search Multiple angles on this topic

AI Productivity By the Numbers

Generative AI tools have been adopted at an unprecedented pace, with ChatGPT alone surpassing 500 million users as of mid-2025. Studies consistently report significant productivity gains in coding, writing, and professional knowledge work when AI assistance is available. However, these headline numbers often obscure the uneven distribution of benefits across different skill levels and use cases, a tension that sits at the heart of AI's productivity paradox.

How Researchers Measure AI's Impact on Work

The standard approach for evaluating generative AI's productivity effects involves controlled experiments comparing task output with and without AI assistance, typically measuring speed, quality, or both. Natural experiments—such as policy changes that abruptly restrict AI access—offer complementary real-world evidence but introduce confounding variables that are difficult to fully isolate. Both methods rely on relatively short observation windows, which may not capture longer-term behavioral shifts like skill atrophy or workflow redesign.

From GPT-3 to Global Regulation

The launch of ChatGPT in late 2022 marked a turning point, transforming large language models from academic curiosities into mainstream productivity tools almost overnight. Within months, governments began grappling with how to regulate the technology—Italy's temporary ban in March 2023 became one of the first national-level restrictions on generative AI. This regulatory milestone set a precedent that foreshadowed the EU AI Act and sparked an ongoing debate about balancing innovation with data protection and safety concerns.

The Unexpected Twist: AI's Impact on Productivity

Software developer at crossroads, AI code vs traditional coding

The study's most striking finding was that the ChatGPT ban's impact varied significantly based on developer experience. Less experienced developers actually saw a short-term increase in both output quantity and quality. Without ChatGPT, they became more productive, while seasoned developers experienced the opposite. The decreased quality could indicate that the AI assists less skilled workers to complete tasks.

Conversely, experienced developers faced a decrease in productivity, particularly on more routine tasks like resolving issues and debugging. This suggests that experienced developers may have become reliant on ChatGPT for these tasks, and its absence disrupted their workflow. This reliance, or over-reliance, on AI is not unheard of.

  • Increased output for beginners: Those new to coding found themselves doing more without the AI, showing reliance and potential over-dependence on such systems.
  • Slowdowns for experts: Experienced coders found that simple tasks took far longer and were more cumbersome without the tool.
AI Search Multiple angles on this topic

Italy's ChatGPT Ban as a Natural Experiment

A study of over 36,000 GitHub users examined the productivity effects of Italy's ban on ChatGPT using a difference-in-differences framework, comparing coding output quantity and quality in Italy against other European countries. A separate controlled experiment by Noy and Zhang found that ChatGPT significantly boosted productivity in midlevel professional writing tasks. Notably, the research on the ban revealed heterogeneous effects—rather than uniformly reducing output, the restriction prompted some developers to seek alternative tools, suggesting that outright bans may simply redirect usage rather than eliminate it.

The Limits and Risks of AI Assistants

A systematic review of 33 empirical studies identified five key limitations of ChatGPT, including accuracy issues, potential for misuse, and concerns about over-reliance on the tool. Researchers caution that generative AI can produce plausible but incorrect outputs, creating a false sense of confidence that may be especially dangerous in high-stakes domains. Ethical concerns around data privacy, intellectual property, and the potential displacement of human expertise further complicate the case for unrestricted AI adoption.

Weighing Access Against Risk

Without access to specific comparative studies in this case, it is worth noting that the general debate around AI bans pits productivity gains against regulatory risk mitigation—a tradeoff that varies significantly by industry, geography, and organizational culture. Early evidence suggests that blanket bans may be less effective than targeted governance frameworks that allow AI use under controlled conditions. Organizations must weigh the opportunity cost of restricted access against the reputational and legal risks of unregulated deployment.

These findings challenge the assumption that generative AI universally boosts productivity. Instead, the impact depends on the user's skill level and the nature of the task. While less experienced developers may benefit from AI assistance, experienced developers may become over-reliant, hindering their ability to perform routine tasks independently.

Lessons Learned: Adapting to an AI-Driven World

The study's findings offer valuable lessons for individuals and organizations navigating the age of AI: Generative AI's effects are not uniform, but depend greatly on the users' experience levels and the complexity of the task. To realize the best results, organizations need to tailor AI tools to match the demands and skills of their workers.

AI Search Multiple angles on this topic

What the Data Tells Us—And What It Doesn't

Analysis of the Italian ban's effects across tens of thousands of developers revealed that productivity impacts were not uniform: more experienced coders showed different patterns than less experienced ones, complicating simple narratives about AI as a universal equalizer. One expert commentator argued that by removing ChatGPT, Italy effectively cut off 'perhaps the most important tool available to our generation,' though others pointed to legitimate security concerns around sensitive data. The research underscores that the productivity consequences of AI restrictions are highly context-dependent and resist one-size-fits-all policy prescriptions.

The Scale and Speed of AI Adoption

ChatGPT became the fastest-adopted consumer technology in history, reaching one million users in just five days and 100 million within two months. By mid-2025, OpenAI reported over 500 million users globally, with enterprise adoption accelerating across sectors. Market projections suggest the generative AI market could reach $1.68 trillion by 2031, driven by emerging capabilities such as agentic AI and multimodal systems that extend far beyond text generation.

Regulation, Equity, and the Global AI Divide

The debate over AI bans sits within a broader tension between accelerating innovation and ensuring equitable access to transformative technologies. Restrictions designed to protect consumers may inadvertently widen the digital divide if wealthier nations or companies retain access to powerful tools while others fall behind. Crafting effective governance frameworks that balance safety, privacy, and productivity remains one of the defining policy challenges of the current era.

How AI Access Shapes Real Workflows

Research on Italy's ChatGPT ban found that the restriction coincided with decreased AI usage by domestic market participants, with measurable effects on information processing capabilities in capital markets. The ban served as a real-world stress test revealing how dependent professional workflows had become on generative AI in a remarkably short period. These findings suggest that restricting AI access carries downstream consequences not just for individual productivity, but for broader market efficiency and information flow.

About this Article -

Written with AI assistance from published research, and reviewed by the Mystum team. See our About page for more information.

Everything You Need To Know

1

How did Italy's ban on ChatGPT in early 2023 provide insights into AI's effects on software development?

The ChatGPT ban in Italy created a natural experiment, allowing researchers to compare the coding output and quality of over 36,000 GitHub users in Italy and other European countries. By using a difference-in-differences framework, they were able to isolate the ban's impact and reveal how restricted AI access affected developers with varying levels of experience. This approach offered a real-world view of AI's influence, challenging assumptions about its universal benefits. However, the study does not cover other potential factors influencing developer productivity during that period, such as changes in project demands or team dynamics.

2

What were the surprising findings regarding the impact of the ChatGPT ban on software developers with different experience levels?

The study revealed that the ChatGPT ban led to increased productivity in less experienced developers, as they showed more output and quality, potentially due to reduced over-reliance on AI. Conversely, experienced developers experienced decreased productivity, particularly on routine tasks like issue resolution and debugging, suggesting they had become dependent on ChatGPT. These results indicate that the impact of generative AI is not uniform and can depend on user expertise and task complexity. The study does not delve into the specific types of tasks where ChatGPT was most beneficial or detrimental.

3

What does the study suggest about the assumption that generative AI universally boosts productivity?

The study challenges the idea that generative AI inherently boosts productivity for everyone. It demonstrates that the impact of tools like ChatGPT varies significantly depending on the user's skill level and the nature of the task. While less experienced developers may benefit from the assistance of AI, experienced developers may become over-reliant, which could hinder their ability to perform routine tasks independently. This finding highlights the importance of tailoring AI integration strategies to the specific needs and skills of workers. However, the study does not explore potential long-term effects on skill development or adaptation strategies beyond the immediate response to the ban.

4

What can organizations learn from the effects of the ChatGPT ban in Italy regarding AI adoption?

Organizations should recognize that the effects of generative AI tools are not uniform. They need to tailor AI tools to match the demands and skills of their workers to realize the best results. The study implies that a one-size-fits-all approach to AI integration can be ineffective or even detrimental. The findings suggest that organizations should provide targeted training and support to help developers of all experience levels effectively use AI tools without becoming over-reliant on them. This study doesn't include the cost or impact of training programs.

5

What are the implications of over-reliance on AI tools like ChatGPT for experienced software developers?

Over-reliance on tools like ChatGPT can hinder the ability of experienced software developers to perform routine tasks independently. The study indicates that these developers may become less productive when AI assistance is unavailable, particularly for tasks such as resolving issues and debugging. This dependence can limit their problem-solving skills and adaptability in situations where AI tools are restricted or unavailable. This also has implications for software development teams. This study however does not delve into potential ways to mitigate this risk, such as regular skill assessments and retraining programs.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.