Products

Problems
we solve

We can help your business

Request a Free Demo / trial

Insights

Insights
20 August, 2025

AI in Software Testing: Just Another Fad?

AI in software testing

AI is everywhere. The software testing industry is flooded with buzzword-heavy solutions, and you’d be hard pressed to find a vendor that hasn’t marked at least one of their tools as AI-powered.

Such overuse naturally invites scepticism, especially given past fads that promised the moon but failed to deliver. But is AI another in a long list of cautionary tales, or does it genuinely herald a new era?

Do Testing Fads Give You a Sense of Déjà Vu?

Something about this current trend is so familiar, you could be forgiven for thinking you’ve been here before.

In the last decade alone, codeless automation, parallel programming, and big data have swept through SDLCs with much fanfare and promise, only to fade as reality set in.

Most fizzled out because the hype exceeded capability, underlying complexity was downplayed, and organisations resisted (wouldn’t fund) the change required to realise the benefits.

Is AI-Based Testing Just The Latest Fad?

There are definite similarities with the current, and rampant, AI washing.

For a start, many testing products labelled as AI-driven lack genuine AI capabilities. Instead, they use simple-but-effective coding techniques that have been around for decades.

As with every other field, this is a case of software testing marketeers exaggerating the current state of technology. Claims that AI can automate everything, generate test suites instantly, or eliminate the need for human testers are just plain false.

Why Software Testing AI Might Just Be Different

Behind the excessive and unrealistic marketing though, lies something undeniable, enough for me to say with absolute conviction that AI isn’t just another marketing fad.

For one thing, unlike most prior SDLC trends, AI is already making a tangible impact:

  • Self-healing scripts: AI updates tests as applications evolve, reducing flakiness and maintenance.
  • Adaptive test selection: Machine learning targets high-risk areas, boosting testing efficiency.
  • Video-based test creation: Teams can generate manual and automated tests from short user videos.
  • Anomaly detection and analytics: AI sifts through massive test result sets, highlighting subtle regressions and risks.

AI has already been shown to cut test design and maintenance time, predict defects before they hit production, and fill test coverage gaps faster than manual methods.

AI Could Be The Most Significant Shift in QA… Ever

The reason AI isn’t just another fad? We are in the earliest days of a technology that has the potential to redefine human life in ways not seen since the Industrial Revolution.

In my opinion, AI will have a bigger impact than the telephone, the Internet, maybe even the printing press. It will continuously learn, adapt, and accelerate into something truly extraordinary; for better or worse.

AI is already polarising society. It has created a two-tier system between the AI-literate, confident early adopters and the rest. Those who embrace it see the opportunities, those who fear it see the threat.

The reality probably lies somewhere in between, and AI is already fundamentally changing working patterns across myriad industries.

When it comes to software testing, AI is already augmenting test management (identifying critical test sets, analysing results), generating and interpreting defect reports (even from videos or logs), and automating repetitive checks—which frees up QA professionals to focus on strategy and creative problem-solving.

AI’s role won’t stop at automation. It will become embedded in every stage of the SDLC, making the feedback loop between development, testing, and business goals smarter and faster than ever.

The question isn’t whether AI will change testing, it’s whether you will embrace it and thrive, or not.

Caveats: Tempering Hype with Current Reality

Of course, not every claim is valid, and present-day testing of AI solutions comes with fundamental limitations:

  • Requires extensive, high-quality data for training.
  • Lacks domain intuition and nuanced understanding.
  • Needs human oversight for context, creativity, and strategic decision-making.
  • Can be complex to implement, especially at scale.

Organisations that succeed will blend strong QA expertise with thoughtful use of AI, sceptically evaluating claims and investing in upskilling—not chasing magic bullets or quick wins.

Conclusion: AI Is a Defining Leap in Software Development

While the current hype cycles echo many past SDLC trends, AI is already delivering advances that outstrip previous fads.

For software testing professionals, the path is clear: Start now.

Look past the marketing noise and adopt AI with care and education. Measure its impact, stay up to date with advancements and, where you can, help guide your organisation’s AI future.

We may well be at AI v0.1, but as capabilities mature, the impact will only grow.

Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

20th August 2025
Calleo Sell Test Tools

Calleo: We Sell Test Tools

With Calleo, you get expert guidance to find the right options, demos and trial licenses to evaluate them, and practical help to get up and running. You’ll see the pros, cons and long-term costs clearly before making any decisions, and stay supported with renewals and updates long after you’ve started using the tool.

cut test maintenance

4 Ways to Cut Test Maintenance Effort with AI

Automation maintenance is a pain. It’s a frustrating time drain that nobody enjoys. Unfortunately, teams are doing more of it than ever, with modern solutions changing like the wind and each new release jeopardising script integrity. Thankfully, AI-driven automation is here to help.

2025 top testing articles

2025 Roundup: Check Out The Top 5 Testing Times Articles

Thanks to your support, 2025 was another excellent year for Testing Times and our 10,000+ subscribers. We explored a wide range of software testing topics, including test automation, performance testing, Jira fatigue, tester authority, and more. Below is a quick look at the five newsletters with the most reactions this year, and why they resonated so strongly.

Is WFH worth the risk

Remote Testing: Is Working From Home Worth The Risk?

Increasingly, organisations expect remote and hybrid testers to use borrowed tool licences, unstable VPNs, and software never designed to leave the office. That creates significant compliance and security risks that can turn into serious long‑term problems. It’s not the testers per se, but remote execution over on‑prem licences is a software audit waiting to happen. Read on to learn why a compliance nightmare isn’t the only reason your test setup might not be fit for distributed and home‑working team members.

Effortless automation

Solved: 4 Common Test Automation Headaches

Software teams know the story all too well: automation promises speed and reliability, but reality often brings fragile scripts, phantom failures, and endless rework. In the end, the technology intended to accelerate releases ends up bogging things down. Or at least, that’s how things used to be… Today’s AI-powered functional

Test the Untestable

Test the Untestable: Unlock Savings & Accelerate Your Project

Testers have long been asked to test earlier, faster, and more often. In truth, however, when critical APIs, integrations, or microservices aren’t ready, testing gets stuck. We’ve all been there, raring to go, like greyhounds in the slips…  but with nothing to test, and increasingly concerned about the impending last-minute panic.

The Test Tools You Need

Testers: Will We Finally Get The Tools We Need?

During the 2008 credit crunch, companies slashed technical investment. The mantra “do more with less” stuck—and 17 years later, testers are still paying the price as demands, complexity, and expectations have soared. It’s no coincidence that we’re witnessing an increasing number of high-profile software failures and cyber attacks. Yet, there’s still little willingness to invest in the right test tools and training.

Test Automation Fails Smaller Teams

Why Test Automation Fails for Smaller Teams

Many small software teams turn to test automation, expecting substantial time and cost savings. However, they often fail to achieve any of these goals; instead of seeing a return on investment, they end up spending more effort and cost fixing their automation packs. This failure can leave lasting scars, deterring people from embracing automation and realising its many benefits…

breaking up with legacy tools

When to Move on From Legacy Test Tools

I often speak to people who want to abandon legacy test tools and transition to shiny new solutions. They cite several reasons for the switch, many of which are valid, while others need greater consideration to avoid a negative or costly outcome. On the other hand, I also speak to people who are reluctant to ever change tools, even though they’d see incredible benefits.

Shift Left

Shift Left Testing: 4 Myths and Why They Matter

Shift-left testing has become one of the most talked-about software development ideas. It sounds deceptively simple: test earlier in the process to avoid late surprises. But while the phrase is repeated at countless conferences and stand-ups, it is often misunderstood, misapplied, or reduced to a box-ticking activity (like many other testing initiatives).

Insights

Search

Related Articles

To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.