Products

Problems
we solve

We can help your business

Request a Free Demo / trial

Insights

Insights
20 August, 2025

AI in Software Testing: Just Another Fad?

AI in software testing

AI is everywhere. The software testing industry is flooded with buzzword-heavy solutions, and you’d be hard pressed to find a vendor that hasn’t marked at least one of their tools as AI-powered.

Such overuse naturally invites scepticism, especially given past fads that promised the moon but failed to deliver. But is AI another in a long list of cautionary tales, or does it genuinely herald a new era?

Do Testing Fads Give You a Sense of Déjà Vu?

Something about this current trend is so familiar, you could be forgiven for thinking you’ve been here before.

In the last decade alone, codeless automation, parallel programming, and big data have swept through SDLCs with much fanfare and promise, only to fade as reality set in.

Most fizzled out because the hype exceeded capability, underlying complexity was downplayed, and organisations resisted (wouldn’t fund) the change required to realise the benefits.

Is AI-Based Testing Just The Latest Fad?

There are definite similarities with the current, and rampant, AI washing.

For a start, many testing products labelled as AI-driven lack genuine AI capabilities. Instead, they use simple-but-effective coding techniques that have been around for decades.

As with every other field, this is a case of software testing marketeers exaggerating the current state of technology. Claims that AI can automate everything, generate test suites instantly, or eliminate the need for human testers are just plain false.

Why Software Testing AI Might Just Be Different

Behind the excessive and unrealistic marketing though, lies something undeniable, enough for me to say with absolute conviction that AI isn’t just another marketing fad.

For one thing, unlike most prior SDLC trends, AI is already making a tangible impact:

  • Self-healing scripts: AI updates tests as applications evolve, reducing flakiness and maintenance.
  • Adaptive test selection: Machine learning targets high-risk areas, boosting testing efficiency.
  • Video-based test creation: Teams can generate manual and automated tests from short user videos.
  • Anomaly detection and analytics: AI sifts through massive test result sets, highlighting subtle regressions and risks.

AI has already been shown to cut test design and maintenance time, predict defects before they hit production, and fill test coverage gaps faster than manual methods.

AI Could Be The Most Significant Shift in QA… Ever

The reason AI isn’t just another fad? We are in the earliest days of a technology that has the potential to redefine human life in ways not seen since the Industrial Revolution.

In my opinion, AI will have a bigger impact than the telephone, the Internet, maybe even the printing press. It will continuously learn, adapt, and accelerate into something truly extraordinary; for better or worse.

AI is already polarising society. It has created a two-tier system between the AI-literate, confident early adopters and the rest. Those who embrace it see the opportunities, those who fear it see the threat.

The reality probably lies somewhere in between, and AI is already fundamentally changing working patterns across myriad industries.

When it comes to software testing, AI is already augmenting test management (identifying critical test sets, analysing results), generating and interpreting defect reports (even from videos or logs), and automating repetitive checks—which frees up QA professionals to focus on strategy and creative problem-solving.

AI’s role won’t stop at automation. It will become embedded in every stage of the SDLC, making the feedback loop between development, testing, and business goals smarter and faster than ever.

The question isn’t whether AI will change testing, it’s whether you will embrace it and thrive, or not.

Caveats: Tempering Hype with Current Reality

Of course, not every claim is valid, and present-day testing of AI solutions comes with fundamental limitations:

  • Requires extensive, high-quality data for training.
  • Lacks domain intuition and nuanced understanding.
  • Needs human oversight for context, creativity, and strategic decision-making.
  • Can be complex to implement, especially at scale.

Organisations that succeed will blend strong QA expertise with thoughtful use of AI, sceptically evaluating claims and investing in upskilling—not chasing magic bullets or quick wins.

Conclusion: AI Is a Defining Leap in Software Development

While the current hype cycles echo many past SDLC trends, AI is already delivering advances that outstrip previous fads.

For software testing professionals, the path is clear: Start now.

Look past the marketing noise and adopt AI with care and education. Measure its impact, stay up to date with advancements and, where you can, help guide your organisation’s AI future.

We may well be at AI v0.1, but as capabilities mature, the impact will only grow.

Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

20th August 2025
Do Stakeholders Understand

Do Stakeholders Actually Understand the Purpose of Testing?

Most stakeholders don’t need to understand the finer points of software testing. They’ve got their own jobs to get on with. A finance director doesn’t need to know how to prepare test data, any more than a tester needs to understand how the finance director prepares the annual accounts. For the most part, this works well. Stakeholders get useful results, visibility of progress and enough information to make decisions. They don’t need a running commentary on everything that happens in a test environment. However, people can expect different things from those results.

testers v AI

Can Software Testers Save Mankind from AI?

In the race to protect us against rogue AI, our best defence might not be scientists or politicians, but the often-overlooked heroes of the tech world: software testers.

As AI systems increasingly mediate healthcare, criminal justice, and military decisions, this unlikely profession could hold the key to preventing existential catastrophe.

Real World UX

How to Test Real World Software Performance

When it comes to performance testing, whether you’re a seasoned expert or a complete novice, having the right tools at your disposal can make all the difference. Enter TruClient, a powerful solution designed to streamline the testing process for web and mobile applications. But what exactly makes TruClient such a valuable tool?

In essence, TruClient protocols allow you to test web and mobile applications quickly, easily and efficiently.

Most performance test scripting tools operate at a protocol level; however, TruClient records your actions in real-time, enabling faster scripting.

Evergreen Software Testing

How to Test Evergreen IT: A Very Short Guide

Evergreen IT sounds simple. Rather than running old systems for years, software is continuously updated. The benefits are obvious: access to new features, no more painful migration projects, better security, and less technical debt. This has knock-on effects for test teams. Evergreen IT reduces the need for large, occasional system

Testing has changed

Your Software Keeps Changing. Can Your Testing Keep Up?

Cloud applications, SaaS platforms, browsers, APIs and security services now update on schedules set largely by their suppliers.

Customers may be able to select a maintenance window or postpone an update briefly, but they usually cannot remain on the same version indefinitely.

The software industry often calls this evergreen software: solutions kept current through frequent, supplier-led updates instead of occasional, customer-controlled upgrades.

OT UFT One in 2026

Test Automation in 2026: Less Scripting, Easier Maintenance

Automation can and should help you release sooner and with more confidence. But it doesn’t always work out that way. It often creates its own delays, with scripts that only a few specialists can maintain, brittle checks that fail after routine interface changes and results that are, rightly, treated with scepticism.

The problem is, many people are still automating poorly, with dated approaches, fragmented automation solutions, and poor tool choices. Thankfully, in 2026, there’s a much easier way to automate functional testing.

ALM Octane in 2026

5 Ways to Know if Your Project is Really on Track

Is your software project on track? Do you really know? Are there hidden issues lurking in the background that will catch you out? Too often, the answers are buried in silos across different tools. By the time someone pulls everything together, some of the information is already out of date.

ALM Octane gives you instant access to up-to-date delivery information. It shows you the current state of quality, what is on track, what is holding delivery up and whether you have enough evidence to release with confidence.

Performance testing in 2026

These LoadRunner Cloud Updates Make Performance Testing Better in 2026

LoadRunner Cloud gives teams a SaaS platform for creating and running performance tests without having to build and maintain all the supporting load-generation infrastructure themselves.

Officially named OpenText Core Performance Engineering, LoadRunner Cloud can simulate anything from a small number of users to millions, across different locations, applications and technologies.

Software Testing Risk

Is Remote Software Testing Creating New Risks You Haven’t Even Considered?

Increasingly, organisations expect remote and hybrid testers to use borrowed tool licences, unstable VPNs, and software never designed to leave the office. That creates significant compliance and security risks that can turn into serious long‑term problems.

It’s not the testers per se, but remote execution over on‑prem licences is a software audit waiting to happen. Read on to learn why a compliance nightmare isn’t the only reason your test setup might not be fit for distributed and home‑working team members.

Insights

Search

Related Articles

To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.