we solve

We can help your business

Request a Free Demo / trial


Insights | How to
5 December, 2023

5 ChatGPT Guidelines For Software Testers

Using Chatbots for Test Creation

People use ChatGPT for all sorts of tasks these days, including software testing. When I initially conceived this post, I was going to focus on whether this was a good idea, but that seems redundant. Let’s face it: that horse has bolted, and there’s no going back. The use of chatbots in software testing is here to stay.

Rather than judge how effective chatbots are for software testing, this insights contains guidelines to help you use AI to enhance, rather than compromise, the quality of your testing and application.

Why AI Is Compelling For Software Testers

ChatGPT and similar AI technologies offer shortcuts; they do a lot of work for you, meaning you can spend your time on other things (unless you need to spend more time editing the tests than it would have taken you to create them yourself).

The fact is, though, that Chatbots can accelerate many tasks. They can quickly generate code, providing solutions to common scripting problems and even offering insights into best practices. In the context of LoadRunner and UFT, AI can create basic test scripts, identify potential performance bottlenecks, and automate some aspects of functional tests with surprising speed.

Chatbots Aren’t All Sunshine and Roses

Despite their promise of accelerated testing and reduced effort, AI chatbots are not without their flaws.

They lack the nuanced understanding of a human tester, especially when interpreting complex requirements and test scenarios. The fact is that most AI-generated scripts will require customisation; the question is how much? Were they more of a hindrance than an aid if they needed a significant rework?

Also, knowing which parts of an AI-generated script are good or bad requires expert knowledge and diligent reviews. Without these, issues could creep into your tests, and they might not do what you think they’re doing.

Furthermore, if you ask ten developers to write the same program, you will end up with 10 different versions and the likelihood is that not all will work the first time. The same is true of AI solutions. They are only as good as their models and inputs – and do you really know what testing experience any of them have?

AI in Software Testing Requires a Collaborative Approach

The key to leveraging AI in software testing is to use it as an assistant rather than a replacement. Yes, ChatGPT can take on the heavy lifting of initial script generation, but human insight is invaluable for refining these scripts to perfection. I can’t stress enough how important this is. Testers must always review, tweak, and validate every AI-generated script to ensure the scripts meet the test objectives and quality standards.

ChatGPT Guidelines For Software Testers

AI chatbots, like ChatGPT, are powerful tools that can transform how you approach test creation.

They are imperfect but can be an asset in your testing toolkit with the right mindset and approach. It’s too late to avoid these technologies altogether; instead, let’s use them to help accelerate tasks, make life easier and get more done in less time – which always seems to be needed in software testing.

Use these 5 simple guidelines to embrace AI in software testing

  1. Think More: Use AI as a starting point, but apply your critical thinking to analyse and improve the work.
  2. Be Creative: Explore creative test scenarios that AI might not anticipate and incorporate them into your testing strategy.
  3. Think Laterally: Consider the broader context of the application under test, the business needs, and how users might interact with the solution – things AI cannot fully comprehend.
  4. Use Your Initiative: Take the initiative to learn from the AI’s approach and integrate those learnings into your testing strategy.
  5. Consider: Is AI enhancing and simplifying creating the test or will using AI add more time to the task, once you have allowed for checking and enhancing the script.

Are You Leveraging the AI Built Into Your Test Tools?

While the spotlight has been on standalone AI solutions like ChatGPT, it’s worth highlighting the AI and machine learning (ML) capabilities already integrated within many modern test automation tools. These built-in features accelerate test creation and execution, offering a more seamless and efficient testing process.

ChatGPT may get all the press for its general capabilities, but the specialised AI features in your test automation tools are unsung heroes. They will complement your testing expertise.

If you want to use AI in software testing, you should leverage these AI advancements. You’ll likely find your testing is faster, more efficient, and more robust.

Related Products

Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

5th December 2023
cut testing costs

Cut Software Testing Costs With These Essential Tactics

Balancing rigorous testing with cost-effectiveness is a challenge. You can test too much, take too much time, and spend too much money on testing. Luckily, there are proven ways to refine your testing practices, increase efficiency, and cut your software testing costs.

performance testing is like herding cats

Herding Cats: Performance Testing Strategies for 2024

Performance testing is more challenging than ever. Technology is more complex, customer expectations are higher, and an increasing number of people and departments need to be involved to make performance testing effective. This article shines a light on strategies to help you execute successful performance test cycles in 2024.

skimping on performance test tools

Why Skimping on Performance Tools Is a False Economy

Performance tool cost is likely to be less than 10% of the performance testing budget, yet many still think that slashing this figure saves money. Common sense tells us that if you do not spend on quality tools, you will spend more on people. In this insight, I look at why investment in professional performance test tools is so important.

The Human Cost of Software Failure

Horizon: The Human Cost of Software  Failure

The Post Office Horizon scandal destroyed lives and livelihoods and is rooted in defective software. This insight looks at the scandal from a testing perspective and serves as a cautionary tale for all involved in deploying large-scale IT systems.

LoadRunner Cloud Migration

Remote Testing with LoadRunner Might Be Breaching Your Contract

Did you know that most LoadRunner Professional licenses are only valid for a specific location? This means that (unless you’ve bought the country or worldwide usage add-on) working from home, other offices or geographic locations is prohibited and doing so could incur financial penalties.

Software Testing Steps For an Easier Life

Simplify Software Testing With These 3 Easy Steps

Software test professionals like us are under constant pressure to get more done in less time. These three software testing steps will make your life easier, help you achieve your goals, and allow you to focus on your own progression.

2023 top testing articles

The Most Popular Testing Articles of 2023

in 2023 we produced 50+ testing insights to help software professionals test better than ever before and consider testing from a different perspective – today we look back at the 3 most popular of these insights.

rudolph the red nosed tester

Rudolph the Red-Nosed Tester

It was December 23rd at the North Pole, and Santa’s software team were enjoying their Christmas go-live party. They’d pushed the new CRM (Christmas Resource Management) system over the line just in time, and they were very pleased with themselves about it. Everyone apart from Rudolph, the tester.



Related Products


Related Articles


To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.