Products

Problems
we solve

We can help your business

Request a Free Demo / trial

Insights

Insights
8 January, 2025

Unlock NASA’s Testing Techniques… and More: The Best of 2024

NASA Software Testing

2024 was a busy year for Calleo content, with 40+ software testing insights and 12 editions of Testing Times! Throughout the year, we covered a wide range of topics, from the World Quality Report to Lessons you can learn from Streetfighter II.

Don’t worry, I won’t judge you if you haven’t read everything we’ve produced! I know you’re busy, so today, I’m giving an overview of our five top articles from 2024.

The articles explore…

  • How NASA techniques can be applied to enterprise-level testing
  • Whether manual testing is becoming obsolete
  • Current automation trends
  • Why the total cost of ownership matters
  • The need for integrity in vendor communications.

Whether you’re a seasoned testing professional or new to the field, this 2024 highlights package provides valuable perspectives and actionable takeaways to enhance your testing strategies.

Learning from the Best: NASA’s Software Testing Approach

NASA is world famous for incredibly complex systems and a high mission success rate.

They launch rockets into space and explore other planets, with software underpinning pretty much everything they do. But how do they achieve such high levels of quality and avoid catastrophic defects?

In How NASA Does Software Testing: 4 Lessons We Can Learn, we explored the rigorous testing practices they use and how they can offer valuable insights for enterprise-level testers:

Theeir practices underscore the importance of thorough, systematic testing in high-stakes environments, principles that can elevate any organisation’s testing practices.

Read the full article to learn how to apply NASA’s testing techniques to your enterprise-level software testing efforts.

The Shift from Manual to Automated Testing

Test automation has existed for decades, and while I’m the first to admit it was a bit ropey in the early days, it is now mature, sophisticated, and essential for modern software testing. So why are some organisations still reluctant to implement it?

Our article It’s 2024: Why Are You Still Doing Manual Software Testing? addressed this critical question facing many organisations.

We discussed why, as technology evolves and software development becomes increasingly complex, relying solely on manual testing is no longer viable.

Automation just solves so many problems:

  • You can test faster and more efficiently
  • Your results will be more accurate and consistent
  • You can cover more features and platforms
  • You will save money despite initial setup investments

Whilst manual testing still has its place, particularly in exploratory and usability testing, automation should be the primary method for most testing scenarios.

Read the full article to learn the right way to implement test automation.

Emerging Trends in Test Automation

Now that I’ve convinced you to take the plunge into automation, I’ll point you to another one of out top articles: Software Test Automation: 5 Important Trends for 2024

Knowing which automation ideas to adopt can be tricky, especially if you haven’t done it before. In this, we’ve helped simplify your journey by identifying five useful trends shaping test automation:

  1. AI-Driven Testing: Artificial Intelligence is now a core aspect of test automation, enhancing efficiency and effectiveness.
  2. Shift-Left Testing: Integrating testing earlier in the development process with IDE-based automation tools.
  3. Codeless Test Automation: Making test automation accessible to professionals with varying technical expertise.
  4. Continuous Testing: Adopting ongoing testing throughout the SDLC to detect regression errors and reduce project timelines.
  5. Cloud-Based Testing Tools: Leveraging scalable, flexible, and cost-efficient SaaS solutions for dynamic testing environments.

These trends are easy to adopt and allow you to implement intelligent, accessible, and efficient testing methodologies.

Read the full article to learn how to implement these trends.

The True Cost of Testing Tools

I speak to so many companies who’ve been stung by unnecessary and unexpected test tool costs. Because of this, I wrote How to Avoid This Expensive Mistake When Choosing Test Tools.

This article highlights a common pitfall in software procurement—that many organisations focus solely on upfront costs, overlooking the total cost of ownership (TCO) and creating serious long-term budgetary and technical problems:

  • Free or low-cost tools often carry hidden implementation, maintenance, and resource allocation expenses.
  • Professional-grade tools, whilst seemingly more expensive initially, often provide better long-term value and lower TCO.
  • Consider factors like hosting costs, integration efforts, and resource requirements when evaluating testing tools.

This insight emphasises the importance of a holistic approach to tool selection, considering both immediate and long-term financial implications.

Read the full article to learn how to avoid making costly mistakes when choosing tools!

Industry Integrity: A Critical Look at Vendor Claims

“What’s happening to you Pinocchio is you told a lie. And when you lie, it’s-a plain like the nose on your face”.

In Tricentis Are Lying. Again, and BlazeMeter is Lying About LoadRunner, I looked at several false claims made by a couple of  test tool vendors.

These articles highlighted lies made by both parties, specifically misleading comparisons and omissions in their marketing materials and their portrayal of OpenText products.

Their hit pieces remind us of the importance of due diligence and critical evaluation of vendor claims in the software testing industry.

I don’t want to sully this article with their fibs, but if you want to know what they said check out Tricentis’ and BlazeMeter’s latest lies.

What You Can Expect in the Year Ahead!

At Calleo, we love to keep you informed about the latest developments, whether they involve learning from industry leaders like NASA, embracing automation and AI, or anything else related to testing.

In 2025, we have planned some great articles to inform, intrigue and challenge your thinking on software testing. If you have not yet signed up, you can follow us here:

Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

8th January 2025
How to Choose A Test Management Tool

How to Choose The Right Test Management Tool

Test management tools ensure efficient, effective, and auditable testing processes. When choosing an enterprise-level test management solution, it’s essential to use a proven and trusted solution.

why choose loadrunner

Performance Testing: 6 Reasons Companies Choose LoadRunner

Despite what some might think, LoadRunner is not a single performance testing tool but a family of world-class load performance testing solutions. The family has recently undergone a name change that you may not be familiar with. Today, I will explain why LoadRunner family products are relied on by the largest companies.

System 38

Carry On Testing: A Couple of Funny QA Mishaps

Ah, software testing—where meticulous planning meets unexpected chaos and where even the most rigorous quality assurance can sometimes go awkwardly awry. As we bid farewell to 2024, it’s time to take a step back and indulge in some light-hearted reflection on the quirky side of our profession.

Tomorrow’s World v. Today’s Reality: My WQR Thoughts

The World Quality Report (WQR) 2024-25 looks at the current state and future trends of Quality Engineering—albeit from a particular perspective. It is based on a survey of 1,775 executives across multiple sectors and regions. While it is a potentially interesting source of information, I’m always left asking the question: Is it useful?

LoadRunner Enterprise 243

LoadRunner Enterprise 24.3 – Release Highlights

Today we look at OpenText LoadRunner Enterprise 24.3, which introduced several enhancements to their enterprise-grade performance testing solution. We’ve been through the release notes so you don’t have to.

OpenText Customer? Read This to Avoid Overpaying for Support Costs

Following its acquisition of Micro Focus, OpenText has implemented a more stringent policy regarding support renewals and term/subscription renewals. This policy could increase your support costs. Today I’ll explain how to minimise costs when renewing your OpenText software support or subscriptions.

AI caution

WQR: This 1 AI Recommendation Could Derail Your QA Strategy

The World Quality Report 2024-25 (WQR) provides a few interesting insights into adopting AI in software testing. And, while many their recommendations are sound for most companies, one specific recommendation regarding AI implementation is a terrible idea for most businesses.

Insights

Search

Related Articles

To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.