Products

Problems
we solve

We can help your business

Request a Free Demo / trial

Insights

Insights | Performance Testing
3 June, 2025

LoadRunner: Cheaper & Easier Than JMeter?

LoadRunner v JMeter

Four years ago, I wrote about how LoadRunner Cloud was debunking the myth that open-source is cheaper. At the time, LoadRunner Cloud’s pay-as-you-go pricing, bundled infrastructure, and rapid setup were already making it a compelling alternative to JMeter and similar tools.

Fast forward to 2025, and the core truth remains: people are the real cost, not tools.

One of the best things about LoadRunner Cloud is that you don’t have to be an expert in the tool.  This lowers the barrier to entry, allowing more people to execute performance tests.

In this follow-up, I’ll explore what’s changed in the last four years, what hasn’t, and why LoadRunner is still the best choice for organisations that value time, efficiency, and results.

LoadRunner Cloud is Cheaper Than You Think

Let’s address the biggest misconception up front: LoadRunner Cloud is far more affordable than most people realise, especially when you factor in the ability to run your existing JMeter or Gatling scripts.

Many are surprised to discover just how cost-effective it can be compared with the hidden costs of open-source solutions.

LoadRunner Cloud offers subscription options, as well as pay-as-you-go options. With pay-as-you-go, there’s no need for upfront investment or ongoing maintenance: the pricing is based on Virtual User Hours (VUHs), so when you’re not testing, you’re not paying.

Everything you need is included in the cost: controller, detailed reporting, and fully managed, cloud-based infrastructure. You simply select the number of load generators and the regions you want, and you’re ready to go.

An Example Of LoadRunner Cloud’s Cost-Effective Pricing

To put this into perspective, running four one-hour tests with JMeter or Gatling Scripts (with LoadRunner Cloud) and 500 Vusers costs just £250. Increase the duration to four hours, and it’s still only £1,000. Even scaling up to 1,000 users for two one-hour tests only comes to £250.

Here are the examples broken down into purely numerical values:

  • 500 Vusers x 4 tests x 1 hour = £250
  • 500 Vusers x 4 tests x 4 hour = £1000
  • 1000 Vusers x 2 tests x 1 hour = £250

You just provide the JMeter or Gatling scripts, define your scenario, and select the load generators you want to use. There’s no additional setup, fees, or configuration needed.

How much time, effort, and hassle would that cost with an open-source tool?

Like I say, most people are shocked when they realise how little it costs. Additionally, if you plan to conduct more testing or for higher volumes, the price per VUH decreases rapidly, making high-volume or frequent testing even more cost-effective.

The Evolving Landscape: More Tools, More Complexity

Over the past four years, the testing ecosystem has exploded. Open-source tools like JMeter, Gatling, and k6 have undoubtedly matured. Cloud-based testing is increasingly prominent. DevOps and CI/CD pipelines demand faster, more integrated testing cycles.

With technological progress comes developmental complexity.

Teams are managing more environments, more protocols, and ever-tighter deadlines. The need for tools that reduce, not add to, your workload has never been greater.

During that period, LoadRunner Cloud was acquired and renamed: OpenText Core Performance Engineering. For simplicity and easier comparison with 2021, I am using the familiar old LoadRunner name in this article.

Open Source: Still Not as Free as It Looks

The original article highlighted the hidden costs of open-source testing: infrastructure, setup time, maintenance, and reporting. In 2025, these costs have only grown.

Open-source tools now require even more scripting expertise, cloud orchestration skills, and manual effort to keep up with evolving application architectures.

Key challenges with open-source tools

  • Infrastructure Overhead: You still need to provision, secure, and maintain your own cloud or on-premises load generators.
  • Setup and Maintenance: Integrating open-source tools into modern CI/CD pipelines is possible, but rarely seamless.
  • Scripting and script maintenance: often complex and requiring coding skills. LoadRunner offers no-code or low-code options, whilst also having a coded option for the experienced performance tester.
  • Reporting: While some progress has been made, deep-dive analytics and real-time dashboards still lag behind LoadRunner.
  • People Costs: Skilled engineers are in short supply and are expensive. With LoadRunner, you can achieve more with fewer people, which translates into savings on people

LoadRunner: Evolving to Meet Modern Demands

The LoadRunner suite has not stood still, with all variants seeing significant enhancements:

  • Seamless Cloud Integration: LoadRunner Cloud now offers even more flexible, on-demand infrastructure, with expanded global coverage and instant scalability.
  • Protocol Breadth: LoadRunner continues to support the broadest range of protocols, from legacy systems to the latest web and mobile technologies.
  • DevOps Ready: Native integrations with CI/CD tools, version control, and automated pipelines make LoadRunner a first-class citizen in modern development workflows.

People often underestimate the significant investment and development that occur with the OpenText toolset. To get an idea of the changes to LoadRunner Cloud over the last few years, check out LoadRunner Cloud section of OpenText’s excellent ADM Help Centre.

Script Reuse: Maximising Your Existing Open-Source Investments

A standout feature across the LoadRunner suite is its ability to natively run JMeter and Gatling scripts, right alongside traditional LoadRunner protocols. For many organisations, this is a game-changer.

Over the years, teams have invested significant time and expertise in developing open-source scripts, often building a valuable library of test assets tailored to their unique applications and business needs.

With LoadRunner, there’s no need to leave those investments behind.

Your existing open-source scripts can be executed as part of broader LoadRunner performance testing scenarios. This integration enables teams to continue leveraging their previous scripting investment, alongside LoadRunner’s advanced analytics, unified reporting, and robust infrastructure.

Importantly, LoadRunner Cloud offers this capability at even lower rates than standard web testing.

The result is a seamless transition for organisations looking to move to LoadRunner or adopt a hybrid approach—continue to use your investment in open-source scripts until you are ready to replace or retire them. Combine open-source scripts with the power and support of the leading enterprise tool.

The Bottom Line: People Are Still the Real Cost

The most significant shift in the last four years? The value and cost of people’s time have only increased. Skilled performance engineers are in high demand, and every hour spent wrestling with infrastructure, writing and maintaining scripts, or manually analysing test results is an hour not spent delivering value.

In 2025, performance testing is more critical—and more complex—than ever.

The real-world costs of setting up, maintaining, and relying on open-source tools, as well as the need for expensive, skilled performance engineers, make them less free than they seem.

LoadRunner Cloud continues to lead the way:

  • Best-in-class functionality and protocol support
  • Rapid setup and minimal maintenance
  • Powerful analytics and reporting
  • Flexible, subscription and pay-as-you-go pricing that scales with your needs
  • Enterprise-grade support

If your goal is to deliver reliable, high-performing applications while minimising effort, time, and total cost, LoadRunner remains the smartest investment you can make.

Ready to see how much you could save?

Contact Calleo today for a demo and discover why LoadRunner is the performance test tool others are chasing.

Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

3rd June 2025
Calleo Sell Test Tools

Calleo: We Sell Test Tools

With Calleo, you get expert guidance to find the right options, demos and trial licenses to evaluate them, and practical help to get up and running. You’ll see the pros, cons and long-term costs clearly before making any decisions, and stay supported with renewals and updates long after you’ve started using the tool.

cut test maintenance

4 Ways to Cut Test Maintenance Effort with AI

Automation maintenance is a pain. It’s a frustrating time drain that nobody enjoys. Unfortunately, teams are doing more of it than ever, with modern solutions changing like the wind and each new release jeopardising script integrity. Thankfully, AI-driven automation is here to help.

2025 top testing articles

2025 Roundup: Check Out The Top 5 Testing Times Articles

Thanks to your support, 2025 was another excellent year for Testing Times and our 10,000+ subscribers. We explored a wide range of software testing topics, including test automation, performance testing, Jira fatigue, tester authority, and more. Below is a quick look at the five newsletters with the most reactions this year, and why they resonated so strongly.

Is WFH worth the risk

Remote Testing: Is Working From Home Worth The Risk?

Increasingly, organisations expect remote and hybrid testers to use borrowed tool licences, unstable VPNs, and software never designed to leave the office. That creates significant compliance and security risks that can turn into serious long‑term problems. It’s not the testers per se, but remote execution over on‑prem licences is a software audit waiting to happen. Read on to learn why a compliance nightmare isn’t the only reason your test setup might not be fit for distributed and home‑working team members.

Effortless automation

Solved: 4 Common Test Automation Headaches

Software teams know the story all too well: automation promises speed and reliability, but reality often brings fragile scripts, phantom failures, and endless rework. In the end, the technology intended to accelerate releases ends up bogging things down. Or at least, that’s how things used to be… Today’s AI-powered functional

Test the Untestable

Test the Untestable: Unlock Savings & Accelerate Your Project

Testers have long been asked to test earlier, faster, and more often. In truth, however, when critical APIs, integrations, or microservices aren’t ready, testing gets stuck. We’ve all been there, raring to go, like greyhounds in the slips…  but with nothing to test, and increasingly concerned about the impending last-minute panic.

The Test Tools You Need

Testers: Will We Finally Get The Tools We Need?

During the 2008 credit crunch, companies slashed technical investment. The mantra “do more with less” stuck—and 17 years later, testers are still paying the price as demands, complexity, and expectations have soared. It’s no coincidence that we’re witnessing an increasing number of high-profile software failures and cyber attacks. Yet, there’s still little willingness to invest in the right test tools and training.

Test Automation Fails Smaller Teams

Why Test Automation Fails for Smaller Teams

Many small software teams turn to test automation, expecting substantial time and cost savings. However, they often fail to achieve any of these goals; instead of seeing a return on investment, they end up spending more effort and cost fixing their automation packs. This failure can leave lasting scars, deterring people from embracing automation and realising its many benefits…

breaking up with legacy tools

When to Move on From Legacy Test Tools

I often speak to people who want to abandon legacy test tools and transition to shiny new solutions. They cite several reasons for the switch, many of which are valid, while others need greater consideration to avoid a negative or costly outcome. On the other hand, I also speak to people who are reluctant to ever change tools, even though they’d see incredible benefits.

Shift Left

Shift Left Testing: 4 Myths and Why They Matter

Shift-left testing has become one of the most talked-about software development ideas. It sounds deceptively simple: test earlier in the process to avoid late surprises. But while the phrase is repeated at countless conferences and stand-ups, it is often misunderstood, misapplied, or reduced to a box-ticking activity (like many other testing initiatives).

Insights

Search

Related Articles

To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.