Products

Problems
we solve

We can help your business

Request a Free Demo / trial

Insights

Insights | Performance Testing
29 October, 2024

BlazeMeter is Lying About LoadRunner

BlazeMeter Are Lying About LoadRunner

Accurate tool comparisons are crucial for organisations to make rapid, informed decisions. However, inaccurate tool comparisons are misleading, threaten to undermine the whole process, and may lead businesses to make expensive mistakes.

So naturally, I was disappointed to see the grossly misleading LoadRunner vs. BlazeMeter page on the BlazeMeter website—a somewhat shoddy attempt at misdirection and false equivalency.

Note that the page refers to LoadRunner as a specific product—which it isn’t. LoadRunner is a family of four products that do different but overlapping things.

While BlazeMeter doesn’t explicitly name LoadRunner Professional, the implications are clear. They are deliberately comparing their solution against the wrong version of LoadRunner.

By pitting its cloud-based solution against OpenText’s on-premises offering, BlazeMeter deliberately obscures its actual competition: LoadRunner Cloud.

It’s obvious to see why…

BlazeMeter and The Art of Misdirection

BlazeMeter knows very well that there are multiple versions of LoadRunner, each with unique features.

They also understand that people looking for performance testing might not know this and are trying to prey on their ignorance.

Omitting the version name is pure sleight of hand—BlazeMeter is dodging the proper comparison with the relevant OpenText tool, LoadRunner Cloud, which (as we’ll see later) yields very different results.

BlazeMeter is Comparing Apples to Oranges

By comparing their cloud-based solution to LoadRunner Professional, BlazeMeter is creating a false equivalency.

LoadRunner Professional is a class-leading on-premises solution and the appropriate tool for thousands of globally leading institutions. It is much better than BlazeMeter in terms of protocol support, complex testing scenarios, reporting capabilities, scripting flexibility, and reliability… but it isn’t a cloud-based performance tool.

I repeat: the appropriate comparison for BlazeMeter must be with LoadRunner Cloud, which offers:

  • SaaS availability for immediate testing
  • Cloud-based load generators
  • Scalability to over 5 million virtual users
  • 42+ geo-locations for testing

These features align closely with BlazeMeter’s offerings, allowing a valid comparison.

Fact-Checking BlazeMeter’s Traffic Lights

BlazeMeter’s comparison page employs this deceptive traffic light slider system:

Blazemeter vs LoadRunner

This isn’t just visual trickery; it’s factually inaccurate, and these claims are easy to rebut:

  • LoadRunner Cloud can be fully integrated into CI/CD Pipelines.
  • You can start testing with LoadRunner Cloud in minutes.
  • All LoadRunner products provide native support for open-source scripts (JMeter, Gatling, Selenium, etc).
  • LoadRunner Cloud can be driven from a UI or an IDE (using the free LoadRunner Developer tool)
  • LoadRunner Cloud scales to 5 million concurrent virtual users
  • LoadRunner Cloud includes free IP whitelisting to allow testing behind a firewall

I can back up all of these bullets with product documentation and my personal experience and deep understanding of the LoadRunner Family of products.

It’s Easy to See Why BlazeMeter Were Hiding The Truth

When we look at more balanced comparisons, LoadRunner Cloud consistently outperforms BlazeMeter in all key areas:

  • Analysis and Reporting: LoadRunner Cloud provides sophisticated and comprehensive reports, while BlazeMeter’s offerings are basic and require additional effort.
  • Performance Testing Capability: LoadRunner Cloud demonstrates superior scalability and can run more extender tests in parallel.
  • Additional Features: LoadRunner Cloud offers more robust service virtualisation and integrations.

But you know what, I’m not angry at BlazeMeter’s lies or their poorly executed legerdemain; I’m just disappointed.

The Importance of Integrity in Comparisons

BlazeMeter’s approach does a disservice to the performance-testing community.

By deliberately comparing their product to a less equivalent alternative, they’re misleading potential customers and undermining their integrity.

Organisations deserve transparent, apples-to-apples comparisons, allowing them to make informed decisions based on their needs.

While BlazeMeter’s sales tactics may be effective for their short-term revenue, they ultimately erode trust in their organisation.

Related Products

LoadRunner Cloud
Stephen Davis
by Stephen Davis

Stephen Davis is the founder of Calleo Software, a OpenText (formerly Micro Focus) Gold Partner. His passion is to help test professionals improve the efficiency and effectiveness of software testing.

To view Stephen's LinkedIn profile and connect 

Stephen Davis LinkedIn profile

29th October 2024
should developers test

Should We Expect Developers to Test?

In my latest Testing Times newsletter, I discussed Microsoft and their poor software quality. This led to a couple of conversations on LinkedIn comments concerning Microsoft’s approach to testing… and whether developers should ‘test their own homework’ as the saying goes. Click the newsletter link to read the comments in full.

Microsoft issues

When Will Microsoft Step Up? A Customer’s Plea for Improvement

Microsoft (MS) has dominated the software landscape for decades, boasting vast resources and some of the brightest engineering minds. Yet, despite this wealth of talent, many users struggle with persistent issues that raise questions about the company’s commitment to quality and customer satisfaction.

the impact of cognitive biases on software testing

Software Testers: How Your Brain Plays Tricks on You

What if I told you that, despite your best efforts, your brain could be sabotaging your testing approach? And that while you’ve spent your entire software testing career trying to find the biggest, juiciest bugs, your subconscious has had other goals altogether?

How to think like a top tester

How to Think Like a Top Tester: The 3 Essential Skills That Nobody Teaches

To become a top tester, you need three critical skills often overlooked in traditional training. These skills are simple to understand and easy to adopt, but they have made a huge difference in my career and will help take yours to the next level. They also have nothing to do with software testing.

4 Lessons We Can Learn

How NASA Does Software Testing: 4 Lessons We Can Learn

As a software tester, I’ve always wondered how organisations like NASA test their critical systems. After all, their systems are unique and complex, and the stakes are almost incomprehensibly high—a single software bug can result in catastrophic failure and loss of life.

Help needed to hit 10000 subscribers

Please Help Us Hit 10,000 Subscribers

Hello, fellow software testing enthusiasts! I’m excited to share something I’m passionate about and have been working on diligently for the last two years—Testing Times, a LinkedIn newsletter dedicated to exploring the latest trends, insights, and innovations in software testing.

Insights

Search

Related Products

LoadRunner Cloud

Related Articles

To get other software testing insights, like this, direct to you inbox join the Calleo mailing list.

You can, of course, unsubscribe 

at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.

Sign up to receive the latest, Software Testing Insights, news and to join the Calleo mailing list.

You can, of course, unsubscribe at any time!

By signing up you consent to receiving regular emails from Calleo with updates, tips and ideas on software testing along with the occasional promotion for software testing products. You can, of course, unsubscribe at any time. Click here for the privacy policy.