All Products
Search
Document Center

Performance Testing:Select a stress testing engine

Last Updated:Nov 01, 2024

This topic describes how to select an appropriate performance testing engine.

Alibaba Cloud Performance Testing Service (PTS) supports the PTS engine developed in-house by Alibaba Cloud and the open source JMeter engine and provides the following benefits:

  • Alibaba Cloud PTS is a fully managed SaaS service that requires no operational maintenance and can generate up to millions of concurrent virtual users and tens of millions of transactions per second (TPS) traffic.

  • Alibaba Cloud PTS can generate custom traffic by geographic region, custom IPv6 traffic, and custom Alibaba Cloud virtual private cloud (VPC) traffic.

  • Alibaba Cloud PTS can integrate seamlessly with the monitoring and alerting toolkit Prometheus and the OpenTelemetry ecosystem. It can provide traffic coloring to differentiate between traffic types, diagnose slow or invalid calls, and perform bottleneck analysis.

  • Alibaba Cloud PTS can be integrated with cloud-based monitoring tools to continuously assess the availability of websites.

Engine comparison

Engine

Advantage

Description

PTS engine

  • Easy to use. Performance testing scenarios can be configured in the PTS console without the need for a graphical interface.

  • Refined control over throughput in requests per second (RPS) mode and support for RPS control at the API level.

  • Suitable for simple business scenarios

  • Single-API performance testing

  • Refined control of RPS per API operation

JMeter engine

  • Supports a wide range of open source plugins. Scripts can be uploaded to supplement required dependencies.

  • Flexible scalability. Java code or Beanshell scripts can be inserted to address complex business scenarios.

  • Requires experience with JMeter or an existing repository of JMeter scripts.

  • Suitable for testing complex business scenarios. Dynamic scripting for request parameters or response bodies is required.

  • Non-HTTP protocol performance testing. JMeter plugins must be used to implement multi-protocol performance testing.