PolarDB:Performance test

Test environment

Benchmark tool: OLTP-Bench

OLTP-Bench is an open source benchmarking tool to test the performance and scalability of OLTP databases. It provides multiple benchmarks such as TPC-C, TPC-E, and YCSB to test the database performance in different types of workloads. In this topic, TPC-C is used to test the performance of PolarDB clusters with PolarDB Always Encrypted enabled.

Metric

Transactions per second (TPS): indicates the number of transactions that are committed on a database per second.

Test procedure

PolarDB Always Encrypted encrypts data based on custom encryption rules. In the tests, different numbers of data columns are encrypted to test the database performance in different scenarios.

1. Configure the OLTP-Bench project in your Elastic Compute Service (ECS) instance. For more information about the configuration method, see the official page of OLTB-Bench.

2. Integrate EncJDBC with OLTP-Bench. For more information about how to integrate EncJDBC, see Integrate EncJDBC.

3. Create an OLTP-Bench configuration file that contains the following content:

   <?xml version="1.0"?>
   <parameters>
   
       <!-- Connection details -->
       <dbtype>mysql</dbtype>
       <driver>com.aliyun.encdb.mysql.jdbc.EncDriver</driver>
       <DBUrl>jdbc:mysql:encdb://xxxx.rwlb.rds.aliyuncs.com:3306/xxxx</DBUrl>
       <DBName>xxxx</DBName>
       <username>xxxx</username>
       <password>xxxxx</password>
       <isolation>TRANSACTION_SERIALIZABLE</isolation>
   
       <scalefactor>1</scalefactor>
   
       <!-- The workload -->
       <terminals>8</terminals>
       <works>
           <work>
               <time>180</time>
               <rate>unlimited</rate>
               <weights>45,43,4,4,4</weights>
           </work>
       </works>
   
   
       <!-- TPCC specific -->
           <transactiontypes>
           <transactiontype>
                   <name>NewOrder</name>
           </transactiontype>
           <transactiontype>
                   <name>Payment</name>
           </transactiontype>
           <transactiontype>
                   <name>OrderStatus</name>
           </transactiontype>
           <transactiontype>
                   <name>Delivery</name>
           </transactiontype>
           <transactiontype>
                   <name>StockLevel</name>
           </transactiontype>
           </transactiontypes>
   </parameters>
   

4. After the OLTP-Bench project is compiled, run the following command to import the data to the database.

   ./oltpbenchmark -b tpcc -c tpcc_encmysql.xml --load=true --create=true -s 1 -o tpcc

5. Adjust configurations like the encrypted columns and TPC-C parameters to comprehensively test the performance of PolarDB Always Encrypted in OLTP scenarios (measured in TPS).

   ./oltpbenchmark -b tpcc -c tpcc_encmysql.xml --execute=true -s 1 -o tpcc

Test conditions and results