Hologres:Test results

The following tables describe the number of rows in each table and instance specifications used for TPC-H performance tests.

• Number of rows in each table

  Table name	Number of rows
  LINEITEM	600,037,902
  ORDERS	150,000,000
  PARTSUPP	80,000,000
  PART	15,000,000
  CUSTOMER	20,000,000
  SUPPLIER	1,000,000
  NATION	25
  REGION	5

• Instance specifications

  Computing resource	Zone	Remarks
  64 CUs (64 CPU cores and 256 GB of memory)	Hangzhou Zone J	Use the default configurations of the instance. The number of shards is 40.
  128 CUs (128 CPU cores and 512 GB of memory)	Hangzhou Zone J	Use the default configurations of the instance. The number of shards is 80.

Test results

• Import time in different scenarios

  The import time indicates the amount of time required to import data to Hologres. The time is measured in seconds. The following table describes the import time in different scenarios that provide 64 CUs of computing resources.

  Note

  If you execute the COPY statement to import data, data is imported from one file to one table in Hologres at a time. Concurrent import is unavailable.

  Table name	Number of rows	Data amount	Time required to import data over the Internet by using the COPY statement	Time required to import data in a VPC by using the COPY statement	Time required to import data by using a MaxCompute foreign table
  LINEITEM	600,037,902	73.6 GB	3,070.453	694.364	148.165
  ORDERS	150,000,000	16.4 GB	691.060	172.529	37.741
  PARTSUPP	80,000,000	2.3 GB	468.560	107.092	18.488
  PART	20,000,000	11.3 GB	96.342	24.020	8.083
  CUSTOMER	15,000,000	2.3 GB	95.190	22.937	10.363
  SUPPLIER	1,000,000	132 MB	5.057	1.803	1.503
  NATION	25	2 KB	0.580	0.584	0.747
  REGION	5	0.375 KB	0.168	0.153	0.430
  ORDERS_ROW	150,000,000	16.4 GB	717,653	143.800	25.676
  Total		122.4 GB	722,080.410	1,167.282	251.196

  In the following bar chart, a blue bar indicates the time required to import data over the Internet by using the COPY statement. A green bar indicates the time required to import data in a virtual private cloud (VPC) by using the COPY statement. A gray bar indicates the time required to import data by using a MaxCompute foreign table. A smaller y-axis value indicates a faster import speed.

  Note

  The x-axis represents the table name, and the y-axis represents the import time measured in seconds.

  The following conclusions can be drawn based on the bar chart:

  • If you execute the COPY statement to import data, the import time is affected by the bandwidth. The time required to import data in a VPC is shorter than the time required to import data over the Internet.

  • The time required to import data by using a MaxCompute foreign table is shorter than the time required to import data by executing the COPY statement.

  

• Online analytical processing (OLAP) queries

  The time required to query data from Hologres internal tables is measured in seconds. The following table describes the execution duration of each query in Hologres.

  TPC-H Query ID	TPC-H 100 GB		TPC-H 500 GB
  	64 CU (V2.2.19)	128 CU (V2.2.19)	64 CU (V2.2.19)	128 CU (V2.2.19)
  1	0.55	0.34	5.61	1.39
  2	0.17	0.15	0.30	0.23
  3	0.38	0.29	3.70	1.17
  4	0.32	0.19	1.44	0.68
  5	0.68	0.48	4.92	1.68
  6	0.10	0.08	0.26	0.15
  7	0.55	0.36	2.32	1.25
  8	0.51	0.38	2.82	0.95
  9	1.62	1.00	11.16	4.67
  10	0.69	0.47	3.59	1.91
  11	0.37	0.32	1.27	1.08
  12	0.22	0.15	0.70	0.38
  13	0.67	0.37	3.35	1.71
  14	0.19	0.13	0.72	0.39
  15	0.36	0.23	1.59	0.81
  16	0.41	0.33	1.47	0.79
  17	0.22	0.16	3.54	0.48
  18	2.02	0.94	10.42	5.35
  19	0.25	0.17	1.38	0.57
  20	0.24	0.27	0.73	0.56
  21	1.03	0.63	6.24	2.36
  22	0.28	0.22	1.09	0.77
  Total	11.81	7.64	68.61	29.34

  In the following bar chart, a blue bar indicates the time required to query data in a Hologres instance with 64 CUs. A green bar indicates the time required to query data in a Hologres instance with 128 CUs. All queries are performed in Hologres V2.0.2. A smaller y-axis value indicates a better performance of the instance in the TPC-H performance test. Higher specifications of the instance bring about a shorter execution duration for each query.

  Note

  The x-axis represents the ID of the query in the table, and the y-axis represents the execution duration measured in seconds.

  

• Point queries of key-value pairs

  The test results are based on queries in Hologres internal tables. The version of Hologres is V1.1.42. Each type of query runs continuously for 5 minutes. The following table describes the specific values in the test results.

  Scenario	Sample SQL statement	Instance specifications	Number of concurrent client connections	QPS (including the connection duration)	QPS (excluding the connection duration)	Average query latency
  1	SELECT O_ORDERKEY ,O_CUSTKEY ,O_ORDERSTATUS ,O_TOTALPRICE ,O_ORDERDATE ,O_ORDERPRIORITY ,O_CLERK ,O_SHIPPRIORITY ,O_COMMENT FROM public.orders_row WHERE o_orderkey = {parameter} ;	64 CUs	500	112,435	112,443	4.447 ms
  		128 CUs	1,000	242,755	242,772	4.119 ms
  2	SELECT O_ORDERKEY ,O_CUSTKEY ,O_ORDERSTATUS ,O_TOTALPRICE ,O_ORDERDATE ,O_ORDERPRIORITY ,O_CLERK ,O_SHIPPRIORITY ,O_COMMENT FROM public.orders_row WHERE o_orderkey in ( {parameter1}, {parameter2}, {parameter3}, {parameter4}, {parameter5}, {parameter6}, {parameter7}, {parameter8}, {parameter9} );	64 CUs	500	27,632	27,634	18.094 ms
  		128 CUs	1,000	90,086	90,092	11.100 ms

  The test results show that the QPS linearly increases with the instance specifications.

• Data updates

  The test results are based on data updates in Hologres internal tables. The version of Hologres is V1.1.42. Each type of query runs continuously for 5 minutes. The following table describes the specific values in the test results.

  Sample SQL statement	Instance specifications	Number of concurrent client connections	QPS (including the connection duration)	QPS (excluding the connection duration)	Average query latency
  INSERT INTO public.orders_row( o_orderkey ,o_custkey ,o_orderstatus ,o_totalprice ,o_orderdate ,o_orderpriority ,o_clerk ,o_shippriority ,o_comment ) VALUES ( {parameter} ,1 ,'demo' ,1.1 ,'2021-01-01' ,'demo' ,'demo' ,1 ,'demo') on conflict(o_orderkey) do update set ( o_orderkey ,o_custkey ,o_orderstatus ,o_totalprice ,o_orderdate ,o_orderpriority ,o_clerk ,o_shippriority ,o_comment )= ROW(excluded.*);	64 CUs	500	92,006	92,000	5.435 ms
  	128 CUs	1,000	191,761	191,771	5.215 ms

  The test results show that the QPS linearly increases with the instance specifications.

The following tables describe the number of rows in each table and instance specifications used for TPC-H performance tests.

• Number of rows in each table

  Table name	Number of rows	Data amount
  LINEITEM	5,999,989,709	752.27 GB
  ORDERS	1,500,000,000	167.11 GB
  PARTSUPP	800,000,000	114.45 GB
  PART	150,000,000	22.94 GB
  CUSTOMER	200,000,000	22.85 GB
  SUPPLIER	10,000,000	1.33 GB
  NATION	25	2.15 KB
  REGION	5	0.38 KB

• Instance specifications

  Computing resource	Storage capacity	Remarks
  96 CUs (96 CPU cores and 384 GB of memory)	1,000 GB	Use the default configurations of the instance. The number of shards is 60.

Test results: execution duration of each query in Hologres

The amount of time required to query data in Hologres internal tables is measured in seconds. The following table describes the execution duration of each query in Hologres.

Instance specifications

• Hologres instance

  Computing resource	Version	Remarks
  64 CUs (64 CPU cores and 256 GB of memory)	V1.1.53	Use the default configurations of the instance. The number of shards is 40.

• Fully managed Flink

  Engine version	vvr-4.0.12-flink-1.13
  Configuration mode	Basic mode
  Parallelism	15
  CPU used by Job Manager	1
  Memory used by Job Manager	1 Gi
  CPU used by Task Manager	1
  Memory used by Task Manager	6 Gi

Test results