All Products
Search
Document Center

Elasticsearch:Performance test of an Elasticsearch cluster with 8-vCPU 32-GiB data nodes

Last Updated:Dec 01, 2023

This topic describes the performance benchmark test performed on an Alibaba Cloud Elasticsearch V8.9.1 cluster that contains data nodes with 8 vCPUs and 32 GiB of memory. The test is performed by using the Rally tool provided by open source Elasticsearch.

Configurations

Item

Description

Cluster configurations

  • Version: 8.9.1

  • CPU type: Intel

  • Data node specifications: 8 vCPUs and 32 GiB of memory

  • Storage type of data nodes: Enhanced SSD (ESSD)

  • Storage performance level of data nodes: PL1

  • Storage space per data node: 200 GiB

  • Number of data nodes: 3

Rally configurations

Default Rally tracks

Dataset

Built-in dataset http_logs of Rally, with 258,610,096 documents

You can obtain the dataset from Elasticsearch Rally Hub.

Number of shards

  • Primary shards: 6

  • Replica shards: 0

bulk_size

2,000 documents submitted each time

bulk_indexing_clients

10 clients used in parallel

Test results

The test results are for reference only. We recommend that you perform stress testing by using your business production data.

Main metrics

Indexing rate

image.png

Indexing latency

image.png

Average CPU utilization of nodes

image.png

Load of each node within 1 minute

image.png

Number of write requests completed per second

image.png

Amount of data that is written per second

image.png

Test report

For more information about the metrics in the following table, see Overview.

Metric

Task

Value

Unit

Cumulative indexing time of primary shards

-

122.536

min

Min cumulative indexing time across primary shards

-

0

min

Median cumulative indexing time across primary shards

-

0.822067

min

Max cumulative indexing time across primary shards

-

15.4798

min

Cumulative indexing throttle time of primary shards

-

0

min

Min cumulative indexing throttle time across primary shards

-

0

min

Median cumulative indexing throttle time across primary shards

-

0

min

Max cumulative indexing throttle time across primary shards

-

0

min

Cumulative merge time of primary shards

-

40.7554

min

Cumulative merge count of primary shards

-

489

-

Min cumulative merge time across primary shards

-

0

min

Median cumulative merge time across primary shards

-

0.090675

min

Max cumulative merge time across primary shards

-

6.85737

min

Cumulative merge throttle time of primary shards

-

9.87777

min

Min cumulative merge throttle time across primary shards

-

0

min

Median cumulative merge throttle time across primary shards

-

0

min

Max cumulative merge throttle time across primary shards

-

2.54748

min

Cumulative refresh time of primary shards

-

7.774

min

Cumulative refresh count of primary shards

-

4821

-

Min cumulative refresh time across primary shards

-

0

min

Median cumulative refresh time across primary shards

-

0.058908

min

Max cumulative refresh time across primary shards

-

0.930517

min

Cumulative flush time of primary shards

-

2.17023

min

Cumulative flush count of primary shards

-

597

-

Min cumulative flush time across primary shards

-

3.33E-05

min

Median cumulative flush time across primary shards

-

0.001292

min

Max cumulative flush time across primary shards

-

0.3642

min

Total Young Gen GC time

-

7.526

s

Total Young Gen GC count

-

429

-

Total Old Gen GC time

-

0

s

Total Old Gen GC count

-

0

-

Store size

-

18.7482

GB

Translog size

-

0.000525

GB

Heap used for segments

-

0

MB

Heap used for doc values

-

0

MB

Heap used for terms

-

0

MB

Heap used for norms

-

0

MB

Heap used for points

-

0

MB

Heap used for stored fields

-

0

MB

Segment count

-

53

-

Total Ingest Pipeline count

-

0

-

Total Ingest Pipeline time

-

0

s

Total Ingest Pipeline failed

-

0

-

Min Throughput

index-append

362508

docs/s

Mean Throughput

index-append

375676

docs/s

Median Throughput

index-append

370496

docs/s

Max Throughput

index-append

407613

docs/s

50th percentile latency

index-append

41.1651

ms

90th percentile latency

index-append

58.5305

ms

99th percentile latency

index-append

478.733

ms

99.9th percentile latency

index-append

1385.4

ms

99.99th percentile latency

index-append

1925.1

ms

100th percentile latency

index-append

2452.26

ms

50th percentile service time

index-append

41.1651

ms

90th percentile service time

index-append

58.5305

ms

99th percentile service time

index-append

478.733

ms

99.9th percentile service time

index-append

1385.4

ms

99.99th percentile service time

index-append

1925.1

ms

100th percentile service time

index-append

2452.26

ms

error rate

index-append

0

%

Min Throughput

default

20.01

ops/s

Mean Throughput

default

20.01

ops/s

Median Throughput

default

20.01

ops/s

Max Throughput

default

20.01

ops/s

50th percentile latency

default

6.33046

ms

90th percentile latency

default

6.83727

ms

99th percentile latency

default

7.56115

ms

100th percentile latency

default

8.45465

ms

50th percentile service time

default

5.15553

ms

90th percentile service time

default

5.49738

ms

99th percentile service time

default

6.40464

ms

100th percentile service time

default

7.38945

ms

error rate

default

0

%

Min Throughput

term

44.85

ops/s

Mean Throughput

term

45.05

ops/s

Median Throughput

term

45.05

ops/s

Max Throughput

term

45.25

ops/s

50th percentile latency

term

7.9993

ms

90th percentile latency

term

8.68191

ms

99th percentile latency

term

11.0025

ms

100th percentile latency

term

13.8358

ms

50th percentile service time

term

6.24537

ms

90th percentile service time

term

7.39182

ms

99th percentile service time

term

10.0738

ms

100th percentile service time

term

13.033

ms

error rate

term

0

%

Min Throughput

terms_enum

49.98

ops/s

Mean Throughput

terms_enum

49.98

ops/s

Median Throughput

terms_enum

49.98

ops/s

Max Throughput

terms_enum

49.98

ops/s

50th percentile latency

terms_enum

6.80751

ms

90th percentile latency

terms_enum

7.78289

ms

99th percentile latency

terms_enum

9.39097

ms

100th percentile latency

terms_enum

13.406

ms

50th percentile service time

terms_enum

5.34045

ms

90th percentile service time

terms_enum

6.03417

ms

99th percentile service time

terms_enum

8.65276

ms

100th percentile service time

terms_enum

12.6348

ms

error rate

terms_enum

0

%

Min Throughput

range

25.01

ops/s

Mean Throughput

range

25.01

ops/s

Median Throughput

range

25.01

ops/s

Max Throughput

range

25.01

ops/s

50th percentile latency

range

8.05112

ms

90th percentile latency

range

8.97042

ms

99th percentile latency

range

10.3617

ms

100th percentile latency

range

14.5887

ms

50th percentile service time

range

7.02528

ms

90th percentile service time

range

7.62575

ms

99th percentile service time

range

9.43728

ms

100th percentile service time

range

13.7973

ms

error rate

range

0

%

Min Throughput

200s-in-range

25.01

ops/s

Mean Throughput

200s-in-range

25.02

ops/s

Median Throughput

200s-in-range

25.02

ops/s

Max Throughput

200s-in-range

25.02

ops/s

50th percentile latency

200s-in-range

7.24157

ms

90th percentile latency

200s-in-range

7.69111

ms

99th percentile latency

200s-in-range

8.2046

ms

100th percentile latency

200s-in-range

8.59885

ms

50th percentile service time

200s-in-range

6.09976

ms

90th percentile service time

200s-in-range

6.43257

ms

99th percentile service time

200s-in-range

7.27131

ms

100th percentile service time

200s-in-range

7.34293

ms

error rate

200s-in-range

0

%

Min Throughput

400s-in-range

49.94

ops/s

Mean Throughput

400s-in-range

49.94

ops/s

Median Throughput

400s-in-range

49.94

ops/s

Max Throughput

400s-in-range

49.95

ops/s

50th percentile latency

400s-in-range

5.86702

ms

90th percentile latency

400s-in-range

6.35979

ms

99th percentile latency

400s-in-range

8.80129

ms

100th percentile latency

400s-in-range

9.06539

ms

50th percentile service time

400s-in-range

4.69607

ms

90th percentile service time

400s-in-range

5.39334

ms

99th percentile service time

400s-in-range

7.95633

ms

100th percentile service time

400s-in-range

8.3838

ms

error rate

400s-in-range

0

%

Min Throughput

hourly_agg

0.2

ops/s

Mean Throughput

hourly_agg

0.2

ops/s

Median Throughput

hourly_agg

0.2

ops/s

Max Throughput

hourly_agg

0.2

ops/s

50th percentile latency

hourly_agg

1853.62

ms

90th percentile latency

hourly_agg

1940.21

ms

99th percentile latency

hourly_agg

1975.29

ms

100th percentile latency

hourly_agg

1994.04

ms

50th percentile service time

hourly_agg

1852.23

ms

90th percentile service time

hourly_agg

1938.97

ms

99th percentile service time

hourly_agg

1972.66

ms

100th percentile service time

hourly_agg

1991.26

ms

error rate

hourly_agg

0

%

Min Throughput

scroll

25.04

pages/s

Mean Throughput

scroll

25.07

pages/s

Median Throughput

scroll

25.06

pages/s

Max Throughput

scroll

25.12

pages/s

50th percentile latency

scroll

275.533

ms

90th percentile latency

scroll

288.14

ms

99th percentile latency

scroll

300.067

ms

100th percentile latency

scroll

303.366

ms

50th percentile service time

scroll

273.268

ms

90th percentile service time

scroll

285.79

ms

99th percentile service time

scroll

297.811

ms

100th percentile service time

scroll

301.071

ms

error rate

scroll

0

%

Min Throughput

desc_sort_timestamp

2.01

ops/s

Mean Throughput

desc_sort_timestamp

2.01

ops/s

Median Throughput

desc_sort_timestamp

2.01

ops/s

Max Throughput

desc_sort_timestamp

2.01

ops/s

50th percentile latency

desc_sort_timestamp

13.4211

ms

90th percentile latency

desc_sort_timestamp

15.366

ms

99th percentile latency

desc_sort_timestamp

27.0805

ms

100th percentile latency

desc_sort_timestamp

40.4204

ms

50th percentile service time

desc_sort_timestamp

11.7868

ms

90th percentile service time

desc_sort_timestamp

13.7557

ms

99th percentile service time

desc_sort_timestamp

26.2268

ms

100th percentile service time

desc_sort_timestamp

39.6381

ms

error rate

desc_sort_timestamp

0

%

Min Throughput

asc_sort_timestamp

19.89

ops/s

Mean Throughput

asc_sort_timestamp

19.9

ops/s

Median Throughput

asc_sort_timestamp

19.9

ops/s

Max Throughput

asc_sort_timestamp

19.92

ops/s

50th percentile latency

asc_sort_timestamp

8.48584

ms

90th percentile latency

asc_sort_timestamp

9.96201

ms

99th percentile latency

asc_sort_timestamp

16.3567

ms

100th percentile latency

asc_sort_timestamp

17.2047

ms

50th percentile service time

asc_sort_timestamp

7.43409

ms

90th percentile service time

asc_sort_timestamp

8.33082

ms

99th percentile service time

asc_sort_timestamp

15.4551

ms

100th percentile service time

asc_sort_timestamp

15.7335

ms

error rate

asc_sort_timestamp

0

%

Min Throughput

desc_sort_with_after_timestamp

1.01

ops/s

Mean Throughput

desc_sort_with_after_timestamp

1.02

ops/s

Median Throughput

desc_sort_with_after_timestamp

1.01

ops/s

Max Throughput

desc_sort_with_after_timestamp

1.09

ops/s

50th percentile latency

desc_sort_with_after_timestamp

79.2798

ms

90th percentile latency

desc_sort_with_after_timestamp

80.8779

ms

99th percentile latency

desc_sort_with_after_timestamp

83.307

ms

100th percentile latency

desc_sort_with_after_timestamp

83.5177

ms

50th percentile service time

desc_sort_with_after_timestamp

77.4403

ms

90th percentile service time

desc_sort_with_after_timestamp

79.0522

ms

99th percentile service time

desc_sort_with_after_timestamp

81.5056

ms

100th percentile service time

desc_sort_with_after_timestamp

81.7177

ms

error rate

desc_sort_with_after_timestamp

0

%

Min Throughput

asc_sort_with_after_timestamp

0.5

ops/s

Mean Throughput

asc_sort_with_after_timestamp

0.51

ops/s

Median Throughput

asc_sort_with_after_timestamp

0.51

ops/s

Max Throughput

asc_sort_with_after_timestamp

0.55

ops/s

50th percentile latency

asc_sort_with_after_timestamp

38.0951

ms

90th percentile latency

asc_sort_with_after_timestamp

44.6393

ms

99th percentile latency

asc_sort_with_after_timestamp

49.4219

ms

100th percentile latency

asc_sort_with_after_timestamp

50.1881

ms

50th percentile service time

asc_sort_with_after_timestamp

35.2014

ms

90th percentile service time

asc_sort_with_after_timestamp

42.1339

ms

99th percentile service time

asc_sort_with_after_timestamp

46.454

ms

100th percentile service time

asc_sort_with_after_timestamp

47.0015

ms

error rate

asc_sort_with_after_timestamp

0

%

Min Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

Mean Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

Median Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

Max Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

50th percentile latency

desc_sort_timestamp_can_match_shortcut

14.0562

ms

90th percentile latency

desc_sort_timestamp_can_match_shortcut

15.2618

ms

99th percentile latency

desc_sort_timestamp_can_match_shortcut

19.2773

ms

100th percentile latency

desc_sort_timestamp_can_match_shortcut

29.1137

ms

50th percentile service time

desc_sort_timestamp_can_match_shortcut

12.4909

ms

90th percentile service time

desc_sort_timestamp_can_match_shortcut

13.7856

ms

99th percentile service time

desc_sort_timestamp_can_match_shortcut

17.2144

ms

100th percentile service time

desc_sort_timestamp_can_match_shortcut

27.9894

ms

error rate

desc_sort_timestamp_can_match_shortcut

0

%

Min Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Mean Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Median Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Max Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

50th percentile latency

desc_sort_timestamp_no_can_match_shortcut

25.4127

ms

90th percentile latency

desc_sort_timestamp_no_can_match_shortcut

27.7406

ms

99th percentile latency

desc_sort_timestamp_no_can_match_shortcut

55.8656

ms

100th percentile latency

desc_sort_timestamp_no_can_match_shortcut

62.5015

ms

50th percentile service time

desc_sort_timestamp_no_can_match_shortcut

23.2302

ms

90th percentile service time

desc_sort_timestamp_no_can_match_shortcut

25.5375

ms

99th percentile service time

desc_sort_timestamp_no_can_match_shortcut

53.6796

ms

100th percentile service time

desc_sort_timestamp_no_can_match_shortcut

59.7691

ms

error rate

desc_sort_timestamp_no_can_match_shortcut

0

%

Min Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Mean Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Median Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Max Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

50th percentile latency

sort_keyword_can_match_shortcut

9.24444

ms

90th percentile latency

sort_keyword_can_match_shortcut

9.88212

ms

99th percentile latency

sort_keyword_can_match_shortcut

12.6447

ms

100th percentile latency

sort_keyword_can_match_shortcut

13.65

ms

50th percentile service time

sort_keyword_can_match_shortcut

7.69027

ms

90th percentile service time

sort_keyword_can_match_shortcut

8.23397

ms

99th percentile service time

sort_keyword_can_match_shortcut

11.2893

ms

100th percentile service time

sort_keyword_can_match_shortcut

12.303

ms

error rate

sort_keyword_can_match_shortcut

0

%

Min Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Mean Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Median Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Max Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

50th percentile latency

sort_keyword_no_can_match_shortcut

8.28016

ms

90th percentile latency

sort_keyword_no_can_match_shortcut

8.87949

ms

99th percentile latency

sort_keyword_no_can_match_shortcut

9.32734

ms

100th percentile latency

sort_keyword_no_can_match_shortcut

9.43089

ms

50th percentile service time

sort_keyword_no_can_match_shortcut

6.65262

ms

90th percentile service time

sort_keyword_no_can_match_shortcut

7.24189

ms

99th percentile service time

sort_keyword_no_can_match_shortcut

7.68775

ms

100th percentile service time

sort_keyword_no_can_match_shortcut

8.47311

ms

error rate

sort_keyword_no_can_match_shortcut

0

%

Min Throughput

sort_numeric_can_match_shortcut

1.26

ops/s

Mean Throughput

sort_numeric_can_match_shortcut

1.26

ops/s

Median Throughput

sort_numeric_can_match_shortcut

1.26

ops/s

Max Throughput

sort_numeric_can_match_shortcut

1.26

ops/s

50th percentile latency

sort_numeric_can_match_shortcut

73385.6

ms

90th percentile latency

sort_numeric_can_match_shortcut

84807.8

ms

99th percentile latency

sort_numeric_can_match_shortcut

87294.7

ms

100th percentile latency

sort_numeric_can_match_shortcut

87586.5

ms

50th percentile service time

sort_numeric_can_match_shortcut

787.571

ms

90th percentile service time

sort_numeric_can_match_shortcut

814.614

ms

99th percentile service time

sort_numeric_can_match_shortcut

834.953

ms

100th percentile service time

sort_numeric_can_match_shortcut

839.377

ms

error rate

sort_numeric_can_match_shortcut

0

%

Min Throughput

sort_numeric_no_can_match_shortcut

1.26

ops/s

Mean Throughput

sort_numeric_no_can_match_shortcut

1.26

ops/s

Median Throughput

sort_numeric_no_can_match_shortcut

1.26

ops/s

Max Throughput

sort_numeric_no_can_match_shortcut

1.26

ops/s

50th percentile latency

sort_numeric_no_can_match_shortcut

73580.1

ms

90th percentile latency

sort_numeric_no_can_match_shortcut

85770.1

ms

99th percentile latency

sort_numeric_no_can_match_shortcut

88529.6

ms

100th percentile latency

sort_numeric_no_can_match_shortcut

88820.8

ms

50th percentile service time

sort_numeric_no_can_match_shortcut

799.614

ms

90th percentile service time

sort_numeric_no_can_match_shortcut

828.045

ms

99th percentile service time

sort_numeric_no_can_match_shortcut

854.933

ms

100th percentile service time

sort_numeric_no_can_match_shortcut

874.804

ms

error rate

sort_numeric_no_can_match_shortcut

0

%

Min Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Mean Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Median Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Max Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

50th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

183.441

ms

90th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

211.52

ms

99th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

241.873

ms

100th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

263.513

ms

50th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

181.216

ms

90th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

209.728

ms

99th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

240.471

ms

100th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

261.097

ms

error rate

desc-sort-timestamp-after-force-merge-1-seg

0

%

Min Throughput

asc-sort-timestamp-after-force-merge-1-seg

49.48

ops/s

Mean Throughput

asc-sort-timestamp-after-force-merge-1-seg

49.52

ops/s

Median Throughput

asc-sort-timestamp-after-force-merge-1-seg

49.52

ops/s

Max Throughput

asc-sort-timestamp-after-force-merge-1-seg

49.56

ops/s

50th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

7.79154

ms

90th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

8.39706

ms

99th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

9.2912

ms

100th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

9.62954

ms

50th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

6.04996

ms

90th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

7.27988

ms

99th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

7.87463

ms

100th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

8.24405

ms

error rate

asc-sort-timestamp-after-force-merge-1-seg

0

%

Min Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.01

ops/s

Mean Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.01

ops/s

Median Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.01

ops/s

Max Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.06

ops/s

50th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

409.538

ms

90th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

450.651

ms

99th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

715.124

ms

100th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

717.66

ms

50th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

407.808

ms

90th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

449.212

ms

99th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

712.978

ms

100th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

715.424

ms

error rate

desc-sort-with-after-timestamp-after-force-merge-1-seg

0

%

Min Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.5

ops/s

Mean Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.51

ops/s

Median Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.51

ops/s

Max Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.55

ops/s

50th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

90.5252

ms

90th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

97.1591

ms

99th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

104.318

ms

100th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

105.863

ms

50th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

87.4308

ms

90th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

93.7792

ms

99th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

100.628

ms

100th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

101.746

ms

error rate

asc-sort-with-after-timestamp-after-force-merge-1-seg

0

%