All Products
Search
Document Center

Elasticsearch:Performance test of an Elasticsearch cluster with 4-vCPU 16-GiB data nodes

Last Updated:Dec 01, 2023

This topic describes the performance benchmark test performed on an Alibaba Cloud Elasticsearch V8.9.1 cluster that contains data nodes with 4 vCPUs and 16 GiB of memory. The test is performed by using the Rally tool provided by open source Elasticsearch.

Configurations

Item

Description

Cluster configurations

  • Version: 8.9.1

  • CPU type: Intel

  • Data node specifications: 4 vCPUs and 16 GiB of memory

  • Storage type of data nodes: Enhanced SSD (ESSD)

  • Storage performance level of data nodes: PL1

  • Storage space per data node: 200 GiB

  • Number of data nodes: 3

Rally configurations

Default Rally tracks

Dataset

Built-in dataset http_logs of Rally, with 258,610,096 documents

You can obtain the dataset from Elasticsearch Rally Hub.

Number of shards

  • Primary shards: 6

  • Replica shards: 0

bulk_size

2,000 documents submitted each time

bulk_indexing_clients

10 clients used in parallel

Test results

The test results are for reference only. We recommend that you perform stress testing by using your business production data.

Main metrics

Indexing rate

image.png

Indexing latency

image.png

Average CPU utilization of nodes

image.png

Load of each node within 1 minute

image.png

Number of write requests completed per second

image.png

Amount of data that is written per second

image.png

Test report

For more information about the metrics in the following table, see Overview.

Metric

Task

Value

Unit

Cumulative indexing time of primary shards

-

129.703

min

Min cumulative indexing time across primary shards

-

0

min

Median cumulative indexing time across primary shards

-

0.857517

min

Max cumulative indexing time across primary shards

-

16.5645

min

Cumulative indexing throttle time of primary shards

-

0

min

Min cumulative indexing throttle time across primary shards

-

0

min

Median cumulative indexing throttle time across primary shards

-

0

min

Max cumulative indexing throttle time across primary shards

-

0

min

Cumulative merge time of primary shards

-

50.4829

min

Cumulative merge count of primary shards

-

601

-

Min cumulative merge time across primary shards

-

0

min

Median cumulative merge time across primary shards

-

0.081167

min

Max cumulative merge time across primary shards

-

9.88038

min

Cumulative merge throttle time of primary shards

-

15.6503

min

Min cumulative merge throttle time across primary shards

-

0

min

Median cumulative merge throttle time across primary shards

-

0

min

Max cumulative merge throttle time across primary shards

-

4.30382

min

Cumulative refresh time of primary shards

-

17.8214

min

Cumulative refresh count of primary shards

-

6140

-

Min cumulative refresh time across primary shards

-

0

min

Median cumulative refresh time across primary shards

-

0.119483

min

Max cumulative refresh time across primary shards

-

2.15253

min

Cumulative flush time of primary shards

-

3.80468

min

Cumulative flush count of primary shards

-

817

-

Min cumulative flush time across primary shards

-

3.33E-05

min

Median cumulative flush time across primary shards

-

0.016117

min

Max cumulative flush time across primary shards

-

0.5159

min

Total Young Gen GC time

-

17.58

s

Total Young Gen GC count

-

922

-

Total Old Gen GC time

-

0

s

Total Old Gen GC count

-

0

-

Store size

-

18.1059

GB

Translog size

-

0.000209

GB

Heap used for segments

-

0

MB

Heap used for doc values

-

0

MB

Heap used for terms

-

0

MB

Heap used for norms

-

0

MB

Heap used for points

-

0

MB

Heap used for stored fields

-

0

MB

Segment count

-

56

-

Total Ingest Pipeline count

-

0

-

Total Ingest Pipeline time

-

0

s

Total Ingest Pipeline failed

-

0

-

Min Throughput

index-append

207170

docs/s

Mean Throughput

index-append

219531

docs/s

Median Throughput

index-append

217484

docs/s

Max Throughput

index-append

238529

docs/s

50th percentile latency

index-append

80.1159

ms

90th percentile latency

index-append

123.321

ms

99th percentile latency

index-append

394.778

ms

99.9th percentile latency

index-append

2125.09

ms

99.99th percentile latency

index-append

2816.56

ms

100th percentile latency

index-append

3341.14

ms

50th percentile service time

index-append

80.1159

ms

90th percentile service time

index-append

123.321

ms

99th percentile service time

index-append

394.778

ms

99.9th percentile service time

index-append

2125.09

ms

99.99th percentile service time

index-append

2816.56

ms

100th percentile service time

index-append

3341.14

ms

error rate

index-append

0

%

Min Throughput

default

19.95

ops/s

Mean Throughput

default

19.96

ops/s

Median Throughput

default

19.97

ops/s

Max Throughput

default

19.97

ops/s

50th percentile latency

default

6.14099

ms

90th percentile latency

default

7.43625

ms

99th percentile latency

default

35.009

ms

100th percentile latency

default

73.9764

ms

50th percentile service time

default

4.93161

ms

90th percentile service time

default

6.18375

ms

99th percentile service time

default

25.6137

ms

100th percentile service time

default

73.0867

ms

error rate

default

0

%

Min Throughput

term

42.14

ops/s

Mean Throughput

term

42.44

ops/s

Median Throughput

term

42.44

ops/s

Max Throughput

term

42.74

ops/s

50th percentile latency

term

8.54857

ms

90th percentile latency

term

10.4358

ms

99th percentile latency

term

12.6224

ms

100th percentile latency

term

22.1556

ms

50th percentile service time

term

7.13231

ms

90th percentile service time

term

8.7835

ms

99th percentile service time

term

11.7613

ms

100th percentile service time

term

20.9707

ms

error rate

term

0

%

Min Throughput

terms_enum

50

ops/s

Mean Throughput

terms_enum

50.01

ops/s

Median Throughput

terms_enum

50.01

ops/s

Max Throughput

terms_enum

50.01

ops/s

50th percentile latency

terms_enum

5.98002

ms

90th percentile latency

terms_enum

8.03784

ms

99th percentile latency

terms_enum

9.48662

ms

100th percentile latency

terms_enum

11.5759

ms

50th percentile service time

terms_enum

4.95221

ms

90th percentile service time

terms_enum

6.8323

ms

99th percentile service time

terms_enum

8.43886

ms

100th percentile service time

terms_enum

11.0347

ms

error rate

terms_enum

0

%

Min Throughput

range

24.88

ops/s

Mean Throughput

range

24.9

ops/s

Median Throughput

range

24.9

ops/s

Max Throughput

range

24.92

ops/s

50th percentile latency

range

8.53625

ms

90th percentile latency

range

10.119

ms

99th percentile latency

range

87.6618

ms

100th percentile latency

range

111.375

ms

50th percentile service time

range

7.46765

ms

90th percentile service time

range

9.07516

ms

99th percentile service time

range

29.1409

ms

100th percentile service time

range

110.444

ms

error rate

range

0

%

Min Throughput

200s-in-range

25.02

ops/s

Mean Throughput

200s-in-range

25.02

ops/s

Median Throughput

200s-in-range

25.02

ops/s

Max Throughput

200s-in-range

25.02

ops/s

50th percentile latency

200s-in-range

6.58007

ms

90th percentile latency

200s-in-range

7.31511

ms

99th percentile latency

200s-in-range

13.0505

ms

100th percentile latency

200s-in-range

14.214

ms

50th percentile service time

200s-in-range

5.47809

ms

90th percentile service time

200s-in-range

6.12861

ms

99th percentile service time

200s-in-range

11.7787

ms

100th percentile service time

200s-in-range

12.7718

ms

error rate

200s-in-range

0

%

Min Throughput

400s-in-range

49.28

ops/s

Mean Throughput

400s-in-range

49.59

ops/s

Median Throughput

400s-in-range

49.59

ops/s

Max Throughput

400s-in-range

49.9

ops/s

50th percentile latency

400s-in-range

5.87218

ms

90th percentile latency

400s-in-range

107.373

ms

99th percentile latency

400s-in-range

165.168

ms

100th percentile latency

400s-in-range

167.499

ms

50th percentile service time

400s-in-range

4.84777

ms

90th percentile service time

400s-in-range

9.54248

ms

99th percentile service time

400s-in-range

36.7794

ms

100th percentile service time

400s-in-range

154.091

ms

error rate

400s-in-range

0

%

Min Throughput

hourly_agg

0.2

ops/s

Mean Throughput

hourly_agg

0.2

ops/s

Median Throughput

hourly_agg

0.2

ops/s

Max Throughput

hourly_agg

0.2

ops/s

50th percentile latency

hourly_agg

1924.92

ms

90th percentile latency

hourly_agg

2009.28

ms

99th percentile latency

hourly_agg

2118.9

ms

100th percentile latency

hourly_agg

2302.15

ms

50th percentile service time

hourly_agg

1921.89

ms

90th percentile service time

hourly_agg

2007.78

ms

99th percentile service time

hourly_agg

2116.37

ms

100th percentile service time

hourly_agg

2300.89

ms

error rate

hourly_agg

0

%

Min Throughput

scroll

25.05

pages/s

Mean Throughput

scroll

25.08

pages/s

Median Throughput

scroll

25.07

pages/s

Max Throughput

scroll

25.14

pages/s

50th percentile latency

scroll

355.086

ms

90th percentile latency

scroll

373.589

ms

99th percentile latency

scroll

407.765

ms

100th percentile latency

scroll

443.031

ms

50th percentile service time

scroll

353.174

ms

90th percentile service time

scroll

371.193

ms

99th percentile service time

scroll

405.43

ms

100th percentile service time

scroll

440.533

ms

error rate

scroll

0

%

Min Throughput

desc_sort_timestamp

2.01

ops/s

Mean Throughput

desc_sort_timestamp

2.01

ops/s

Median Throughput

desc_sort_timestamp

2.01

ops/s

Max Throughput

desc_sort_timestamp

2.01

ops/s

50th percentile latency

desc_sort_timestamp

33.0101

ms

90th percentile latency

desc_sort_timestamp

36.9596

ms

99th percentile latency

desc_sort_timestamp

58.5063

ms

100th percentile latency

desc_sort_timestamp

58.978

ms

50th percentile service time

desc_sort_timestamp

31.3791

ms

90th percentile service time

desc_sort_timestamp

35.3589

ms

99th percentile service time

desc_sort_timestamp

57.1305

ms

100th percentile service time

desc_sort_timestamp

57.783

ms

error rate

desc_sort_timestamp

0

%

Min Throughput

asc_sort_timestamp

19.99

ops/s

Mean Throughput

asc_sort_timestamp

19.99

ops/s

Median Throughput

asc_sort_timestamp

19.99

ops/s

Max Throughput

asc_sort_timestamp

19.99

ops/s

50th percentile latency

asc_sort_timestamp

11.2175

ms

90th percentile latency

asc_sort_timestamp

14.8594

ms

99th percentile latency

asc_sort_timestamp

21.2579

ms

100th percentile latency

asc_sort_timestamp

21.2697

ms

50th percentile service time

asc_sort_timestamp

10.3341

ms

90th percentile service time

asc_sort_timestamp

13.5502

ms

99th percentile service time

asc_sort_timestamp

20.1624

ms

100th percentile service time

asc_sort_timestamp

20.5719

ms

error rate

asc_sort_timestamp

0

%

Min Throughput

desc_sort_with_after_timestamp

1

ops/s

Mean Throughput

desc_sort_with_after_timestamp

1.01

ops/s

Median Throughput

desc_sort_with_after_timestamp

1.01

ops/s

Max Throughput

desc_sort_with_after_timestamp

1.04

ops/s

50th percentile latency

desc_sort_with_after_timestamp

585.964

ms

90th percentile latency

desc_sort_with_after_timestamp

616.699

ms

99th percentile latency

desc_sort_with_after_timestamp

658.428

ms

100th percentile latency

desc_sort_with_after_timestamp

675.078

ms

50th percentile service time

desc_sort_with_after_timestamp

584.084

ms

90th percentile service time

desc_sort_with_after_timestamp

615.507

ms

99th percentile service time

desc_sort_with_after_timestamp

657.173

ms

100th percentile service time

desc_sort_with_after_timestamp

673.631

ms

error rate

desc_sort_with_after_timestamp

0

%

Min Throughput

asc_sort_with_after_timestamp

0.5

ops/s

Mean Throughput

asc_sort_with_after_timestamp

0.51

ops/s

Median Throughput

asc_sort_with_after_timestamp

0.51

ops/s

Max Throughput

asc_sort_with_after_timestamp

0.55

ops/s

50th percentile latency

asc_sort_with_after_timestamp

14.9573

ms

90th percentile latency

asc_sort_with_after_timestamp

16.8667

ms

99th percentile latency

asc_sort_with_after_timestamp

21.4881

ms

100th percentile latency

asc_sort_with_after_timestamp

29.497

ms

50th percentile service time

asc_sort_with_after_timestamp

11.9017

ms

90th percentile service time

asc_sort_with_after_timestamp

14.1056

ms

99th percentile service time

asc_sort_with_after_timestamp

18.8203

ms

100th percentile service time

asc_sort_with_after_timestamp

27.1084

ms

error rate

asc_sort_with_after_timestamp

0

%

Min Throughput

desc_sort_timestamp_can_match_shortcut

2

ops/s

Mean Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

Median Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

Max Throughput

desc_sort_timestamp_can_match_shortcut

2.01

ops/s

50th percentile latency

desc_sort_timestamp_can_match_shortcut

37.3768

ms

90th percentile latency

desc_sort_timestamp_can_match_shortcut

40.8894

ms

99th percentile latency

desc_sort_timestamp_can_match_shortcut

53.2476

ms

100th percentile latency

desc_sort_timestamp_can_match_shortcut

81.5778

ms

50th percentile service time

desc_sort_timestamp_can_match_shortcut

35.942

ms

90th percentile service time

desc_sort_timestamp_can_match_shortcut

39.7756

ms

99th percentile service time

desc_sort_timestamp_can_match_shortcut

51.8262

ms

100th percentile service time

desc_sort_timestamp_can_match_shortcut

80.1559

ms

error rate

desc_sort_timestamp_can_match_shortcut

0

%

Min Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Mean Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Median Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

Max Throughput

desc_sort_timestamp_no_can_match_shortcut

2.01

ops/s

50th percentile latency

desc_sort_timestamp_no_can_match_shortcut

47.6447

ms

90th percentile latency

desc_sort_timestamp_no_can_match_shortcut

50.1462

ms

99th percentile latency

desc_sort_timestamp_no_can_match_shortcut

63.3456

ms

100th percentile latency

desc_sort_timestamp_no_can_match_shortcut

68.4468

ms

50th percentile service time

desc_sort_timestamp_no_can_match_shortcut

46.1795

ms

90th percentile service time

desc_sort_timestamp_no_can_match_shortcut

48.3907

ms

99th percentile service time

desc_sort_timestamp_no_can_match_shortcut

61.9762

ms

100th percentile service time

desc_sort_timestamp_no_can_match_shortcut

66.3827

ms

error rate

desc_sort_timestamp_no_can_match_shortcut

0

%

Min Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Mean Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Median Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

Max Throughput

sort_keyword_can_match_shortcut

2.01

ops/s

50th percentile latency

sort_keyword_can_match_shortcut

11.2726

ms

90th percentile latency

sort_keyword_can_match_shortcut

12.2857

ms

99th percentile latency

sort_keyword_can_match_shortcut

13.6317

ms

100th percentile latency

sort_keyword_can_match_shortcut

13.9129

ms

50th percentile service time

sort_keyword_can_match_shortcut

9.69712

ms

90th percentile service time

sort_keyword_can_match_shortcut

10.7475

ms

99th percentile service time

sort_keyword_can_match_shortcut

11.9499

ms

100th percentile service time

sort_keyword_can_match_shortcut

12.4481

ms

error rate

sort_keyword_can_match_shortcut

0

%

Min Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Mean Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Median Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

Max Throughput

sort_keyword_no_can_match_shortcut

2.01

ops/s

50th percentile latency

sort_keyword_no_can_match_shortcut

9.78064

ms

90th percentile latency

sort_keyword_no_can_match_shortcut

10.7862

ms

99th percentile latency

sort_keyword_no_can_match_shortcut

12.436

ms

100th percentile latency

sort_keyword_no_can_match_shortcut

16.6298

ms

50th percentile service time

sort_keyword_no_can_match_shortcut

8.18368

ms

90th percentile service time

sort_keyword_no_can_match_shortcut

9.25296

ms

99th percentile service time

sort_keyword_no_can_match_shortcut

10.9936

ms

100th percentile service time

sort_keyword_no_can_match_shortcut

15.1334

ms

error rate

sort_keyword_no_can_match_shortcut

0

%

Min Throughput

sort_numeric_can_match_shortcut

0.96

ops/s

Mean Throughput

sort_numeric_can_match_shortcut

0.97

ops/s

Median Throughput

sort_numeric_can_match_shortcut

0.97

ops/s

Max Throughput

sort_numeric_can_match_shortcut

0.97

ops/s

50th percentile latency

sort_numeric_can_match_shortcut

134537

ms

90th percentile latency

sort_numeric_can_match_shortcut

155131

ms

99th percentile latency

sort_numeric_can_match_shortcut

159715

ms

100th percentile latency

sort_numeric_can_match_shortcut

160208

ms

50th percentile service time

sort_numeric_can_match_shortcut

1004.01

ms

90th percentile service time

sort_numeric_can_match_shortcut

1101.34

ms

99th percentile service time

sort_numeric_can_match_shortcut

1254.52

ms

100th percentile service time

sort_numeric_can_match_shortcut

1380.32

ms

error rate

sort_numeric_can_match_shortcut

0

%

Min Throughput

sort_numeric_no_can_match_shortcut

0.97

ops/s

Mean Throughput

sort_numeric_no_can_match_shortcut

0.97

ops/s

Median Throughput

sort_numeric_no_can_match_shortcut

0.97

ops/s

Max Throughput

sort_numeric_no_can_match_shortcut

0.97

ops/s

50th percentile latency

sort_numeric_no_can_match_shortcut

133640

ms

90th percentile latency

sort_numeric_no_can_match_shortcut

155138

ms

99th percentile latency

sort_numeric_no_can_match_shortcut

159603

ms

100th percentile latency

sort_numeric_no_can_match_shortcut

160232

ms

50th percentile service time

sort_numeric_no_can_match_shortcut

1005.74

ms

90th percentile service time

sort_numeric_no_can_match_shortcut

1169.51

ms

99th percentile service time

sort_numeric_no_can_match_shortcut

1339.2

ms

100th percentile service time

sort_numeric_no_can_match_shortcut

1406.59

ms

error rate

sort_numeric_no_can_match_shortcut

0

%

Min Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Mean Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Median Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

Max Throughput

desc-sort-timestamp-after-force-merge-1-seg

1

ops/s

50th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

260.097

ms

90th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

284.032

ms

99th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

306.384

ms

100th percentile latency

desc-sort-timestamp-after-force-merge-1-seg

353.419

ms

50th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

258.32

ms

90th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

283.151

ms

99th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

304.338

ms

100th percentile service time

desc-sort-timestamp-after-force-merge-1-seg

351.788

ms

error rate

desc-sort-timestamp-after-force-merge-1-seg

0

%

Min Throughput

asc-sort-timestamp-after-force-merge-1-seg

44.84

ops/s

Mean Throughput

asc-sort-timestamp-after-force-merge-1-seg

45.27

ops/s

Median Throughput

asc-sort-timestamp-after-force-merge-1-seg

45.27

ops/s

Max Throughput

asc-sort-timestamp-after-force-merge-1-seg

45.7

ops/s

50th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

10.0604

ms

90th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

12.623

ms

99th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

15.9647

ms

100th percentile latency

asc-sort-timestamp-after-force-merge-1-seg

16.4214

ms

50th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

8.78168

ms

90th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

11.2994

ms

99th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

14.7302

ms

100th percentile service time

asc-sort-timestamp-after-force-merge-1-seg

15.193

ms

error rate

asc-sort-timestamp-after-force-merge-1-seg

0

%

Min Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1

ops/s

Mean Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.01

ops/s

Median Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1

ops/s

Max Throughput

desc-sort-with-after-timestamp-after-force-merge-1-seg

1.03

ops/s

50th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

694.29

ms

90th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

750.585

ms

99th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

833.284

ms

100th percentile latency

desc-sort-with-after-timestamp-after-force-merge-1-seg

868.189

ms

50th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

692.68

ms

90th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

749.14

ms

99th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

831.755

ms

100th percentile service time

desc-sort-with-after-timestamp-after-force-merge-1-seg

866.98

ms

error rate

desc-sort-with-after-timestamp-after-force-merge-1-seg

0

%

Min Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.5

ops/s

Mean Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.51

ops/s

Median Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.51

ops/s

Max Throughput

asc-sort-with-after-timestamp-after-force-merge-1-seg

0.55

ops/s

50th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

63.5612

ms

90th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

76.791

ms

99th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

104.963

ms

100th percentile latency

asc-sort-with-after-timestamp-after-force-merge-1-seg

105.541

ms

50th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

60.8479

ms

90th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

73.6437

ms

99th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

101.033

ms

100th percentile service time

asc-sort-with-after-timestamp-after-force-merge-1-seg

102.378

ms

error rate

asc-sort-with-after-timestamp-after-force-merge-1-seg

0

%