ApsaraDB for SelectDB:Release notes for SelectDB Core

Version

Release date

Description

References

V3.0.10

2024-08-23

New features:

• All features of Apache Doris 2.0.15 and Apache Doris 2.0.13 are supported.

Optimized feature:

• The issue of inconsistent mapping distribution among multiple tablets is mitigated.

Release 2.0.13

V3.0.9

2024-06-25

New features:

All features of Apache Doris 2.0.11 and SelectDB Core V3.0.8 are supported.

Optimized features:

• The calculation of delete bitmaps for Merge-on-Write (MoW) table imports is optimized to improve the import speed and robustness.

• The response to SHOW DATA operations is accelerated.

• The query performance of inverted indexes and semi-structured data is optimized.

Fixed issues:

• The issue that an instance out-of-memory (OOM) exception occurs due to a large number of COPY INTO jobs is fixed.

• The issue that an instance OOM exception occurs due to a large number of ALTER jobs is fixed.

• The issue that some metrics of an instance may be missing when multiple clusters exist is fixed.

• The issue that version information is unavailable for some tablets imported in a single transaction in extreme cases is fixed.

• The issue that prevents instances from immediately recognizing file cache size modifications is fixed.

• Several issues related to Java Database Connectivity (JDBC) connections to external tables are fixed.

• The issue that Elasticsearch catalogs cannot use ESQuery is fixed.

• The issues of uneven balance and decommission suspension are fixed.

Release 2.0.11

V3.0.8

2024-05-15

New features:

• A rate limit is supported for recyclers.

• The SHOW PROC statement is supported.

• The feature of obtaining all JSON keys is supported.

• All features of Apache Doris 2.0.10 are supported.

Optimized features:

• The amount of time consumed to create a table is reduced.

• The calculation speed of delete bitmaps for MoW tables is optimized to improve import throughput.

• The query speed for high-frequency import of multi-version MoW tables is improved.

• The query efficiency is improved.

Fixed issues:

• The issue that metrics become incorrect after you rename a cluster is fixed.

• The issue that the traffic statistics become inaccurate after you rename a cluster is fixed.

• The issue that the format of the SHOW PROCESSLIST statement is invalid is fixed.

• The issue that a schema change fails due to insufficient memory is fixed.

• The issue that you do not have the permission to import audit logs is fixed.

• The error of the datetimev2 round function is fixed.

• The issue that nullable planning may lead to core dumps is fixed.

• The issue that nullable planning may lead to incorrect results is fixed.

Release 2.0.10

V3.0.7

2024-03-31

New features:

• A built-in audit log plug-in is supported. You must manually create an audit log table.

• All features of Apache Doris 2.0.6 are supported.

Optimized features:

• The cluster to be queried can be left empty. If you do not specify the default cluster when you perform a query, ApsaraDB for SelectDB selects an available cluster from the clusters that are running and on which you have permissions to access. The available clusters are sorted based on the cluster name in alphabetical order.

• The USE command is not explicitly needed to trigger the automatic startup of a cluster after the cluster is automatically stopped.

• The availability and performance of inverted indexes and logs are optimized.

• The ambiguous PROJECTION HAVING syntax is optimized by the new optimizer.

• The performance of the list of compounds for inverted indexes is improved.

Fixed issues:

• The issue that data import fails due to a large number of DELETE operations is fixed.

• The issue that the automatic shutdown logic of clusters does not take effect due to repeated SQL execution triggered by the data statistics logic is fixed.

• The issue that the specified UTC time zone of the imported data fails to be converted is fixed.

• The error reported by the SHOW PROCESSLIST statement is fixed by calling the JDBC API.

• The issue that the value of the ttl_seconds attribute is reset after a checkpoint is created is fixed.

• The error of the function used to add a date, month, or year is fixed.

Release 2.0.6

V3.0.6

2024-02-05

New features:

• Automatic analysis is supported.

• Wide tables can be imported.

• The group commit feature is supported, which allows you to import multiple data records to databases at a time or import data to databases in real time.

• Automatic inference is supported when the LEFT JOIN operations and IN queries are performed.

• All features of Apache Doris 2.0.4 are supported.

Optimized features:

• The error messages that appear when data fails to be imported are optimized.

• Stability is improved.

Fixed issues:

• The issue that a cluster restart may invalidate cluster permissions is fixed.

• The issue that SelectDB Core fails to be upgraded from V2.4.x to V3.0.x is fixed.

• The issue that the output layout of the SHOW PROCESSLIST command is dislocated is fixed.

• The issue that the ALTER TABLE TTL attribute is invalid is fixed. If this attribute is invalid, the time-to-live (TTL) of the queried table is 0.

• The issue that the "failed to initialize storage reader" error message appears during queries is fixed.

• The issue that memory leak may occur due to path exceptions of the parquet reader is fixed.

• The issue related to the pushdown of the DATE_SUB, DATA_ADD, and TO_DATE functions to external tables is fixed.

• The issue that a colocate join plan fails to be executed because the balancing feature is enabled for colocate tables is fixed.

• The issue that the replay on nodes fails after you execute the ALTER COLOCATE statement is fixed.

• The issue that data cannot be queried due to special characters in the DELETE conditions is fixed.

• The issue that the NOT_IMPLEMENTED_ERROR error is reported with a small probability during queries is fixed.

• The issue that the imported data becomes invalid due to time zone conversion is fixed.

• The issue that a core dump is triggered because a negative value is specified in the substr() function is fixed.

Release 2.0.4

V3.0.5

2023-12-20

New features:

• The following API operation that is compatible with Stream Load is provided:

/api/{db}/{table}/_stream_load_2pc

• The whitelist configuration to execute the SHOW proc/statistic command is supported.

• All features of Apache Doris 2.0.3 are supported.

  Note

  We recommend that you do not enable the automatic analysis feature.

Optimized features:

• The stability of importing MOW tables is improved.

• The speed of creating dynamic tables is increased.

• The performance of generating plans is enhanced.

• The operations performed on data of the DECIMAL type are optimized.

• Stability is improved.

Fixed issues:

• The issue that data writing is suspended due to insufficient Object Storage Service (OSS) buffers is fixed.

• The issue that the "failed to find version path" error message appears when you perform queries in multi-cluster scenarios is fixed.

• The issue that a plan is executed across clusters in multi-cluster scenarios is fixed.

• The issue that partitions cannot be created for a dynamically partitioned table because the length of a VARCHAR row is modified is fixed.

• The issue that the SHOW CREATE TABLE DECIMAL statement is incompatible with SmartBI is fixed.

• The issue that the column type conversion feature is unavailable is fixed.

• The issue that the attributes of row-oriented tables are invalid is fixed.

• The issue that base compaction tasks fail is fixed.

• The issue that the latest data cannot be queried during point queries is fixed.

• The issue that a wait timeout occurs when you execute the COPY INTO statement to import the data from duplicate files is fixed.

• The issue that the value of the query_parallel_instance_num parameter may be divided by zero is fixed.

• The issue that the cache hit ratio is inaccurate is fixed.

• The issue that an NGram index is invalid is fixed.

Release 2.0.3

V3.0.4

2023-11-23

New feature:

• The SHOW PROC current_stmt statement is supported.

Optimized features:

• The access control security is enhanced.

• The reliability of verifying the uploaded data is enhanced.

• The service availability of the metadata stored in warehouses is improved.

• The error messages related to the dynamic_partition.replication_num parameter that occur when you create a table are optimized.

Fixed issues:

• The issue that you fail to import data by executing the COPY INTO statement when you upgrade SelectDB Core from V2.4 to V3.0 is fixed.

• The issue that data fails to be imported by specifying the authentication information in the external stage is fixed.

• The issue that data fails to be imported by using Routine Load is fixed.

• The issue that MOW tables fail to be imported is fixed.

• The issue that the real-time execution of the INSERT statement fails is fixed.

• The issue that the TPC-DS performance is deteriorated is fixed.

• The issue that the session variables are invalid is fixed.

• The issue that a query is slow because a large number of WHERE conditions in the query statement cause high CPU utilization is fixed.

None

V3.0.3

2023-11-02

New features:

• Doris Clean Label is supported.

• The cloud API operations of Stream Load are compatible with the community behavior of Apache Doris.

• The JDBC driver in instances is provided.

Optimized features:

• By default, the new optimizer supports the Runtime Filter feature in top N queries.

Fixed issues:

• The issue that slow query response occurs due to resource leaks of instances is fixed.

• The issue that the function statement fails to be disabled is fixed.

• The issue that a table schema fails to be changed is fixed.

None

V3.0.2

2023-10-17

New features:

• You can configure a whitelist of JDBC Driver URL to import data from OSS.

• All features of Apache Doris 2.0.2 are supported.

• All features of SelectDB Core V2.3.10 and V2.4.4 are supported.

Optimized features:

• The amount of time consumed to obtain metadata during plan executions is reduced and the speed of plan generation is increased.

• The amount of time consumed to access metadata is included in query profiles.

• The resource utilization is optimized in a balanced manner.

Fixed issues:

• The issue that errors occur during data reading and writing after the File Cache TTL parameter is specified is fixed.

• The issue that the service becomes unavailable due to the queries performed on the backends and rowsets tables is fixed.

Release 2.0.2

V3.0.1

2023-09-18

New features:

• All features of Apache Doris 2.0.1 are supported.

• All features of SelectDB Core V2.4.3 are suppported.

Optimized feature:

• The response time to run the Get Version command is reduced.

Release 2.0.1

Version

Release date

Description

References

V2.4.6

2023-11-14

Fixed issue:

• The issue that memory leaks occur on multiple compute nodes is fixed.

None

V2.4.5

2023-11-06

Optimized feature:

• Balance policies are optimized.

Fixed issues:

• The issue that a query fails because a temporary partition is replaced is fixed.

• The deadlock issue that is caused by the mixed use of pthread and bthread is fixed.

None

V2.4.4

2023-09-20

Optimized features:

• All features of SelectDB Core V2.3.9 and V2.3.10 are supported.

• The availability of the data import feature is improved.

Fixed issue:

• The issue that a request to truncate a table fails because the table has a large number of partitions during a MySQL session is fixed.

None

V2.4.3

2023-09-11

New features:

• Service suspension caused by overdue payments is supported.

• All features of SelectDB Core V2.3.8 are supported.

Fixed issue:

• The issue related to time zones in the Docker runtime environment is fixed.

None

V2.4.2

2023-08-28

New feature:

• You can configure constants when you execute the COPY INTO statement to import data.

Optimized feature:

• The accuracy of storage statistics is optimized.

Fixed issue:

• The issue that Cloud Stream Load fails is fixed.

None

V2.4.1

2023-08-03

New features:

• You can import data by using Stream Load.

• A stopped pay-as-you-go cluster can be automatically started if it receives the requests to query data.

Optimized features:

• All the features, improvements, and fixed issues of SelectDB Core V2.3.5, V2.3.6, and V2.3.7 are integrated.

Fixed issue:

• The issue that queries based on inverted indexes fail is fixed.

None

V2.4.0

2023-07-03

New features:

• You can use session variables to specify whether to enable the cache feature for SQL statements.

• Incremental data synchronization among clusters is supported.

• The prefetch feature is supported based on table clusters to prefetch the cached data.

• You can query the cache usage by using SQL statements.

• Pay-as-you-go clusters can be automatically stopped if they become idle.

Optimized features:

• Data security is enhanced.

• The response time that is required when the query does not hit the cache is reduced.

Fixed issues:

• The issue that the SET DEFAULT CLUSTER statement may fail to be executed is fixed.

• The issue that an upgrade fails is fixed.

None