All Products
Search

This Product

    ApsaraDB for SelectDB:Release notes for SelectDB Core

    Document Center

    ApsaraDB for SelectDB:Release notes for SelectDB Core

    Last Updated:Dec 20, 2024

    This topic describes the release notes for SelectDB Core of ApsaraDB for SelectDB and provides links to the relevant references.

    V4.0

    Note

    • SelectDB Core V4.0 of ApsaraDB for SelectDB is developed based on Apache Doris 3.0. For more information, see the following release notes on the official website of Apache Doris:

    • SelectDB Core V4.0 is restricted in use. You can use one of the following methods to use SelectDB Core V4.0:

      • Before you create an instance, submit a ticket and provide your Alibaba Cloud account ID so that the product manager can add you to the whitelist.

      • Update an existing instance to V3.0.x (x ≥ 9) and then update the instance to V4.0.x. For more information, see Update the kernel version of an instance.

    Version

    Release date

    Description

    References

    V4.0.4

    2024-12-06

    New features:

    All features of Apache Doris 3.0.3 are supported.

    Release 3.0.3

    V4.0.3

    2024-10-11

    New features:

    • All features of Apache Doris 3.0.2 are supported.

    • Ultra-large transaction import is supported. By default, this feature is disabled.

    Optimized features:

    • By default, Java user-defined functions (UDFs) are disabled.

    • The query performance of top N logs is optimized.

    • A short path is supported to optimize the performance of point queries.

    • Tablet cropping is optimized to improve the query performance.

    Fixed issues:

    • The issue that replaying a catalog may cause the instance to fail to start in the background is fixed.

    • The issue that the audit log component fails to work after SelectDB Core is updated from V3.0.x to V4.0.x is fixed.

    • The issue that the default compute cluster permissions are revoked after SelectDB Core is updated to V4.0.2 is fixed.

    • The issue that Remote Procedure Call (RPC) for constant folding may cause computing across clusters is fixed.

    • The issue that the compute cluster is not found when SQL queries are forwarded is fixed.

    • The issue that a core dump is triggered by a null pointer in compaction delete bitmaps is fixed.

    • The issue that too large delete bitmaps for Merge-on-Write (MoW) tables cannot trigger full compaction is fixed.

    • The issue that the materialized view defined by SELECT * fails to be created is fixed.

    Release 3.0.2

    V4.0.2-beta

    2024-08-25

    New features:

    • All features of Apache Doris 3.0.1 are supported.

    Fixed issues:

    • The issue that the data import performance may deteriorate if a large amount of data fails to be imported with the same label is fixed.

    • The issue that a cluster scale-out may cause the instance to get stuck during version updates is fixed.

    • The issue of memory leak of the runtime filter is fixed.

    Release 3.0.1

    V4.0.1-beta

    2024-07-09

    New features:

    • SelectDB Core can be updated from V3.0.x (x ≥ 9) to V4.0.x.

    • All features of Apache Doris 3.0.0 are supported.

    Fixed issues:

    • The issue that the instance needs to be restarted to restore the permissions on clusters after SelectDB Core is updated from V3.0.9 is fixed.

    • The issue that queries that use inverted indexes may get stuck is fixed.

    Release 3.0.0

    V4.0.0-beta

    2024-05-15

    New features:

    • Multi-table materialized views are supported, including transparent rewrite acceleration, automatic refresh, materialized views based on external tables, data synchronization to internal tables by using materialized views, and direct queries on materialized views. Based on the preceding features, materialized views can also be used for layered modeling in data warehouses, job scheduling, and data processing.

    • The VARIANT and IP data types are supported, and a series of analysis functions are improved. You can store and analyze complex semi-structured data with ease.

    • Auto-increment columns, automatic partitioning, and group commit of requests on servers are supported. These features improve the efficiency of writing large amounts of data in real time.

    • The Arrow Flight SQL protocol is supported, which enables fast access to data and increases the data transmission efficiency by 100 times. This helps you read large amounts of data with ease in scenarios such as data science.

    • All features of Apache Doris 2.1.0 are supported.

    Optimized features:

    • The performance of queries without optimization is significantly improved, including complex SQL queries. ApsaraDB for SelectDB delivers industry-leading query performance with an improvement of more than 100% based on the 1-TB TPC-DS test dataset.

    • Data lake analytics capabilities are greatly improved. Compared with Trino and Spark, ApsaraDB for SelectDB improves the data lake analytics performance by four to six times. ApsaraDB for SelectDB is compatible with multiple SQL dialects, which allows you to seamlessly switch from the original system to ApsaraDB for SelectDB.

    Release 2.1.0

    V3.0

    Note

    SelectDB Core V3.0 of ApsaraDB for SelectDB is developed based on Apache Doris 2.0. For more information, see Release 2.0.

    Version

    Release date

    Description

    References

    V3.0.11

    2024-11-10

    New features:

    • All features of Apache Doris 2.0.15 are supported.

    Optimized features:

    • The file cache hit ratio is improved.

    Fixed issues:

    • The issue that the query result in the agg table may be inaccurate is fixed.

    • The issue that the query result of STRUCT data may be unavailable is fixed.

    • The issue that the window funnel function does not support datetime v2 is fixed.

    • The issue that a permission error may be reported when you execute the INSERT INTO SELECT statement is fixed.

    • The issue that the routine load transaction cannot be properly aborted is fixed.

    • The issue that a bad page error is reported when you perform a query or compaction operation is fixed.

    Release 2.0.15

    V3.0.10

    2024-08-23

    New features:

    • All features of Apache Doris 2.0.13 are supported.

    Optimized features:

    • The issue of inconsistent mapping distribution among multiple tablets is mitigated.

    Fixed issues:

    • The issue that the new optimizer cannot automatically retry the INSERT INTO SELECT statement is fixed.

    • The issue that a node restart is caused by dual-write of nullable data for schema changes is fixed.

    • The issue that the disposable file cache may be occupied by other queues, causing slow compaction or scheme changes is fixed.

    Release 2.0.13

    V3.0.9

    2024-06-25

    New features:

    All features of Apache Doris 2.0.11 and SelectDB Core V3.0.8 are supported.

    Optimized features:

    • The calculation of delete bitmaps for MoW table imports is optimized to improve the import speed and robustness.

    • The response to SHOW DATA operations is accelerated.

    • The query performance of inverted indexes and semi-structured data is optimized.

    Fixed issues:

    • The issue that an instance out-of-memory (OOM) exception occurs due to a large number of COPY INTO jobs is fixed.

    • The issue that an instance OOM exception occurs due to a large number of ALTER jobs is fixed.

    • The issue that some metrics of an instance may be missing when multiple clusters exist is fixed.

    • The issue that version information is unavailable for some tablets imported in a single transaction in extreme cases is fixed.

    • The issue that prevents instances from immediately recognizing file cache size modifications is fixed.

    • Several issues related to Java Database Connectivity (JDBC) connections to external tables are fixed.

    • The issue that Elasticsearch catalogs cannot use ESQuery is fixed.

    • The issues of uneven balance and decommission suspension are fixed.

    Release 2.0.11

    V3.0.8

    2024-05-15

    New features:

    • All features of Apache Doris 2.0.10 are supported.

    • A rate limit is supported for recyclers.

    • The SHOW PROC statement is supported.

    • The feature of obtaining all JSON keys is supported.

    Optimized features:

    • The amount of time consumed to create a table is reduced.

    • The calculation speed of delete bitmaps for MoW tables is optimized to improve import throughput.

    • The query speed for high-frequency import of multi-version MoW tables is improved.

    • The query efficiency is improved.

    Fixed issues:

    • The issue that metrics become incorrect after you rename a cluster is fixed.

    • The issue that the traffic statistics become inaccurate after you rename a cluster is fixed.

    • The issue that the format of the SHOW PROCESSLIST statement is invalid is fixed.

    • The issue that a schema change fails due to insufficient memory is fixed.

    • The issue that you do not have permissions to import audit logs is fixed.

    • The error of the datetimev2 round function is fixed.

    • The issue that nullable planning may lead to core dumps is fixed.

    • The issue that nullable planning may lead to incorrect results is fixed.

    Release 2.0.10

    V3.0.7

    2024-03-31

    New features:

    • All features of Apache Doris 2.0.6 are supported.

    • A built-in audit log plug-in is supported. You must manually create an audit log table.

    Optimized features:

    • The cluster to be queried can be left empty. If you do not specify the default cluster when you perform a query, ApsaraDB for SelectDB selects an available cluster from the clusters that are running and on which you have permissions to access. The available clusters are sorted based on the cluster name in alphabetical order.

    • The USE command is not explicitly needed to trigger the automatic startup of a cluster after the cluster is automatically stopped.

    • The availability and performance of inverted indexes and logs are optimized.

    • The ambiguous PROJECTION HAVING syntax is optimized by the new optimizer.

    • The performance of the list of compounds for inverted indexes is improved.

    Fixed issues:

    • The issue that data import fails due to a large number of DELETE operations is fixed.

    • The issue that the automatic shutdown logic of clusters does not take effect due to repeated SQL execution triggered by the data statistics logic is fixed.

    • The issue that the specified UTC time zone of the imported data fails to be converted is fixed.

    • The error reported by the SHOW PROCESSLIST statement is fixed by using the JDBC API.

    • The issue that the value of the ttl_seconds attribute is reset after a checkpoint is created is fixed.

    • The error of the function used to add a date, month, or year is fixed.

    Release 2.0.6

    V3.0.6

    2024-02-05

    New features:

    • All features of Apache Doris 2.0.4 are supported.

    • Automatic analysis is supported.

    • Wide tables can be imported.

    • The group commit feature is supported, which allows you to import multiple data records to databases at a time or import data to databases in real time.

    • Automatic inference is supported when the LEFT JOIN operations and IN queries are performed.

    Optimized features:

    • The error messages that appear when data fails to be imported are optimized.

    • Stability is improved.

    Fixed issues:

    • The issue that a cluster restart may invalidate cluster permissions is fixed.

    • The issue that SelectDB Core fails to be updated from V2.4.x to V3.0.x is fixed.

    • The issue that the output layout of the SHOW PROCESSLIST statement is dislocated is fixed.

    • The issue that the ALTER TABLE TTL attribute is invalid is fixed. If this attribute is invalid, the time-to-live (TTL) of the queried table is 0.

    • The issue that the "failed to initialize storage reader" error message appears during queries is fixed.

    • The issue that memory leak may occur due to the path exceptions of the parquet reader is fixed.

    • The issue related to the pushdown of the DATE_SUB, DATA_ADD, and TO_DATE functions to external tables is fixed.

    • The issue that a colocate join plan fails to be executed because the balancing feature is enabled for colocate tables is fixed.

    • The issue that the replay on nodes fails after you execute the ALTER COLOCATE statement is fixed.

    • The issue that data cannot be queried due to special characters in the DELETE conditions is fixed.

    • The issue that the NOT_IMPLEMENTED_ERROR error is reported with a small probability during queries is fixed.

    • The issue that the imported data becomes invalid due to time zone conversion is fixed.

    • The issue that a core dump is triggered because a negative value is specified in the substr() function is fixed.

    Release 2.0.4

    V3.0.5

    2023-12-20

    New features:

    • All features of Apache Doris 2.0.3 are supported.

      Note

      We recommend that you do not enable the automatic analysis feature.

    • An API operation that is compatible with Stream Load is provided.

    • A whitelist that allows you to execute the SHOW PROC or SHOW STATISTIC statement is supported.

    Optimized features:

    • The stability of importing MoW tables is improved.

    • The speed of creating dynamic tables is increased.

    • The performance of generating plans is enhanced.

    • The operations performed on data of the DECIMAL type are optimized.

    • Stability is improved.

    Fixed issues:

    • The issue that data writing is suspended due to insufficient Object Storage Service (OSS) buffers is fixed.

    • The issue that the "failed to find version path" error message appears when you perform queries in multi-cluster scenarios is fixed.

    • The issue that a plan is executed across clusters in multi-cluster scenarios is fixed.

    • The issue that partitions cannot be created for a dynamically partitioned table because the length of a VARCHAR row is modified is fixed.

    • The issue that the SHOW CREATE TABLE DECIMAL statement is incompatible with SmartBI is fixed.

    • The issue that the column type conversion feature is unavailable is fixed.

    • The issue that the attributes of row-oriented tables are invalid is fixed.

    • The issue that base compaction tasks fail is fixed.

    • The issue that the latest data cannot be queried during point queries is fixed.

    • The issue that a wait timeout occurs when you execute the COPY INTO statement to import the data from duplicate files is fixed.

    • The issue that the value of the query_parallel_instance_num parameter may be divided by zero is fixed.

    • The issue that the cache hit ratio is inaccurate is fixed.

    • The issue that an NGram index is invalid is fixed.

    Release 2.0.3

    V3.0.4

    2023-11-23

    New features:

    • The SHOW PROC current_stmt statement is supported.

    Optimized features:

    • The access control security is enhanced.

    • The reliability of verifying the uploaded data is enhanced.

    • The service availability of the instance metadata is improved.

    • The error messages related to the dynamic_partition.replication_num parameter that appear when you create a table are optimized.

    Fixed issues:

    • The issue that you fail to import data by executing the COPY INTO statement after SelectDB Core is updated from V2.4.x to V3.0.x is fixed.

    • The issue that data fails to be imported based on the authentication information specified in the external stage is fixed.

    • The issue that data fails to be imported by using Routine Load is fixed.

    • The issue that MoW tables fail to be imported is fixed.

    • The issue that the real-time execution of the INSERT statement fails is fixed.

    • The issue that the TPC-DS performance is deteriorated is fixed.

    • The issue that the session variables are invalid is fixed.

    • The issue that a query is slow because a large number of WHERE conditions in the query statement cause high CPU utilization is fixed.

    None

    V3.0.3

    2023-11-02

    New features:

    • Doris Clean Label is supported.

    • The cloud API operations of Stream Load are compatible with the community behavior of Apache Doris.

    • The JDBC driver is provided in instances.

    Optimized features:

    • By default, the Runtime Filter feature is supported by the new optimizer in top N queries.

    Fixed issues:

    • The issue that slow query response occurs due to resource leaks of instances is fixed.

    • The issue that the function statement fails to be disabled is fixed.

    • The issue that a table schema fails to be changed is fixed.

    None

    V3.0.2

    2023-10-17

    New features:

    • All features of Apache Doris 2.0.2 are supported.

    • All features of SelectDB Core V2.3.10 and V2.4.4 are supported.

    • A whitelist of JDBC driver URLs can be configured to import data from OSS.

    Optimized features:

    • The amount of time consumed to obtain metadata during plan executions is reduced and the speed of plan generation is increased.

    • The amount of time consumed to access metadata is included in query profiles.

    • The resource utilization is optimized in a balanced manner.

    Fixed issues:

    • The issue that errors occur during data reading and writing after the File Cache TTL parameter is specified is fixed.

    • The issue that the service becomes unavailable due to the queries performed on the backends and rowsets tables is fixed.

    Release 2.0.2

    V3.0.1

    2023-09-18

    New features:

    • All features of Apache Doris 2.0.1 are supported.

    • All features of SelectDB Core V2.4.3 are supported.

    Optimized features:

    • The amount of time consumed to run the GET version command is reduced.

    Release 2.0.1

    V2.4

    Note

    • SelectDB Core V2.4 of ApsaraDB for SelectDB is developed based on Apache Doris 1.2. For more information, see Release 1.2.

    • SelectDB Core V2.4 of ApsaraDB for SelectDB is discontinued and unavailable for purchase.

    Version

    Release date

    Description

    References

    V2.4.6

    2023-11-14

    Fixed issues:

    • The issue that memory leaks occur on multiple compute nodes is fixed.

    None

    V2.4.5

    2023-11-06

    Optimized features:

    • Balance policies are optimized.

    Fixed issues:

    • The issue that a query fails because a temporary partition is replaced is fixed.

    • The deadlock issue that is caused by the mixed use of pthread and bthread is fixed.

    None

    V2.4.4

    2023-09-20

    Optimized features:

    • All features of SelectDB Core V2.3.9 and V2.3.10 are supported.

    • The availability of the data import feature is improved.

    Fixed issues:

    • The issue that a request to truncate a table fails because the table has a large number of partitions during a MySQL session is fixed.

    None

    V2.4.3

    2023-09-11

    New features:

    • All features of SelectDB Core V2.3.8 are supported.

    • Service suspension caused by overdue payments is supported.

    Fixed issues:

    • The issue related to time zones in the Docker runtime environment is fixed.

    None

    V2.4.2

    2023-08-28

    New features:

    • Constants can be configured when you execute the COPY INTO statement to import data.

    Optimized features:

    • The accuracy of storage statistics is optimized.

    Fixed issues:

    • The issue that Cloud Stream Load fails is fixed.

    None

    V2.4.1

    2023-08-03

    New features:

    • All features of SelectDB Core V2.3.5, V2.3.6, and V2.3.7 are supported.

    • Data can be imported by using Stream Load.

    • A stopped pay-as-you-go cluster can be automatically started if it receives the requests to query data.

    Fixed issues:

    • The issue that queries based on inverted indexes fail is fixed.

    None

    V2.4.0

    2023-07-03

    New features:

    • Session variables can be used to specify whether to enable the cache feature for SQL statements.

    • Incremental data synchronization among clusters is supported.

    • The prefetch feature is supported based on table clusters to prefetch the cached data.

    • The cache usage can be queried by using SQL statements.

    • Pay-as-you-go clusters can be automatically stopped if they become idle.

    Optimized features:

    • Data security is enhanced.

    • The response time that is required when the query does not hit the cache is reduced.

    Fixed issues:

    • The issue that the SET DEFAULT CLUSTER statement may fail to be executed is fixed.

    • The issue that a version update fails is fixed.

    None

    For more information about the historical versions of SelectDB Core, see Core Release Notes on the official website of SelectDB Cloud.