ApsaraMQ for Kafka provides fully managed and O&M-free connectors that allow you to synchronize data between ApsaraMQ for Kafka and other Alibaba Cloud services. This topic describes the types of connectors and the procedure and limits of using connectors. This topic also describes how to use connectors to synchronize data between services in different regions.
The connector feature of ApsaraMQ for Kafka is in public preview and independent of ApsaraMQ for Kafka instances. ApsaraMQ for Kafka does not charge you for the connector feature. Alibaba Cloud does not provide a service level agreement (SLA) for the connector feature. For information about SLAs and pricing of other services that are required to use the connector feature, see the documentation of the related services.
Connector types
ApsaraMQ for Kafka supports the following types of connectors:
Sink connector: Sink connectors are used to synchronize data from ApsaraMQ for Kafka to other Alibaba Cloud services.
Connector
Description
References
FC sink connector
Synchronizes data from ApsaraMQ for Kafka to Function Compute.
MaxCompute sink connector
Synchronizes data from ApsaraMQ for Kafka to MaxCompute.
OSS sink connector
Synchronizes data from ApsaraMQ for Kafka to Object Storage Service (OSS).
Elasticsearch sink connector
Synchronizes data from ApsaraMQ for Kafka to Elasticsearch.
DLA sink connector
Synchronizes data from ApsaraMQ for Kafka to Data Lake Analytics (DLA).
Tablestore sink connector
Synchronizes data from ApsaraMQ for Kafka to Tablestore.
AnalyticDB sink connector
Synchronizes data from ApsaraMQ for Kafka to AnalyticDB for MySQL or AnalyticDB for PostgreSQL.
Source connector: Source connectors are used to synchronize data from other Alibaba Cloud services to ApsaraMQ for Kafka.
Connector
Description
References
MySQL source connector
Synchronizes data from ApsaraDB RDS for MySQL to ApsaraMQ for Kafka.
Use a connector
To use a connector, perform the following steps:
Create a connector.
Limits
The following limits are imposed on the connector feature of ApsaraMQ for Kafka.
Item | Limit |
Number of connectors | You can create up to 20 connectors for an ApsaraMQ for Kafka instance. You can create multiple connector tasks to export data from the same ApsaraMQ for Kafka instance to different services. |
Region | The connector feature is unavailable in specific regions. For more information, see Supported regions. |
Synchronize data across regions
If you want to use a connector to synchronize data between Alibaba Cloud services that are deployed in different regions, you must enable Internet access for the connector and then synchronize the data over the Internet. For more information, see Enable Internet access for a connector.
If you want to use a MySQL source connector to synchronize data across regions, you must activate Cloud Enterprise Network (CEN). For more information, see Create a MySQL source connector.