ApsaraMQ for Kafka provides fully managed connectors to synchronize data between ApsaraMQ for Kafka and other Alibaba Cloud services. You do not need to perform O&M operations on these connectors. This topic describes the types of connectors and the procedure and limits of using connectors. This topic also describes how to use connectors to synchronize data between services in different regions.
Types of connectors
ApsaraMQ for Kafka provides two types of connectors:
- Sink connector: Sink connectors are used to synchronize data from ApsaraMQ for Kafka to other Alibaba Cloud services.
Connector Description References FC Sink Connector Synchronizes data from ApsaraMQ for Kafka to Function Compute. Create a Function Compute sink connector MaxCompute Sink Connector Synchronizes data from ApsaraMQ for Kafka to MaxCompute. Create a MaxCompute sink connector OSS Sink Connector Synchronizes data from ApsaraMQ for Kafka to Object Storage Service (OSS). Create an OSS sink connector Elasticsearch Sink Connector Synchronizes data from ApsaraMQ for Kafka to Elasticsearch. Create an Elasticsearch sink connector DLA Sink Connector Synchronizes data from ApsaraMQ for Kafka to Data Lake Analytics (DLA). Create a DLA sink connector Tablestore Sink Connector Synchronizes data from ApsaraMQ for Kafka to Tablestore. Create a Tablestore sink connector AnalyticDB Sink Connector Synchronizes data from ApsaraMQ for Kafka to AnalyticDB for MySQL or AnalyticDB for PostgreSQL. Create an AnalyticDB sink connector - Source connector: Source connectors are used to synchronize data from other Alibaba Cloud services to ApsaraMQ for Kafka.
Connector Description References MySQL Source Connector Synchronizes data from ApsaraDB RDS for MySQL to ApsaraMQ for Kafka. Create a MySQL source connector
Procedure
To use a connector, perform the following steps:
- Enable the connector feature
- Create a connector
- Manage a connector
Limits
The following table lists the limits of ApsaraMQ for Kafka on connectors.
Item | Limit |
---|---|
Quantity | You can create up to 20 connectors for a Message Queue for Apache Kafka instance. You can create multiple connector tasks to export data from the same Message Queue for Apache Kafka instance to different services. |
Region | The connector feature is unavailable in some regions. For more information, see Supported regions. |
Synchronize data across regions
If you need to use a connector to synchronize data between Alibaba Cloud services that are deployed in different regions over the Internet, you must enable Internet access for the connector. For more information, see Enable Internet access for a connector.