Easily Build Kafka Cluster
ApsaraMQ for Kafka is a fully-managed Apache Kafka service which manages complex infrastructure-related operations for you, such as the configuration, maintenance, upgrading, and monitoring of your workloads, allowing you to focus on perfecting your streaming data pipelines and applications.
Compatible with Apache Kafka
Allows you to migrate your existing Apache Kafka workloads seamlessly to Alibaba Cloud.
Fully Managed
Provides systematic and comprehensive services to help you manage your operational and maintenance challenges.
High Availability
Optimizes long standing issues with Apache Kafka and provides a more reliable service.
Quick Deployment without Complex Configurations
Self-managed Apache Kafka clusters are difficult to operate and maintain. You may often face the following challenges:
Data loss and low availability
Cluster operation and maintenance
Server maintenance
Hardware maintenance
Specifications change
Unknown bugs
AlibabaMQ for Apache Kafka provides the following capabilities:
Automatic inspection and alarm
Automatic disk cleanup
Automatic system recovery
Cluster expansion in seconds
Open source bug fixing
Features
Compatible with Apache Kafka
Offers a quick and seamless Kafka workload migration experience.
Works Out-of-The-Box
Compatible with Apache Kafka (0.10.x ~ 3.x) and open source clients.
Seamless Migration
Seamless cloud migration without making any changes to your Apache Kafka code.
Rich Ecosystem
Deeply integrated with Alibaba Cloud's big data platforms and engaged within the open source community.
Fully Managed
Provides systematic and comprehensive services to help you manage your operational and maintenance challenges, allowing you to focus on building your streaming applications and data pipelines.
Zero Maintenance Required
Apache Kafka clusters and Apache ZooKeeper nodes management service.
HouseKeeping (Health Inspection Component)
Runtime inspection is provided. A comprehensive scan diagnosis and health warning are performed on the cluster every minute to ensure the security of the underlying servers.
Monitoring and Alarm
Supports multi-dimensional monitoring and alarm settings such as instance, message, and TPS to help you locate problems in a timely manner.
High Availability
Optimizes long standing issues with Apache Kafka and provides a more reliable service.
High Reliability/High Availability
Multi-AZ replication data redundancy, 99.999999% data reliability, and 99.9% service availability.
High Throughput
Even with massive message accumulation, AlibabaMQ for Apache Kafka ensures high throughput for message receiving and sending in the Kafka cluster.
Auto Scaling
The broker, topics, and partitions automatically scales on demand with no impact on the dependent applications.
Data Security
Provides enterprise-level security that includes an authentication and authorization access control mechanism, master and sub accounts, etc.
Access Control
VPC network and access control for each message receiving and sending request to ensure message security.
Master and Sub Accounts
Supports Resource Access Management (RAM) with master and sub accounts, black and white lists, Security Token Service (STS), and others.
Data Security
SASL user identity authentication and SSL encryption ensure that data is not stolen or tampered with during transmission to ensure data security.
Scenarios
Log Analysis
Log Collection
AlibabaMQ for Apache Kafka capable performance makes it suitable for log collection because:
1. It has no perceivable impact on the service.
2. It provides real-time online analysis between systems such as Storm/Spark and offline storage warehouses like Hadoop/ODPS.
Benefits
System decoupling: serves as a bridge between application and analysis systems, allowing them to decouple.
Online/offline analysis system: supports real-time online analysis systems and offline analysis system such as Hadoop.
Website Tracking
High Throughput and Data Integration
AlibabaMQ for Apache Kafka allows users to collect real-time website activity statistics (including browsing, searching, and other behaviors).
Publish/subscribe mode routes messages to different topics by data type.
Message streaming can be used in real-time monitoring or service analysis if subscribed to real-time message delivery or offline processing if loaded to offline data warehouses such as Hadoop and ODPS.
Benefits
High throughput: provides a high throughput data pipeline to support the large behavior information generated by website users.
Big data analysis: seamless integration with open source ecosystems such as Storm/Spark or Alibaba Cloud ecosystems such as Hadoop/ODPS, making it easy to build big data architecture.
Data Hub
Multipath Routing
Supports both real-time and batch processing: local data persistence and PageCache can be delivered to multiple computing engines at the same time without performance loss.
Benefits
You can use AlibabaMQ for Apache Kafka as a data hub. The same data can be imported to different systems such as KV storage (HBase), search engine (Elastic Search), Streaming processing (Storm/Spark Streaming/Samza), time series database (OpenTSDB), etc.
One-to-many consumption: a publish/subscribe mode that allows the same data to be consumed multiple times at the same time.
Pricing
Commercial use after 00:00, 1 May 2020 UTC+08:00.
AlibabaMQ for Apache Kafka offers a subscription-based billing model.
For billing policy: see Billing
Edition
Two editions are available: Standard (logically isolated and shared) and Professional (physically isolated and exclusive).
Table 1 Differences between standard edition and professional edition
| Edition | Standard edition | Professional edition |
| Isolation | Logically isolated and shared | Physically isolated and exclusive |
|---|---|---|
| Versions | 0.10. x | 0.10. x~2. x |
| Disaster Recovery | Single-AZ deployment | Multi-AZ deployment |
| O&M | Fully managed with basic O&M features | Fully managed with advanced O&M features |
| Capacity | Basic topic and partition quota | Larger topic and partition quota |
Total fee = (Traffic peak unit price + Disk capacity unit price x Disk capacity purchased/100 + Topic unit price x Number of added topics) x Number of months
Table 2-1 Peak traffic billing rules (standard edition)
| Peak traffic (MB/s) | Number of topics | Number of partitions | Region 1 (USD/month) | Region 2 (USD/month) | Region 3 (USD/month) |
| 20 | 50 | 400 | 250 | 370 | 340 |
|---|---|---|---|---|---|
| 30 | 50 | 500 | 360 | 530 | 480 |
| 60 | 80 | 600 | 520 | 760 | 700 |
| 90 | 100 | 800 | 660 | 960 | 880 |
| 120 | 150 | 900 | 800 | 1160 | 1070 |
Table 2-2 Peak traffic billing rules (professional edition)
| Peak traffic (MB/s) | Number of topics | Number of partitions | Region 1 (USD/month) | Region 2 (USD/month) | Region 3 (USD/month) |
| 20 | 50 | 1100 | 600 | 870 | 800 |
|---|---|---|---|---|---|
| 30 | 50 | 1200 | 780 | 1040 | 1040 |
| 60 | 80 | 1040 | 1130 | 1510 | 1510 |
| 90 | 100 | 1600 | 1440 | 1920 | 1920 |
| 120 | 150 | 1800 | 1750 | 2330 | 2330 |
| 160 | 180 | 2000 | 2060 | 2740 | 2740 |
| 200 | 200 | 2200 | 2980 | 3970 | 3970 |
| 250 | 250 | 2500 | 3430 | 4570 | 4570 |
| 300 | 300 | 3000 | 3880 | 5170 | 5170 |
| 600 | 450 | 4500 | 5280 | 7030 | 7030 |
| 800 | 500 | 5000 | 6220 | 8280 | 8280 |
| 1000 | 600 | 6000 | 7270 | 9670 | 9670 |
| 1200 | 700 | 7000 | 8100 | 10780 | 10780 |
| 1500 | 800 | 8000 | 9500 | 12640 | 12640 |
| 1800 | 900 | 9000 | 10910 | 14520 | 14520 |
| 2000 | 1000 | 10000 | 12070 | 16060 | 16060 |
| Disk types | Size (GB) | Region 1 (USD/month) | Region 2 (USD/month) | Region 3 (USD/month) |
| ultra disk | 100 | 6 | 8 | 8 |
|---|---|---|---|---|
| SSD | 100 | 16 | 23 | 21 |
| Billing item | Number of topics | Region 1 (USD/month) | Region 2 (USD/month) | Region 3 (USD/month) |
| Topic | 1 | 7 | 11 | 10 |
|---|
Note
Currently available Region: Singapore
Pending regions:
Region 1: Mainland China
Region 2: China (Hong Kong), Singapore (Singapore), Japan (Tokyo), United States (Silicon Valley), United States (Virginia), and Australia (Sydney)
Region 3: Malaysia (Kuala Lumpur) and Indonesia (Jakarta)
Upgraded Support For You
1 on 1 Presale Consultation, 24/7 Technical Support, Faster Response, and More Free Tickets.
1 on 1 Presale Consultation
24/7 Technical Support
6 Free Tickets per Quarter
