This topic describes how to perform extract, transform, and load (ETL) operations on business data and log data in the e-commerce industry by using MaxCompute and DataWorks, synchronize the processed data to AnalyticDB for MySQL for real-time analysis, and use Quick BI to present the analysis results.
Background information
MaxCompute: used to perform computing on large amounts of data. For more information, see What is MaxCompute?
AnalyticDB for MySQL: used to perform real-time, online analysis on large amounts of data at high concurrency. For more information, see What is AnalyticDB for MySQL?
DataWorks: used to collect, process, and analyze data in complex datasets to implement the ETL feature. For more information, see What is DataWorks?
Quick BI: used to generate reports for the processed data to achieve visualized display and analysis of data. For more information, see What is Quick BI?
Use scenarios
Business Intelligence (BI) analysis for websites, apps, and mini programs in the Internet, e-commerce, and gaming industries
BI analysis for various websites
Procedure
The following steps show the process of using MaxCompute to analyze data and Quick BI to present the analysis results:
Use Data Integration to synchronize business data and log data to MaxCompute.
Use MaxCompute and DataWorks to perform ETL operations on the data.
Synchronize the processed data to AnalyticDB for MySQL.
Use Quick BI to present the results.
Benefits
This solution supports quick and real-time analysis of business data and log data based on AnalyticDB for MySQL and Quick BI.
Simple Log Service used in this solution can be seamlessly integrated with various services, such as Realtime Compute for Apache Flink, Elasticsearch, AnalyticDB for MySQL, E-MapReduce (EMR), and DataV, which improves user experience.
This solution leverages powerful data processing and analysis capabilities of MaxCompute and AnalyticDB for MySQL, which makes it easier to build big data platforms and compute huge amounts of data. This solution also effectively reduces costs while ensuring data security for enterprises.
This solution is seamlessly integrated with third-party open source services. This way, these third-party services can transmit logs to Simple Log Service without the need to access user applications.