:Overview

• Which information about DataWorks and its network capabilities do I need to take note of before I configure a data synchronization node?
• How do I make sure the network connectivity between a resource group in DataWorks and a self-managed data source that is hosted on an Elastic Compute Service (ECS) instance when I synchronize data from the self-managed data source?
• How do I make sure the network connectivity between a resource group in DataWorks and a data source that is deployed in a different region from the resource group when I synchronize data from the data source?
• When I synchronize data from a data source, the account that I use to access the data source is different from the account that I use to access DataWorks. How do I make sure the network connectivity between DataWorks and the data source?
• What do I do if the network connectivity test for a data source in a VPC fails?

• I cannot find the exclusive resource group for Data Integration that I purchased when I test network connectivity for a data source or run a data synchronization node. What do I do?
• How can I determine the type of the resource group on which a data synchronization node is run from a log?
• How do I configure a resource group to wait for gateway resources?

• What types of data sources support real-time synchronization?
• Why is the Internet not recommended for real-time synchronization?
• What operation does DataWorks perform on the data records that are synchronized in real time?
• How do I deal with the TRUNCATE statement during real-time data synchronization?
• How do I improve the speed and performance of real-time synchronization?
• Can I directly run a real-time synchronization node on the codeless user interface (UI)?

When I run a node to synchronize data from Kafka in real time, the following error message is returned: Startup mode for the consumer set to timestampOffset, but no begin timestamp was specified. What do I do?

• When I run a node to synchronize data from MySQL in real time, the following error message is returned: Cannot replicate because the master purged required binary logs. What do I do?
• When I run a node to synchronize data from MySQL, the following error message is returned: MySQLBinlogReaderException. What do I do?
• When I run a node to synchronize data from MySQL, the following error message is returned: how master status' has an error!. What do I do?
• When I run a node to synchronize data from MySQL in real time, the following error message is returned: parse.exception.PositionNotFoundException: can't find start position forxxx. What do I do?
• When I run a node to synchronize data from MySQL in real time, data can be read at the beginning but cannot be read after a period of time. What do I do?

When I run a node to synchronize data from Hologres in real time, the following error message is returned: permission denied for database xxx. What do I do?

• Why is the connectivity test of a data source successful, but the batch synchronization node that uses the data source fails to be run?
• How do I change the resource group that is used to run a data synchronization node in Data Integration?
• How do I locate and handle dirty data?

• How do I handle a dirty data error that is caused by encoding format configuration issues or garbled characters?
• What do I do if the following error message is returned when I run a batch synchronization node to synchronize data: [TASK_MAX_SLOT_EXCEED]:Unable to find a gateway that meets resource requirements. 20 slots are requested, but the maximum is 16 slots.?
• What do I do if a server-side request forgery (SSRF) attack is detected in a node and the error message Task have SSRF attacts is returned?
• What do I do if the error message OutOfMemoryError: Java heap space is returned when I run a batch synchronization node?
• What do I do if the same batch synchronization node fails to be run occasionally?
• Batch synchronization
• What do I do if an error message that contains Duplicate entry 'xxx' for key 'uk_uk_op' is returned when I run a batch synchronization node?
• What do I do if the error message plugin xx does not specify column is returned when I run a batch synchronization node?

• What do I do if an error occurs when I add a MongoDB data source as the root user?
• The authDB database used by MongoDB is the admin database. How do I synchronize data from business databases?
• How do I convert the values of the variables in the query parameter into values in the timestamp format when I synchronize incremental data from a table of a MongoDB database?
• What do I do if the error message AccessDenied The bucket you access does not belong to you. is returned when I read data from an OSS bucket?
• Is an upper limit configured for the number of OSS objects that can be read?
• What do I do if the error message Code:[RedisWriter-04], Description:[Dirty data]. - source column number is in valid! is returned when I write data to Redis in hash mode?
• What do I do if the following error message is returned when I read data from or write data to ApsaraDB RDS for MySQL: Application was streaming results when the connection failed. Consider raising value of 'net_write_timeout/net_read_timeout' on the server.?
• What do I do if the error message The last packet successfully received from the server was 902,138 milliseconds ago is returned when I read data from a MySQL data source?
• What do I do if an error occurs when I read data from PostgreSQL?
• What do I do if an error message that contains Communications link failure is returned when I read data from or write data to a MySQL data source?
• What do I do if an error message that contains The download session is expired. is returned when I read data from a MaxCompute table?
• What do I do if an error message that contains Error writing request body to server is returned when I write data to a MaxCompute table?
• What do I do if data fails to be written to DataHub because the amount of data that I want to write to DataHub at a time exceeds the upper limit?

• Batch synchronization
• How do I specify custom table names in a batch synchronization node?
• What do I do if the table that I want to select does not appear in the Table drop-down list in the Connection step when I configure a batch synchronization node?
• What are the items that I must take note of when I use the Add feature in a batch synchronization node that reads data from a MaxCompute table?
• How do I read data from partition key columns in a MaxCompute table?
• How do I read data from multiple partitions in a MaxCompute table?
• What do I do if a synchronization node fails to be run because the name of a column in the source table is a keyword?
• Why is no data obtained when I read data from a LogHub data source whose fields contain values?
• Why is some data missing when I read data from a LogHub data source?
• What do I do if the LogHub fields that I read based on the field mappings configured for a batch synchronization node are not the expected fields?
• I configured the endDateTime parameter to specify the end time for reading data from a Kafka data source, but some data generated at a point in time that is later than the specified end time is returned. What do I do?
• How do I remove the random strings that appear in the data I write to OSS?
• How do I synchronize data from a MySQL data source on which sharding is performed to a MaxCompute table?