SchedulerX:SDK for Java

Version

Type

Description

Release date

References

1.12.2

Optimized feature

• Security vulnerabilities in the visual MapReduce jobs are fixed.

• Security vulnerabilities in the API operations of Akka are fixed.

November 20, 2024

N/A

1.12.1

New feature

• The thread pool size of HTTP jobs that are run in Agent mode can be adjusted.

• The logger option can be set to export SchedulerX logs.

• The @ SchedulerX annotation is added. It can take effect at the same time as the Spring @Scheduled annotation to allow SchedulerX to take over some of the scheduled Spring jobs.

October 12, 2024

N/A

Optimized feature

• The fastJSON package is removed to resolve security vulnerabilities.

N/A

1.11.5

Optimized feature

• The log export from Simple Log Service is optimized.

• The following issue is fixed: Heartbeat reporting is affected if exceptions occur while multiple application groups read configurations.

• The number of retries that are allowed after a heartbeat times out is decreased.

June 17, 2024

N/A

1.11.4

New feature

Workflow IDs can be obtained by using JobContext.

March 20, 2024

JobContext parameters

Optimized feature

• Unnecessary dependencies are removed from SchedulerX SDK for Java.

• Log4j2.xml is removed from SchedulerX SDK for Java, which prevents log configuration conflicts.

N/A

1.11.1

New feature

Job parameters can be read from environment variables.

February 20, 2024

N/A

New feature

Log isolation by application is supported.

N/A

Fixed issue

• Security vulnerabilities in Netty are fixed.

• Security vulnerabilities in Logback are fixed.

• The following issue is fixed: Logs of the SchedulerX framework cannot be displayed due to log conflicts.

N/A

1.10.14

New feature

The graceful shutdown feature is supported. An application can be shut down only after all the ongoing jobs of the application are complete. This ensures service availability during the release or restart process.

January 2, 2024

Gracefully shut down jobs and tasks executed in an application

New feature

Push model jobs are optimized to support the configuration of job distribution rate.

N/A

New feature

H2 databases are optimized to support the configurations of username and password.

• spring.schedulerx2.h2DatabaseUser: the username of the H2 built-in database.

• spring.schedulerx2.h2DatabasePassword: the password of the H2 built-in database.

Connect a Spring Boot application to SchedulerX

Optimized feature

Business logs can be isolated by instance group.

N/A

Optimized feature

Broadcast jobs are optimized to support sorting and distribution by worker IP address.

N/A

Optimized feature

• Spring jobs are optimized to support Spring 4.

• You can specify scheduling methods for Spring jobs to return any processing results.

Spring jobs

Optimized feature

• SchedulerX SDK for Java is optimized to prevent heartbeat threads from being repeatedly created when Spring containers are repeatedly initialized.

• Akka Actor supports automatic restart upon unexpected termination.

N/A

Fixed issue

• The following issue is fixed: An exception is returned after Spring fails to read a processor bean.

• The following issue is fixed: Map jobs are stuck in V 1.10.x.

• The following issue is fixed: The instance of a broadcast job cannot be terminated when an exception occurs during the execution of preProcess of the broadcast job.

• The following issue is fixed: An alert is triggered due to a job execution timeout error caused by residual threads when the job instance is stopped unexpectedly.

• The following issue is fixed: The status of an application is unknown or stuck upon application startup in the shared thread pool mode.

• The following issue is fixed: The access configurations cannot be loaded as expected when multiple instance groups or AppKeys contain special characters.

• The following issue is fixed: You cannot use the features of a visual MapReduce job of the Professional edition.

N/A

Version

Type

Description

Release date

References

1.7.10

New feature

• Native and scheduled Spring jobs can be integrated.

• End-to-End tracing is supported.

August 30, 2022

• Spring jobs

• Integrate tracing analysis

Optimized feature

The response is accelerated when an agent is stopped or disconnected.

N/A

Fixed issue

• The following issue is fixed: The Out of Memory (OOM) error occurs when a large number of Simple Log Service logs are generated for a job that is scheduled frequently.

• The following issue is fixed: Large latency occurs when many second-delay jobs are run together.

N/A

1.6.1

Fixed issue

The following issue is fixed: High CPU usage is caused by second-delay broadcast detection threads.

August 3, 2022

N/A

1.6.0

New feature

Kubernetes job scheduling capabilities can be integrated.

June 24, 2022

N/A

Optimized feature

• The processor class can be used to configure the Spring Aspect Orient Programming (AOP) proxy.

• The content in the error log that is generated occasionally for an available worker monitor timer is optimized.

• Logs of second_delay jobs can be collected.

N/A

1.5.1.1

New feature

You can dynamically enable or disable the logging feature.

April 19, 2022

N/A

Fixed issue

• The following issue is fixed: V1.5.0.x is incompatible with Spring Boot 2.0.3.

• The following issue is fixed: An error may be reported during JobSyncService Bean initialization in V1.5.0.x.

1.5.0.2

New feature

Spring Boot declarative jobs are supported. You can declare namespaces, applications, jobs, and alerts by using configuration files. This facilitates job management. You can modify configuration files based on your business requirements and launch your application with a few clicks in all environments.

April 1, 2022

Scheduled jobs for Spring Cloud applications

Visualized MapReduce jobs, formerly known as parallel computing jobs, are supported. You can view the tasks of a specific visualized MapReduce job, view the logs of visualized MapReduce jobs, and rerun visualized MapReduce jobs. You can also add custom tags to tasks and filter tasks by tag.

Enterprise-class distributed batch processing solution

1.4.2

New feature

The logging feature is supported by SchedulerX V2.0. To enable the logging feature, you need to only add the Log4j or Logback configuration to the corresponding job. Then, you can view the log that is generated each time the job is triggered in the SchedulerX console. Distributed jobs also support the logging feature.

March 7, 2022

Integrate Simple Log Service with SchedulerX 2.0

You can view the stacks based on which jobs are run in the SchedulerX console. This helps troubleshoot jobs that are stuck. You must update your agent to 1.4.0 or a later version before you can view stacks.

N/A

SchedulerX can be interfaced with the executor that is developed for elastic jobs.

1.3.4

New feature

• DataWorks jobs are supported.

• schedulerx2-plugin-xxljob is added to support the XXL-JOB interface.

January 6, 2022

• DataWorks jobs

• XXL-JOB jobs

Version

Type

Description

Release date

References

1.3.2

Optimized feature

The default dependency Log4j 2 is updated to V2.15.0.

December 15, 2021

N/A

1.3.0.3

New feature

Second-delay jobs enhanced in standalone mode: Second-delay jobs can be distributed to different idle workers in standalone mode. To distribute second-delay jobs to different idle workers in standalone mode, set the spring.schedulerx2.enableSecondDelayStandaloneDispatch parameter to true. The default value of the parameter is false.

November 26, 2021

N/A

Optimized feature

The response is accelerated when an agent is stopped or disconnected.

N/A

Fixed issue

• The following issue is fixed: The running workers send heartbeats only to the specified scheduled service if an agent belongs to multiple instance groups.

• The following issue is fixed: Threads are occasionally interrupted or the null pointer exception occasionally occurs when SchedulerX schedules second-delay jobs.

• The following issue is fixed: Jobs become stuck and time out if the SchedulerX agent is integrated with a Spring Cloud application.

• The following issue is fixed: Jobs are interrupted if SchedulerX runs the jobs in parallel in broadcast mode.

• The following issue is fixed: SchedulerX fails to update the worker list when SchedulerX runs second-delay jobs.

• The following issue is fixed: The scan thread is not terminated after a second-delay job that is scheduled in broadcast mode executes the terminate instruction.

• The following issue is fixed: A second-delay job that is scheduled in broadcast mode may become stuck when a large number of workers publish the job in batches.

N/A

1.2.9.1

Fixed issue

The following issue is fixed: Jobs become stuck and time out if the worker is integrated with a Spring Cloud application.

August 30, 2021

N/A

1.2.9

New feature

Second-delay jobs enhanced in standalone mode: Second-delay jobs can be distributed to different idle workers in standalone mode. To distribute second-delay jobs to different idle workers in standalone mode, set the spring.schedulerx2.enableSecondDelayStandaloneDispatch parameter to true. The default value of the parameter is false.

August 27, 2021

N/A

Fixed issue

The following issue is fixed: Jobs are interrupted if SchedulerX runs the jobs in parallel in broadcast mode and the list of available workers is not updated.

N/A

1.2.8.3

Fixed issue

The following issue is fixed: The scan thread is not terminated after a second-delay job that is scheduled in broadcast mode executes the terminate instruction.

August 13, 2021

N/A

1.2.8.2

Fixed issue

The following issue is fixed: A second-delay job that is scheduled in broadcast mode may become stuck when a large number of workers publish the job in batches.

August 6, 2021

N/A

1.2.8

New feature

• Enhanced broadcast mode: postProcess can be used to retrieve the status (JobContext.getTaskStatuses()) and execution results (JobContext.getTaskResults()) of all workers.

• Enhanced sharding broadcast mode: JobContext can be used to retrieve the number (shardingNum) and IDs (sharingId) of shards. You can use the index of your worker to process data in a distributed manner.

• Enhanced sharding mode: JobContext can be used to retrieve the number (shardingNum) of all shards.

June 23, 2021

N/A

1.2.7

New feature

A failover switch is added to allow you to enable or disable the failover feature.

April 28, 2021

N/A

Fixed issue

• The following issue is fixed: The socket may be disclosed if the heartbeat probe fails.

• The following issue is fixed: MapTaskMaster frequently performs failovers when MapTaskMaster needs to handle a large number of tasks.

N/A

1.2.5.2

New feature

Second-delay jobs can be triggered at a millisecond granularity.

April 8, 2021

N/A

Optimized feature

• The MapReduce model is optimized. Root tasks are scheduled only to the master worker. This can help you identify the cause when exceptions occur.

• The SchedulerX agent is no longer strongly reliant on Log4j 2. If you use Logback, you can remove the Log4j and Log4j 2 dependencies.

N/A

1.2.4.3

New feature

• The progress of jobs that are scheduled in broadcast mode can be reported.

• Heartbeat logging can be enabled or disabled.

January 21, 2021

N/A

Fixed issue

• The interval of heartbeat probes is changed to 10 seconds.

• The following issue is fixed: Broadcast jobs may be stuck.

N/A

Version

Type

Description

Release date

References

1.2.3.1

Optimized feature

The following issue is fixed: Jobs cannot continue to be scheduled due to traffic surges during the persistent connection caused by heavy workloads on the SchedulerX agent.

December 16, 2020

N/A

1.2.2.2

New feature

• The actual CPU utilization of a container in a Container Service for Kubernetes (ACK) cluster can be collected. However, you must add the corresponding configurations. For example, if you use starter, you must perform the following steps: Set the spring.schedulerx2.enableCgroupMetrics parameter to true and the spring.schedulerx2.cgroupPathPrefix parameter to /sys/fs/cgroup/cpu/. If the /sys/fs/cgroup/cpu/ path exists on your container, you do not need to specify the spring.schedulerx2.cgroupPathPrefix parameter. Otherwise, you must specify the actual path of cgroup.

• Tags are supported. You can add tags to workers after you launch the SchedulerX agent. For example, if you use starter, you can set the spring.schedulerx2.labels parameter to xxx. You can specify a worker that has specific tags to run a job in the Task Management module. This feature is suitable for canary release and cell-based management scenarios.

December 10, 2020

N/A

Optimized feature

• The heartbeat thread and Akka thread of the SchedulerX agent can run independently. This ensures that heartbeat probes are not affected when the SchedulerX agent is busy.

• h2 is removed from shade. shade h2 may cause the failure to load the MySQL driver.

N/A

1.2.1.2

New feature

• The shared container pool feature is supported. All jobs that are scheduled by the SchedulerX agent can share the same thread pool. This increases the performance and stability of the SchedulerX agent when the agent needs to schedule a large number of jobs in parallel.

• Shade Scala is supported to eliminate scala conflicts.

• Authentication based on AppKeys is supported in the public cloud.

• The MapReduce model is enhanced and allows you to specify whether to perform the Reduce method only after all tasks are complete.

• The AppKey can be specified in the -Dschedulerx.appKey parameter on the SchedulerX agent.

October 20, 2020

N/A

Optimized feature

The Netty thread pool of the SchedulerX agent is optimized.

N/A

Fixed issue

• The following issue is fixed: Jobs that are scheduled in broadcast mode may become stuck.

• The following issue is fixed: The AccessKey ID or AccessKey secret of Simple Log Service is leaked.

N/A

1.2.0.2

New feature

• More than 100,000 jobs are supported by an application that is deployed in the public cloud.

• A logging switch is added to allow you to enable or disable logging for the SchedulerX agent.

• The status of a job can be configured if you use the SchedulerX API to create the job.

• The diamond-client, logger.API, and Log4j dependencies are removed.

August 19, 2020

N/A

Fixed issue

• The following issue is fixed: The SchedulerX agent disconnects from the server if you disable Internet access for the agent.

• The following issue is fixed: EDAS applications cannot read the AccessKey secret.

N/A

1.1.4.RELEASE

New feature

• Namespaces can be created.

• Multiple SchedulerX workers can be initialized at the same time.

• The MapReduce model is enhanced.

• The Reduce method can be performed even if a task fails.

• JobContext.getTaskStatuses can be used to obtain the status of a task. The key of the Map<Long,TaskStatus> structure indicates the ID of the task and the value indicates the status of the task.

May 15, 2020

N/A

Fixed issue

• The following issue is fixed: A null pointer error occurs if ProcessResult returns an empty result.

• The following issue is fixed: A job becomes stuck if thread-dispatcher-delivery becomes hung.

N/A

1.1.2.RELEASE

New feature

shade protobuf and netty from AccessKey IDka are used to eliminate more than 90% of JAR package conflicts when you connect an agent to SchedulerX.

February 10, 2020

N/A

Optimized feature

AppKeys are not supported when you create multiple groups.

N/A

Version

Type

Description

Release date

References

1.1.0

New feature

• Support for sharding models in multiple languages (similar to elastic-job): ShedulerX2.0 supports sharding models in multiple languages.

• The AppKey of a group can be returned when you use the SchedulerX API to create the group.

• Job instances that are in the Successful state can be rerun. Job instances in a workflow can rerun their jobs and their downstream jobs.

December 17, 2019

N/A

Optimized feature

• The performance of the server is optimized. The method that the server uses to communicate with the SchedulerX agent is changed from synchronous communication to asynchronous communication. The configurations of the default dispatcher of Akka are optimized.

• The performance of heartbeat probes provided by the SchedulerX agent V1.1.0 is increased by three times.

• The Task Management page in the SchedulerX console is redesigned to display more information.

N/A

Fixed issue

• The following issue is fixed: Global tasks may not take effect if the pull model is used to distribute jobs.

• The following issue is fixed: The SchedulerX agent may fail to be launched in an isolated cell environment if no domain is specified.

N/A

1.0.9

New feature

• The BlockAppStart setting is added. The setting specifies whether to block the startup of the application when SchedulerX fails to start up. The default value is true.

• An API operation is added to allow you to query the status of a workflow. The API operation is GetWorkflowInstanceRequest.

• The jobName field is added to jobContext. This allows you to obtain the name of a running job.

November 28, 2019

N/A

Fixed issue

• The following issue is fixed: The result of Hessian deserialization on BigDecimal is 0.

• The following issue is fixed: A LocalDateTime error occurs after Hessian deserialization is complete.

• The following issue is fixed: Tasks of a job fail to be scheduled to specified workers. The following issue is fixed: If a job runs for a specific period of time, the tasks of the job are scheduled to workers that you did not specify.

• The following issue is fixed: The springContext.getBean of the SchedulerX agent throws an AnnotationConfigApplicationContext has not been refreshed yet exception.

• The following issue is fixed: The ServeletWebServer of Spring Boot is terminated if the configuration of the implementation class of the job is invalid. As a result, the web service is shut down but the application process continues to run.

• The following issue is fixed: A job becomes stuck if the system enables the user.dir='/' variable.

• The following issue is fixed: The springContext.getBean of the SchedulerX agent throws an AnnotationConfigApplicationContext has been closed already exception.

• The following issue is fixed: The workerId values that are generated by the SchedulerX agent may be duplicate. As a result, the job may be scheduled to workers that do not belong to the application to which the job belongs.

• The following issue is fixed: Custom class loaders are not supported by Spring applications.

• The following issue is fixed: The counter that counts the number of times a second-delay job in broadcast mode is triggered does not display the correct value.

• The following issue is fixed: jobContext.getScheduleTime is not updated when a second-delay job is periodically scheduled.

N/A

1.0.8

New feature

• Important changes: JobProcessor.postProcess is reconfigured. ProcessResult is added to return values. You need to modify the code of the job if you use the original postProcess interface.

• The broadcast mode is enhanced. BroadcastJobProcessor supports preProcess and postProcess. All workers must perform preProcess once before they perform process. All workers must perform postProcess once after they perform process.

• JobContext.getTaskAttempt can be used to retrieve the number of times that SchedulerX attempts to run the current task.

• Custom listening ports can be specified for the SchedulerX agent. Example: SchedulerxWorker.setPort.

• JobProcessor can be implemented by Java jobs. Java jobs no longer need to inherit JavaProcessor.

August 6, 2019

N/A

Fixed issue

• The following issue is fixed: Tasks whose TaskId is set to 1 cannot be automatically retried.

• The following issue is fixed: The cause of failure is not displayed if the root task of a distributed job fails.

• The following issue is fixed: Tasks in the task list of a job that is scheduled in parallel computing mode cannot be retried.

N/A

1.0.6-compatible

Optimized feature

This SchedulerX agent version is compatible with the SchedulerX 1.0 (DTS) interface. The agent version cannot rely on both the schedulerx-client and schedulerx-worker packages. The agent version can rely on only the schedulerx-worker package. Therefore, you must migrate all Data Transmission Service (DTS) jobs to SchedulerX 2.0.

July 2, 2019

N/A

1.0.6

New feature

• shade: aliyun-log, commons-validator, gson, fastjson, guava, and commons-collections are added.

• errorMsg can be displayed in logs in the SchedulerX console if you use ProcessResult(false,errorMsg) to return execution results.

Optimized feature

• The performance of at-least-once-delivery is optimized.

• Duplicate messages are no longer submitted in heavy load scenarios. Duplicate messages caused second-delay jobs to become stuck or interrupt application threads.

July 2, 2019

Fixed issue

• The following issue is fixed: Jobs that are scheduled in broadcast mode become stuck.

• The following issue is fixed: Second-delay jobs become stuck.

• The following issue is fixed: at-least-once-delivery may cause SchedulerX to keep retrying specific tasks.

• The following issue is fixed: The SchedulerX agent fails to start up if logcollector fails to initialize.

• The following issue is fixed: A workflow cannot be recovered because the database cleans the job instances in the workflow.

• The following issue is fixed: kill is not supported if the application is launched by using Spring.

1.0.3

New feature

• The execution results of all tasks can be returned by the MapReduce model and processed by using the Reduce method.

• The pull model is supported for jobs that use distributed programming models. This model can eliminate the barrel effect that occurs due to the limited performance of standalone computing. This model allows workers to dynamically scale out to pull tasks.

• The global degree of concurrency can be configured for tasks if you use the pull mode. This helps you limit the number of concurrent tasks.

• wfInstanceId is added to JobContext.

• The startup of the Java virtual machine (JVM) is blocked when the SchedulerX agent fails to be started and an exception occurs. This allows you to troubleshoot issues at the earliest opportunity.

• The SchedulerX agent prints the JAR version and path on which Maven relies when the SchedulerX agent starts up. This helps you troubleshoot JAR package conflicts.

• Distributed programming models can return details about tasks. You can view the queue of tasks that are cached on each worker.

June 6, 2019

N/A

Fixed issue

• Workers that are quarantined by mistake due to high workloads on servers can be automatically recovered without restarting the SchedulerX agent.

• Distributed programming models can return details about tasks. You can view the number of tasks that run on each worker.

• The server automatically cleans the resources on slave nodes to prevent memory leaks if the master node fails.

N/A

1.0.0

New feature

• The following expressions are supported when you create a periodic scheduling job: crontab and fixed_rate.

• Workflows are supported. You can create workflows to orchestrate jobs.

• Second-delay expressions are supported. You can use second-delay expressions to create second-delay jobs.

• Jobs that use the following programming languages are supported: Java, Shell, Python, and Go.

• The following execution modes are supported: standalone, broadcast, parallel computing, memory grid, and grid computing.

• The following distributed programming models are supported: Map and MapReduce.

• SchedulerX can be configured to automatically retry failed job instances or tasks. By default, this feature is disabled.

• Time-series data is supported and the outputs of jobs can be updated.

April 30, 2019

N/A