You are viewing the documentation for Blueriq 17. Documentation for other versions is available in our documentation directory.

Introduction

This page shows possible configuration setups for Basic Scheduler.

For an overview about scheduler properties, read Properties Overview.

  1. In case your project does not have a Process Engine, no configuration has to be made. Quartz is used for projects which contain either timers, priority algorithms, automatic or expiration tasks.

  2. In case your project has a Process Engine with no scheduled tasks and
    1. your runtime uses spring config additional location, please read Setup Quartz With Spring Config Location.
    2. your runtime does not use a spring config additional location, please read Setup Quartz With No Spring Config Location.
    3. your runtime uses spring cloud config, please read Setup Quartz With Spring Cloud Location.

  3. In case your project has a Process Engine with already scheduled tasks
    1. first read Setup Quartz with scheduled tasks.
    2. and then one of the configurations from (2) point.

  4. In case you want to setup quartz in a cluster, please read Setup Quartz in Cluster.


aTable of Contents

Properties

Quartz is configured using a set of properties that are available for the Runtime. Quartz uses a job store in order to persist jobs details, triggers and other job related information.

All quartz related properties are stored in application-scheduler-quartz.properties in spring.config.additional-location.

Read best practices to know every insight on how to use these properties.

 

For more information visit Quartz Scheduler Configuration.

 

Properties
JobStore Properties
Quartz Property KeyExample ValueDefault ValueDescription
spring.quartz.job-store-typejdbcmemory

The type of job store to be used by quartz.
Do not use memory in production environments as there is no way to save quartz jobs during downtime.

The preferred way is to use Direct or JNDI Connection.
To configure a Direct or JNDI Connection please visit Quartz Scheduler Configuration.

spring.quartz.properties.org.quartz.jobStore.tablePrefixQRTZ_QRTZ_ The table prefix you used for quartz tables in your database. In case of an in-memory connection, this property is not required.
spring.quartz.properties.org.quartz.jobStore.dataSourceNAMEnull Represents the name of your datasource. It can be any string, but be sure you will use the same value for your datasource properties described in the next section.
spring.quartz.properties.org.quartz.jobStore.misfireThreshold6000060000

The number of milliseconds the scheduler will tolerate a trigger to pass its next-fire-time by, before being considered misfired.

In case you do not specify this property, 60 sec is considered as misfire.

Datasource Properties in external datasources
blueriq.datasource.scheduler-quartz.url com.microsoft.sqlserver.jdbc.SQLServerDrivernullJava class name of JDBC driver for your database connection.

To configure other types of datasources, visit Quartz Scheduler Configuration .
blueriq.datasource.scheduler-quartz.urljdbc:sqlserver://[host]:[port];databaseName=[dbname];instance=SQLEXPRESSnull Url Connection to your database.
blueriq.datasource.scheduler-quartz.username test"" Username which is used for connecting to the database.
blueriq.datasource.scheduler-quartz.password test""Password which is used for connecting to the database. 
Thread Pool Properties
spring.quartz.properties.org.quartz.threadPool.classorg.quartz.simpl.SimpleThreadPoolnullThe name of thread pool implementation you want to use.
spring.quartz.properties.org.quartz.threadPool.threadCount30-1Represents the number of threads that are available for concurrent execution of jobs.
Clustered Environment Properties
spring.quartz.properties.org.quartz.jobStore.isClusteredtruefalseEnables clustering.
spring.quartz.properties.org.quartz.jobStore.clusterCheckinInterval9000015000Represents the number of threads that are available for concurrent execution of jobs.
Quartz Scheduler Properties
spring.quartz.properties.org.quartz.scheduler.instanceNameMySchedulerQuartzSchedulerName of the cluster. Must be the same for all nodes in the cluster.

spring.quartz.properties.org.quartz.scheduler.instanceIdAUTONON_CLUSTERED

Instance id of the quartz node. 

Each node in the cluster must use a unique instanceId. (This is done by setting AUTO)

spring.quartz.properties.org.quartz.scheduler.skipUpdateChecktruefalse

If this is true, quartz skips running a request which checks if there is an updated version of Quartz available.

It is recommended to be true for production environment so Quartz updates do not interfere with the application.



Installation

Steps:

  1. Add scheduler-quartz to the list of spring active profiles in the bootstrap.properties (this profile is active when using the installer). More information on how to configure the application using Spring Profiles can be found here: External application configuration with Spring Profiles.
  2. Add the application-scheduler-quartz.properties file in the configuration location. This properties file is added in the 
    spring.config.additional-location
    when using the installer. Otherwise, please create this according to the documentation below.
  3. Run the provided scripts for creating the quartz tables in the database: msssql.sql or oracle.sql. The scripts are located in the release zip in \Runtime\Java\Webapp\DBScripts\blueriq-component-scheduler-quartz
  4. Define quartz database connection in the application-externaldatasources.properties file.


Steps 3 and 4 are applicable only if a job store database connection is chosen instead of in memory job store.


Configuration

Every Quartz configuration property has to be specified in application-scheduler-quartz.properties for Runtime.


In order to tune resources for job execution we provided a few details about the Thread Pool.

Quartz is configured using a set of properties. Quartz uses a job store in order to persist jobs details, triggers and other job related information. We support two types of job stores:


Memory (default)

Info

This is the default configuration for java environments.
For more details about in memory job store configuration please visit Config RAM Job Store.

By default memory mode is enabled which should not be used unless for demo's and standalone development. For recommended settings please check the database settings. For memory the following setting should appear in the application-scheduler-quartz.properties.

application-scheduler-quartz.properties
spring.quartz.job-store-type=memory


Database

Scripts to create the required database content are provided for the following databases:

  • SQL Server
  • Oracle
  • PostgreSQL

There are two types of connection that are supported:

Generate the Quartz Database

Generate the quartz database with respect to the database used (either oracle, mssql or postgresql).

In the blueriq deliverable there is a scheduler-quartz-component that contains sql scripts. Use the favorite database viewer to run those scripts against the database server.

  1. Connect to the database server with the favorite viewer.
  2. Create a new database dedicated to quartz - pick a meaningful name for this, e.g. 'QuartzScheduler'.
  3. Depending on the database viewer used, one must make sure that the new database created is selected and set by default in the editor.
  4. Import the mssql.sql (for mssql server) or oracle.sql (for oracle server) and run it in the editor. If the run was successful new tables should be present under the newly created database.

JDBC Connection

To enable the JDBC Connection the externaldatasources profile must enabled and the following properties have to be used:

application-scheduler-quartz.properties
spring.quartz.job-store-type=jdbc
spring.quartz.properties.org.quartz.jobStore.tablePrefix=QRTZ_

# This example we use MSSQL, please check the online quartz documentation which driverDelegateClass to use
# Note that for Oracle, no driverDelegateClass is needed
spring.quartz.properties.org.quartz.jobStore.driverDelegateClass=org.quartz.impl.jdbcjobstore.MSSQLDelegate
application-externaldatasources.properties - mssql
blueriq.datasource.scheduler-quartz.driverClassName=com.microsoft.sqlserver.jdbc.SQLServerDriver
blueriq.dataSource.scheduler-quartz.url=jdbc:sqlserver://<server_url>:<port>;databaseName=<database_name>;instance=<instance_name>
blueriq.datasource.scheduler-quartz.username=<user>
blueriq.datasource.scheduler-quartz.password=<password>
application-externaldatasources.properties - oracle
blueriq.datasource.scheduler-quartz.driverClassName=oracle.jdbc.driver.OracleDriver
blueriq.dataSource.scheduler-quartz.url=jdbc:oracle:thin:@<server_url>:<port>:xe
blueriq.datasource.scheduler-quartz.username=<user>
blueriq.datasource.scheduler-quartz.password=<password>


If necessary, create a new datasource. See Configuring JDBC database drivers for information on how to do this.

JobStoreTX allows Quartz managing quartz related transactions. 

JDBCJobStore’s “table prefix” property is a string equal to the prefix given to Quartz’s tables that were created in your database. You can have multiple sets of Quartz’s tables within the same database if they use different table prefixes.

 

When changing the org.quartz.jobStore.tablePrefix, please change the create scripts accordingly.

 

For more information and properties related to the connection JobStoreTX please visit JDBC-JobStoreTX.

 

JNDI Connection

 

To enable JNDI Connection jndidatasources profile must be activated and the following properties have to be used:

application-scheduler-quartz.properties
spring.quartz.properties.org.quartz.jobStore.class = org.quartz.impl.jdbcjobstore.JobStoreCMT
spring.quartz.properties.org.quartz.jobStore.tablePrefix = QRTZ_

# This example we use MSSQL, please check the online quartz documentation which driverDelegateClass to use
# Note that for Oracle, no driverDelegateClass is needed
spring.quartz.properties.org.quartz.jobStore.driverDelegateClass = org.quartz.impl.jdbcjobstore.MSSQLDelegate
spring.quartz.job-store-type = jdbc

 

The scheduler always uses the datasource with the name scheduler-quartz which we define inside application-jndidatasources.properties:

application-jndidatasources.properties - jndi
# JBoss Example provided that the jndi name is set to java:jboss/jdbc/quartzdb
blueriq.datasource.scheduler-quartz.jndiName = java:jboss/jdbc/quartzdb

# Tomcat Example provided that the jndi name is set to jdbc/quartzdb
blueriq.datasource.scheduler-quartz.jndiName = java:/comp/env/jdbc/quartzdb

 

JobStoreCMT relies upon transactions being managed by the application which is using Quartz.

For more information and properties related to the connection JobStoreCMT please visit JDBC-JobStoreCMT.

 

Thread Pool

If the Database configuration is chosen we recommend to also add the thread pool with the following default values:

Each DCM project gets it's own trigger. The process engine only allows one process engine (one project) to evaluate timers at a time. Setting the threadCount higher then 1 only will only create waiting threads, this means the best setting for threadCount is 1.

The quartz documentation suggests the following configuration: provided that the database allows X connections, then the threadCount should never be higher then X - 3.

Thread Pool properties are the following:

application-scheduler-quartz.properties
spring.quartz.properties.org.quartz.threadPool.class = org.quartz.simpl.SimpleThreadPool
spring.quartz.properties.org.quartz.threadPool.threadCount = 1

For more information and properties related to Quartz ThreadPool, please visit ThreadPool Configuration

Cluster

Info

Clustered environment can be configured only for JDBC JobStore (JobStoreTX and JobStoreCMT).
For more information about clustered setup read Configuring Clustered Environment.

In order to run the Quartz Scheduler on multiple Runtime instances in a cluster, every Runtime instance has to be identical and have the same projects installed.
Each instance in the cluster needs to have the same  application-scheduler-quartz.properties files. You may set different thread pool size on each node.

To read more about quartz clustered environment visit Quartz in Cluster.


To set up quartz in cluster create the following two files and place them in your spring config additional location:

  1. Create a application-scheduler-quartz.properties file (check Quartz Properties Cluster for an example)
    Make sure the following were added:
         1.1 Set spring.quartz.properties.org.quartz.jobStore.isClustered to true
         1.2 Set spring.quartz.properties.org.quartz.scheduler.instanceId to AUTO, or a different id for each instance node.

  2. Create application-scheduler-quartz.properties file


Do not enable this setting in clustered environment

When quartz is used in a clustered environment one must not set the blueriq.processengine.cancel-started-tasks=true. The property can be set in the application-scheduler-quartz.properties file and the default value is false.

When a single server is restarted and the blueriq.processengine.cancel-started-tasks is set to true all opened task are reset so they can be opened again.
In a multi node environment the danger is when a single node is restarted and could result in having all tasks that are in progress being reset while they are still in progress on the other server.

Cluster properties example

applcation-scheduler-quartz.properties - cluster
spring.quartz.properties.org.quartz.threadPool.class=org.quartz.simpl.SimpleThreadPool
spring.quartz.properties.org.quartz.threadPool.threadCount=2

spring.quartz.properties.org.quartz.jobStore.class=org.quartz.impl.jdbcjobstore.JobStoreTX
spring.quartz.properties.org.quartz.jobStore.tablePrefix=QRTZ_

spring.quartz.properties.org.quartz.jobStore.isClustered = true
spring.quartz.properties.org.quartz.jobStore.clusterCheckinInterval = 90000
spring.quartz.properties.org.quartz.scheduler.instanceName = MyClusteredScheduler
spring.quartz.properties.org.quartz.scheduler.instanceId = AUTO
spring.quartz.properties.org.quartz.scheduler.skipUpdateCheck = true

 

Scheduler Maintenance Properties

In this section you can find a list of scheduler related properties. These should be placed in a file named application-scheduler-quartz.properties in spring.config.additional-location.
These properties are needed to enable or personalize scheduler functionalities from blueriq runtime perspective.
Properties
Blueriq Property KeyDefault ValueDescription
blueriq.scheduler-quartz.retryInterval30Represents a number in minutes, which is used for jobs retry mechanism in case of misfire.

For more information about this property visit  Retry Interval.


Examples

Default configuration file:

application-scheduler-quartz.properties
blueriq.scheduler-quartz.enable-task-migration=false
blueriq.scheduler-quartz.retryInterval=30


Retry Interval

If the case is locked when a timer job or expiring job is fired a new quartz job will be scheduled. The reschedule interval for this job can be configured in minutes, with a property in application-scheduler-quartz.properties file. The default value is 30 minutes.

application-scheduler-quartz.properties
blueriq.scheduler-quartz.retryInterval=30


Setup Quartz

Various spring configurations

Using spring cloud config

Configure the runtime in cloud. For more details about how to do this visit The runtime in the cloud.

Actions

  1. Place your scheduler properties in application-scheduler-quartz.properties (Check here for example) in the searchLocations you specified for spring cloud.
  2. Place application-externaldatasources.properties or application-jndidasarouces.properties files in the searchLocations you specified for spring cloud.

Not using spring config additional location

Default quartz properties will be used because application-scheduler-quartz.properties file is not present. The default setup is in-memory configuration.

Scheduler properties can be personalized via JVM arguments:

JVM Arguments
-Dblueriq.scheduler-quartz.enable-task-migration=false
-Dblueriq.scheduler-quartz.retryInterval=30

If no property is defined, the default ones will be used.

Using spring config additional location

Configure a spring.config.additional-location for your application. For more details about how to do this visit Installing Runtime.

  1. In spring.config.additional-location folder place the application-scheduler-quartz.properties (Check here for example) file.
  2. In spring.config.additional-location folder place the application-externaldatasources.properties or application-jndidasarouces.properties files

Using existing scheduled tasks

In order for the already scheduled tasks to be executed in time, you need to do a migration to the scheduler.

Before running the migration you need to create the following files and place them in your spring.config.additional-location folder:

  • Create a application-scheduler-quartz.properties file with one of the following configurations: Direct Connection(MsSqlOracle), JNDI Connection.
    We advise you not to use an In-Memory Configuration or leave the default one for this purpose.
  • In the application-scheduler-quartz.properties file, set blueriq.scheduler-quartz.enable-task-scheduler and blueriq.scheduler-quartz.enable-task-migration to true (Check here for example).

Setup quartz in cluster

Overview

Basic Scheduler

The quartz evaluation of time dependent tasks (timer nodes, tasks with priority algorithms, expiration tasks, automatic recovery tasks) is done per Process Engine per Project installed on the Runtime. A quartz job is created for every single project which uses a process engine in the cluster. The number of jobs in Quartz equals with the number of initialized projects from the cluster which are using a process engine. The number of jobs in quartz does not depend on the number of runtime instances available in the cluster.

An interval is defined in the application.properties file which marks the triggering and execution of the job. If the interval is MINUTE, the quartz job will be triggered and executed every minute. The execution consists in finding and evaluating all the timer tasks, expiration tasks, tasks with priority which should fire in that period.
The Runtime instances are selected for execution almost randomly, more busy servers have a lower chance to be selected for the execution.The main advantage for this is that:  As multiple runtime instances are available in cluster, the execution of the jobs might be done in parallel.

The quartz job is created in the cluster when the project which uses a process engine is initialized. This means whenever a project is published and the process engine is initialized in a Runtime, that Runtime will try to start the job for the project if the job is not already created.

The execution of quartz jobs is being done on any Runtime in the cluster as soon as the Runtime is started. This might happen even though in that Runtime no projects are published yet. 

Troubleshooting

There might be a side scenario in which one runtime in a cluster does not have all the projects available but it is started. In this case, Quartz might trigger a job on that server without having a project to run on. If this happens the job for that project is deleted and won't trigger until the project is loaded - this usually means that there is a configuration problem in the cluster. Loading/publishing a project in a Runtime will trigger the creation of the job in the cluster if the job doesn't already exist.

If you're uncertain that a job is running or not, you can check the logs. Starting or deleting a job is always logged. Besides this you can check the quartz database. In the table QRTZ_JOB_DETAILS there should be a column JOB_NAME. That field should contain the project and process engine name for which that job was created.

It is very recommended that no changes to be done in quartz tables and you let only Quartz manage the data there.

For more information on quartz configurations, please visit: Quartz-Scheduler.org.

Atomikos transaction log

If you want to run multiple runtimes on one machine, Atomikos tends to fail to access it's transaction log. This will result in a runtime that doesn't start.

To fix this problem, add a VM argument to one of your runtimes to set the folder of the Atomikos transaction log files to something other than the default (which is '${user.home}').


-Dcom.atomikos.icatch.log_base_dir=C:/tmlogs/tmlog-development/


For more information please refer to the Atomikos documentation

https://www.atomikos.com/Documentation/JtaProperties#Transaction_logs