How to Nest Parallel Executing Jobs in a Job Chain

Scope

• Use Case
  • Run parts of a job chain in parallel, where the i.e.
    
    • split jobs for parallel processing,
    • join up jobs after parallel processing.
• Solution Outline
  • Two standard JITL Jobs are provided for this:
    • JobSchedulerJobChainSplitter
      
      • splits an incoming order into multiple orders that are run in parallel through a job chain within a range of predefined job chain nodes.
    • JobSchedulerJoinOrders
      
      • joins the orders that have previously been split in a job chain node, i.e. this job forces any split orders to complete to this job chain node before processing continues.
• References
  • How to Execute Jobs in a Job Chain in Parallel for an overview of the methods available for Parallel Execution within a Job Chain
  • Example showing how to set up a splitter job

Solution

• Download nested_parallel_execution.zip
• Extract the archive to a folder ./config/live of your JobScheduler Master installation.
• The archive will extract the files to a folder nested_parallel_execution. 
• You can save the sample files in any folder as you like, the solution does not require the use of specific folder names. Job names can be freely chosen, with the exception of JITL jobs - which here are JobChainSplitter and join.

Job Chain Pattern