Page History

Running multiple instances of the JobScheduler Universal Agent

Multiple instances of the JobScheduler Universal Agent on can be operated the same computer

...

. This allows, for example, jobs to be executed for different user accounts.

...

Multiple instances only require a full installation of a single Universal Agent to be carried out on each computer. Each instance only then requires the creation of a separate start script, and log and configuration files. Note that each Agent instance has to use a different port for listening to requests from a JobScheduler Master.

Universal Agent instance installation - an overview

The installation of a first Universal Agent is described in the JobScheduler Universal Agent - Installation & Operation article. 

Once the first Universal Agent has been installed:

• Find the Create an instance startscript for each JobScheduler Agent instance.
  You find a templatejobscheduler_agent_instance.(sh|cmd)-example for an instance script template in the ./bin directory of the JobScheduler Agent installation since release 1.10.
  • Templates 2.Here you can download the templates for Unix and for Windows for releases before 1.10.2.Copy this previous releases can be downloaded if required.
• Copy the template to jobscheduler_agent_<port>.(sh|cmd) where <port> is the port that the Agent is listening to listen on.
• The instance script has first the setting of includes settings for the environment variables and then it calls for calling the Agent startscript start script (./bin/jobscheduler_agent.(sh|cmd)).
  • Configure the instance script with a text editor and set the environment variables which are already described in  as described in the following two sections of this article.
    
    • Note that the environment variables are described in slightly more detail in the JobScheduler Universal Agent - Installation & Operation article.
• Now you You can start and stop etc. the JobScheduler Agent with the instance script where you no longer need to and you will not have to use command line options like such as -http-port, -ip-address, -kill-script and -java-options because as they are specified by the environment variables specified in the instance script.
• On Unix you can use the instance script as a service init script in /etc/init.d or corresponding locations for an automated start-up and shutdown.
• On Windows the instance script is used to create a service for an automated start-up and shutdown.
  

...

Manually creating and

...

configuring a JobScheduler Universal Agent instance on Unix

• We assume that the JobScheduler Agent instance should listen to port 4445 4441 for example (the default is 4445).

  Code Block
  language bash title create instance script for an Agent with port 44454441
  > cp ./bin/jobscheduler_agent_instance.sh-example ./bin/jobscheduler_agent_44454441.sh

• Edit the ./bin/jobscheduler_agent_

  4445

  4441.sh script.

  You find the  environment variables  of the JobScheduler Universal Agent.

  • All variables are still undefined All environment variables in the instance script so that defaults are usedare initially commented out -  the default values will be used unless they are configured.

  • If you want to set a an environment variable then the line with the variable has to be uncommented .and a value specified following the syntax:

    • ENVIRONMENT_VARIABLE=value

      SCHEDULER_HOME

      This variable has to point to the installation path of the JobScheduler Universal Agent

    (

    • , e.g. /opt/sos-berlin.com/jobscheduler_agent

    )

    • . If the instance script is

    only

    • exclusively used in the current ./bin directory then this variable can remain

    undefined

    • unused.. Note This setting is required if the instance script is used as a service init script in /ect/init.d to find the Agent installation!

      SCHEDULER_USER

    Sets

    • Specifies the user account that the JobScheduler Agent is operated for. This includes running jobs with the permissions of the specified user. Without setting this environment variable the user account that runs the start script is used. Note This setting is required if the instance script is used as a service init script in /ect/init.d to avoid that the Agent runs with the root user!
      SCHEDULER_HTTP_PORT	The http port of the Agent.

    It

    • This has to be the same value

    like

    • as the suffix in the instance script basename. In this example Code Block SCHEDULER_HTTP_PORT=4441 This option can be also used for indicating which network interfaces the JobScheduler Agent should listen to if you additionally specify a hostname or ip address. Code Block SCHEDULER_HTTP

    _PORT=4445

    • _PORT=localhost:4441
      SCHEDULER_HTTPS_PORT	The https port of the Agent. Code Block SCHEDULER_HTTPS_PORT=40441 This option can be also used for indicating which network interfaces the JobScheduler Agent should listen to if you additionally specify a hostname or ip address. Code Block SCHEDULER_HTTPS_PORT=123.456.789:40441
      SCHEDULER_DATA	Set the directory where the JobScheduler Agent has the configuration, logs, etc. This directory must be unique for each instance of the JobScheduler Agent. The default is: Code Block SCHEDULER_HOME/var_SCHEDULER_HTTP_PORT Make sure that the JobScheduler Agent user has read/write permissions.
      SCHEDULER_LOG_DIR	Set the directory where the JobScheduler Agent log

    file is

    • files are created. The default location is SCHEDULER_HOME/logs. It is recommended to use the same log directory for all instances. According to the Linux Filesystem Hierarchy Standard (FHS) you can

    set

    • use for example Code Block SCHEDULER_LOG_DIR=/var/log/jobscheduler/agent Note Make sure that the SCHEDULER_USER has read and write permissions in SCHEDULER_LOG_DIR. If you use the same SCHEDULER_LOG_DIR for all instances then make sure that the SCHEDULER_USER of all instances has read and write permissions.
      SCHEDULER_PID_FILE_DIR	Set the directory where the JobScheduler Agent pid file is created. The default location is SCHEDULER_LOG_DIR. Note Make sure that the SCHEDULER_USER has read and write permissions in SCHEDULER_PID_FILE_DIR. If you use the same SCHEDULER_PID_FILE_DIR for all instances then make sure that the SCHEDULER_USER of all instances has read and write permissions.
      SCHEDULER_WORK_DIR	The default working directory of the JobScheduler Agent is SCHEDULER_HOME.

    Here you

    • You can

    set

    • specify a different working

    (

    • directory, e.g. $HOME

    )

    • .

  • According to the shell in use you can set the environment variables except SCHEDULER_HOME, SCHEDULER_HTTP_PORT and SCHEDULER_USER in a ~/.profile or ~/.bashrc file too.

  • Info
    title Note
    An often-used minimum configuration is: Code Block language text ... SCHEDULER_HOME=/opt/sos-berlin.com/jobscheduler/jobscheduler_agent ... SCHEDULER_USER=sos ... SCHEDULER_HTTP_PORT=4441 ... SCHEDULER_LOG_DIR=/var/log/sos-berlin.com/jobscheduler/agent ... Note that in this example configuration, the Universal Agent is being installed in a directory with restricted permissions, /opt/. In this case, even if the sos user is a member of sudoers, the  SCHEDULER_LOG_DIR variable should be set to a directory where the sos user is able to write without requiring elevated permissions. If this is not the case the agent will not be able to execute any tasks.

• If you want to install a JobScheduler Agent service for an automated start-up and shutdown then copy this instance script to /ect/init.d or corresponding locations.

  Code Block
  language bash title create a service init script set automated start-up and shutdown
  > cp ./bin/jobscheduler_agent_44454441.sh /etc/init.d/jobscheduler_agent_44454441 > # on SuSe or CentOS > chkconfig jobscheduler_agent_44454441 > # on Ubuntu or Debian > update-rc.d jobscheduler_agent_44454441 default

...

Manually creating and

...

configuring a JobScheduler Universal Agent instance on Windows

For Windows exists an installer which An installer is available for Windows that you can download here. The following describes steps explain how you to manually create an instance manually.

• We assume that the JobScheduler Agent instance should listen to port 4445 4441 for example (the default is 4445).

  Code Block
  language bash title create instance script for an Agent with port 44454441
  > copy .\bin\jobscheduler_agent_instance.cmd-example .\bin\jobscheduler_agent_44454441.cmd

• Edit the .\bin\jobscheduler_agent_44454441.cmd.

• You find Find the  environment variables of the JobScheduler Universal Agent.

  • All environment variables are still undefined commented out in the instance script so that defaults , i.e. the default values are used.

  • If you want to set a an environment variable then the line with the variable has to be uncommented.

    SCHEDULER_HOME	This variable has to point to the installation path of the JobScheduler Universal Agent (e.g. C:\Program Files\sos-berlin.com\jobscheduler_agent). This variable is only required if this instance script is moved outside the folder where the startscript start script .\bin\jobscheduler_agent.cmd is located. There is no reason on Windows to move this script to a different folder so this variable can normally remain undefinedunused.
    SCHEDULER_HTTP_PORT	The port of the Agent. It has to be the same value like as the suffix in the instance script basename. In this example Code Block set /a SCHEDULER_HTTP_PORT=44454441 This option can be also used for indicating which network interfaces the JobScheduler Agent should listen to if you specify a hostname or ip address in addition. Code Block set /a SCHEDULER_HTTP_PORT=localhost:4441
    SCHEDULER_HTTPS_PORT	The https port of the Agent. Code Block set /a SCHEDULER_HTTPS_PORT=40441 This option can be also used for indicating which network interfaces the JobScheduler Agent should listen to if you specify a hostname or ip address in addition. Code Block set /a SCHEDULER_HTTPS_PORT=123.456.789:40441
    SCHEDULER_DATA	Set the directory where the JobScheduler Agent has the configuration, logs, etc. This directory must be unique for each instance of the JobScheduler Agent. The following will create the directory  alongside a directory created by the Universal Agent Windows Installer: Code Block C:\ProgramData\sos-berlin.com\jobscheduler\agent_4441 Make sure that the JobScheduler Agent user has read/write permissions.
    SCHEDULER_LOG_DIR	Set the directory where the JobScheduler Agent log file is files are created. The default location is SCHEDULER_HOME/logs. It is recommended to use the same log directory for all instances. If the installation path of the JobScheduler Agent is located in C:\Program Files then due to the required permissions it is recommended caused by the permissions to set this variable to a different folder, e.g. Code Block set SCHEDULER_LOG_DIR=C:\ProgramData\sos-berlin.com\jobscheduler\agent\logs Note The JobScheduler Agent is installed as a service. Make sure that the service account has read and write permissions in SCHEDULER_LOG_DIR. If you use the same SCHEDULER_LOG_DIR for all instances then make sure that all service accounts have read and write permissions.
    SCHEDULER_PID_FILE_DIR	Set the directory where the JobScheduler Agent pid file is created. The default location is SCHEDULER_LOG_DIR. Note The JobScheduler Agent is installed as a service. Make sure that the service account has read and write permissions in SCHEDULER_PID_FILE_DIR. If you use the same SCHEDULER_PID_FILE_DIR for all instances then make sure that all service accounts have read and write permissions.
    SCHEDULER_WORK_DIR	The default working directory of the JobScheduler Agent is SCHEDULER_HOME. Here you You can set a different working (directory, e.g. %USERPROFILE%).

  • create the service with the instance script

    Code Block
    > .\bin\jobscheduler_agent_44454441.cmd install-service

  • The service runs now with the local system account. Set Specify a different user account of for the service if necessaryrequired.
    
    • For this open the .\service\sos_jobscheduler_agent_4445w.exe, go to the  Open the Windows service panel for the service name SOS JobScheduler Agent -port=4441 and navigate to the tab "Log On", choose "This account" and type add the account in with the form syntax DOMAIN\USER and the corresponding password.

...