Agent Startup
Start Script: agent.sh, agent.cmd
The JS7 Agent includes a Start Script for managing the Agent:
- The default location of the
/opt/sos-berlin.com/js7/agent/bin/agent.sh
on Unix andC:\Program Files\sos-berlin.com\js7\agent\bin\agent.cmd
on Windows.
Usage
Running the Agent Start Script without parameters displays the usage clause:
Usage: agent.sh command [options] command: start [options] start_docker [options] stop [options] abort [options] restart [options] status [options] kill [options] cert [cert-options] | see https://kb.sos-berlin.com/x/jLbAAw options: --http-port=<[hostname or ip address:]number> | default: 4445 --https-port=<[hostname or ip address:]number> | default: --data-directory=<location of data directory> | default: /var/sos-berlin.com/js7/agent/var_4445 --config-directory=<location of config directory> | default: /var/sos-berlin.com/js7/agent/var_4445/config --sigkill | only for stop and restart; running tasks will be killed --kill-script=<location of kill script> | only for start --java-options=<java options> | default: -Xms100m -Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j2.asyncLoggerWaitStrategy=Block; see https://kb.sos-berlin.com/x/aIC9 see https://kb.sos-berlin.com/x/fAmGAw for more information.
Usage: agent.cmd command [options] command: start [options] start_docker [options] stop [options] abort [options] restart [options] status [options] kill [options] cert [cert-options] | see https://kb.sos-berlin.com/x/jLbAAw options: --http-port=<[hostname or ip address:]number> | default: 4445 --https-port=<[hostname or ip address:]number> | default: --data-directory=<location of data directory> | default: /var/sos-berlin.com/js7/agent/var_4445 --config-directory=<location of config directory> | default: /var/sos-berlin.com/js7/agent/var_4445/config --sigkill | only for stop and restart; running tasks will be killed --kill-script=<location of kill script> | only for start --java-options=<java options> | default: -Xms100m -Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j2.asyncLoggerWaitStrategy=Block; see https://kb.sos-berlin.com/x/aIC9 see https://kb.sos-berlin.com/x/fAmGAw for more information.
Command Line Options
--http-port=<[hostname or ip address:]number>
- Specifies the HTTP port that the Agent is listening to in order to receive requests from a JS7 Controller:
agent.sh|cmd --http-port=####
- where
####
is the numeric port. - This option can be used to indicate which network interface the JS7 Agent should listen to if in addition you specify a hostname or IP address for example with
--http-port=myhost:4445
.
- Without this option being used the port defaults to
4445
and the Agent listens to all available network interfaces. - Should you want to specify a port then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JS7_AGENT_HTTP_PORT
(see below) - Third precedence: use of default value
- Specifies the HTTP port that the Agent is listening to in order to receive requests from a JS7 Controller:
--https-port=<[hostname or ip address:]number>
- Specifies the HTTPS port that the Agent is listening to in order to receive requests from a Controller:
agent.sh|cmd command --https-port=####
- where
####
is the numeric port. - This option can be used to indicate which network interfaces the Agent should listen to if in addition you specify a hostname or IP address for example with
--https-port=myhost:4445
.
- When using the HTTPS protocol for connections from a Controller instance consider additionally allowing the HTTP protocol for local connections as with
--http-port=localhost:4445
. As the Agent Start Script makes use of an HTTP connection this protocol has to be in place to allow the Agent to be started, stopped, etc. by its Start Script. - Without this option being used the port defaults to
4445
and the Agent listens to all available network interfaces. - Should you want to specify a port then the following precedence applies:
- First precedence: command line option
- Second precedence: environment variable
SJS7_AGENT_HTTPS_PORT
(see below) - Third precedence: use of default value
- Specifies the HTTPS port that the Agent is listening to in order to receive requests from a Controller:
--data-directory=<location of data directory>
- Specifies the location of the data directory that usually includes the
config
,logs, tmp
andstate
directories. - This location has to be unique for any Agent instances
- Should you want to specify a data directory then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JS7_AGENT_DATA
(see below) - Third precedence: use of default value
JS7_AGENT_HOME/var_<JS7_AGENT_PORT>
- Specifies the location of the data directory that usually includes the
--config-directory=<location of config directory>
- Specifies the location of the
config
directory for configuration data. - This location has to be unique for any Agent instances.
- Should you want to specify a configuration directory then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JS7_AGENT_CONFIG_DIR
(see below) - Third precedence: use of default value
JS7_AGENT_HOME/var_<JS7_AGENT_PORT>
- Specifies the location of the
--sigkill
With the
stop
andrestart
commands this option kills any running processes of a job by use of a SIGKILL signal.
--kill-script=<location of kill script>
The kill script provides the functionality to kill tasks and any child processes of jobs.
- Kill scripts are by default provided from the following locations:
JS7_AGENT_DATA/tmp/kill_task.sh
for Unix.JS7_AGENT_DATA\tmp\kill_task.cmd
for Windows.
This option can be used to specify the location of an individual "kill script" if required.
Should you want to specify an individual "kill script" then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JS7_AGENT_KILL_SCRIPT
(see below) - Third precedence: use of default value
--java-options=<java options>
With Java 1.8 the initial memory allocation has changed, for details see How to manage the Java heap space.
This option can be used to apply Java options for the Agent, e.g. for memory settings.
Without this option being used the Java options default to '-Xms100m'.
Should you want to specify the Java options then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JAVA_OPTIONS
(see below) - Third precedence: use of default value
--job-java-options=<java options>
Without this option being used the Java options apply for each job which is started by the Agent.
Should you want to specify the Java options for execution of JITL and JVM jobs then the following precedence order applies:
- First precedence: command line option
- Second precedence: environment variable
JS7_AGENT_JOB_JAVA_OPTIONS
(see below)
Instance Start Script: agent_<port>.sh, agent_<port>.cmd
The JS7 Agent includes a template file for an Instance Start Script that can be adjusted to specify startup parameters.
- The Instance Start Script sets a number of environment variables and finally executes the Start Script.
- In the Instance Start Script you can adjust startup parameters from environment variables, see below.
It is recommended that an individual Instance Start Script from the template file is created as this allows individual startup parameters to specified by using environment variables.
Location
- The default location of the Instance Start Script template file is:
/opt/sos-berlin.com/js7/agent/bin/agent_instance.sh-example
on Unix systems andC:\Program Files\sos-berlin.com\js7\agent\bin\agent_instance.cmd-example
on Windows.
- Create a copy of the template file and remove the
-example
extension from the file name. The renamed Instance Start Script will not be overwritten when updating the Agent later on. - It is recommended to copy the template file to a Instance Start Script file with the name
agent
_<port>.sh|cmd
with<port>
being the HTTP port used by the Agent (see below).- If the Agent installation was performed on Windows by use of the installer, either in headless mode or in graphical mode, then the installer automatically creates the script.
- If the Agent installation was performed by extracting a .tar.gz/.zip archive then the Instance Start Script has to be created from a copy of the template file.
- With the Instance Start Script being copied you can adjust startup parameters from environment variables, see below.
Usage
The Instance Start Script can be executed with the same arguments as the Start Script, see above.
Agent Environment Variables
Most environment variables in the Instance Start Script correspond to command line options in the Start Script (described above). The following environment variables can be modified in the script:
JS7_AGENT_HOME
- Points to the directory where the JS7 Agent has been installed.
- Without setting this environment variable the default value is the parent directory of the Agent Start Script.
- Should you want to start the Agent from a directory other than the Agent installation directory, e.g. by copying the Start Script to some other location, then this environment variable has to be set in order to locate the JS7 Agent installation directory.
- There is no corresponding command line option.
JS7_AGENT_USER
- Sets the user account that the Agent is operated for. This includes running jobs with the permissions of the specified user account.
- This setting is available for Unix systems only. For Windows systems, the user account that runs the Windows Service is used.
- Without setting this environment variable the user account that runs the Start Script is used.
- This setting can be used when running the Agent Start Script on system startup and shutdown configurations that are executed by
root
, e.g. in/etc/init.d
and corresponding locations or withsystemd
. - There is no corresponding command line option.
JS7_AGENT_HTTP_PORT
- Sets the HTTP port that the Agent is listening to.
- Indicates which network interfaces the Agent should listen to if a hostname or IP address is specified as e.g. with
JS7_AGENT_HTTP_PORT=myHost:4444
. - If only a port number is specified then the Agent listens to all available network interfaces via HTTP.
- Without setting this environment variable the port defaults to
4445
. - Corresponding command line option:
--http-port
JS7_AGENT_HTTPS_PORT
- Sets the HTTPS port that the Agent is listening to.
- Indicates which network interfaces the Agent should listen to if a hostname or IP address is specified as e.g. with
JS7_AGENT_HTTPS_PORT=myHost:4443
. - If only a port number is specified then the Agent listens to all available network interfaces via HTTPS.
- When using the HTTPS protocol for connections from a Controller consider additionally allowing the HTTP protocol for local connections as with
JS7_AGENT_HTTP_PORT=localhost:4445
. As the Agent Start Script makes use of an HTTP connection, this protocol has to be in place to allow the Agent instance to be started, stopped etc. by its Start Script. - Without setting this environment variable the HTTPS protocol is not used.
- Corresponding command line option:
--https-port
JS7_AGENT_DATA
- Points to the location where the Agent finds its configuration data, log data and journals.
- Without setting this environment variable the default value is
JS7_AGENT_HOME/var_<JS7_AGENT_HTTP_PORT>
. - Corresponding command line option:
--data-directory
JS7_AGENT_CONFIG_DIR
- Points to the directory where the Agent finds its configuration data.
- Without setting this environment variable the default value is
JS7_AGENT_DATA/config
. - Corresponding command line option:
--config-directory
JS7_AGENT_LOG_DIR
- Specifies the directory where the Agent log files are created.
- This setting defaults to the sub-directory
logs
in theJS7_AGENT_DATA
directory. - There is no corresponding command line option.
JS7_AGENT_PID_FILE_DIR
- Specifies the directory where the Agent PID file is created.
- This setting defaults to the directory that is specified with the
JS7_AGENT_LOG_DIR
environment variable or the log directory default value. - There is no corresponding command line option.
JS7_AGENT_WORK_DIR
- Specifies the working directory for the jobs started by the Agent, e.g.
${HOME}
or%USERPROFILE%
. - This setting defaults to
JS7_AGENT_HOME
. - There is no corresponding command line option.
- Specifies the working directory for the jobs started by the Agent, e.g.
JS7_AGENT_KILL_SCRIPT
- Specifies the location of a "kill script" if an individual script is required.
The kill script allows the task and any child processes of a job to be killed.
- Kill scripts are by default provided from the following locations:
JS7_AGENT_DATA/tmp/kill_task.sh
for Unix.JS7_AGENT_DATA\tmp\kill_task.cmd
for Windows.
- Corresponding command line option:
--kill-script
JAVA_HOME
- Points to the location of the Java Runtime Environment (JRE).
- Without setting this environment variable Java will be used from the location specified by the system path.
- Please consider that
JAVA_HOME
does not point to the location of a JDK but to a JRE directory where thebin/java
executable resides, for example if the location of the Java executable is/opt/java/jdk8u202-b08/jre/bin/java
thenJAVA_HOME=/opt/java/jdk8u202-b08/jre
. - There is no corresponding command line option.
JAVA_OPTIONS
- Sets Java options, e.g. the Java memory settings for the Agent.
- Without setting this environment variable the Java options default to
'-Xms100m'
. - Corresponding command line option:
--java-options
JS7_AGENT_JOB_JAVA_OPTIONS
- Sets Java options for each JITL job and JVM job that is started by the Agent.
- Corresponding command line option:
--job-java-options
Individual Environment Variables
In addition to Agent Environment Variables users can add individual environment variables. Such environment variables can be made available for jobs.
SCRIPT_PATH=/var/scripts export SCRIPT_PATH
set SCRIPT_PATH=C:\ProgramData\scripts
Running the Agent
- SOS does not recommend to run the JS7 Agent as
root
(for Unix) or asAdministrator
(for Windows).- In fact the Agent can be operated with administrative privileges which leverages switching to any user account without specifying a password if jobs should be executed for a different user account.
- However, in compliance-aware environments this is considered an unwanted risk and in any other environments this simply is a bad idea.
- For Windows the JS7 Agent can switch to a different user account in a compliant way, see JobScheduler Universal Agent - Running jobs as a different user.
- For Unix use of
sudo
is recommended.
The examples listed below make use of an Instance Start Script agent_4445.sh|cmd
, which is created from the template file to run the Agent using port 4445
.
Starting the Agent
agent_4445.sh|cmd start [options]
Stopping the Agent
agent_4445.sh|cmd stop [options]
This command will safely terminate the Agent (recommended).
- The Agent waits for running processes of any jobs to be completed.
- Using the
--sigkill
command line option will terminate the Agent normally and will kill any running processes.
agent_4445.sh|cmd abort [options]
The Agent process is immediately aborted.
- Any running tasks and child processes of jobs are killed immediately with a SIGKILL signal.
- Should tasks use resources such as database connections then they will not be properly closed.
agent_4445.sh|cmd kill [options]
The Agent process is killed.
- This corresponds to sending a SIGKILL signal with a
kill -9
command (Unix) ortaskkill
command (Windows). - Should jobs be running that start detached child processes then it is not guaranteed that child processes will be killed.
Restarting the Agent
agent_4445.sh|cmd restart [options]
This command will safely restart the Agent (recommended).
- The Agent waits for running processes of any jobs to be completed.
- Using the
--sigkill
command line option will terminate the Agent normally, kill any running processes and restart the Agent.
Checking the Agent Status
agent_4445.sh|cmd status [options]
If the Agent is up and running then this command results in output such as:
version: 2.0.0-alpha.20210722.2 (2021-07-22) buildId: QQqWYNiJRbqcYqx4iiFWww startedAt: 1626981330629 isTerminating: false system: hostname: agent-2-0-primary distribution: Alpine Linux v3.13 cpuModel: Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz mxBeans: operatingSystem: availableProcessors: 8 systemLoadAverage: 0.0107421875 java: version: 1.8.0_292 memory: maximum: 954728448 total: 289931264 free: 87118936 systemProperties: java.vendor: IcedTea os.arch: amd64 java.runtime.name: OpenJDK Runtime Environment os.version: 3.10.0-957.1.3.el7.x86_64 os.name: Linux java.vm.name: OpenJDK 64-Bit Server VM java.version: 1.8.0_292
Performing Certificate Rollout
agent_4445.sh|cmd cert [cert-options]
This command is used to generate an SSL certificate for client and server authentication.
For details and command line options see JS7 - Certificate Authority - Rollout Certificates for HTTPS Connections
Windows Service Interface
The following information applies to headless installation for Windows systems. For installation with a GUI and user dialog see JS7 - Agent - Installation Using the Windows Graphical Installer.
The Agent is operable as a Windows Service. The Start Script of the Agent allows the installation/removal of the Windows Service.
The below examples make use of an Instance Start Script agent_4445.cmd
, which is created from the template file to run the Agent for port 4445
.
Installing the Windows Service
agent_4445.cmd install-service [--http-port=<number>]
This command installs the Agent's Windows Service. After the installation, you will find the Windows Service with the name SOS JS7 Agent -port=<number>
in the Services Manager Console. The Windows service uses the "local system" account.
During service installation, the installer tries to copy the executable file for the Windows Service to the .\service
directory. This operation could fail with the error "Access denied" if you have extracted the Agent to e.g. C:\Program Files. In this case you can change the permissions of the .\service
directory or open the command prompt with elevated administrator rights and execute the above command once again.
Starting the Windows Service
agent_4445.cmd start-service [--http-port=<number>]
This command starts the Windows Service with the name SOS JS7 Agent -port=<number>.
The stop
command performs more than a simple stop-service
command: the stop
command checks whether the Agent was started by the command line interface or as a Windows Service and stops the Agent accordingly. Therefore there is no stop-service
command.
Removing the Windows Service
agent_4445.cmd remove-service [--http-port=<number>]
This command removes the Windows Service. After executing this command you should not find the Windows Service with the name SOS JS7 Agent -port=<number>
in the Services Manager Console any longer.
During removal of the service it tries to remove the executable file of the Windows Service from the .\service
directory. This operation could fail with the error "Access denied" if you have extracted the Agent to e.g. C:\Program Files. In this case you can change the permissions of the .\service
directory or open the command prompt with elevated administrator rights and execute the above command once more.
Configuring the Windows Service
After the installation of the Windows Service you will find the .\service\js7_agent_<http-port>w.exe
file. Start this program to configure the Windows Service.
For example go to the "Startup" tab |
Debugging the Windows Service
- The Agent log level can be increased using the Agent's Apache ProcRun Demon Service Manager demon/service.
- On Windows systems this is installed in the Agent's
service
folder with a name such asjs7_agent_<port>w.exe
where<port>
is the Agent's HTTP port. - Start the ProcRun Manager, select the Logging tab in the Manager interface and set the level to Debug.
- The location of log files is explained above.
- Consider reverting a debug log level to its original value once you are finished with debugging.