Page History

...

The File Size Monitor can be configured from job or order parameters.

The following parameters are used:

Parameter	Required	Default	Description
`monitor_file_change_location`	yes		The full path of a file that should be monitored.
`monitor_file_change_timeout`	yes		The max. duration in seconds that repeated checks for steady file size are performed.
`monitor_file_change_interval`	no	1	Specifies the number of seconds that the monitor sleeps between repeated checks of the file size.
`monitor_file_change_exit_code`	no	1	Optionally sets the exit code of the current job to the specified value if the monitored files is not being found steady. This works for shell jobs exclusively.
`monitor_file_change_error_state`	no		Optionally sets the order to the specified state if the monitored file is not being found steady

...

An order can be used to carry the parameters for the File Size Monitor.

The order can be implemented like this:

Code Block

language	xml
title	Order Implementation Sample
linenumbers	true
collapse	true

<order>
    <params >
        <param  name="monitor_file_change_location" value="/tmp/jobscheduler/file/some_changing_file.txt"/>
        <param  name="monitor_file_change_timeout" value="30"/>

        <param  name="monitor_file_change_error_state" value="error"/>
    </params>


    <run_time />
</order>

Job Implementation

...

The File Size Monitor is implemented as follows:

Code Block

language	js
title	Monitor Implementation
linenumbers	true
collapse	true

function spooler_process_before() {

    var rc = true;

    // merge parameters from task and order
    var params = spooler_task.params;
    params.merge( spooler_task.order.params );

    // required parameters
    var monitorLocation = params.value( 'monitor_file_change_location' );
    var monitorTimeout = params.value( 'monitor_file_change_timeout' );

    // optional parameters
    var monitorInterval = params.value( 'monitor_file_change_interval' );
    var monitorExitCode = params.value( 'monitor_file_change_exit_code' );
    var monitorErrorState = params.value( 'monitor_file_change_error_state' );
 
    if ( !monitorLocation ) {
        spooler_log.error( '.. parameter missing: monitor_file_change_location' );
        return false;
    }

    if ( !monitorTimeout ) {
        spooler_log.error( '.. parameter missing: monitor_file_change_timeout' );
        return false;
    } else {
        monitorTimeout = parseInt( monitorTimeout );
    }

    if ( !monitorInterval ) {
        monitorInterval = 1;
    } else {
        monitorInterval = parseInt( monitorInterval );
    }

    if ( !monitorExitCode ) {
        monitorExitCode = 1;
    } else {
        monitorExitCode = parseInt( monitorExitCode );
    }

    // let's use a Java package for file operations
    var monitorFile = new java.io.File( monitorLocation );
    if ( !monitorFile.isFile() ) {
        spooler_log.error( 'file does not exist: ' + monitorLocation );
        return false;
    } else {
        spooler_log.info( '.. monitoring file for max. ' + monitorTimeout + ' seconds: ' + monitorLocation );
    }

    var currentDuration = 0;
    var fileSize = 0;
    var lastFileSize = 0;

    do {
        lastFileSize = monitorFile.length();
        spooler_log.info( '.. current file size: ' + lastFileSize + ' bytes' );
        java.lang.Thread.sleep( monitorInterval * 1000 );
        fileSize = monitorFile.length();
        currentDuration = currentDuration + monitorInterval;
    } while ( (fileSize != lastFileSize) && (currentDuration < monitorTimeout) )

    if ( fileSize === lastFileSize ) {
        spooler_log.info( '.. file size is steady after ' + currentDuration + ' seconds (' + fileSize + ' bytes): ' + monitorLocation );
    } else {
        spooler_log.info( '.. giving up as file size is not steady after ' + currentDuration + ' seconds (' + fileSize + ' bytes): ' + monitorLocation );
        rc = false;

        if ( monitorExitCode ) {
            spooler_log.info( '.. setting task exit code: ' + monitorExitCode );
            spooler_task.exit_code = monitorExitCode;
        }

        if ( monitorErrorState ) {
            spooler_log.info( '.. moving order to error state: ' + monitorErrorState );
            spooler_task.order.state = monitorErrorState;
        }
    }

    return rc;
}

Explanations
- line 1: the monitor implements the spooler_process_before() function, i.e. it is executed for orders (not for standalone jobs) before the order is processed by the associated job.
- line 6-7: the monitor parameters are merged from task and order parameters. Precedence is granted to order parameters.
- line 10-16: parameters values are assigned to local variables.
- line 18-28: the required parameters are checked and an error is raised if parameters are missing.
- line 30-40: default values for optional parameters are assigned
- line 43-49: the monitor makes use of the Java File class as JavaScript does not provide file operations. Integrating Java with JavaScript works seemlessly as both are provided by the JVM. This integrations allows to use any Java classes from JavaScript. The monitor checks the existence of the monitored file and will raise an error if the file does not exist.
- line 51-61: a loop is implemented that considers changes in the file size for the max. duration of repeated checks. Between checks a sleep interval is implemented.
- line 63-78: finally if the file size is found to be steady the respective informative message is written to the log and otherwise the return code is set accordingly.

x

Space shortcuts

Page tree

Versions Compared

Old Version 4

New Version 5

Key

Job Implementation