Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The Java properties configured using  System Property Files system_property_files options are global properties available to all protocol fragments. The SystemPropertyFiles system_property_files option can be assign a semicolon separated list of property files. The A property files file can contain on or more properties as key value pairs.

Following is the example of such a System Property File which contains global properties for a data providers. One System Property File can also contain properties for multiple data providersprovider. The YADE will apply applicable properties to respective data provider e.g. SFTP properties to JSch data provider and SMB properties to JCifs data provider. 

  • sftp_system_proprietiesproperties.ini

    Code Block
    languagebash
    titleSystemProperyFile sftp_system_proprietiesproprerties.in
    # SFTP properties
    known_hosts=/home/gollum.sos/.ssh/known_hosts
    remote_exec=true
  • smb_system_proprietiesproperties.ini

    Code Block
    languagebash
    titleSystemProperyFile smb_system_proprietiesproperties.ini
    # SMB properties
    jcifs.smb.client.useExtendedSecurity=false

...

  • The YADE profile has three sections 
    1. Globals section 
    2. ProtocolsFragments section
    3. Transfer Profiles section
  • The In the following example yade_settings.ini file, the system properties files are configure under globals section with option system_property_files as semicolon separated list of property files.
  • The properties defined in the files sftp_system_properties.ini and  smb_system_properties.ini will be available to all the protocol fragments. At the run time the YADE will automatically apply applicable properties to respective data provider e.g. SFTP properties to JSch data provider and SMB properties to JCifs data provider.
  • The known_hosts andremote_exec system property will be available and applied to all the fragments using proticol protocol SFTP  e.g. to protocol fragments protocol_fragment_sftp@sftp-uk.sos and protocol_fragment_sftp@sftp-japan.sos.

...

Code Block
languagebash
titleYADE Settings file with system_property_files_files yade_settings.ini
collapsetrue
[globals]
history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/sftp_system_proprietiesproperties.ini ; /home/test/sos-berlin.com/jade_client/configurations/smb_system_proprietiesproperties.ini

[protocol_fragment_sftp@sftp-uk.sos]
protocol                            = sftp
host                                = uk.sos
port                                = 22
user                                = london
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[protocol_fragment_sftp@sftp-japan.sos]
protocol                            = sftp
host                                = japan.sos
user                                = tokyo
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[CopyLocal2SFTPUKSOS]
operation                           = copy
file_spec                           = TEST-M-1111.TXT
source_protocol                     = local
source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel
target_include                      = protocol_fragment_sftp@sftp-uk.sos
target_dir                          = /home/london/data/to_london/

[CopySFTPJapanSOS2Local]
operation                           = copy
file_spec                           = TEST-M-2222.TXT
source_protocol                     = sftp
source_include                      = protocol_fragment_sftp@sftp-japan.sos
source_dir                          = /home/tokyo/data/from_tokyo/
target_protocol                     = local
target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

YADE Configuration Files Configuration

The ConfigurationFiles are properties available only to the protocol fragments they are assigned. The ConfigurationFile option protocol fragment specific Java properties can be configured using configuration_files option on protocol fragment level . The configuration_files option can be assign a semicolon separated list of property files. The  A property files file can contain on or more properties as key value pairs.

...

  • The global SystemProperty file will be applicable as described in the previous section YADE System Property Configuration. 
  • In the following YADE Settings example two configuration files are created, both of them has configuration properties for the SFTP data provider;
    1. sftp-zlip-compression.ini :  effects packet compression during transfer over SFTP.
    2. sftp-cipher-aes128-ctr.ini : effects Cipher used by SFTP data provider.
  • The sftp-zlip-compression.ini is referred by the protocol fragment protocol_fragment_sftp@sftp-uk.sos using configuration_files option, thus the packet compression properties will only be applicable to the transfers using protocol fragment protocol_fragment_sftp@sftp-uk.sos e.g. CopyLocal2SFTPUKSOS

  • Similarly the sftp-cipher-aes128-ctr.ini is referred by the protocol fragment protocol_fragment_sftp@sftp-japan.sos using configuration_files option, thus the Cipher aes128-ctr will only be applicable to the transfers using the protocol fragment protocol_fragment_sftp@sftp-japan.sos e.g. CopySFTPJapanSOS2Local.

...

  • Code Block
    languagebash
    titleYADE Settings with system_property_files and configuration_files yade_settings.ini
    collapsetrue
    [globals]
    history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
    system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/sftp_system_proprietiesproperties.ini ; /home/test/sos-berlin.com/jade_client/configurations/smb_system_proprietiesproperties.ini
     
    [protocol_fragment_sftp@sftp-uk.sos]
    protocol                            = sftp
    host                                = uk.sos
    port                                = 22
    user                                = london
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-zlip-compression.ini
     
    [protocol_fragment_sftp@sftp-japan.sos]
    protocol                            = sftp
    host                                = japan.sos
    user                                = tokyo
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-cipher-aes128-ctr.ini
    
    [CopyLocal2SFTPUKSOS]
    operation                           = copy
    file_spec                           = TEST-M-1111.TXT
    source_protocol                     = local
    source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel
    target_include                      = protocol_fragment_sftp@sftp-uk.sos
    target_dir                          = /home/london/data/to_london/
     
    [CopySFTPJapanSOS2Local]
    operation                           = copy
    file_spec                           = TEST-M-2222.TXT
    source_protocol                     = sftp
    source_include                      = protocol_fragment_sftp@sftp-japan.sos
    source_dir                          = /home/tokyo/data/from_tokyo/
    target_protocol                     = local
    target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

...