Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • The YADE profile has three sections 
    1. Globals section 
    2. ProtocolsFragments section
    3. Transfer Profiles section
  • The system properties files configure under globals section with option system_property_files will be available to all the protocol fragments and The . At the run time the YADE will automatically apply applicable properties to respective data provider e.g. SFTP properties to JSch data provider and SMB properties to JCifs data provider. .
  • In above mentioned example the location of hashed known hosts file is configured as name value pair in the file hashed_known_hosts.ini.
  • The known_hosts andremote_exec The known_hosts system property will be available and applied to all the fragments and profile using proticol SFTP data provider e e.g. to protocol fragments protocolfragments protocol_fragment_sftp@sftp-uk.sos and sos and protocol_fragment_sftp@sftp-japan.sos.

YADE Settings

 

Code Block
languagebash
titleYADE Settings system_property_files
collapsetrue
[globals]
history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/sftp_system_proprieties.ini ; /home/test/sos-berlin.com/jade_client/configurations/smb_system_proprieties.ini

[protocol_fragment_sftp@sftp-uk.sos]
protocol                            = sftp
host                                = uk.sos
port                                = 22
user                                = london
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[protocol_fragment_sftp@sftp-japan.sos]
protocol                            = sftp
host                                = japan.sos
user                                = tokyo
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[CopyLocal2SFTPUKSOS]
operation                           = copy
file_spec                           = TEST-M-1111.TXT
source_protocol                     = local
source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel
target_include                      = protocol_fragment_sftp@sftp-uk.sos
target_dir                          = /home/london/data/to_london/

[CopySFTPJapanSOSCopySFTPJapanSOS2Local]
operation                           = copy
file_spec                           = TEST-M-2222.TXT
source_protocol                     = sftp
source_include                      = protocol_fragment_sftp@sftp-japan.sos
source_dir                          = /home/tokyo/data/from_tokyo/
target_protocol                     = local
target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

...

YADE Configuration Files Configuration

...

  • The global SystemProperty file will be used applicable as described in the previous section YADE System Property Configuration. 
  • In the following example the two configuration files are created, both of them has configuration properties for the SFTP data provider;
    1. sftp-zlip-compression.ini :  effects packet compression during transfer over SFTP.
    2. sftp-cipher-aes128-ctr.ini : effects Cipher used by SFTP data provider.
  • The sftp-zlip-compression.ini is being assigned to  is referred by the protocol fragment protocol_fragment_sftp@sftp-uk.sos using configuration_files option, thus the packet compression properties will only be applicable to the transfers using protocol fragment protocolfragment protocol_fragment_sftp@sftp-uk.sossos e.g. CopyLocal2SFTPUKSOS

  • Similarly the sftp-cipher-aes128-ctr.ini is being assigned to is referred by the protocol fragment protocolfragment protocol_fragment_sftp@sftp-japan.sossos using configuration_files option, thus the Cipher aes128-ctr will only be applicable to the transfers using the protocol fragment protocolfragment protocol_fragment_sftp@sftp-japan.sos e.g.sos CopySFTPJapanSOS2Local. 

YADE Settings
  • Code Block
    languagebash
    titleYADE Settings system_property_files
    collapsetrue
    [globals]
    history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
    system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/sftp_system_proprieties.ini ; /home/test/sos-berlin.com/jade_client/configurations/smb_system_proprieties.ini
     
    [protocol_fragment_sftp@sftp-uk.sos]
    protocol                            = sftp
    host                                = uk.sos
    port                                = 22
    user                                = london
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-zlip-compression.ini
     
     
    [protocol_fragment_sftp@sftp-japan.sos]
    protocol                            = sftp
    host                                = japan.sos
    user                                = tokyo
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-cipher-aes128-ctr.ini
    
    [CopyLocal2SFTPUKSOS]
    operation                           = copy
    file_spec                           = TEST-M-1111.TXT
    source_protocol                     = local
    source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel
    target_include                      = protocol_fragment_sftp@sftp-uk.sos
    target_dir                          = /home/london/data/to_london/
     
     
    [CopySFTPJapanSOSCopySFTPJapanSOS2Local]
    operation                           = copy
    file_spec                           = TEST-M-2222.TXT
    source_protocol                     = sftp
    source_include                      = protocol_fragment_sftp@sftp-japan.sos
    source_dir                          = /home/tokyo/data/from_tokyo/
    target_protocol                     = local
    target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

...