Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • YADE implements a Virtual File System that supports a number of data providers, e.g. SMB/CIFS protocol implementation by Samba.
  • Data providers can make use of individual Java properties, e.g. for SMB/CIFS to specify compatibility levels for authentication with NTLMv2 and newer or for SFTP to specify packet compression to zlib, compression level 9 or Cipher blowfish-cbc,aes192-ctr.
  • YADE allows to specify Java property files at a global level and individually per transfer fragment.
    • Jira
      serverSOS JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId6dc67751-9d67-34cd-985b-194a8cdc9602
      keyYADE-400
    • Properties from Java property files are applied as system properties by YADE.
  • YADE allows to specify configuration files individually per transfer fragment.
    • Jira
      serverSOS JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId6dc67751-9d67-34cd-985b-194a8cdc9602
      keyYADE-403
    • An application configuration file contains settings that are specific to an app/data provider.

YADE Java Property File Configuration

...

Code Block
languagetext
titleYADE Settings system_property_files
collapsetrue
[globals]
history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/hashed_known_hosts.ini

[protocol_fragment_sftp@sftp-uk.sos]
protocol                            = sftp
host                                = uk.sos
port                                = 22
user                                = london
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[protocol_fragment_sftp@sftp-japan.sos]
protocol                            = sftp
host                                = japan.sos
user                                = tokyo
ssh_auth_method                     = publickey
ssh_auth_file                       = ${HOME}/.ssh/id_rsa

[CopyLocal2SFTPUKSOS]
operation                           = copy
file_spec                           = TEST-M-1111.TXT

source_protocol                     = local
source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel

target_include                      = protocol_fragment_sftp@sftp-uk.sos
target_dir                          = /home/london/data/to_london/

[CopySFTPJapanSOS]
operation                           = copy
file_spec                           = TEST-M-2222.TXT

source_protocol                     = sftp
source_include                      = protocol_fragment_sftp@sftp-japan.sos
source_dir                          = /home/tokyo/data/from_tokyo/

target_protocol                     = local
target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

 

YADE

...

Configuration Files Configuration

The ConfigurationFiles are properties available only to the protocol fragments they are assigned. The ConfigurationFile option can be assign a semicolon separated list of property files. The property files can contain on or more properties as key value pairs.

Example

  • Code Block
    languagebash
    titleSFTP packet compression configuration sftp-zlip-compression.ini
    compression.s2c=zlib@openssh.com,zlib,none
    compression.c2s=zlib@openssh.com,zlib,none
    compression_level=9
    
  • Code Block
    languagebash
    titleSFTP Cipher configuration sftp-cipher-aes128-ctr.ini
    cipher=aes128-ctr
Description 
  • In following example the location of hashed known hosts file is configured as name value pair in the file hashed_known_hosts.ini.
  • The known_hosts system property will be available and applied to all the fragments and profile using SFTP data provider e.g. to protocol fragments protocol_fragment_sftp@sftp-uk.sos and protocol_fragment_sftp@sftp-japan.sos.

YADE Settings
  • Code Block
    languagebash
    collapsetrue
    [globals]
    history                             = /home/test/sos-berlin.com/jade_client/logs/jade_history.csv
    system_property_files               = /home/test/sos-berlin.com/jade_client/configurations/known_hosts_file.ini
    [protocol_fragment_sftp@sftp-uk.sos]
    protocol                            = sftp
    host                                = uk.sos
    port                                = 22
    user                                = london
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-zlip-compression.ini
    [protocol_fragment_sftp@sftp-japan.sos]
    protocol                            = sftp
    host                                = japan.sos
    user                                = tokyo
    ssh_auth_method                     = publickey
    ssh_auth_file                       = ${HOME}/.ssh/id_rsa
    configuration_files                 = /home/test/sos-berlin.com/jade_client/configurations/sftp-cipher-aes128-ctr.ini
    
    [CopyLocal2SFTPUKSOS]
    operation                           = copy
    file_spec                           = TEST-M-1111.TXT
    source_protocol                     = local
    source_dir                          = /mnt/r2d2/nobackup/data/from_galadriel
    target_include                      = protocol_fragment_sftp@sftp-uk.sos
    target_dir                          = /home/london/data/to_london/
    [CopySFTPJapanSOS]
    operation                           = copy
    file_spec                           = TEST-M-2222.TXT
    source_protocol                     = sftp
    source_include                      = protocol_fragment_sftp@sftp-japan.sos
    source_dir                          = /home/tokyo/data/from_tokyo/
    target_protocol                     = local
    target_dir                          = /mnt/r2d2/nobackup/data/to_galadriel

 

 

References

Change Management References

...