Server-to-Server File Transfer without touchdown
File Transfer Schema
Configuration Example
A profile definition for Server-to-Server File Transfer, from SFTP to FTP:
[ftp_server_2_server_with_polling] ssh_auth_method=password source_user = kb source_password = ***** source_ssh_auth_method = password source_host = wilma.sos source_protocol = sftp source_port = 22 target_user = test target_password = ***** target_host = 8of9.sos target_protocol = ftp target_port = 21 file_spec = ^.*\.txt$ operation = copy poll_interval = 60 poll_minfiles = 1 poll_timeout = 0 log_filename=${TEMP}/sosftphistory.log
In this example all files with the file name extension .txt should be transferred from the server wilma via SFTP to the server 8of9 by FTP. YADE will do the polling on the source server for specific files.
To start this with the command line client one must type:
jade.sh -settings=name_of_settings_file -profile=ftp_server_2_server_with_polling
To make the profile reusable and more readable it is possible to organize profiles by fragments like this:
[wilma_as_source] ssh_auth_method=password source_user = kb source_password = ***** source_ssh_auth_method = password source_host = wilma.sos source_protocol = sftp source_port = 22 [8of9_as_target] target_user = test target_password = ***** target_host = 8of9.sos target_protocol = ftp target_port = 21 [globals] log_filename = ${TEMP}/sosftphistory.log [globals_polling] poll_interval = 60 poll_minfiles = 1 poll_timeout = 0
The profile fragments for wilma as source and 8of9 as target are defined once. They could be used as many times as needed. There is a globals profile as well.
Now we will specify the profile using fragments:
[ftp_server_2_server_with_polling] include = globals , globals_polling source_include = wilma_as_source target_include = 8of9_as_target operation = move file_spec = ^.*\.txt$ [ftp_more] include = wilma_as_source,8of9_as_target operation = move file_spec = ^.*\.(txt|pdf|dat)$ source_folder = /outbound/daily target_folder = /inbound/transfer
The include parameter will include the named profile snippets in the order they are defined. The globals profile is included automatically, no need to specifiy it in an include parameter.
The profiles have to be defined in the same settings file.
See also
- YADE Implementation Architecture
- How to transfer files with YADE from Server A to Server B using polling and post-processing
- Example for YADE Server-to-Server File Transfer