Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinh1. true
outlinh1. true
1printablefalse
2stylh1. none
3indent20px
h1.

What

...

is the purpose of the

...

YADE Background Service?

Ideally JADE The principle objective of the YADE Background Service is collecting to collect all the file transfer activities through JADE and archieving it into supported RDBMS Systems i.eYADE and store them to a database, e.g. MySQL, PostgreSQL, Oracle etc.
The YADE transfer history can then be used for analysis, compliance, alerting, planning, to measure SLAs etc.

The main components of the JADE YADE Background Service are

  1. SOS JobScheduler running as demondaemon/service on central a server
  2. JADE Jobchain YADE history import job chain running inside the SOS JobScheduler

How to

...

transmit the transfer history data to the

...

YADE Background Service?

JADE YADE writes detail detailed log entries of the all file transfers irspective irrespective of there status i.e. success, error in their status into the jade_history.csv and jade_history.log.

...

There are two possible ways how to transfer the JADE trasnfer histroy transmit the YADE transfer history to the JADE YADE Background Service:

...

  • Near Real Time: immediately after

...

  • file transfer using TCP/UDP, the YADE Client initiates the transfer.
  • Batch

...

  • Mode: as per

...

  • scheduled job

...

  • of the YADE Background Service

...

  • using file transfer, the YADE Background Service initiates the transfer.

TCP/UDP Communication

The transfer history can be send sent to JADE the YADE Background Service immedially immediately after the file transfer over TCP or UDP. The JADE Background Service server_name, port etc required parameters for the YADE Background Service, i.e.ServiceHost, ServicePort, TransferMethod (protocol) etc., can be configured in the profile BackgroundService of the jade_settings.ini, which will be used by all the subsiquent subsequent profiles.

No Format
No Formatcode

[BackgroundService]
BackgroundServiceHosh1. BackgroundServiceHost=jadebs.sos
BackgroundServicePort4210
SendTransferHistorh1. true
TransferMethodTCP

UDP Communication

BackgroundServicePort=4210
SendTransferHistory=true
TransferMethod=TCP

File Transfer

The file name and location of jade_histiry.log and jade_history.csv can be configured by the profile jadeHistory in the file jade_settingsThe transfer history can be send to JADE Background Service immedially after the file transfer over TCP or UDP. The JADE Background Service server_name, port etc can be configured in the jade_transfer.ini, which will be used by all the subsiquent subsequent profiles.

File Transfer

The JADE YADE Background Service can have scheduled job will launch tasks (YADE history import job chain) to collect all the jade_histroyhistory.logcsv files from different servershosts. The jade_history file(s) histroy.csv files can be transferd received from the JADE Client (server where JADE different YADE Client hosts where YADE isrunning), to the YADE Background Service, using FTP, SFTP, FTPS, SCP. Once file is reveived by JADE the files have been successfully received by the YADE Background Service then the files will be automatically processed and processed automatically and the transfer history will be imported in into the respective Databasedatabase.

ddigraph G \{ rankdir=LR <source> node [shape=rectangle, color=blue, label="JADE Client"] node1 [shape=rectangle, color=blue , label="Firewall" ] node2 [shape=box, color=blue , label="JADE Background Service (JADEBS)"] node3 [shape=rectangle, color=blue , label="Firewall"] node4 [shape=rectangle, color=blue , label="Database"] </source> node0 -> node1 [label=" " , dir=both ,fontsize=10.0, arrowhead=boxnormal, headlabel="TCP/UDP 5432 ", arrowtail="none", taillabel="" , minlen="3" ] ; node1 ->node2 [label=" " , dir=both ,fontsize=10.0, arrowhead=boxnormal, headlabel="", arrowtail="box", taillabel=" TCP/UDP 5432" , minlen="3" ] ; node2 -> node3 [label="TCP" arrowhead=box ]; node3->node4 [label="TCP"] \}
Code Block
Graphviz
languagetext
[jadeHistory]
log_filename=${TEMP}/jade_history.log
HistoryFileName=${TEMP}/jade_history.csv

Firewall and Port Settings

  • The YADE Background Service is using TCP/UDP ports, i.e. 4440 for the JobScheduler Operation Center GUI and to receive the transfer history (TCP/UDP packets), therefore firewall rules should include:
    • allow incoming TCP traffic from YADE Client host to YADE Background Service at port 4440.
    • allow incoming UDP traffic from YADE Client host to YADE Background Service at port 4440.
    • allow incoming TCP traffic from a host accessing the JobScheduler Operation Center GUI and YADE Background Service at port 4440.
  • For YADE Background Service to receive jade_history.csv files from the YADE Client hosts the respective ports as per transfer protocol, i.e. FTP 21, SFTP 22, should be allowed by the firewall on YADE Client hosts for the YADE Background Service.