This application enables the exchange of data between data sources of various types, of different structures and distributed over networks. The fundamental principles and concepts of the system are listed below, use the links to find out more, and see Getting started for a summary of how to use these elements.
Actions
are the executables, the fundamental integration steps.
Data transfers are one important kind of action (see below). Other actions
can call and execute an external program or an operating system command,
validate data, execute a SQL statement, script, or standard or customized
piece of script code, send or receive an email, manipulate files on local
disks or remote machines, and repeat previous actions, see Action
types for a full list. Customized plugin actions can also be developed,
see Plugin
action overview for more. Actions can also be combined into complex
workflow sequences known as activities (see below). See Actions
overview for more.
Data
transfers are actions that transfer data between
a source and a target data source and are thus a particularly important
action type (see below for more on data sources). Data transfers are created
by specifying the source data source, the target data source, then mapping
between the two, using the graphical Mapping
screen. They may form part of a wider activity that can include complex
manipulations including database updates, transformations using the in-built
calculator and scripts (see below). See Data
transfers overview for more.
A
data source is a type of data and a means of accessing
that data. The system supports the exchange of data between any combination
of the following data source types: Databases, which are handled via the
JDBC data source type, file type data sources which include text, CSV,
EDI, XML, IDOC, HTML but which may not have to exist as a file. In
addition Terminal sessions may be the target data source of a data transformation,
and other applications may also be supported, see Data source overview
for links to further discussion and Data source types for a summary of
the data source structures supported.
Resources
include JDBC drivers, JMS server details and JMS
message queues. These can be set up and then used throughout the application,
see Resources overview
for more.
Activities
are complex actions designed as workflows. Actions can
be combined into sequences that allow complex manipulations of data to
be performed. Business rules, notifications, decisions, error handling
as well as rollbacks or compensating actions for transactable items and
components, can all be incorporated into an activity workflow. This allows
the data transformation process to be controlled in very specific ways,
allowing automation even of complex business processes. The built-in graphical
workflow designer lets you build and test an activity interactively and
then save it for execution on a local or remote server. See Activities
overview, Transactions
overview for more.
Projects
are groupings of integration components and resources,
organized for efficiency. Project resources include actions and activities,
data sources, event monitors and global variables. Within a project these
resources can be shared and can be copied to other projects using drag
and drop or copy and paste. Projects can be assigned to authorized
users and are deployed to authorized host servers, see Projects
overview.
Web
services are modular, self-describing applications
that are fast becoming a standard means of sending and receiving information
over distributed networks. The system allows the use and publication of
web services which can be incorporated into workflow activities and are
defined as part of a project, see Web
services overview for more.
Users can be one of three different categories: Standard
users are assigned to specific projects and hosts. Administrators can
view users, projects and hosts, which ensures managing and monitoring
projects on both local and remote hosts is simple and efficient. Administrators
can also update off-line hosts, remote hosts that store their configuration
data locally and do not normally connect to the primary server. Super
Users are special administrators with full system privileges, see Users
overview.
Hosts
are servers running the application that execute actions
and workflows. The system can be configured with just a single host, used
for both testing and deployment for example within a small business, or
with multiple hosts which may be in different physical locations including
test, backup and live servers. Each host understands how to manage and
route communication between itself and other hosts both outside a firewall
and within the corporate network. In general remote hosts connect to a
primary server for their configuration information and this host can be
directly accessed by the system administrator, see Hosts
overview. Remote administration of a host is possible via an Internet
browser, on a machine which does not have this application installed,
see Remote administration
for more.
Execution : Having created the required actions or activities, you can
test them on a local server or execute them directly on a specified host.
Actions and activities can be scheduled for later execution either as
a one-off or on a regular basis, or they may be deployed in such a way
that other systems interact to initiate their execution, see below.
Events and Event monitoring
: An action can
be deployed to a production server for immediate execution, can be scheduled
for execution at a specific time, or you can specify particular events
that will initiate particular actions or workflow activities, allowing
complex processes to occur. For example the following events could feed
incoming data to a workflow activity: arrival of a specific file, locally
or via FTP; the arrival of specific JMS events in a queue; or a simple
socket event. The system can also access remote data sources and can schedule
actions on remote servers using a proxy host facility. To handle these
triggers, event properties are created on the production host server either
directly or by assigning the appropriate action to that host, see Event
overview and Event
Monitor overview for further discussion.
Related topics include Getting started, Actions overview, Data source overview, Projects overview, Hosts overview, Event overview, Event Monitor overview, Plugin overview