Informatica – Connected vs Unconnected Transformation

December 30, 2010
By

One of the frequently asked questions in Informatica is the difference between connected and unconnected Transformation.

The way to differentiate between the two is rather simple. Take a look at the mapping and see if they are “connected” to the data flow or not. In other words, is there data going in and coming out of the transformation and is it being fed to a next transformation.

From the Informatica Documentation…

Transformations can be connected to the data flow, or they can be unconnected. 
An unconnected transformation is not connected to other transformations in the mapping. 
An unconnected transformation is called within another transformation,
and returns a value to that transformation.

Apart from being called from within another transformation, an unconnected transformation also include those that can be called in the beginning or end of the session to do things like calculate statistics, build/drop indexes etc. A common example for this is an (unconnected) external stored procedure Transformation.

One of the practical cases for this is the stored procedure that will be executed at the end of the load to collect the table statistics and to make an entry into a load status table . You can compile this as a stored procedure with an input parameter for table name and include it in the mapping using an external stored procedure transformation.

CREATE OR REPLACE PROCEDURE post_load_procedure (i_tabname IN user_tables.table_name%TYPE) AS
    BEGIN
       INSERT INTO load_status_XXXX (TABLE_NAME, load_date, process_date ) VALUES
                         (i_tabname, sysdate, sysdate-1);
       commit;
 
       DBMS_STATS.GATHER_TABLE_STATS (
               ownname  => 'SCOTT',
               tabname   => i_tabname,
               estimate_percent => DBMS_STATS.AUTO_SAMPLE_SIZE
    );
    END post_load_procedure;
/

Most transformations that we use in mappings are “connected Transformations” as they are involved in the data flow. An input is passed to them, processed based on what the transformation is and the output is moved on to the next downstream transformation.

Here is the list of transformations that can be either connected (or) unconnected…

Stored Procedure Transformation :
Connected :
Stored procedures / functions like calculate_commission based on a set of complex rules. If it is already present in your database and you do not want to “re-code” the same set of logic again, you can import it as a stored procedure and pass input to it and get the output . This is then passed on to the next transformation, hence “connected”.

Unconnected :
Examples include
a) truncate table before the load using a stored procedure that executed pre-session.
b) Compute statistics and make load status entries after the load..etc.

LookUp Transformation : Can be connected or unconnected.

From the Informatica Documentation
Connected or unconnected lookup.

A connected Lookup transformation receives source data, performs a lookup, and returns data to the pipeline. 
An unconnected Lookup transformation is not connected to a source or target. 
A transformation in the pipeline calls the Lookup transformation with a :LKP expression. 
The unconnected Lookup transformation returns one column to the calling transformation

Connected Lookup : As the above quote indicates, a connected lookup is a part of the data flow and is connected to other transformations. It is generally used when you want to get multiple columns from a particluar source file / table / pipeline ) based on a lookup key. Eg.. Let’s say you want to pass in a department ID and get the department name and location for it, Connected Lookup would be the way to go.

Unconnected Look Up Transformation : Unconnected lookup is generally used when the result of a query is a single column. More importantly, if it returns values like that indicate “Does the record exist”, “what’s the value of this column” and so. It can return only one input , but it is reusable and can save you a lot of effort in some cases where it’s applicable.

I’ll cover the major differences between different options in the look up transformation (Connected/unconnected, Static vs Dynamic..and so on) in a future post.

Cheers..
Rajesh

  • waseem

    Thank for this post…. the technical detail especially in database part u mentions is very good …….keep writing

  • Dhanashri

    Rejesh this is very useful post. Can you please exlpain connected & unconnected lookup trsnsformations with example. I mean with the screenshots of mapping. It will be very useful.