Pipeline Lookup Transformation, Beyond Relational and Flat File Data Sources
Lookup transformation is synonymous to SQL outer join, which is primarily used for relational and flat file data source lookups. But with the introduction of pipeline lookup, we can use all variety of data sources in the lookup transformation. This feature is really powerful just like Active Lookup Transformation. In this article lets see how pipeline lookup transformation can be configured in a mapping.
What is Pipeline Lookups
Create a pipeline Lookup transformation to perform a lookup on an application source that is not a relational table or flat file. A pipeline Lookup transformation has a source qualifier as the lookup source. The source qualifier can represent any type of source definition, which ever is supported by you Informatica PowerCenter license.
Configuring a Pipeline Lookup
Since pipeline lookup is sourcing data from the source qualifier, as the first step lets create the source qualifier in the mapping from which the lookup is caching the data from. Here we are using a PowerExchange data source like shown in below image.
Now we can create the lookup transformation using Transformation -> Create Menu. In the lookup table selection window choose 'Source Qualifier' as shown in below image.
Now the lookup can be configured just like any normal lookup transformation. Below is the completed mapping, which uses a pipeline lookup transformation.
You can see the partial pipeline that processes the lookup source, which is not connected to any target definition.
You can see the partial pipeline that processes the lookup source, which is not connected to any target definition.
If you open and watch the property tab, you will notice that the 'Source Type' is 'Source Qualifier' and the 'Lookup table name' is the name of the Source Qualifier. Just like shown in below image.
Hope you enjoyed this tutorial, Please let us know if you have any difficulties in trying out pipeline lookup transformation and subscribe to the mailing list to get the latest tutorials in your mail box.