Workflow - Dynamic Partition On Relational Source

You might also like

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 1

Workflow : Dynamic Partition on Relational Source

Description
Performance tuning is an integral part of the data integration process. It is essential to optimize the performance of each individual piece of the application so that optimal performance can be achieved. After the application and databases have been tuned for maximum single partition performance, you may find that the system is under-utilized. PowerCenter provides enhanced pipeline partitioning capabilities that when appropriately configured, can increase pipeline parallelism, resulting in greater throughput and a significant performance improvement. Dynamic Partitioning : If the volume of data grows or you add more CPUs, you might need to adjust partitioning so that the session run time does not increase. You can use dynamic partitioning, so that the Integration Service determines the number of partitions to create at run time based on factors such as source database partitions or the number of nodes in a grid. Use Case Details : In this block you can download a workflow that demonstrates dynamic partitioning. Oracle source is partitioned based on range of the customer_key data. As this partition on the source database can change based on data growth, we can use the dynamic partitioning based on source portioning to create partitions dynamically.

You might also like