Extractors - Target-Based CDC


 Attachments:3
 Added by Brandon Jacobson, last edited by Brandon Jacobson on Feb 29, 2012  (view change)

This method extracts all of the data from the source system and compares it against the target system.  The result of
the comparison is a set of rows flagged as Insert, Update or Delete.  It is implemented in Data Services using the
Table_Comparison transform.

Here are the steps to perform a simple Target-Based CDC extraction.

1.   Create an SAP Application Datastore for your source system.

2.   Import the Extractor.

3.   Create/import metadata in HANA.

4.   Create a Datastore for HANA.

5.   Import the target table.

6.   Create a Batch Job.

7.   Create a Dataflow and add it to the Batch Job.

8.   Add the Extractor to the Dataflow.

9.   Open the extractor

10.   Make sure the Initial load drop down list box has the value Yes 

11.   Add a Query to the Dataflow and connect it to the extractor.

12.   Add a Table_Compare and connect it to the Query.

13.   Open the Query and map all columns to be extracted.

14.   Add the primary key column(s) to the Order By tab.

15.   Open the Table_Comparison and configure as follows… 

16.   Add the target table to the Dataflow.

17.   Connect the target table to the Table_Comparison.

If the target table has a primary key, these columns should be enough to determine whether a row from the source should be inserted or updated in the targ
help identify uniqueness, these can be added as “Compare columns” to improve performance.

The resulting Dataflow should look something like this… 

This implementation is not recommended for tables with a large number of rows.