Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 28

Creating an ODI Project and Interface: Exporting a Flat File to a Flat File:

A common task that is performed using ODI is to export data from a flat file and load this data into another flat file.
This tutorial walks you through the steps that are needed to create a project and an interface that will import a file to a
staging area, perform some minor transformations, and then write the data to a file. You also execute the interface
and verify the execution using ODI Operator.

Scenario

Linda works as a database administrator for Global Enterprise. In Global Enterprise, Linda is responsible for
performing database management and integration tasks on various resources within the organization. In particular,
Linda is responsible for data loading, transformation, and validation. To begin working on her projects, Linda created
the new Master repository and Work repository. Now Linda needs to create a project and an interface to export data
from a flat file, perform transformations, and load this data into another flat file.

Software and Hardware Requirements (Optional)

The following is a list of software requirements:

 The system should include the following installed products:


o Oracle Database 11g
o Oracle Data Integrator 11gR1
 If not done before, start the services and components for Oracle Database 11g

Prerequisites

Before you start the tasks, make sure that your system environment meets the following requirements:

1 . Have installed Oracle Database 11g. If not done before, start the services and components for Oracle Database 11g
2 . Have installed Oracle Data Integrator 11gR1
3 . Before attempting this OBE, you should have successfully completed the following OBE: ODI11g: Creating and
Connecting to ODI Master and Work Repositories. To access this OBE, click HERE.

Creating a New Project with Oracle Data Integrator

To create a new project within Oracle Data Integrator, perform the following steps:

1. Start ODI Designer: Start > Programs > Oracle > Oracle Data Integrator > ODI Studio . Select WORKREP1 from
the Login Name drop-down list if not already selected. Enter SUPERVISOR in the User field and SUNOPSIS in the
Password field. Click OK to login.
2.
In the designer tab, click the Projects tab, click New Project icon , and then click New Project.

3. On the screen that appears, set the Name of the project to ODIexp_RT_RT in the Name field. The Code field is filled
automatically. Click Save icon . The newly created ODIexp_RT_RT project now appears in the Projects tree
view. You have now successfully added a new ODI project.
4 . For this interface, Linda has to import a flat file into the SQL staging area, and then export the file to a different flat
file. The Knowledge Modules (KMs) that are required for this are LKM File to SQL and IKM SQL to File Append.
To import the KMs, click the Project tab in the left panel and expand the Knowledge Modules folder. Right-click
Loading (LKM) and select Import Knowledge Modules.

Note: In this example, the generic SQL KMs are used. However, specific KMs for the RDBMS technology can be
used as well.

5 . On the screen that follows,in the File Name, navigate to xml-reference directory as shown in the following
screenshot. Click Open.The files to import should appear in the Import Knowledge Modules window. Press and
hold the CTRL key to select IKM SQL to File Append and LKM File to SQL. Click OK.
6. On Import Report window, click Close. Expand the Loading (LKM) and Integration (IKM) folders, and view each
imported KM in the tree view as shown below.
Creating a New Physical Schema for the Flat File Model
To create a Physical schema for a new flat file model, perform the following steps:
1 . Click Topology tab. In Topology navigator, click the Physical Architecture tab, select Technologies > File. Right-click
FILE_GENERIC, and then select New Physical Schema.

2 . For the Directory (Schema) and Directory (Work Schema) fields, enter the path to the directory, where your input flat
files are located ( C:\Oracle\Middleware\Oracle_ODI1\oracledi\demo\file ). Select Default check box, and then click
Save button. Close editing window for your new physical schema. On the Information window that follows, click OK.
Verify that your new Physical schema was added under the FILE_GENERIC data server in the Technologies tree
view.
3 . .Open Logical Architecture, navigate to Technologies > File, right-click File and select New Logical Schema. Enter
the Logical Schema name: FLAT_FILES_SRC, select the your nely created physical schema in Global context as
shown below. Click Save and close the editing windows.
Creating a New ODI Model for the Flat File Source

To create a new model for the flat file target datastore, perform the following steps: .

1. Click the Models tab in the left panel of ODI Designer. Click the Insert Model Folder icon, and then select New
Model Folder. On the screen that appears, set the Name to Files. Click Save icon.
2. Right-click the Files model folder and select New Model. On the screen that appears, enter the values provided in
the following table. Select Reverse Engineer tab.

Parameter Value
Name Flat_File_1
Technology File
Logical Schema FILE_DEMO_SRC
3. On the screen that appears, verify settings and click Save icon to save your model . very that your newly created
model appeared in the tree view under Files node.
Creating a New ODI Source Datastore for use with ODI Interface

To create a new ODI source datastore, perform the following steps:

1. Expand the Flat Files folder, right-click the newly created Flat_File_1 model, and then select New Datastore. On the

screen that appears, set Name to SRC_SALES_PERSON. Click the button next to the Resource Name field.
Select the SRC_SALES_PERSON.txt file and click Open.

Note: In this OBE, you use the sample files that are delivered with the ODI installation.
2. Click the Files tab. Set the File Format to Fixed, and then click the Columns tab.
3 . On the Columns tab, click the Reverse Engineer button. The following screen appears. Click Yes.. The Column
Setup Wizard appears.
4 . Point the cursor, and then click the ruler at the beginning of each column as shown below. The wizard marks each
column.
5 . After the columns are marked, click each column data and set the Name and Datatype for each column. For the
names and data types of each column, refer to the following table. Click OK when you have finished.

Column Name Data Type


C1 SALES_PERSON_ID numeric
C2 FIRST_NAME string
C3 LAST_NAME string
C4 DATE_HIRED string
6 . The columns should now look as follows. Click OK to save the model. Expand Files >Flat_ File1 >
SRC_SALES_PERSON (SRC_SALES_PERSON.txt) > Columns to view your source model. Verify that the
columns were successfully created as shown in the screenshot.
Note: If the columns have not been created, edit the newly created datastore: right-click the SRC_SALES_PERSON
datastore, select Edit, and repeat steps 3, 4, 5, and 6.

7 . In the Flat_File_1 model, right-click SRC_SALES_PERSON datastore, and then select View Data option. Close all
tabs.
Creating a New ODI Target Datastore for use with ODI Interface

To create a new ODI target datastore, perform the following steps:

1. In this OBE, you use the sample files that are delivered with the ODI installation. Browse to the
ODI_HOME\demo\file directory (C:\Oracle\Middleware\Oracle_ODI1\oracledi\demo\file). Make a copy of the
SRC_SALES_PERSON.txt file and name the copy TRG_SALES_PERSON.txt as shown in the example in the
following screenshots.
2. In ODI Designer, right-click the newly created source datastore SRC_SALES_PERSON and select Duplicate. On
the screen that follows, click Yes. The new Copy of SRC_SALES_PERSON.txt appears in the tree view.

3 . Right-click the newly created duplicate Copy of SRC_SALES_PERSON.txt and select Edit. On the screen that

appears, set the Name to TRG_SALES_PERSON. Click the button next to the Resource Name field.

Note: The Files tab and Columns tab do not need to be changed because they are duplicated from the source file
4 . Select the TRG_SALES_PERSON.txt file and click Open. Click Save icon. The datastores for the source and target
files have now been successfully created in the same model and can be used in an ODI interface. Close editing tabs.
Creating a New ODI Interface for Flat File to Flat File Transformations

To create a new interface, perform the following steps:

1. In ODI Designer, click the Projects tab. Expand your project ODIexp_RT_RT, and then expand First Folder. Right-
click Interfaces and select Insert Interface.

2. On the screen that follows, enter the interface name as INT_exp_FT_FT. Select In-Memory Engine:
SUNOPSIS_MEMORY_ENGINE from drop-down list. Click the Mapping tab. If the Help screen appears, click OK.

Note: For this OBE, we will use the Sunopsis Memory Engine as our staging area because we want to perform some
transformations on the imported data.

3 . Click the Models tab to drag the source and target to Designer. Expand Files > Flat_File_1 and drag the
SRC_SALES_PERSON datastore from the Files folder into the Sources container. Drag the
TRG_SALES_PERSON.txt datastore from Files into the Target Datastore container. When Designer asks "Do you
want to perform an Automatic Mapping?" click Yes. The Diagram tab should look as follows. Click the Flow tab.

Note: For the purposes of this tutorial, default mappings are used, although a number transformation can be
performed in the mapping. The mapping should be performed in the staging area.

4 . Click the SS_0 (1 - FILE_GENERIC) source datastore. This makes the properties for the source appear below. In the
LKM Selector section, select LKM File to SQL from the LKM drop-down list if not already selected.

5 . Click Target (FILE_GENERIC). This makes the properties for the target appear below. For IKM, select IKM SQL to
File Append from the IKM drop-down list if not already selected. Set the IKM options TRUNCATE to True and
GENERATE_HEADER to False as shown below. Click Save icon to save your interface .
6.
To test your interface, click Execute icon . The following screen appears. Retain the defaults and click OK. On
the screen that follows, click OK.
7 . To verify that your interface was executed successfully, you need to open ODI Operator. Click the ODI Operator tab.
In ODI Operator, click Hierarchial Sessions. Expand Date > Today > INT_exp_FF_FF > Steps > INT_exp_FF_FF,
and view the execution results for each step. Double-click any step and click the Description and Execution tabs to
see the execution results. Double-click step 6. View the number of rows that are inserted into the target flat file. Click
OK. Close the tabs.
Summary

In this tutorial, you have learned how to:

 Verify the Prerequisites


 Create a New Project with Oracle Data Integrator
 Create a New ODI Model for the Flat File Source
 Create a New ODI Source Datastore for Use with ODI Interface
 Create a New ODI Target Datastore for Use with ODI Interface
 Create a New Interface with Oracle Data Integrator for a flat file to a flat file data transformation

You might also like