Professional Documents
Culture Documents
Oug Ireland 2012 Rittman Odi PDF
Oug Ireland 2012 Rittman Odi PDF
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Mark Rittman
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
About Rittman Mead
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Data Integrator 11g
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Data Integrator Key Features
Same philosophy as OWB and Oracle RDBMS Use the Database as the ETL engine
ODI supports heterogeneous databases, not just Oracle
Built for SOA environments
Support for Web Services, EII etc
Supports batch, event-based and real-time integration
Data Integrity Controls create a data firewall
Reduces data prep time by not
processing erroneous data
Extensible through Knowledge Modules
Change Data Capture
Slowly Changing Dimensions
Bulk load
Java client application
with server elements
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Data Integrator 11g Key Components
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Studio Navigators
Repository
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Designer Navigator
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Topology Navigator
Defines the physical and logical architecture for the ODI system
Connections through to databases, OLAP servers, applications, files etc
Logical aliases for these connections
Contexts (environments)
Standalone and JEE agents
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Operator Navigator
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Agents
Java processes (applications) that are used for executing interfaces and packages
ODI Studio comes with an embedded agent,
or you can install them standalone on Designer Operator
one or more servers Model data sources View running
ODI 11g introduces option to install into Define projects
Create interfaces
interfaces and
packages
WebLogic server (more resilent, Release scenarios Operate production
clustering etc)
Repository
Standalone
Agent
Orchestrate
interfaces
and scenarios
Information Systems
(Databases, files, applications)
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Master and Work Repositories
ODI systems connects to a single Master Repository, and one or more Work Repositories
Master Repository contains topology, security and version management details for all of an
organizations resources (generally only one per organization)
Work Repository contains data models, projects, interfaces etc
- Can have more than one work repository;
subdivide by project, department etc Security
Work Repositories can either be Topology
Development or Execution work repositories Versioning
- Development work repositories are full-function,
and can be developed in Master Repository
Execution
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI 11g Overall Logical Architecture, incl. Java EE Components
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Heterogenous Connectivity
Monday, 19 March 12
Business Rules and Technical Details
Monday, 19 March 12
Extensible Knowledge Modules
Monday, 19 March 12
ODI Within Oracle Fusion Middleware 11g
ODI is the data integration technology within Oracle Fusion Middleware 11g
Leverages key FMW technologies such as
WebLogic Server
Oracle Platform Security Services
(optional)
Web Services and SOA
Clustering and HA
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Data Integrator 11g New Features
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
New Fusion User Interface - ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
New Interface Elements
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Load Plans
Alternative to packages for sequencing and orchestrating interfaces and procedures (scenarios)
Allows conditional logic for mapping exection
Define resume / restart settings for steps or groups of steps
Explicitely define parallel / serial execution
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Use of Repository Creation Utility
ODI Repository can now be created using RCU, as well as direct through ODI
No additional functionality, however aligns repository creation with rest of FMW11g
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Use of Oracle WebLogic Server
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Data Integrator Console
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Oracle Fusion Middleware Control Integration
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ETL Integration with OBIEE 11g
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Demonstration
Oracle Data Integrator 11g
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Some Typical ODI Development Tasks
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interfaces within ODI
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Business Rules and Technical Details
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
Sources Canvas
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
Target Datastore
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
Property Inspector
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Interface Designer within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Components of an Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Components of an Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Components of an Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 1 : Create & Name Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 2 : Select Sources
Drag and drop source datastores from Models panel onto sources area
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating Joins Between Multiple Source Datastores
More than one datastore can be dropped onto the sources canvas
Join datastores by dragging and dropping key columns between datastores
Set join condition in the properties panel if join is non-equijoin
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating Filters
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Combining DataSets using Set Operations
DataSets with same column definition can be combined using set operations
Union, Union All, Intersect, Minus etc
Press Add/Remove Dataset button, choose set operation
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Combining DataSets using Set Operations
DataSets with same column definition can be combined using set operations
Union, Union All, Intersect, Minus etc
Press Add/Remove Dataset button, choose set operation
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Combining DataSets using Set Operations
DataSets with same column definition can be combined using set operations
Union, Union All, Intersect, Minus etc
Press Add/Remove Dataset button, choose set operation
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 3 : Select Target Datastore
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 4 : Define Mappings - Part I
Columns from the source area can either be dragged and dropped directly onto the
target datastore
Or they can be created or transformed using SQL expressions
SQL syntax is based on where the transformation is executed
Source, staging or target
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 4 : Define Mappings - Part II
Execute on property specifies where the mapping expression will get substituted in the
query generated by KM task
Source - substituted in query to load data from source datastores into C$ table for
LKM and I$ table for IKM
Staging - substituted in query to load data from C$ table into I$ table for LKM or
source datastores into I$ table for IKM
Target - substituted in query to load data into target datastore either from I$ table or
source datastores
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Temporary Datastores (Yellow Interfaces)
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 5 : Define Flows (KMs)
Second part of the interface, defines the technologies used for the mapping
Mapping is broken down into execution units
Select the appropriate KM for each unit
Select options presented by the KM (truncate table, check controls etc)
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 6 : Optionally, Use Check KM
When enabled, runs all the checks defined by the constraints on the tables
Moves error rows to E$ error tables
Can be recycled later on if errors fixed
Generally good practice to include CKM in interface if constraints defined
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating an Interface Step 7 : Execute and Test Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Demonstration
Defining an Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
What are Modular Interfaces?
Complex Integration Task - Requirement is broken down into set of regular and
temporary (yellow) interfaces
Pipeline - Interfaces are linked together to generate complex code or execute in an
orderly fashion
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
What are Temporary Interfaces?
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Create Modular Interface Step 1 - Create a Temporary Interface
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Create Modular Interface Step 2 - Set the Temporary Datastore
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Create Modular Interface Step 3 - Set as a Source
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Create Modular Interface Step 4 - Sub-Select Property
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Code Generation - Sub-Select Enabled
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Demonstration
Temporary Interfaces, Sub-Select Tables and Interface Pipelines
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Sequencing Interfaces using Packages and Scenarios
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
Diagram Palette
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
Properties Panel
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
Toolbar
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
Toolbox
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package Editor within ODI Studio
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Scenarios (Compiled Code) In ODI
Interfaces and other project objects can be added to packages in their regular,
uncompiled state
Useful during development
Or they can be compiled into Scenarios
Fixes the code at a certain state
Allows interfaces to be run in parallel
Required when promoting into production
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
ODI Package - Controlling Execution
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating a Package Step 1 : Create and Name Package
Right-click on the Packages entry under the required project, select New Package
Name the package and fill the Description
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating a Package Step 2 : Add Steps
Switch to the Diagram tab, drag and drop the required ODI objects (scenarios,
variables, etc) as steps from the project
ODI tool as step
To add click the ODI tool under Toolbox and then click under diagram palette
To stop adding ODI tool, click the arrow icon on the toolbar
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating a Package Step 3 : Set Properties for Steps
Select the step, under Properties panel set values for required properties
Runtime substitution - ODI variables\substitution apis
Static substitution - Hardcode values
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating a Package Step 4 : Add Transitions
Click the ok or ko transition icon on the toolbar and draw lines between steps
ok (green line) to next step on success
ko (red line) to next step on failure
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Creating a Package Step 5 : Save and Execute
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Demonstration
Compiling Interfaces into Scenarios, and Sequencing using a Package
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
New in ODI 11.1.1.5+ : Load Plans
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Load Plans
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Conditional Branching
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Exception Handling
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Exception Steps
Exception steps can be defined and attached to one or many Load Plan Steps
Exception steps can invoke serial/parallel steps, scenarios
Conditional branching can be used within exception steps
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Restarting Failed Load Plans
The behavior of each step and scenario in a load plan on restart can be configured
Serial steps:
- Restart all children steps (failed or not)
- Restart from the failing child step
Parallel steps:
- Restart all children steps (failed or not)
- Restart just the children step(s) that failed
For Run Scenario steps:
Restart session, session step, or session task
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Running Load Plans
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Running Load Plans
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Demonstration
Load Plans
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Summary, and More Information
ODI is a fully-featured ETL and data integration tool, and available now on OTN
New features in ODI 11g to support complex mappings, enterprise deployments
More information can be found at http://www.rittmanmead.com
Contact us at info@rittmanmead.com or mark.rittman@rittmanmead.com
Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12
Inside Oracle Data Integrator 11g
Mark Rittman, Technical Director, Rittman Mead
OUG Ireland Conference 2012
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com
Monday, 19 March 12