Professional Documents
Culture Documents
Ibm Information Server Websphere Datastage 8.0
Ibm Information Server Websphere Datastage 8.0
Unified Deployment
Discover, model, and Standardize, merge, Combine and restructure Synchronize, virtualize
govern information and correct information information for new uses and move information for
structure and content in-line delivery
Parallel Processing
Rich Connectivity to Applications, Data, and Content
IBM Information Server Architecture
UNIFIED USER INTERFACE
Supporting IBM
WebSphere
Analysis Development Web Admin Application Server
Interface Interface Interface
COMMON CONNECTIVITY
Find item in
Repository tree
– In-place find
New object in
repository that contains
the names and values
of job parameters
Available from
Range expression
operator drop down.
Specifies whether the
range bounds are
inclusive or exclusive
Surrogate Key Management
New engine functionality
Exposed in 2 new stages and 1 old one
– Surrogate Key Generator
– Slowly Changing Dimension
– Transformer – Initialize(), GetNextKey()
How it works
– Uses built-in state files or DBMS sequences (DB2 & Oracle)
– Supports large integer (uint64) surrogate key values
– Can be used to discover surrogate key values which are already
being used so that use of duplicate key values will be avoided
– Customizable block size to manage key gaps vs. performance
New Functionality to Support SCD
New engine
capabilities
– Surrogate Key
management
– Updatable in-memory
lookups
New & enhanced
stages
– Surrogate Key
Generator
– Slowly Changing
Dimension
Agenda
IBM Information Server Overview & Architecture
WebSphere DataStage Usability Improvements
Best in class Data Transformation
Focus on Connectivity
Performance, Performance, and Performance
Installation, Configuration, Administration, Reporting
Upgrade to WebSphere DataStage v8.0
Connectivity Updates
ODBC
– Embedded DataDirect v5.2 Connect for ODBC drivers
DB2 – Q107
– For DPF and non-DPF
Teradata – Q107
– New support for Teradata Parallel Transport (TPT)
Oracle – Q107
– New support for 10gR2
WebSphere MQ – Q107
– Adding support for “client only” configuration
Next Generation “Rich” Connectors
Connection
objects allow
properties to
be dropped Test the
onto stage connection
instantly
Diagram lets
you select the
link to edit as Parameter
though you’re button on
on the canvas every field
Warning sign
Graphical SQL
tells you which
builder
fields are
mandatory
Enterprise Packs Updates
– New Functionality
• Enhanced support for Siebel EIM and Business Components
• New Metadata browser and importer for Oracle Applications
• Greater support for large enterprise class deployments
CFF Stage – Multi-Format Record Support
Complex Flat File stage now
processes Multi Format Flat
(MFF) file
Buffer Optimization
– Improved buffer placement algorithm
– E.g., Removed unnecessary buffer before parallel sort in some
instances
Combinability Optimizations
– More combinable stages
– Intelligent combining
5. Map Credentials
Security Services
Internal Directory
– Defines users, groups, roles
– Support browsing/creation/deletion/update operations
External Directories
– LDAP, Active Directory, Unix
– External directories password are not stored
– Support browsing/partial update operations
Roles
– Suite roles: Suite User, Suite Administrator
– Product roles: e.g. DataStage user
– Project roles: e.g. Information Analyzer User
Standard Based Authentication
– JAAS
– Work against the supported directories
Logging
A new common logging facility
– Used by all the products of the Suite
– Logs go into the operational repository
DataStage Client log viewer does not change
Logging administration done from the administration console
Logging Views are “saved queries”
– Opening a view displays the log events corresponding to the
“saved query”
– Example
• Severity level: Error
• Category: DataStage
• Timestamp: past 12 hours
– A user can now view logs in a Production environment via a
browser and perform nothing else in that environment
Reporting Console
Job Reports,
Advanced Find,
Impact Analysis, etc.
Source-to-Target and Target-to-Source
Agenda
IBM Information Server Overview & Architecture
WebSphere DataStage Usability Improvements
Best in class Data Transformation
Focus on Connectivity
Performance, Performance, and Performance
Installation, Configuration, Administration, Reporting
Upgrade to WebSphere DataStage v8.0
Upgrade
All objects from DataStage v7 projects upgrade into
DataStage v8.0
– Export projects and Import into DataStage v8.0
– All jobs (Server, Parallel, Mainframe, and Sequencer)
along with all other objects will migrate