Professional Documents
Culture Documents
DCT Model v005 LTM All
DCT Model v005 LTM All
For live feed scenario, where site/country data keeps changing on ongoing
basis even after go live and needs to be incorporated in target SAP/other
system, please refer to our other presentation.
Nomenclature
What’s New
NEW METHODOLGY
A proven methodology and mature technological architecture to
be used for Data Migration projects by big clients with multiple
countries/sites to be migrated in a phased plan over a period
of time.
• Benefit Highlights
q We present you a architecture model, that will meet your immediate and long term needs
q A architecture that has a proven track record of being one of the best. It has been built over few
years of continuous inputs and acts as great reference
q Eliminate try and try approach by inexperienced resources.
This approach can be costly in terms of time and money
Often this is a continuous ongoing patchy work to existing solution
Often becomes more and more unmanageable due to patch works
q Delivery of proven platform will deliver great values and provide cost saving on business front too
q This platform gives the country data owners high level of transparency in term of seeing there data
that gets selected, the data that would get loaded along with errors at each check level.
q Save multi millions euros over the next 1-2 years in terms of learning curve, avoiding fixes to
existing work, eliminate waste of time by dependent users to get right reports etc
Shorten delivery of right platform
Delivery capability to manage / roll-out more sites at the same time within fixed deadlines
Shorten each phase time due to better platform and quick turnaround time for checks and
appropriate reports
What’s New
• Better Control
q Introduction of new template to manage tasks, progress and issues at SAP object level
q Introduction of new template for enhanced SAP configuration values management
q These templates will deliver the appropriate graphs and figures for management reports
• Financial ROI
q This approach is a candidate for projects with more then xx million € budget and more then 1 site
q It can assure 10 upto 30% financial savings
q It can guarantee higher quality data migration and thus ensuring further saving of 10%, which
normally is spent to fix poor data quality migration. This is ensured by this platform approach and
further supported by our suggested strategy to manage real time data quality validations.
General Client issues at hand
Nomenclature
Team Setup Approach
SAP
S1) Basic Mappings for S2) Mappings for
S3) SAP Check & Load System Load
extracting Site data and Basic checks &
Mappings & Reconciliation
map it to object templates Data accumulation
Legacy
System Mapping
Off-Line J
L Quality
Checks
Flat
Data File to Central Team, via FTP
Cleansing Site
Responsibility
Informatica Cluster/Central Process
Checks
Legacy Chk1
System Mapping Chk2
Chk3
Free
Format
Online
J
Off-Line
L Quality Quality
Checks Checks
J
Data
Cleansing Site
Responsibility
Flat
File
L
Cluster SAP
Responsibility Production
System
OverAll Process Flow
CONFIG
SITE CLUSTER
REPO
LEGACY Excel
Template/
SYSTEM KDS SAP
Extract Extract R/3
LKP
Data Data
Site Mapping Check 6&7
Check 0
1 1 2 3 4 5
e ck e ck e ck ck ck ck o ad
Target/
Ch Ch Ch he Ch
e
Ch
e L
Source Source Source Source C SQL Load
file file file file Data
Check 1 errors
Check 2 errors
• Check 1 Mapping
q Perform Relevance check (quality checks level 1)
q Running this mapping to ensure that all the necessary data fields are available from the data
owners
q Generated separate files for good and error records
•
q Perform duplicates check and generates output file with duplicate records
q Mapping 3 loads all records which passed Chk-2 into a SQL table.
q Assess inner duplicate ratio (percentage of duplicated records within site legacy systems) and outer
duplicate ratio (local data already existing in SAP)
q A version of this mapping also deletes all the previously loaded data for this delivery for this specific
site
Informatica Mappings C- Team
•
q checks the integrity between data objects in SAP. There is no standard layout for this
mapping. The checks are specified in the BII.
•
q These mappings downloads the data from SAP tables on daily basis or regular
intervals.
OverAll Process Flow – Error Reporting
SITE CLUSTER
Business User
Check 2 errors
lin
e
Check 1 errors
St
SAP
at
us
R/3
an
d
Er
ro
rL
og
o ad
ac
L
ce
ss
Load
CHECKS SQL CHECKS
Data
Web Portal-
One Point Control Center File Server
Informatica –File Server Overview - Central
• It covers the understanding of the location of in & out files used for the
mapping and tracing of them on server; these are primarily the I/O files
related to mappings.
• Also we cover the following things in context of specifying the sessions for
mappings:
q Speciying of Source files location
q Speciying of Target files location
q Locating error files generated
q Locating duplicates/bad files generated
• In brief, we highlight the tracing of following In & out files types of files:
q Source, Target Error, Duplicates Files –Chk1
q Source, Target Error Files –Chk1 (C)
q Source, Target Error Files –Chk2
q Duplicates Files –Chk3
• The initial decision for the source, target locations are specified by the
Informatica expert OR the person responsible for administration of your
informatica Server.
• The location of the files generated is somewhere on a central server, which
has restricted access. It is highly organized by SiteCodes and ObjectNames.
The Informatica I/O are usually structured as:
INF_ROOT/
SITE_ID/
<<Folders>>
Informatica –File Server Overview - Central
• Each time you FTP your file to central
server, a special code and a directory
with that code name is created to track
all actions on it. Eg. 20090815_1609 on
right side. It consist of date and a
random number.
• Source File
q Your source file is with the same name that you used in FTP name.
q In above case it is with <object_name>.out (eg. c002_vendor_partner_function.out)
• Target Files –Chk1
q Files generated after the automatic running of the CHK1 central mappings are
<object_name>_chk1.out & <object_name>_chk1_error.out
q <object_name>_chk1.out represents the file with correct records
q <object_name>_chk1_error.out represents the file with error records
q In above eg. the concerned files are:
c002_vendor_partner_function_chk1.out
c002_vendor_partner_function_chk1_error.out
• Target Files –Chk2
q Files generated after the automatic running of the CHK2 central mappings are
<object_name>_chk2.out & <object_name>_chk2_error.out
q <object_name>_chk2.out represents the file with correct records
q <object_name>_chk2_error.out represents the file with error records
q In above eg. the concerned files are:
c002_vendor_partner_function_chk2.out
c002_vendor_partner_function_chk2_error.out
• Target Files –Chk3
q Files generated after the automatic running of the CHK3 central mappings are
<object_name>_sql.bad
q <object_name>_sql.bad represents the file with duplicate records
q In above eg. the concerned files are:
c002_vendor_partner_function_sql.bad
Informatica – Disorganised Site Data
Chk0 Mapping-
• Basic activies in the basic site mappings are :
q Legacy Unit Codes into SAP Unit Codes
q Format Codes – eg. Sales Material begin with ‘A’ and have no ‘-’
q Set the KDS Values
q Set Default Values
q Lookup tables to compare values, return new data values.
q Test for small relationships eg. bankcode of vendors not in Banks file
q Filter out any unwanted records Or take only desired ones eg. Same source file contains all
customers and we need to filter out External, Internal etc.
Nomenclature
AIP (Automated Informatica Platform)- Main Functions
• Scope Control
q Global Repository for all data objects (documentation)
q Site specific scope control
• Planning
q Set Delivery / Load dates
• Statistics
q Follow Up on delayed deliveries / loads
• SAP Downloads
q Manage all table downloads from SAP
q Instantly refresh tables – Selective access to end users
• Easy To Maintain
q Maintain multiple sites at the same time in the AIP
q Adding additional sites will have no lead-time < 1 minute to setup.
q Whole solution can be maintained by 2-3 Informatica Developers at the central data
conversion location
Scope Control
File Management
Planning
Statistics
SAP Downloads
Agenda
Nomenclature
Nomeclature
• P3 Targets, Sources
q Central Team generates these Targets, Sources.
q The structure specified in the FD needs to be built in Informatica as a target. The sites will map their
source to this target in the mapping process.
• SAP Extracts
q Central Team Extracts current production SAP Data for Sites to use as reference tables. eg.
Vendors,Customers, Materials, Banks.
• Site Mappings
q Used to refer Mappings used for the purpose of extraction/formating of data from legacy systems
into the P2 Target format.
q It could be 1 or more mappings for each FD object based on complexity
• Site Chk1 Mapping
q A shortcut to the Central teams Chk1 mapping
q It checks data for Mandatory Fields and generates a error file
q If no errors during running of this mapping, we can FTP the file to the central team, else analyse the
errors and fix them.
q The source and the Target structure is same in this mapping
• Central Chk Mappings
q These represent the reusable set of object mappings. They require minimal set of changes to
include new countries
• KDS
q It refers to Key Data structure values which are configured inside SAP for each country/site
• Localization Matrix
q It refers to country specific exceptions
• Site Team
q This is the team of technical and business data owners who focuses on extracting site data, site
level checks and reconciliations and delivery it further
• Central Team
q This is the technical and Functional designers who ensures implementation of all site level, project
phase level and SAP level checks and reconciliations