AIM : Study of ETL Data Warehouse tools

THEORY:
While working with databases, it is essential to
properly format and prepares data in order to load it
into data storage systems. ETL are three separate but
crucial functions combined into a single
programming tool that helps in preparing data and in
the management of databases.
Extract, Transform, Load each denotes a process in
the movement of data from its source to a data
storage system, often referred to as a data
warehouse.
1.)Extract: The extract function reads data from a
source database and extracts the desired subset of
data. The purpose of this step is to retrieve all the
required data from the source system with minimum
resources.
2.)Transform: This function filter cleanses and
prepares the extracted data using lookup tables or
rules or by creating combinations with other data
and converts it to the desired state. The transform
step includes validation of records, rejection of data
(if they are not acceptable) and data integration. The
commonly used processes for transformation are
conversion, sorting, filtering, clearing the duplicates,
standardizing, translating and looking up or verifying
the consistency of data sources.
3.)Load: The loading is the last stage of an ETL
process. The load function writes the resulting data,
i.e. the extracted and transformed data, (all of the
subset or just the changes) to a target data
repository.

Why Do We Need ETL Tools?

1.)ETL is much easier and faster to use when
compared to the traditional methods of moving data
which involve writing conventional computer
programs.
2.)ETL tools can collect, read and migrate data from
multiple data structures and across different
platforms, like a mainframe, server, etc.
3.)ETL tools include ready to use operations like
filtering, reformatting, sorting, joining, merging, and
aggregation.
What are the benefits of ETL tools?
Ease of Use:The first and foremost advantage of
using an ETL tool is the ease of use.
Visual Flow:tools are based on Graphical User
Interface (GUI) and offer a visual flow of the system’s
logic.
Operational Resilience:Many of the data warehouses
are fragile and give rise to operational problems.
Good for Complex Data Management Situations:ETL
tools offer better utility for moving large volumes of
data and transferring them in batches.
High Return on Investment (ROI):The use of ETL tools
saves cost, thereby enabling businesses to generate
higher revenue.
Performance:The structure of an ETL platform
simplifies the process of building a high-quality data
warehousing system. Moreover, several ETL tools
come with performance-enhancing technologies like
Cluster Awareness, Massively Parallel Processing,
and Symmetric Multi-Processing.
ETL Tools:
1.) Informatica PowerCenter
2.) Business Objects Data Integrator
3.) IBM InfoSphere DataStage
4.) Microsoft SQL Server Integration Services
5.) Oracle Warehouse Builder / Data Integrator
6.) Pentaho Data Integration (Open Source)
7.) Jasper ETL (Open Source)