Professional Documents
Culture Documents
Extract, Transform, Load: Inmon Bill
Extract, Transform, Load: Inmon Bill
Extract, Transform, Load: Inmon Bill
DATA WAREHOUSING - is a process for collecting and 1. Structured Data - data that is collected from a
managing data from varied sources to provide known method and can be neatly arranged.
meaningful business insights. Info that is highly organized, factual,
and to the point.
- a blend of technologies and components which
Quanti
allows the strategic use of data.
Data warehouses/ relational databases
- It is a process of transforming data into
Several pre-determined formats
information and making it available to users in a
2. Semi-structured -
timely manner to make a difference.
3. Unstructured data - that has no pre-defined
- the core of the BI system which is built for data
format or organization, making analysis more
analysis and reporting.
difficult
ETL - extract, transform, load (ETL) is the general Doesn’t have any pre-determined
procedure of copying data from one or more sources structured to it and comes in all its
into a destination system which represents the data diversity of form
differently from the source(s) or in a different context Quali
than the source(s) Data lakes/ Non-relational databases
Huge array of formats
A Data Warehouse works as a central repository where 2. Operational Data Store- which is also called
information arrives from one or more data sources. ODS.
Data flows into a data warehouse from the transactional - widely preferred for routine activities like
system and other relational databases. storing records of the Employees
- (ODS) is a powerful tool to help provide any
company or organization operational reports.
3. Data Mart - is a subset of the data warehouse.
7 PRINCIPLES
- specially designed for a particular line of
business, such as sales, finance, sales or finance. 1. GOVERNANCE – develop a program to ensure
- typically summarized data. compliance of key steps in data life cycle.
- It is a subject-oriented database and is also 2. DATA CONTENT – gather info that generates
known as High-Performance Query Structures value for business helping to achieve goals.
(HPQS). 3. DATA QUALITY – consider the quality and
consistency of your data as defined by
Kimball Model – from varied sources to data standardized processes.
marts then ETL to data warehouse. 4. DATA ACCESS – ensure data is readily/
Inmon Model – from Varies sources to Data available and understood by all influence in
Warehouse extract to Data Mart. your org.
5. DATA MANAGEMENT – develop and enforce
company-wide standards for technology and
UNDERSTANDING THE TYPES OF DATA IN BUSINESS
proper data usage.
ORGANIZATION
6. DATA INFORMED/DECISION MAKING –
1. Transactional Data - this type of data describes leverage your data as predictive intelligence
your core business activities. when making decision that relate to clients,
2. Master Data - it consists of key information that competitors, funders, donors, society and
make up the transactional data. partners.
3. Reference Data - is a subset of master data. It is 7. ANALYTICS – use data as competitive advantage
usually a standardized data that governed by by exploring patterns and predictive insights –
certain codification. to discover new patterns and perspective for
4. Reporting Data - It’s an aggregated data the business.
compile for the purpose of analytic and
reporting.
HR ANALYTICS - is the process of collecting and
5. Metadata - It’s a data about data. Metadata is
analyzing Human Resource data in order to improve an
giving you the answer to any question that you
organization’s workforce performance. HR analytics
cannot answer by just looking at the data
provides data-backed insight on what is working well
and what is not so that organizations can make
improvements and plan more effectively for future.
ORGANIZATIONAL DATA
III.
WHO NEEDS TO REGISTER?
BUSINESS INTELLIGENCE - is a set of processes,
- Companies with at least 250 employees or access to
architectures, and technologies that convert raw data
the personal and identifiable information of at least
into meaningful information that drives profitable
1,000 people are required to register with the National
business actions.
Privacy Commission and comply with the Data Privacy
Act of 2012 - It is a suite of software and services to
transform data into actionable intelligence and
knowledge.
COMPLIANCE OF THE DATA PRIVACY ACT - It has a direct impact on organization’s
strategic, tactical and operational business
decisions.
- BI supports fact-based decision making using patterns, spot trends, and uncover insights that foster
historical data rather than assumptions and gut growth and improvement.
feeling.
- BI tools perform data analysis and create
reports, summaries, dashboards, maps, graphs, Importance of Data Gathering
and charts to provide users with detailed
Data - A collection of facts that has been
intelligence about the nature of the business.
translated into a form that computers can
- It help businesses to identify market trends and
process.
spot business problems that need to be
Data Gathering is the systematic approach to
addressed.
collecting and measuring information from a
- BI technology can be used by Data analyst, IT
variety of sources to get a complete and
people, business users and head of the
accurate picture of an area of interest.
company.
- BI system helps organization to improve Importance
visibility, productivity and fix accountability.
- Gathering data allows us to store and analyze
important information about our existing and
potential customers.
CONCEPTS OF BUSINESS INTELLIGENCE
- Gathering data can also save money by building
The 4 basic components within business intelligence a database of customers for future marketing.
are: - Allows organizations to visualize relationships
between what is happening in different
1. The data itself (raw data) -The first component of an
locations, departments, and systems.
integral BI solution is the data itself. This data could be
- You no longer need to cast a “wide net” to
anything like sales records for the year, the keywords
reach potential consumers within your target
implemented in your latest advertising program, salary
audience.
and benefit tables, or profit and loss statements.
- You can use the information to build segmented
2. The data warehouse -The data storage warehouse is audience profiles for future marketing efforts,
the logistics platform that connects all of your different making your marketing spend more efficient
databases together and allows you to create and effective.
relationships between them. This is an area that has
seen great advances recently with the introduction of
IMPORTANCE OF STORING DATA
cloud-based BI tools.
DATA STORAGE- refers to conserving your data
3. Data access, analytics, and presentation -Once all of
files in a secured location and in a way such that
your data is connected and can ‘talk to each other,’ one
it can be accessed readily
of the next key business intelligence concepts is to
DATA ANALYZING - Process of cleaning,
make use of that data. This involves accessing the data,
transforming and modeling data to discover
analyzing it for important trends, and presenting it in a
useful information for business decision-
way that is immediately understandable.
making.
4. Data dashboarding and reporting -The fourth and DATA ANALYSIS TOOLS
perhaps most pivotal component of an interactive
• R-PROGRAMMING
dashboard is the ability to continuously track, monitor,
and report your data. • PLOTLY
• Inferential Analysis
IV.
DIAGNOSTIC ANALYSIS - shows "why did it
WHAT IS A RECORD?
happen?" by finding the cause from the insight
found in statistical analysis. - is an output that contains valuable information
PREDICTIVE ANALYSIS - "What is likely to for the business and reflects details of
happen" by using previous data. transactions of an institution, its staff and its
PRESCRIPTIVE ANALYSIS - Combines insights stakeholders
from all previous analysis to determine which - is an evidence of an activity or transaction
action to take in a current problem or decision. performed by the organization which shall
require retention for a specific period of time
- is information created, received and maintained
DATA ANALYSIS PHASES as information by the organization
F ISCAL
L EGAL