SISTEMAS DE APOIO À DECISÃO / Engenharia Informática, 3º Ano / 1º Semestre / Plataforma ETL^2: Mapa Geral da Arquitetura

SOURCE SYSTEMS DATA STAGING AREA MULTIDIMENSIONAL DB END-USERS

EXTRACTION TRANSFORMATION LOAD
SALES_SRC SALES_DSA SALES_DW
T_CLEAN_CUSTOMERS
transform_customers
(student) (student)

sb_tables sb_readonly
table_extract T_DATA_CUSTOMERS
incremental
VIEW_CLIENTES
T_CLIENTES
T_LOG_ETL
T_INFO_EXTRACTIONS

T_CLEAN_PRODUCTS
transform_products

VIEW_CATEGORIAS load_dim_customer
T_CATEG
T_DIM_CUSTOMER
non incremental

table_extract_non_ T_DATA_CATEGORIES
incremental screen_product_brands T_LOOKUP_*
T_PRODUTOS VIEW_PRODUTOS Marketing
load_dim_product Board
incremental

T_LOG_ETL
T_PROMOCOES T_DATA_PRODUCTS
table_extract screen_product_weight
VIEW_PROMOCOES

T_DATA_PROMOTIONS T_CLEAN_PROMOTIONS

incremental T_DIM_PROMOTION
T_LINHASVENDA_ T_DIM_PRODUCT
PROMOCOES load_dim_
Sales Employee table_extract screen_product_dimensions promotion
VIEW_LINHASVENDA_
PROMOCOES T_LOG_ETL
T_DATA_
LINESOFSALEPROMOTIONS
incremental

table_extract T_FACT_LINEOFSALE
T_LINHASVENDA
transform_promotions T_CLEAN_LINESOFSALE
VIEW_LINHASVENDA T_DATA_LINESOFSALE

incremental

table_extract
T_EMPREGADOS load_fact_table
VIEW_VENDAS
T_DATA_SALES transform_linesofsale T_CLEAN_SALES
T_DIM_DATE
incremental T_EXT_TIME
T_DIM_TIME

table_extract
T_VENDAS
T_DATA_STORES_NEW
load_dim_time
T_EXT_STORES
transform_sales

non incremental file_extract transform_stores

T_DATA_STORES_OLD
T_CLEAN_STORES (src_files/time.csv) T_DIM_STORE
FK Store
<stores’ data> (src_files/
stores.csv)
Manager

load_dim_store
T_DATA_MANAGERS_NEW
(src_files/
Store Manager lojas.xls)
non
incremental transform_celsius T_CLEAN_CELSIUS
load_dim_date

T_EXT_MANAGERS
(src_files/
managers.csv) file_extract

T_DATA_MANAGERS_OLD
T_TEL_EXT_DATES
TRANSFORMATION
ERROR LOGGER

non T_EXT_DATES
incremental
(http://api.ipma.pt/.../ web_extract T_DATA_CELSIUS
hp-daily-forecast-day0.json)
error_log
(src_files/dates.csv)

RELATIONAL TABLE INFO TABLE EXTERNAL TABLE STATIC DATA TABLE DIMENSION FACT TABLE VIEW PL/SQL CODE DATABASE OLAP TOOL

PROCESS WRITES PROCESS READS PROCESS READS&WRITES DATABASE

DATA TO TABLE DATA FROM TABLE DATA FROM/TO TABLE USER