Loading Data

Michael Walker
SENIOR BUSINESS INTELLIGENCE ANALYST

mwportfolio.github.io/blog
 Visualizing Data
- Exploring the data model

Summary Loading Data

- Joining and manipulating

Next steps?
- Build an App!
- Data model maturity

Help?
- Discussion forum
Summary QlikSense Desktop
- Build Apps
- Load & Visualize Data

Data Files
- Load Into Qlik
 Visualizations
- Common Chart Types

Filtering the Data

Summary - Interesting Patterns

Bookmarks
- Saving Filters

Customizations
- Colors, layouts

Sheets
Bookmarks
Stories
 Develop Knowledge of Data Model
- Visual Exploration

Developing Chart Prototypes

Summary
- Conversation Starter

Structuring Your App

- Summary and Detailed Views

Using Bookmarks
- Saves Time Reapplying Filters

Using Stories
- Provide Additional Context
Summary
Sheet Management and Navigation
Chart Creation and Management
Summary
Labelling Charts
Splashing Color
Sorting Data Items
Demo Importing multiple data sources
Establish centralized reporting
Integrate / join data sources
Validating your data model
Demo Creating a new Qlik App
Importing multiple data sources
Navigating the Qlik interfaces
Reviewing your data model
Demo
Creating a New App
Navigating the Data Interfaces
Demo Loading Data using Data Manager
- Multiple data sources

Previewing Data
- Data values
- Metadata
Demo Joining Data using Data Manager
Associations Tab
Configuring the Join Columns
Demo Data Interface Synchronization
Impacts on Data Model
Demo Loading Data using Data Load Editor
Creating Code Sections
- Modularize App Code

Creating Aliases for Tables

- User Friendly Names
 Joining Data using Data Load Editor
Demo
- Full control of code

Understanding Automatic Join Logic

- Use Cases
Demo Transforming Data Items using Data Load
Editor
- Mapping tables
Demo Reviewing The Data Model
- Validating changes
- Previewing changes
 Develop Integrated Visualizations
- Present multiple data sources into a

Demo single page

Identifying Data Model Issues
- Adjusting model to resolve issue

Calculations Level-Up
- Set Analysis capability
 Adjusting Chart Properties
Headers
- Dynamically Setting Titles and
Demo Subtitles
Coloring
- Highlight Interesting Values

Ordering
- Sorting Data Items
 Trust Goals

Report Audience Developer

The numbers in the Qlik report The report data model
 Changing Hats

Data Modeler Report Developer

Data transformation, joining, Dashboard, visualizations,
validating presentation
 Converting Abbreviations to Full Names

If Statements Mapping Table

Lots of hardcoded manual work Single table containing lookup
values
 Joining Scenarios

Don’t Want Want

Avoid unwanted joins Control data model relationships
 Joining Data in Qlik

Sales Customers
CUST_ID CUST_ID
 Joining Data in Qlik

JOIN_COL JOIN_COL
 Joining Data in Qlik

CUSTOMER CUSTOMER
 Joining Data in Qlik

LAST_UPDATED LAST_UPDATED
 Joining Data in Qlik

Sales Customers
CUST_ID ID
 Joining Data in Qlik

Sales Customers
CUST_ID ID
 Joining Data in Qlik

Sales Customers
CUST_ID CUST_ID
 Our Data Model

Medals GDP Data

LOCATION LOCATION
 Modelling Issue

Medals GDP Data

LOCATION LOCATION
Year TIME
 Modelling Issue Resolution

Medals GDP Data

LOCATION LOCATION
Year TIME
 Qlik Data Interfaces

Data Manager Data Load Editor

Graphics based; drag and drop Text based; manually control
components load statements and logic
 Qlik Data Interfaces

Data Manager Data Load Editor

Graphics based; drag and drop Text based; manually control
components load statements and logic
 Qlik Data Interfaces

Data Manager Data Load Editor

Data Model
 Interrogating Data Model

Explore Data Relationships Query Data

Data Model
 Tables

Detailed Trust Reconciliation

Displays lowest-level Accuracy of aggregate Comparing data to
records charts other systems
 Data Preview

Metadata Data Selective Import

Confirm available Sanity check data Subset of columns
columns values
 How Are Mapping Tables Different?

Structure Syntax Visibility

Only 2 columns MAPPING LOAD Only during load
 High-Level Summary

Global Filters Counts Starting Point

Big slices of data Number of rows Base camp for
exploring the data
model
 Specific Question / Subject Area

Composition Focused Context

How total figures are Specific data values or How zoomed view
made up business questions relates to overall totals
 Detailed

Structure Syntax Visibility

Only 2 columns MAPPING LOAD Only during load
 Data Preview

Confirm if all required columns are available in file

Sanity check data values

Select a subset of columns to import if appropriate

 Methods for Not Joining

Alias column name

Remove from LOAD statement

Comment column from LOAD statement

 Data Model Viewer Tasks

Review data model layout

Validate integrity of data model

Preview changes to underlying data model

Collaboration – An Audience Perspective

Regular progress updates

Opportunity to provide direct feedback

Knowledge sharing of business process details

 Good Charts

Meaningful Titles

Appropriate Sorting

Easy To Read
 What Are We Counting?

All Athletes Medal Winning

Every Athlete who has
Athletes
participated in an Olympic Only those Athletes that have
event. won medals.
 Report Development

Validate Data
Build Data Model
Model Build Reports
Load and join data
Ensure correct data Presentation
sources
source integration
Simplified Report Development Workflow

Walkthrough
Prototype Prioritize
Ensure correct data
Develop Presentation
source integration
 Data Tasks

Convert Split Upper/Lower

Shape Pivot/Unpivot Group/Count

 Rhyming Data Model Exploration

Enumerate Investigate Tabulate

Charts counting data View data Provide
items, overall or by high- movement over time exportable table
level grouping period with key fields

Collaborate Iterate
Filtrate Involve audience by Make changes
Provide searchable lists of data providing based on audience
items for filtering Charts walkthrough of feedback and
prototypes direction
 Title Only Layout Example
System 1 Sight
Information

Database
System 2 Mobile

System 3 Process
 Centralized Reporting

QlikSense

CSV files
 Centralized Reporting
Relational Databases
QlikSense

Data Lake

CSV files
 Exporting Data From Systems

Enterprise System

CSV files
Export Function
APPLYMAP(‘MapCountryName’, NOC) as FullCountryName

Using The ApplyMap Function

Parameter 1: ‘MapCountryName’ is Mapping Table alias
Parameter 2: NOC is key column for lookup
 SQL SELECT vs QLIK LOAD

SELECT LOAD
col1, col1,
col2 col2
FROM FROM
DB.TABLE DATASOURCE
WHERE WHERE
X=Y X=Y
; ;
 Column Alias

LOAD
ID
FROM
[Customers.csv];
 Column Alias

LOAD
ID as CUST_ID
FROM
[Customers.csv];
 Conditional Calculation Using IF Statement

IF (MEASURE = ‘MLN_USD’, SUM(Value))

 Conditional Calculation Using Set Analysis

Sum( {<MEASURE = {‘MLN_USD’}>} Value)

 Count Gold Medals With Set Analysis

Count( {<Medal = {‘Gold’}>} ID)

 Conditional Coloring With IF Statement

IF (Medal = ‘Gold’, ‘Gold’)

 Dynamic Subtitle

Count( {<Medal = {‘Gold’}>} ID) & ‘ Gold’

 Bar Chart Configuration

Dimension: FullCountryLabel
Measure: Count( {<Medal = {‘Gold’}>} ID)
LOAD  LOAD statement header
ID,  List of columns or calculations
Name,

Sex,

"Age"

FROM  FROM statement header

[lib://datasets/athlete_events.csv]  Data source string
(txt, codepage is 28591, embedded  Properties (data source specific)
labels, delimiter is ',', msq)

 End statement with semicolon

;
[My Table]:  Table alias
 LOAD statement header
LOAD

ID,  List of columns or calculations

Name,

Sex,

"Age"
 FROM statement header
FROM
 Data source string
[lib://datasets/athlete_events.csv]

(txt, codepage is 28591, embedded  Properties (data source specific)

labels, delimiter is ',', msq)

 End statement with semicolon

;
Sum(Value)  Normal aggregate calculation

Sum( {<>} Value)  Aggregate calculation with

empty set analysis block

Sum( {<MEASURE = {‘MLN_USD’}>} Value)  Set analysis statement

 Qlik Data Interfaces

Data Manager Data Load Editor

Graphical-based Text-based
Suited to business analysts Suited to data analysts
Provides recommendations Gives developer full control
Automatic code generation Manual code generation
App
An App refers to a report which may contain one or
more Sheets.
Sheet
A Sheet is a screen canvas upon which graphical,
interactive charts and widgets can be placed. Multiple
Sheets can exist within a single App.
“O l’oun t’awa se n’yara, Je k’abere

Let’s start what we have come into

the room to do.”
Fela Kuti