Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 27

Data Mesh

Rethinking Enterprise Data Architecture


Anders Boje Hertz
Head of AI & Data Platforms at INTELLISHORE

anders.hertz@Intellishore.dk
https://www.linkedin.com/in/andersboje/
We focus on providing the next generation of consultancy for the digital age: a true passion for
data, a combination of strategy advisors and native technologists , and a dedication to
delivering actionable insights and cultural change

45+ 34.8%
In 2013 Top-line growth in 2020 &
It all started Employees
29.7% in 2019

200+ analytics 3,500 employees trained


In analytics solutions developed by
projects completed Intellishore
AND A COMPREHENSIVE TOOLKIT TO SUPPORT THE DIGITAL TRANSFORMATION

Learning Platform Visual Analytics

N CH
U
LA
User Journey Algorithmic Science
ENGAGING IGNITING
PEOPLE DATA
PR
EP

E
A

G
RE

A
G
EN
Strategizing | Data & AI
Automation
Sources & Platforms

Decision Maturity
Industry

IGNITING DATA – ENGAGING PEOPLE | 2021 | NON-EXHAUSTIVE |


TRANSFORMATIONS ARE DRIVEN BY HOW FAST COMPANIES MASTER 5
DISCIPLINES
005
Ensuring that data scientists, engineers and their
analyses are fully engaged and integrated with the
001
day-to-day business
Defining a shared action plan for all
elements of transformation: business,
technical and organizational

004
Building up the organization’s capabilities and
ways of working to drive data literacy and usage

002
Establishing the setup to continuously
validate, access, explore and expand the
foundation of quality data

003
Turning the insights from the data into
accessible reports and tools that can be used in
day-to-day operations

IGNITING DATA – ENGAGING PEOPLE | 2020


let's get data messy
CENTRALIZED | MONOLITHIC

BIG DATA | AI PLATFORM

Ubiquitous Data Innovation Agenda


THE NEXT GENERATION DATA PLATFORM
… and yet, the failure modes remain

Data Lake Cloud


Warehouse
Data Mesh
A decentralized sociotechnical
approach in managing and
accessing analytical data at scale.
THE FOUR PRINCIPLES OF DISTRIBUTED ARCHITECTURE

Domain-oriented Data as a Self-serve data Federated


decentralised data product infrastructure as computational
ownership and architecture a platform governance

IGNITING DATA – ENGAGING PEOPLE | 2021


DECOMPOSE DATA AROUND DOMAINS
Distribute the ownership

Domains aligned
with the origin of Domains aligned
data with shared aggregates

Domains aligned with


the consumption

IGNITING DATA – ENGAGING PEOPLE | 2021


SERVE DATA AS A PRODUCT
Delight the consumer with ease of data discovery and use

Domain Data
Product Owner

E T L

Domain Data
Product

IGNITING DATA – ENGAGING PEOPLE | 2021


ENABLE AUTONOMY
Abstract technical complexity in self-serve data infrastructure

Data | ML Infrastructure as a Platform

Data Infra Team

IGNITING DATA – ENGAGING PEOPLE | 2021


BUILD AN ECOSYSTEM
Create a federated and global governance

Global Governance| Open Standards

Data Infra as a Platform

IGNITING DATA – ENGAGING PEOPLE | 2021


ed
edd
Emb g Code
Co n
fi
Domain representative
Domain DP owners

ices
erv
&S
cies
Poli Dat
a
nal
p ut ati o
d ri ven
Com ain- cts
Dom Produ
Federated Computational API
Governance Domain’s Data Product Devs
and Data
e Product Owner
Plan
D ata
s&
vice
a l Ser
lytic
Ana

Data Product as Architecture


Quantum API
(Analytical Data, Meta-data, Code / Legacy
Pipeline, Policy sidecar) App
Domain’s App Devs

Micro es &
rvic
Service nal Se e
o
rati Plan
Ope Data

Apps
(Transactional Data, Code)
Data Platform Teams
sh
Me ane
Data nce Pl
r ie

API
e
Exp

ct
odu ane
a Pr l
Dat ence P
p eri
Ex
e
ity Plan
Multi-plane Data Util
Platforms

IGNITING DATA – ENGAGING PEOPLE | 2021


I though this was a tech
community?
IGNITING DATA – ENGAGING PEOPLE | 2021
IGNITING DATA – ENGAGING PEOPLE | 2021
IGNITING DATA – ENGAGING PEOPLE | 2021
But why?
IGNITING DATA – ENGAGING PEOPLE | 2021
Data Mesh
A decentralized sociotechnical
approach in managing and
accessing analytical data at scale.
While data (for most) may not be a “product” in a
strictly economic sense, it is still the life-blood of
organizational decision making, and should not be
allowed to become a by-product.

Serge Gershkovich

IGNITING DATA – ENGAGING PEOPLE | 2021


REFERENCES

Dehghani, Z. (2020). Data Mesh Principles and Logical Architecture.


Retrieved from Martin Fowler: https://martinfowler.com/

Moses, B. (2022). Data Mesh 101: Everything You Need To Know to Get Started.
Retrieved from Monte Carlo Data: https://www.montecarlodata.com/blog-data-mesh-101-everything-you-need-to-know-to-get-started/

Thoughtworks. (2022). Introduction to Data Mesh A principled approach.


Retrieved from Thoughtworks: https://www.thoughtworks.com/what-we-do/data-and-ai/data-mesh

Data Mesh Learning. (2022). Intro to Data Mesh.


Retrieved from Data Mesh Learning: https://datameshlearning.com/

Dehghani, Z. (2019). How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh.
Retrieved from Martin Fowler: https://martinfowler.com/articles/data-monolith-to-mesh.html

Gershkovich, S. (2022). Data Mesh: overhyped, misunderstood, and useful!


Retrieved from Medium: https://medium.com/sqldbm/data-mesh-overhyped-misunderstood-and-useful-e65c60ba6643
Thanks
Anders Boje Hertz
Head of AI & Data Platforms at INTELLISHORE

anders.hertz@Intellishore.dk
https://www.linkedin.com/in/andersboje/

You might also like