Data Mesh

What is a Data Mesh

A Data Mesh is a decentralised approach to your enterprise data architecture. The concept provides end-users with the ability to find and access cross-domain data easily. The approach is designed and operates based on a level of data ownership and responsibility within different domains, diverging from the legacy centralised monolithic data architectures of old.

The approach was originally theorised by Zhamak Degani, building the concept on Four Essential Pillars; Domain Ownership, Data as a Product, Self-serve data platform, and Federated Computational Governance. Learn about this state-of-the-art enterprise data approach and explore how Data Watchdog can be utilised in constructing your own Data Mesh Architecture.

Explore WCKD RZR Solutions

Find out how WCKD RZR can help you implement Data Mesh architecture.

Our Solutions

Why a Data Mesh?

Existing Data Estates are commonly monolithic and centralised around complex and convoluted pipelines and processes. These processes are overseen by dedicated teams; however, as organisations are becoming more data-centric these archaic processes are becoming increasingly overwhelmed by the ever-growing demands for their data from across the enterprise.

A Data Mesh approach to enterprise data architecture will enable your organisation to handle and grow with the increasing importance and volume of data requests.

The Four Pillars of Data Mesh

Explore the four pillars of Data Mesh and how Data Watchdog can help you implement this state-of-the-art enterprise data approach.

Benefits of Data Mesh

In moving away from the centralised processes and pipelines of the monolithic data estate, a modern Data Mesh moves the responsibility and control of data access and processing to those stakeholders with the contextual knowledge of their own information. This contextual knowledge of their own means you avoid the back-and-forth communications, contextual questions and requests for approvals of existing monolithic processes.

Ultimately, the Data Mesh approach is designed to put the stakeholders with the relevant knowledge in a position to carry out their own data access processes without time-consuming interactions with external teams and convoluted processes.

Domain Ownership

In existing monolithic data processes, external data teams hold the responsibility for the handling of data assets between stakeholders and data sources, without the context of the assets intended deployment. Without a link between data providers and consumers, direct feedback and context is lost leading to the end-to-end processes of the data pipeline becoming inefficient.

In a Data Mesh, Domain owners are able to leverage data assets directly in line with their operational needs eliminating time-consuming and convoluted back-and-forth processes associated with existing data access pipelines.

Back to the Pillars

Data as a Product

Data products or 'Data Assets' are data sets served by a domain and transformed into business value. The Data product is key to the operation of a Data Mesh, existing attitudes treat the Data Product as a by-product of business processes, collected and dumped in central stores.

When treating Data as a Product, a Data Mesh approach ensures high quality data is captured and delivered efficiently to the relevant domains and stakeholders.

Back to the Pillars

Self-Serve Data Platform

The end-to-end process for accessing a relevant data resource within a centralised enterprise data pipeline involves a number of external processes and stakeholders, outside of the business users' domain. These convoluted processes require a chain of approvals, requests, and delays in the simple task of providing business users access to valuable data resources. The Data Mesh approach deploys the Domain Ownership in designing a Self-service infrastructure for all data processes.

The Self-serve Data Platform within a Data Mesh will allow domain users and engineers the ability to carry out key tasks on a centrally managed and operated tool; however, without the constraints of centralised requirements, communication, and requests. This streamlines processes within domains and enables the true Domain Ownership of case-specific data at a reduced cost.

Back to the Pillars

Domain Driven Data Governance

The Data Mesh approach proposes decentralisation of data requests and processes, with Domains taking ownership of their pipeline; however, with the stakeholders and risks involved in corporate governance, a Data Mesh approach requires a shared responsibility between domains and centralised processes for data governance.

A Domain Driven Governance function utilises domain ownership of data processes in ensuring all actions taken within the Data Mesh are fully compliant with relevant requirements, whilst also being held in compliance with universal requirements and policies through centralised enforcement infrastructure.

Back to the Pillars