Название: Implementing Data Mesh: Design, Build, and Implement Data Contracts, Data Products, and Data Mesh
Автор: Jean-Georges Perrin, Eric Broda
Издательство: O’Reilly Media, Inc.
Год: 2024
Страниц: 268
Язык: английский
Формат: epub
Размер: 10.1 MB

As data continues to grow and become more complex, organizations seek innovative solutions to manage their data effectively. Data mesh is one solution that provides a new approach to managing data in complex organizations. This practical guide offers step-by-step guidance on how to implement data mesh in your organization.

In this book, Jean-Georges Perrin and Eric Broda focus on the key components of data mesh and provide practical advice supported by code. Data engineers, architects, and analysts will explore a simple and intuitive process for identifying key data mesh components and data products. You'll learn a consistent set of interfaces and access methods that make data products easy to consume.

Data Mesh is, at its foundation, a conceptual framework in the realm of data architecture, which emphasizes decentralized data ownership and architecture. It recognizes that in large organizations, data is vast and varied, where each business domain has a significant degree of autonomy over (as well as local knowledge and mastery of) its own data. By decentralizing control, Data Mesh empowers individual domains to manage and make decisions about their data while maintaining a cohesive overall structure. With this autonomy presumably comes better, more localized, and faster decisions, which in turn lead to more speed and agility.

In the context of a Data Mesh, a data product is a package of data that is self-contained, self-descriptive, and oriented toward a specific business purpose or function. Data products are packages of data crafted to address specific business objectives within an organization. These are not mere collections of data; rather, they are comprehensive units that encapsulate the data itself along with essential tools, documentation, and metadata. This ensures that the data is not only present but also understandable and usable. Each data product is purpose oriented, tailored to serve a particular business need or solve a specific problem, making them much more than just repositories of information.

The structure of a data product is self-contained, meaning that it includes everything necessary for its effective utilization. It adheres to strict standards of quality and governance, thereby ensuring reliability, security, and compliance with relevant regulations. This comprehensive approach makes data products a trusted and dependable resource within the organization. They are designed with user accessibility in mind, offering interfaces and documentation that are easily navigable by a wide range of users, from data experts to those with minimal technical expertise.

This approach ensures that your data products are easily accessible and the data mesh ecosystem is easy to navigate. This book helps you:

Identify, define, and build data products that interoperate within an enterprise data mesh
Build a data mesh fabric that binds data products together
Build and deploy data products in a data mesh
Establish the organizational structure to operate data products, data platforms, and data fabric
Learn an innovative architecture that brings data products and data fabric together into the data mesh

Who Is This Book For?
This book is for all those who are interested in Data Mesh concepts and implementation, regardless of their level of expertise. We value your interest and are excited to share our insights with you.

If you are a data engineer, you will learn how your job and tasks will evolve with Data Mesh. Don’t worry—it will make your day-to-day a lot more interesting.

If you are an architect, you will discover how this software architecture will benefit data architecture and will allow you to build better data platforms.

If you are a technology leader, this book will give all the help you need to build and implement Data Mesh. Most importantly, Part III imparts a lot of knowledge about change management and the social aspects of Data Mesh.

If you are a nontechnical C-level, this book may not be the best investment for you, but it is for all the technology staff in your organization. Think about end-of-year gifts, birthdays, anniversaries… You will make people happy.