Название: Ultimate Data Engineering Design Patterns: Design and Build Scalable Data Pipelines Using Proven Patterns for Modern Data Platforms
Автор: Bragadeesh Sundararajan
Издательство: Orange Education Pvt Ltd, AVA
Год: 2026
Страниц: 387
Язык: английский
Формат: pdf, epub (true), mobi
Размер: 10.1 MB
Build data pipelines that perform, scale, and last in production. Data engineering is the backbone of every modern data-driven organization — and the ability to design scalable, reliable pipelines is the most in-demand skill across analytics, AI, and platform engineering. Ultimate Data Engineering Design Patterns provides a comprehensive, pattern-driven guide to building robust data infrastructure, from foundational ingestion and storage to stream processing, governance, and cloud-native deployment. You begin with core architectural patterns and data engineering fundamentals, then progressively work through ingestion, storage, batch processing, stream processing, and transformation patterns using tools such as Apache Spark, Kafka, and Airflow. The final section covers data quality, governance, compliance, scalability optimization, and DataOps practices with end-to-end pipeline implementation and future trends. Thus, by the end of the book, you can design, build, and operate production-grade data pipelines with confidence, applying proven patterns to solve real-world data challenges at scale.