Data Engineering with Databricks Cookbook: Build effective data and AI solutions

Description: Data Engineering with Databricks Cookbook by Pulkit Chadha This book shows you how to use Apache Spark, Delta Lake, and Databricks to build data pipelines, manage and transform data, optimize performance, and more. FORMAT Paperback CONDITION Brand New Publisher Description Work through 70 recipes for implementing reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake, and use Databricks to orchestrate and govern your dataKey FeaturesLearn data ingestion, data transformation, and data management techniques using Apache Spark and Delta LakeGain practical guidance on using Delta Lake tables and orchestrating data pipelinesImplement reliable DataOps and DevOps practices, and enforce data governance policies on DatabricksPurchase of the print or Kindle book includes a free PDF eBookBook DescriptionWritten by a Senior Solutions Architect at Databricks, Data Engineering with Databricks Cookbook will show you how to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, starting with comprehensive introduction to data ingestion and loading with Apache Spark.What makes this book unique is its recipe-based approach, which will help you put your knowledge to use straight away and tackle common problems. Youll be introduced to various data manipulation and data transformation solutions that can be applied to data, find out how to manage and optimize Delta tables, and get to grips with ingesting and processing streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Advanced recipes later in the book will teach you how to use Databricks to implement DataOps and DevOps practices, as well as how to orchestrate and schedule data pipelines using Databricks Workflows. Youll also go through the full process of setup and configuration of the Unity Catalog for data governance.By the end of this book, youll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.What you will learnPerform data loading, ingestion, and processing with Apache SparkDiscover data transformation techniques and custom user-defined functions (UDFs) in Apache SparkManage and optimize Delta tables with Apache Spark and Delta Lake APIsUse Spark Structured Streaming for real-time data processingOptimize Apache Spark application and Delta table query performanceImplement DataOps and DevOps practices on DatabricksOrchestrate data pipelines with Delta Live Tables and Databricks WorkflowsImplement data governance policies with Unity CatalogWho this book is forThis book is for data engineers, data scientists, and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of data architecture, SQL, and Python programming. Author Biography Pulkit Chadha is a Sr. Solutions Architect at Databricks. He has over 12 years of experience working in Data Engineering. With his expertise in building and optimizing data pipelines using various tools and technologies Pulkit has worked with enterprises in various industries, including healthcare, Media and Entertainment, Hi-Tech, and Manufacturing providing data engineering solutions to meet enterprises unique business needs. His work history includes the likes of Dell Services, Adobe, and Databricks.Pulkit holds a Masterss Degree in Management Information Systems from Eller College of Management at the University Of Arizona and has several cloud certifications in data analytics. Table of Contents Table of ContentsData Ingestion and Data Extraction with Apache SparkData Transformation and Data Manipulation with Apache SparkData Management with Delta LakeIngesting Streaming DataProcessing Streaming DataPerformance Tuning with Apache SparkPerformance Tuning in Delta LakeOrchestration and Scheduling Data Pipeline with Databricks WorkflowsBuilding Data Pipelines with Delta Live TablesData Governance with Unity CatalogImplementing DataOps and DevOps on Databricks Details ISBN1837633355 Author Pulkit Chadha Publisher Packt Publishing Limited Year 2024 ISBN-13 9781837633357 Format Paperback Imprint Packt Publishing Limited Place of Publication Birmingham Country of Publication United Kingdom Audience Professional & Vocational Publication Date 2024-05-31 UK Release Date 2024-05-31 DEWEY 005.745 Pages 438 Subtitle Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake We've got this At The Nile, if you're looking for it, we've got it. With fast shipping, low prices, friendly service and well over a million items - you're bound to find what you want, at a price you'll love! TheNile_Item_ID:160148218;

Price: 90.11 AUD

Location: Melbourne

End Time: 2024-12-01T02:14:54.000Z

Shipping Cost: 23.18 AUD